Member since
10-13-2017
12
Posts
0
Kudos Received
0
Solutions
01-17-2018
12:39 AM
And new error while installing 0.8 version. [ERROR] /home/cloudera/shares/vm_shared_folder/atlas_0.8/atlas/typesystem/src/main/scala/org/apache/atlas/typesystem/json/InstanceSerialization.scala:262: File name too long
This can happen on some encrypted or legacy file systems. Please see SI-3623 for more details.
[ERROR] ts <- traits
[ERROR] ^
[ERROR] /home/cloudera/shares/vm_shared_folder/atlas_0.8/atlas/typesystem/src/main/scala/org/apache/atlas/typesystem/json/InstanceSerialization.scala:263: File name too long
This can happen on some encrypted or legacy file systems. Please see SI-3623 for more details.
[ERROR] s_attr <- Some(convertSystemAttributes)
[ERROR] ^
[ERROR] two errors found
[DEBUG] Compilation failed (CompilerInterface)
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Atlas Typesystem ............................ FAILURE [ 54.231 s]
... View more
01-16-2018
06:52 PM
@Nixon Rodrigues Yes Mvn configured latest version 3.5.2. Apache Maven 3.5.2 (138edd61fd100ec658bfa2d307c43b76940a5d7d; 2017-10-18T00:58:13-07:00)
Maven home: /usr/local/apache-maven-3.5.2
Java version: 1.8.0_151, vendor: Oracle Corporation
Java home: /usr/java/jdk1.8.0_151/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "linux", version: "2.6.32-573.el6.x86_64", arch: "amd64", family: "unix" Hbase version is 1.2.0.. Java HotSpot(TM) 64-Bit Server VM warning: Using incremental CMS is deprecated and will likely be removed in a future release
HBase 1.2.0-cdh5.12.0
Source code repository file:///data/jenkins/workspace/generic-package-rhel64-6-0/topdir/BUILD/hbase-1.2.0-cdh5.12.0 revision=Unknown
Compiled by jenkins on Thu Jun 29 04:42:07 PDT 2017
From source with checksum 6834049453a9459ccaf4cadbf9a54b2c So how and where i can download the 0.8.1 release and not the master checkout.?
... View more
01-12-2018
07:06 PM
@Nixon Rodrigues Here are some more errors. It shows some thing regarding mojoFRailuer exception. I try to resolve but still it not resolved. [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.7.0:compile (default-compile) on project atlas-intg: Compilation failure: Compilation failure:
[ERROR] /home/cloudera/shares/vm_shared_folder/ATLAS/atlas/intg/src/main/java/org/apache/atlas/model/typedef/AtlasEnumDef.java:[158,33] cannot find symbol
[ERROR] symbol: method equalsIgnoreCase(java.lang.String,java.lang.String)
[ERROR] location: class org.apache.hadoop.util.StringUtils
[ERROR] /home/cloudera/shares/vm_shared_folder/ATLAS/atlas/intg/src/main/java/org/apache/atlas/model/typedef/AtlasEnumDef.java:[177,33] cannot find symbol
[ERROR] symbol: method equalsIgnoreCase(java.lang.String,java.lang.String)
[ERROR] location: class org.apache.hadoop.util.StringUtils
[ERROR] /home/cloudera/shares/vm_shared_folder/ATLAS/atlas/intg/src/main/java/org/apache/atlas/model/typedef/AtlasEnumDef.java:[199,32] cannot find symbol
[ERROR] symbol: method equalsIgnoreCase(java.lang.String,java.lang.String)
[ERROR] location: class org.apache.hadoop.util.StringUtils
[ERROR] /home/cloudera/shares/vm_shared_folder/ATLAS/atlas/intg/src/main/java/org/apache/atlas/model/typedef/AtlasStructDef.java:[155,33] cannot find symbol
[ERROR] symbol: method equalsIgnoreCase(java.lang.String,java.lang.String)
[ERROR] location: class org.apache.hadoop.util.StringUtils
[ERROR] /home/cloudera/shares/vm_shared_folder/ATLAS/atlas/intg/src/main/java/org/apache/atlas/model/typedef/AtlasStructDef.java:[173,33] cannot find symbol
[ERROR] symbol: method equalsIgnoreCase(java.lang.String,java.lang.String)
[ERROR] location: class org.apache.hadoop.util.StringUtils
[ERROR] /home/cloudera/shares/vm_shared_folder/ATLAS/atlas/intg/src/main/java/org/apache/atlas/model/typedef/AtlasStructDef.java:[195,32] cannot find symbol
[ERROR] symbol: method equalsIgnoreCase(java.lang.String,java.lang.String)
[ERROR] location: class org.apache.hadoop.util.StringUtils
[ERROR] /home/cloudera/shares/vm_shared_folder/ATLAS/atlas/intg/src/main/java/org/apache/atlas/model/typedef/AtlasStructDef.java:[553,31] cannot find symbol
[ERROR] symbol: method equalsIgnoreCase(java.lang.String,java.lang.String)
[ERROR] location: class org.apache.hadoop.util.StringUtils
... View more
01-08-2018
08:07 AM
@Nixon Rodrigues i just follow the steps same as documented on http://atlas.apache.org/InstallationSteps.html. I'm getting below errors: [INFO] Tests run: 64, Failures: 0, Errors: 0, Skipped: 0
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Atlas Repository ............................ FAILURE [17:47 min]
[INFO] Apache Atlas Authorization ......................... SKIPPED
[INFO] Apache Atlas UI .................................... SKIPPED
[INFO] Apache Atlas Web Application ....................... SKIPPED
[INFO] Apache Atlas Documentation ......................... SKIPPED
[INFO] Apache Atlas FileSystem Model ...................... SKIPPED
[INFO] Apache Atlas Plugin Classloader .................... SKIPPED
[INFO] Apache Atlas Hive Bridge Shim ...................... SKIPPED
[INFO] Apache Atlas Hive Bridge ........................... SKIPPED
[INFO] Apache Atlas Falcon Bridge Shim .................... SKIPPED
[INFO] Apache Atlas Falcon Bridge ......................... SKIPPED
[INFO] Apache Atlas Sqoop Bridge Shim ..................... SKIPPED
[INFO] Apache Atlas Sqoop Bridge .......................... SKIPPED
[INFO] Apache Atlas Storm Bridge Shim ..................... SKIPPED
[INFO] Apache Atlas Storm Bridge .......................... SKIPPED
[INFO] Apache Atlas Hbase Bridge Shim ..................... SKIPPED
[INFO] Apache Atlas Hbase Bridge .......................... SKIPPED
[INFO] Apache Atlas Distribution .......................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 17:51 min
[INFO] Finished at: 2018-01-07T23:55:26-08:00
[INFO] Final Memory: 57M/435M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.20.1:test (default-test) on project atlas-repository: There are test failures.
[ERROR]
[ERROR] Please refer to /home/cloudera/shares/vm_shared_folder/ATLAS/atlas/repository/target/surefire-reports for the individual test results.
[ERROR] Please refer to dump files (if any exist) [date]-jvmRun[N].dump, [date].dumpstream and [date]-jvmRun[N].dumpstream.
[ERROR] ExecutionException org.apache.maven.surefire.report.SafeThrowable.<init>(Ljava/lang/String;)V
[ERROR] ExecutionException org.apache.maven.surefire.report.SafeThrowable.<init>(Ljava/lang/String;)V
[ERROR] ExecutionException org.apache.maven.surefire.report.SafeThrowable.<init>(Ljava/lang/String;)V
[ERROR] ExecutionException org.apache.maven.surefire.report.SafeThrowable.<init>(Ljava/lang/String;)V
[ERROR] ExecutionException org.apache.maven.surefire.report.SafeThrowable.<init>(Ljava/lang/String;)V
[ERROR] ExecutionException org.apache.maven.surefire.report.SafeThrowable.<init>(Ljava/lang/String;)V
[ERROR] ExecutionException org.apache.maven.surefire.report.SafeThrowable.<init>(Ljava/lang/String;)V org.apache.maven.surefire.report.SafeThrowable.<init>(Ljava/lang/String;)V
[ERROR] ExecutionException org.apache.maven.surefire.report.SafeThrowable.<init>(Ljava/lang/String;)V
[ERROR] ExecutionException org.apache.maven.surefire.report.SafeThrowable.<init>(Ljava/lang/String;)V
[ERROR] ExecutionException org.apache.maven.surefire.report.SafeThrowable.<init>(Ljava/lang/String;)V
[ERROR] ExecutionException org.apache.maven.surefire.report.SafeThrowable.<init>(Ljava/lang/String;)V
[ERROR] ExecutionException org.apache.maven.surefire.report.SafeThrowable.<init>(Ljava/lang/String;)V
[ERROR] ExecutionException org.apache.maven.surefire.report.SafeThrowable.<init>(Ljava/lang/String;)V
[ERROR] ExecutionException org.apache.maven.surefire.report.SafeThrowable.<init>(Ljava/lang/String;)V
[ERROR] ExecutionException org.apache.maven.surefire.report.SafeThrowable.<init>(Ljava/lang/String;)V
[ERROR] ExecutionException org.apache.maven.surefire.report.SafeThrowable.<init>(Ljava/lang/String;)V
[ERROR] ExecutionException org.apache.maven.surefire.report.SafeThrowable.<init>(Ljava/lang/String;)V
[ERROR] ExecutionException org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:832)
[ERROR] at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:134)
[ERROR] at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
[ERROR] at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:154)
[ERROR] at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:146)
[ERROR] at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:117)
[ERROR] at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:81)
[ERROR] at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
[ERROR] at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128)
[ERROR] at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:309)
[ERROR] at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:194)
[ERROR] at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:107)
[ERROR] at org.apache.maven.cli.MavenCli.execute(MavenCli.java:955)
[ERROR] at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:290)
[ERROR] at org.apache.maven.cli.MavenCli.main(MavenCli.java:194)
[ERROR] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[ERROR] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[ERROR] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[ERROR] at java.lang.reflect.Method.invoke(Method.java:498)
... View more
01-05-2018
07:14 AM
@Nixon Rodrigues Thank you for response. In my CDH i have every component installed but still i'm getting lot of errors. Specially when i'm installing i'm getting error on Apache Atlas UI package problem.
... View more
01-05-2018
01:08 AM
Hello, I try to install Apache Atlas on cloudera 5.12.X version on my VM. It giving lot of error while i'm build project (clean and install Maven). So, is it possibale to install Atlas on cloudera without using cloudera manager? If, can you please provide any relavent documentation for installation. Thank you in advance!!
... View more
Labels:
11-27-2017
02:40 AM
Hello, I try to run spark yarn cluster job in cloudera. I\m getting these error. INFO yarn.Client: Application report for application_1510270039885_0032 (state: FAILED) INFO yarn.Client: client token: N/A diagnostics: Application application_1510270039885_0032 failed 2 times due to AM Container for appattempt_1510270039885_0032_000002 exited with exitCode: 1 For more detailed output, check application tracking page:http://quickstart.cloudera:8088/proxy/application_1510270039885_0032/Then, click on links to logs of each attempt. Diagnostics: Exception from container-launch. Container id: container_1510270039885_0032_02_000001 Exit code: 1 Stack trace: ExitCodeException exitCode=1: at org.apache.hadoop.util.Shell.runCommand(Shell.java:578) at org.apache.hadoop.util.Shell.run(Shell.java:481) at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:763) at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:213) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Container exited with a non-zero exit code 1 Failing this attempt. Failing the application. ApplicationMaster host: N/A ApplicationMaster RPC port: -1 queue: root.hdfs start time: 1511456640638 final status: FAILED tracking URL: http://quickstart.cloudera:8088/cluster/app/application_1510270039885_0032 user: hdfs Exception in thread "main" org.apache.spark.SparkException: Application application_1510270039885_0032 finished with failed status at org.apache.spark.deploy.yarn.Client.run(Client.scala:1035) at org.apache.spark.deploy.yarn.Client$.main(Client.scala:1082) at org.apache.spark.deploy.yarn.Client.main(Client.scala) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:731) at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:181) at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:206) at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121) at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) 17/11/23 09:04:16 INFO util.ShutdownHookManager: Shutdown hook called 17/11/23 09:04:16 INFO util.ShutdownHookManager: Deleting directory /tmp/spark-116ce8c4-82c9-481b-a230-5a649ff63ecd I try to open the log file in above location. I couldn't find any log files in any log directory. Can someone help to find how to see the log information in log file. Is there any setup mistake. ?
... View more
Labels:
11-10-2017
12:34 AM
Hello, I want read the parameters from some DB and use those values as input property values for nifi processor. I know i can read config file from external source and update the values dynamically. But my use case they have to use DB table for store the parameters. Thank you in advance!!!
... View more
Labels:
10-21-2017
09:37 PM
@Shu <?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="myfile.xsl" ?> <bookstore specialty="novel"> <book style="autobiography"> <author>
<first-name>Joe</first-name> <last-name>Bob</last-name>
<award>Trenton Literary Review Honorable Mention</award>
</author>
<price>12</price> </book> </bookstore>
... View more
10-21-2017
09:17 PM
@Shu : I just created output as .txt files for better understanding purpose. But i need to store data in Hive or HDFS location.
... View more
10-21-2017
09:14 PM
@Shu Thank you for response, here are my input file(xml.xml). And i attached my expected output files output-author.txt, output-books.txt, output-bookstore.txt . Hope you will understand my problem.
... View more
10-13-2017
03:41 PM
Hello, I’m very new for nifi and new for programming language. Here are my scenario I’m getting different type of nested XML files from HTTP or SFTP or local drives. I have to split the those XML files based on nested (child elements). Same child elements will have to save in same file and they have some primary key or unique key have to know the relationship of the parent and child. EX: A(root)-> B(Child)-> C (Child of B)-> D(Child of C) A(root)-> B(Child) C (Child of B) D(Child of C) B(Child) C (Child of B) D(Child of C) Now I need all data of B’s have to save in one table and C’s in another table and so on.., And must have to maintain the relationship between the child and parents with some unique key (if you have use otherwise we have to generate the unique keys for identification of relationship between the tables.). Same as the below example: <customer> <group> <site> <userline></userline> <userline></userline> <userline></userline> </site> </group> <group> <site> <userline></userline> <userline></userline> <userline></userline> </site> </group> </customer> I saw already same solution for above in "https://community.hortonworks.com/questions/70087/complex-xml-to-hive-table-using-nifi.html" BUt i didn't understand solution so can someone help me the step by step to split XML for separate files. Thank you in Advance..
... View more
Labels: