About msure4

msure4 · ‎01-17-2018

And new error while installing 0.8 version. [ERROR] /home/cloudera/shares/vm_shared_folder/atlas_0.8/atlas/typesystem/src/main/scala/org/apache/atlas/typesystem/json/InstanceSerialization.scala:262: File name too long This can happen on some encrypted or legacy file systems. Please see SI-3623 for more details. [ERROR] ts <- traits [ERROR] ^ [ERROR] /home/cloudera/shares/vm_shared_folder/atlas_0.8/atlas/typesystem/src/main/scala/org/apache/atlas/typesystem/json/InstanceSerialization.scala:263: File name too long This can happen on some encrypted or legacy file systems. Please see SI-3623 for more details. [ERROR] s_attr <- Some(convertSystemAttributes) [ERROR] ^ [ERROR] two errors found [DEBUG] Compilation failed (CompilerInterface) [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Apache Atlas Typesystem ............................ FAILURE [ 54.231 s]

msure4 · ‎01-16-2018

@Nixon Rodrigues Yes Mvn configured latest version 3.5.2. Apache Maven 3.5.2 (138edd61fd100ec658bfa2d307c43b76940a5d7d; 2017-10-18T00:58:13-07:00) Maven home: /usr/local/apache-maven-3.5.2 Java version: 1.8.0_151, vendor: Oracle Corporation Java home: /usr/java/jdk1.8.0_151/jre Default locale: en_US, platform encoding: UTF-8 OS name: "linux", version: "2.6.32-573.el6.x86_64", arch: "amd64", family: "unix" Hbase version is 1.2.0.. Java HotSpot(TM) 64-Bit Server VM warning: Using incremental CMS is deprecated and will likely be removed in a future release HBase 1.2.0-cdh5.12.0 Source code repository file:///data/jenkins/workspace/generic-package-rhel64-6-0/topdir/BUILD/hbase-1.2.0-cdh5.12.0 revision=Unknown Compiled by jenkins on Thu Jun 29 04:42:07 PDT 2017 From source with checksum 6834049453a9459ccaf4cadbf9a54b2c So how and where i can download the 0.8.1 release and not the master checkout.?

msure4 · ‎01-12-2018

@Nixon Rodrigues Here are some more errors. It shows some thing regarding mojoFRailuer exception. I try to resolve but still it not resolved. [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.7.0:compile (default-compile) on project atlas-intg: Compilation failure: Compilation failure: [ERROR] /home/cloudera/shares/vm_shared_folder/ATLAS/atlas/intg/src/main/java/org/apache/atlas/model/typedef/AtlasEnumDef.java:[158,33] cannot find symbol [ERROR] symbol: method equalsIgnoreCase(java.lang.String,java.lang.String) [ERROR] location: class org.apache.hadoop.util.StringUtils [ERROR] /home/cloudera/shares/vm_shared_folder/ATLAS/atlas/intg/src/main/java/org/apache/atlas/model/typedef/AtlasEnumDef.java:[177,33] cannot find symbol [ERROR] symbol: method equalsIgnoreCase(java.lang.String,java.lang.String) [ERROR] location: class org.apache.hadoop.util.StringUtils [ERROR] /home/cloudera/shares/vm_shared_folder/ATLAS/atlas/intg/src/main/java/org/apache/atlas/model/typedef/AtlasEnumDef.java:[199,32] cannot find symbol [ERROR] symbol: method equalsIgnoreCase(java.lang.String,java.lang.String) [ERROR] location: class org.apache.hadoop.util.StringUtils [ERROR] /home/cloudera/shares/vm_shared_folder/ATLAS/atlas/intg/src/main/java/org/apache/atlas/model/typedef/AtlasStructDef.java:[155,33] cannot find symbol [ERROR] symbol: method equalsIgnoreCase(java.lang.String,java.lang.String) [ERROR] location: class org.apache.hadoop.util.StringUtils [ERROR] /home/cloudera/shares/vm_shared_folder/ATLAS/atlas/intg/src/main/java/org/apache/atlas/model/typedef/AtlasStructDef.java:[173,33] cannot find symbol [ERROR] symbol: method equalsIgnoreCase(java.lang.String,java.lang.String) [ERROR] location: class org.apache.hadoop.util.StringUtils [ERROR] /home/cloudera/shares/vm_shared_folder/ATLAS/atlas/intg/src/main/java/org/apache/atlas/model/typedef/AtlasStructDef.java:[195,32] cannot find symbol [ERROR] symbol: method equalsIgnoreCase(java.lang.String,java.lang.String) [ERROR] location: class org.apache.hadoop.util.StringUtils [ERROR] /home/cloudera/shares/vm_shared_folder/ATLAS/atlas/intg/src/main/java/org/apache/atlas/model/typedef/AtlasStructDef.java:[553,31] cannot find symbol [ERROR] symbol: method equalsIgnoreCase(java.lang.String,java.lang.String) [ERROR] location: class org.apache.hadoop.util.StringUtils

msure4 · ‎01-08-2018

@Nixon Rodrigues i just follow the steps same as documented on http://atlas.apache.org/InstallationSteps.html. I'm getting below errors: [INFO] Tests run: 64, Failures: 0, Errors: 0, Skipped: 0 [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Apache Atlas Repository ............................ FAILURE [17:47 min] [INFO] Apache Atlas Authorization ......................... SKIPPED [INFO] Apache Atlas UI .................................... SKIPPED [INFO] Apache Atlas Web Application ....................... SKIPPED [INFO] Apache Atlas Documentation ......................... SKIPPED [INFO] Apache Atlas FileSystem Model ...................... SKIPPED [INFO] Apache Atlas Plugin Classloader .................... SKIPPED [INFO] Apache Atlas Hive Bridge Shim ...................... SKIPPED [INFO] Apache Atlas Hive Bridge ........................... SKIPPED [INFO] Apache Atlas Falcon Bridge Shim .................... SKIPPED [INFO] Apache Atlas Falcon Bridge ......................... SKIPPED [INFO] Apache Atlas Sqoop Bridge Shim ..................... SKIPPED [INFO] Apache Atlas Sqoop Bridge .......................... SKIPPED [INFO] Apache Atlas Storm Bridge Shim ..................... SKIPPED [INFO] Apache Atlas Storm Bridge .......................... SKIPPED [INFO] Apache Atlas Hbase Bridge Shim ..................... SKIPPED [INFO] Apache Atlas Hbase Bridge .......................... SKIPPED [INFO] Apache Atlas Distribution .......................... SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 17:51 min [INFO] Finished at: 2018-01-07T23:55:26-08:00 [INFO] Final Memory: 57M/435M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.20.1:test (default-test) on project atlas-repository: There are test failures. [ERROR] [ERROR] Please refer to /home/cloudera/shares/vm_shared_folder/ATLAS/atlas/repository/target/surefire-reports for the individual test results. [ERROR] Please refer to dump files (if any exist) [date]-jvmRun[N].dump, [date].dumpstream and [date]-jvmRun[N].dumpstream. [ERROR] ExecutionException org.apache.maven.surefire.report.SafeThrowable.<init>(Ljava/lang/String;)V [ERROR] ExecutionException org.apache.maven.surefire.report.SafeThrowable.<init>(Ljava/lang/String;)V [ERROR] ExecutionException org.apache.maven.surefire.report.SafeThrowable.<init>(Ljava/lang/String;)V [ERROR] ExecutionException org.apache.maven.surefire.report.SafeThrowable.<init>(Ljava/lang/String;)V [ERROR] ExecutionException org.apache.maven.surefire.report.SafeThrowable.<init>(Ljava/lang/String;)V [ERROR] ExecutionException org.apache.maven.surefire.report.SafeThrowable.<init>(Ljava/lang/String;)V [ERROR] ExecutionException org.apache.maven.surefire.report.SafeThrowable.<init>(Ljava/lang/String;)V org.apache.maven.surefire.report.SafeThrowable.<init>(Ljava/lang/String;)V [ERROR] ExecutionException org.apache.maven.surefire.report.SafeThrowable.<init>(Ljava/lang/String;)V [ERROR] ExecutionException org.apache.maven.surefire.report.SafeThrowable.<init>(Ljava/lang/String;)V [ERROR] ExecutionException org.apache.maven.surefire.report.SafeThrowable.<init>(Ljava/lang/String;)V [ERROR] ExecutionException org.apache.maven.surefire.report.SafeThrowable.<init>(Ljava/lang/String;)V [ERROR] ExecutionException org.apache.maven.surefire.report.SafeThrowable.<init>(Ljava/lang/String;)V [ERROR] ExecutionException org.apache.maven.surefire.report.SafeThrowable.<init>(Ljava/lang/String;)V [ERROR] ExecutionException org.apache.maven.surefire.report.SafeThrowable.<init>(Ljava/lang/String;)V [ERROR] ExecutionException org.apache.maven.surefire.report.SafeThrowable.<init>(Ljava/lang/String;)V [ERROR] ExecutionException org.apache.maven.surefire.report.SafeThrowable.<init>(Ljava/lang/String;)V [ERROR] ExecutionException org.apache.maven.surefire.report.SafeThrowable.<init>(Ljava/lang/String;)V [ERROR] ExecutionException org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:832) [ERROR] at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:134) [ERROR] at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208) [ERROR] at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:154) [ERROR] at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:146) [ERROR] at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:117) [ERROR] at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:81) [ERROR] at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51) [ERROR] at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128) [ERROR] at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:309) [ERROR] at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:194) [ERROR] at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:107) [ERROR] at org.apache.maven.cli.MavenCli.execute(MavenCli.java:955) [ERROR] at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:290) [ERROR] at org.apache.maven.cli.MavenCli.main(MavenCli.java:194) [ERROR] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [ERROR] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [ERROR] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [ERROR] at java.lang.reflect.Method.invoke(Method.java:498)

msure4 · ‎01-05-2018

@Nixon Rodrigues Thank you for response. In my CDH i have every component installed but still i'm getting lot of errors. Specially when i'm installing i'm getting error on Apache Atlas UI package problem.

msure4 · ‎01-05-2018

Hello, I try to install Apache Atlas on cloudera 5.12.X version on my VM. It giving lot of error while i'm build project (clean and install Maven). So, is it possibale to install Atlas on cloudera without using cloudera manager? If, can you please provide any relavent documentation for installation. Thank you in advance!!

msure4 · ‎11-27-2017

Hello, I try to run spark yarn cluster job in cloudera. I\m getting these error. INFO yarn.Client: Application report for application_1510270039885_0032 (state: FAILED) INFO yarn.Client: client token: N/A diagnostics: Application application_1510270039885_0032 failed 2 times due to AM Container for appattempt_1510270039885_0032_000002 exited with exitCode: 1 For more detailed output, check application tracking page:http://quickstart.cloudera:8088/proxy/application_1510270039885_0032/Then, click on links to logs of each attempt. Diagnostics: Exception from container-launch. Container id: container_1510270039885_0032_02_000001 Exit code: 1 Stack trace: ExitCodeException exitCode=1: at org.apache.hadoop.util.Shell.runCommand(Shell.java:578) at org.apache.hadoop.util.Shell.run(Shell.java:481) at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:763) at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:213) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Container exited with a non-zero exit code 1 Failing this attempt. Failing the application. ApplicationMaster host: N/A ApplicationMaster RPC port: -1 queue: root.hdfs start time: 1511456640638 final status: FAILED tracking URL: http://quickstart.cloudera:8088/cluster/app/application_1510270039885_0032 user: hdfs Exception in thread "main" org.apache.spark.SparkException: Application application_1510270039885_0032 finished with failed status at org.apache.spark.deploy.yarn.Client.run(Client.scala:1035) at org.apache.spark.deploy.yarn.Client$.main(Client.scala:1082) at org.apache.spark.deploy.yarn.Client.main(Client.scala) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:731) at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:181) at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:206) at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121) at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) 17/11/23 09:04:16 INFO util.ShutdownHookManager: Shutdown hook called 17/11/23 09:04:16 INFO util.ShutdownHookManager: Deleting directory /tmp/spark-116ce8c4-82c9-481b-a230-5a649ff63ecd I try to open the log file in above location. I couldn't find any log files in any log directory. Can someone help to find how to see the log information in log file. Is there any setup mistake. ?

msure4 · ‎11-10-2017

Hello, I want read the parameters from some DB and use those values as input property values for nifi processor. I know i can read config file from external source and update the values dynamically. But my use case they have to use DB table for store the parameters. Thank you in advance!!!

msure4 · ‎10-21-2017

@Shu <?xml version="1.0"?> <?xml-stylesheet type="text/xsl" href="myfile.xsl" ?> <bookstore specialty="novel"> <book style="autobiography"> <author> <first-name>Joe</first-name> <last-name>Bob</last-name> <award>Trenton Literary Review Honorable Mention</award> </author> <price>12</price> </book> </bookstore>

msure4 · ‎10-21-2017

@Shu : I just created output as .txt files for better understanding purpose. But i need to store data in Hive or HDFS location.

msure4 · ‎10-21-2017

@Shu Thank you for response, here are my input file(xml.xml). And i attached my expected output files output-author.txt, output-books.txt, output-bookstore.txt . Hope you will understand my problem.

msure4 · ‎10-13-2017

Hello, I’m very new for nifi and new for programming language. Here are my scenario I’m getting different type of nested XML files from HTTP or SFTP or local drives. I have to split the those XML files based on nested (child elements). Same child elements will have to save in same file and they have some primary key or unique key have to know the relationship of the parent and child. EX: A(root)-> B(Child)-> C (Child of B)-> D(Child of C) A(root)-> B(Child) C (Child of B) D(Child of C) B(Child) C (Child of B) D(Child of C) Now I need all data of B’s have to save in one table and C’s in another table and so on.., And must have to maintain the relationship between the child and parents with some unique key (if you have use otherwise we have to generate the unique keys for identification of relationship between the tables.). Same as the below example: <customer> <group> <site> <userline></userline> <userline></userline> <userline></userline> </site> </group> <group> <site> <userline></userline> <userline></userline> <userline></userline> </site> </group> </customer> I saw already same solution for above in "https://community.hortonworks.com/questions/70087/complex-xml-to-hive-table-using-nifi.html" BUt i didn't understand solution so can someone help me the step by step to split XML for separate files. Thank you in Advance..

Online	Offline
Last Visited	‎01-17-2018 12:39 AM

Date Registered	‎10-13-2017 04:05 AM
Last Visited	‎01-17-2018 12:39 AM
Total Messages Posted	12

Re: How to install Apache Atlas on cloudera on VM?

Re: How to install Apache Atlas on cloudera on VM?

Re: How to install Apache Atlas on cloudera on VM?

Re: How to install Apache Atlas on cloudera on VM?

Re: How to install Apache Atlas on cloudera on VM?

How to install Apache Atlas on cloudera on VM?

Spark on Yarn job fails when launching container

Reading operational metadata from database(mysql/r...

Re: Split each xml attribute into separate tables...

Re: Split each xml attribute into separate tables...

Re: Split each xml attribute into separate tables...

Split each xml attribute into separate tables sto...