Member since
01-09-2017
49
Posts
7
Kudos Received
2
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 538 | 01-19-2017 06:37 AM | |
| 1288 | 12-23-2016 05:54 AM |
04-10-2019
12:54 PM
Hi All, I have a query here. How to assign a seperate yarn queue when i submit query for hive-hbase integration table ? By default it goes to default queue. Appreciate your help please. thanks, Rishit Shah
... View more
01-10-2018
09:19 AM
1 Kudo
All, Just adding for knowledge gain , if my source is kerberos enabled while target is not , then the command to be executed will be hadoop distcp -D ipc.client.fallback-to-simple-auth-allowed=true webhdfs://source-ip webhdfs://target-ip hadoop distcp -D ipc.client.fallback-to-simple-auth-allowed=true : this command overrides values present in the hive-site.xml. thanks, Rishit Shah
... View more
07-10-2017
09:14 AM
Yes it fails with select queries. i checked above that but i dont know how to make us of the patch? thanks, Rishit Shah
... View more
07-10-2017
04:11 AM
Hi @Pardeep i think this is not a seperate issue but it is on same line. the above resolution just solved a partial query. Hope this is fine. Let me know your input for resolving my query. thanks, Rishit Shah
... View more
07-07-2017
12:57 PM
Hi Sindhu, the above just resolved the issue for normal function. Now when i am trying to run frunction for hive as a UDF hplsql, it throws error. Failed with exception java.io.IOException:org.apache.hadoop.hive.ql.metadata.HiveException: Error evaluating hplsql Below steps followed: add jar /usr/hdp/current/hive-server2-hive2/lib/antlr4-runtime-4.5.jar; add jar /usr/hdp/2.6.0.3-8/hive2/lib/hive-hplsql-2.1.0.2.6.0.3-8.jar; add jar /home/devRht/hplsql/hplsql-0.3.17/hplsql-0.3.17.jar; CREATE TEMPORARY FUNCTION hplsql AS 'org.apache.hive.hplsql.Udf'; add file /home/devRht/hplsql/hplsql-0.3.17/hplsql-site.xml; add file /home/devRht/hplsql/hplsql-0.3.17/hplsql; thanks, Rishit Shah
... View more
07-07-2017
10:54 AM
Hi Sindhu, i could solve it with this: java -cp $SCRIPTPATH:$HADOOP_CLASSPATH:/home/devRht/hplsql/hplsql-0.3.17/hplsql-0.3.17.jar:/home/devRht/hplsql/hplsql-0.3.17/antlr-runtime-4.5.jar $H
ADOOP_OPTS org.apache.hive.hplsql.Hplsql "$@"
... View more
07-07-2017
10:04 AM
hi Sindhu, Thanks for the reply. I tried to change as per your suggestion : java -cp /home/devRht/hplsql/hplsql-0.3.17/hplsql-0.3.17.jar:/home/devRht/hplsql/hplsql-0.3.17/antlr-runtime-4.5.jar:$HADOOP_OPTS org.apache.hive.hpl
sql.Hplsql "$@" but now its showing below error Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/commons/cli/ParseException
at org.apache.hive.hplsql.Exec.<init>(Exec.java:87)
at org.apache.hive.hplsql.Hplsql.main(Hplsql.java:23)
Caused by: java.lang.ClassNotFoundException: org.apache.commons.cli.ParseException
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 2 more thanks, Rishit Shah
... View more
07-01-2017
11:49 AM
1 Kudo
Hi, I am trying to create hplsql function using details present in http://www.hplsql.org/udf. However when i am trying to execute it , it throws error. /home/devRht/hplsql/hplsql-0.3.17/hplsql.jar does not exist
However i can see that jar name is hplsql-0.3.17.jar which is present in above path. So why is it not picking up correct name? I have my hplsql file also configured same way. export PATH=$PATH:/home/devRht/hplsql/hplsql-0.3.17/ SCRIPTPATH=${0%/*}
java -cp $SCRIPTPATH:$HADOOP_CLASSPATH:$SCRIPTPATH/hplsql-0.3.17.jar:$SCRIPTPATH/antlr-runtime-4.5.jar $HADOOP_OPTS org.apache.hive.hplsql.Hplsql "$@
" what is the issue i am not able to understand ?
... View more
Labels:
- Labels:
-
Apache Hive
07-01-2017
09:50 AM
Hi Dmitro, I think you have not given the hive connection path. replace localhost:10000 with your hive cluster path. thanks, Rishit Shah
... View more
06-14-2017
12:11 PM
1 Kudo
this is solved. it seems bucketing was not done properly. created orc table again and it worked. thanks, Rishit Shah
... View more
06-14-2017
10:44 AM
even i am facing similar issue, is there any solution? thanks, Rishit Shah
... View more
06-14-2017
08:02 AM
Hi , i am receiving error while running merge query.merge-query.txt Any idea of what could be issue? Note : Using HDP 2.6. and query is attached. Log Type: syslog Log Upload Time: Wed Jun 14 13:00:51 +0530 2017 Log Length: 95661 2017-06-14 12:59:15,168 INFO [main] org.apache.hadoop.security.SecurityUtil: Updating Configuration
2017-06-14 12:59:15,223 WARN [main] org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate configuration: tried hadoop-metrics2-reducetask.properties,hadoop-metrics2.properties
2017-06-14 12:59:15,318 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s).
2017-06-14 12:59:15,318 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: ReduceTask metrics system started
2017-06-14 12:59:15,330 INFO [main] org.apache.hadoop.mapred.YarnChild: Executing with tokens:
2017-06-14 12:59:15,330 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: mapreduce.job, Service: job_1496922997306_0098, Ident: (org.apache.hadoop.mapreduce.security.token.JobTokenIdentifier@5032714f)
2017-06-14 12:59:15,584 INFO [main] org.apache.hadoop.mapred.YarnChild: Sleeping for 0ms before retrying again. Got null now.
2017-06-14 12:59:15,884 INFO [main] org.apache.hadoop.mapred.YarnChild: mapreduce.cluster.local.dir for child: /hadoop/yarn/local/usercache/devRht/appcache/application_1496922997306_0098,/opt/hadoop/yarn/local/usercache/devRht/appcache/application_1496922997306_0098,/usr/hadoop/yarn/local/usercache/devRht/appcache/application_1496922997306_0098,/var/hadoop/yarn/local/usercache/devRht/appcache/application_1496922997306_0098
2017-06-14 12:59:16,230 INFO [main] org.apache.hadoop.conf.Configuration.deprecation: session.id is deprecated. Instead, use dfs.metrics.session-id
2017-06-14 12:59:16,779 INFO [main] org.apache.hadoop.mapred.Task: Using ResourceCalculatorProcessTree : [ ]
2017-06-14 12:59:16,858 INFO [main] org.apache.hadoop.mapred.ReduceTask: Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@f6c03cb
2017-06-14 12:59:31,271 INFO [main] ExecReducer: conf classpath = [file:/usr/hadoop/yarn/local/usercache/devRht/appcache/application_1496922997306_0098/container_e01_1496922997306_0098_01_000004/, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7.3.2.6.0.3-8-tests.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/lib/commons-io-2.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/lib/jersey-core-1.9.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/lib/aopalliance-1.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/lib/paranamer-2.3.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.9.13.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/lib/javax.inject-1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/lib/junit-4.11.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/lib/log4j-1.2.17.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/lib/avro-1.7.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/lib/asm-3.2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/lib/jackson-core-asl-1.9.13.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/lib/hadoop-annotations-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/lib/jersey-server-1.9.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/lib/xz-1.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/lib/netty-3.6.2.Final.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/lib/guice-3.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/hadoop-common-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/hadoop-azure-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/hadoop-nfs-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/hadoop-azure-datalake-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/hadoop-common-2.7.3.2.6.0.3-8-tests.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/azure-data-lake-store-sdk-2.1.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/hadoop-aws-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/commons-io-2.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/apacheds-i18n-2.0.0-M15.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/jaxb-api-2.2.2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/httpcore-4.4.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/jetty-sslengine-6.1.26.hwx.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/commons-configuration-1.6.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/jersey-core-1.9.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/api-util-1.0.0-M20.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/jackson-annotations-2.2.3.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/snappy-java-1.0.4.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/paranamer-2.3.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/jackson-core-2.2.3.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/stax-api-1.0-2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/aws-java-sdk-kms-1.10.6.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/commons-digester-1.8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/hadoop-auth-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/slf4j-api-1.7.10.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/activation-1.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/commons-collections-3.2.2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/junit-4.11.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/htrace-core-3.1.0-incubating.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/jsp-api-2.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/commons-lang-2.6.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/jets3t-0.9.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/jackson-xc-1.9.13.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/commons-codec-1.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/commons-net-3.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/commons-math3-3.1.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/gson-2.2.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/log4j-1.2.17.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/commons-compress-1.4.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/commons-beanutils-1.7.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/xmlenc-0.52.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/zookeeper-3.4.6.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/avro-1.7.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/mockito-all-1.8.5.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/asm-3.2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/aws-java-sdk-core-1.10.6.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/curator-recipes-2.7.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/jsr305-3.0.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/hadoop-annotations-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/jetty-6.1.26.hwx.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/aws-java-sdk-s3-1.10.6.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/jackson-databind-2.2.3.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/jersey-server-1.9.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/hamcrest-core-1.3.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/joda-time-2.9.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/java-xmlbuilder-0.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/jettison-1.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/jcip-annotations-1.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/guava-11.0.2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/commons-lang3-3.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/xz-1.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/api-asn1-api-1.0.0-M20.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/apacheds-kerberos-codec-2.0.0-M15.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/netty-3.6.2.Final.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/curator-framework-2.7.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/curator-client-2.7.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/httpclient-4.5.2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/commons-logging-1.1.3.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/nimbus-jose-jwt-3.9.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/jersey-json-1.9.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/jsch-0.1.54.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/azure-keyvault-core-0.8.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/servlet-api-2.5.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/protobuf-java-2.5.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/azure-storage-4.2.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/commons-cli-1.2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/json-smart-1.1.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/jetty-util-6.1.26.hwx.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-api-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-client-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-server-tests-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-server-timeline-pluginstorage-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-registry-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-server-common-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/commons-io-2.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/apacheds-i18n-2.0.0-M15.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/httpcore-4.4.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/jetty-sslengine-6.1.26.hwx.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/objenesis-2.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/commons-configuration-1.6.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/jersey-core-1.9.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/api-util-1.0.0-M20.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/jackson-annotations-2.2.3.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/aopalliance-1.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/snappy-java-1.0.4.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/guice-servlet-3.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/javassist-3.18.1-GA.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/jackson-jaxrs-1.9.13.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/paranamer-2.3.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/jackson-core-2.2.3.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/stax-api-1.0-2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/commons-digester-1.8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/jackson-mapper-asl-1.9.13.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/javax.inject-1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/activation-1.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/commons-collections-3.2.2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/metrics-core-3.0.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/fst-2.24.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/htrace-core-3.1.0-incubating.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/jsp-api-2.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/commons-lang-2.6.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/jets3t-0.9.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/jackson-xc-1.9.13.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/commons-codec-1.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/commons-net-3.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/commons-math3-3.1.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/gson-2.2.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/log4j-1.2.17.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/commons-compress-1.4.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/commons-beanutils-1.7.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/xmlenc-0.52.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/zookeeper-3.4.6.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/avro-1.7.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/zookeeper-3.4.6.2.6.0.3-8-tests.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/asm-3.2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/curator-recipes-2.7.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/jackson-core-asl-1.9.13.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/commons-beanutils-core-1.8.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/jsr305-3.0.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/jetty-6.1.26.hwx.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/jersey-client-1.9.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/jackson-databind-2.2.3.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/jersey-server-1.9.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/java-xmlbuilder-0.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/jettison-1.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/jcip-annotations-1.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/jersey-guice-1.9.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/guava-11.0.2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/commons-lang3-3.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/xz-1.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/api-asn1-api-1.0.0-M20.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/apacheds-kerberos-codec-2.0.0-M15.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/netty-3.6.2.Final.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/curator-framework-2.7.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/curator-client-2.7.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/httpclient-4.5.2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/commons-logging-1.1.3.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/nimbus-jose-jwt-3.9.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/jersey-json-1.9.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/jsch-0.1.54.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/azure-keyvault-core-0.8.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/servlet-api-2.5.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/guice-3.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/azure-storage-4.2.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/commons-cli-1.2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/json-smart-1.1.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/jetty-util-6.1.26.hwx.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/hadoop-hdfs-nfs-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/hadoop-hdfs-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/hadoop-hdfs-2.7.3.2.6.0.3-8-tests.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/commons-io-2.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/jersey-core-1.9.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/jackson-annotations-2.2.3.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/jackson-core-2.2.3.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/okhttp-2.4.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/htrace-core-3.1.0-incubating.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/xml-apis-1.3.04.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/commons-lang-2.6.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/commons-codec-1.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/log4j-1.2.17.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/xmlenc-0.52.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/xercesImpl-2.9.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/asm-3.2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/netty-all-4.0.23.Final.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/jsr305-3.0.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/jetty-6.1.26.hwx.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/jackson-databind-2.2.3.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/jersey-server-1.9.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/okio-1.4.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/guava-11.0.2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/netty-3.6.2.Final.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/servlet-api-2.5.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/commons-cli-1.2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/jetty-util-6.1.26.hwx.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/commons-io-2.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/apacheds-i18n-2.0.0-M15.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/jaxb-api-2.2.2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/httpcore-4.4.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/jetty-sslengine-6.1.26.hwx.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/commons-configuration-1.6.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/jersey-core-1.9.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/api-util-1.0.0-M20.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/snappy-java-1.0.4.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/jackson-jaxrs-1.9.13.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/paranamer-2.3.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/stax-api-1.0-2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/hadoop-rumen-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/hadoop-openstack-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/okhttp-2.4.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/commons-digester-1.8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/hadoop-auth-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/hadoop-ant-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/jackson-mapper-asl-1.9.13.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/activation-1.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/commons-collections-3.2.2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/metrics-core-3.0.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/junit-4.11.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/htrace-core-3.1.0-incubating.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/jsp-api-2.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/commons-lang-2.6.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/jets3t-0.9.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/jackson-xc-1.9.13.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/commons-codec-1.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/commons-net-3.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/commons-math3-3.1.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/gson-2.2.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/log4j-1.2.17.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/hadoop-streaming-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/jaxb-impl-2.2.3-1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/commons-compress-1.4.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/commons-beanutils-1.7.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/hadoop-sls-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/xmlenc-0.52.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/zookeeper-3.4.6.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/avro-1.7.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/mockito-all-1.8.5.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/asm-3.2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/hadoop-distcp-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/curator-recipes-2.7.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/hadoop-gridmix-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/jackson-core-asl-1.9.13.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/commons-beanutils-core-1.8.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/jsr305-3.0.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/jetty-6.1.26.hwx.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/hadoop-extras-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/jersey-server-1.9.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/okio-1.4.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/hamcrest-core-1.3.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/hadoop-datajoin-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/hadoop-archives-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/java-xmlbuilder-0.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/commons-httpclient-3.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/jettison-1.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/jcip-annotations-1.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/guava-11.0.2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/commons-lang3-3.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/xz-1.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/api-asn1-api-1.0.0-M20.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/apacheds-kerberos-codec-2.0.0-M15.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/netty-3.6.2.Final.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/curator-framework-2.7.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/curator-client-2.7.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/httpclient-4.5.2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/commons-logging-1.1.3.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/nimbus-jose-jwt-3.9.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/jersey-json-1.9.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/jsch-0.1.54.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/azure-keyvault-core-0.8.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/servlet-api-2.5.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/protobuf-java-2.5.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/commons-cli-1.2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/json-smart-1.1.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/jetty-util-6.1.26.hwx.jar, file:/usr/hdp/2.6.0.3-8/hadoop/lib/hadoop-lzo-0.6.0.2.6.0.3-8.jar, file:/etc/hadoop/2.6.0.3-8/0/secure/, file:/usr/hadoop/yarn/local/usercache/devRht/appcache/application_1496922997306_0098/filecache/11/job.jar/job.jar, file:/usr/hadoop/yarn/local/usercache/devRht/appcache/application_1496922997306_0098/filecache/11/job.jar/classes, file:/usr/hadoop/yarn/local/usercache/devRht/appcache/application_1496922997306_0098/filecache/11/job.jar/lib/*, file:/usr/hadoop/yarn/local/usercache/devRht/appcache/application_1496922997306_0098/filecache/11/job.jar/, file:/usr/hadoop/yarn/local/usercache/devRht/filecache/837/hive-hcatalog-core.jar]
2017-06-14 12:59:31,272 INFO [main] ExecReducer: thread classpath = [file:/usr/hadoop/yarn/local/usercache/devRht/appcache/application_1496922997306_0098/container_e01_1496922997306_0098_01_000004/, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7.3.2.6.0.3-8-tests.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/lib/commons-io-2.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/lib/jersey-core-1.9.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/lib/aopalliance-1.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/lib/paranamer-2.3.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.9.13.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/lib/javax.inject-1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/lib/junit-4.11.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/lib/log4j-1.2.17.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/lib/avro-1.7.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/lib/asm-3.2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/lib/jackson-core-asl-1.9.13.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/lib/hadoop-annotations-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/lib/jersey-server-1.9.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/lib/xz-1.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/lib/netty-3.6.2.Final.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/mapreduce/lib/guice-3.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/hadoop-common-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/hadoop-azure-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/hadoop-nfs-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/hadoop-azure-datalake-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/hadoop-common-2.7.3.2.6.0.3-8-tests.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/azure-data-lake-store-sdk-2.1.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/hadoop-aws-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/commons-io-2.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/apacheds-i18n-2.0.0-M15.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/jaxb-api-2.2.2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/httpcore-4.4.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/jetty-sslengine-6.1.26.hwx.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/commons-configuration-1.6.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/jersey-core-1.9.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/api-util-1.0.0-M20.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/jackson-annotations-2.2.3.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/snappy-java-1.0.4.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/paranamer-2.3.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/jackson-core-2.2.3.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/stax-api-1.0-2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/aws-java-sdk-kms-1.10.6.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/commons-digester-1.8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/hadoop-auth-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/slf4j-api-1.7.10.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/activation-1.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/commons-collections-3.2.2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/junit-4.11.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/htrace-core-3.1.0-incubating.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/jsp-api-2.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/commons-lang-2.6.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/jets3t-0.9.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/jackson-xc-1.9.13.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/commons-codec-1.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/commons-net-3.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/commons-math3-3.1.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/gson-2.2.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/log4j-1.2.17.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/commons-compress-1.4.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/commons-beanutils-1.7.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/xmlenc-0.52.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/zookeeper-3.4.6.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/avro-1.7.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/mockito-all-1.8.5.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/asm-3.2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/aws-java-sdk-core-1.10.6.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/curator-recipes-2.7.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/jsr305-3.0.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/hadoop-annotations-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/jetty-6.1.26.hwx.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/aws-java-sdk-s3-1.10.6.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/jackson-databind-2.2.3.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/jersey-server-1.9.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/hamcrest-core-1.3.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/joda-time-2.9.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/java-xmlbuilder-0.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/jettison-1.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/jcip-annotations-1.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/guava-11.0.2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/commons-lang3-3.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/xz-1.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/api-asn1-api-1.0.0-M20.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/apacheds-kerberos-codec-2.0.0-M15.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/netty-3.6.2.Final.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/curator-framework-2.7.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/curator-client-2.7.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/httpclient-4.5.2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/commons-logging-1.1.3.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/nimbus-jose-jwt-3.9.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/jersey-json-1.9.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/jsch-0.1.54.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/azure-keyvault-core-0.8.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/servlet-api-2.5.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/protobuf-java-2.5.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/azure-storage-4.2.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/commons-cli-1.2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/json-smart-1.1.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/jetty-util-6.1.26.hwx.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-api-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-client-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-server-tests-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-server-timeline-pluginstorage-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-registry-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-server-common-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/commons-io-2.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/apacheds-i18n-2.0.0-M15.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/httpcore-4.4.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/jetty-sslengine-6.1.26.hwx.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/objenesis-2.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/commons-configuration-1.6.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/jersey-core-1.9.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/api-util-1.0.0-M20.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/jackson-annotations-2.2.3.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/aopalliance-1.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/snappy-java-1.0.4.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/guice-servlet-3.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/javassist-3.18.1-GA.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/jackson-jaxrs-1.9.13.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/paranamer-2.3.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/jackson-core-2.2.3.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/stax-api-1.0-2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/commons-digester-1.8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/jackson-mapper-asl-1.9.13.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/javax.inject-1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/activation-1.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/commons-collections-3.2.2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/metrics-core-3.0.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/fst-2.24.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/htrace-core-3.1.0-incubating.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/jsp-api-2.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/commons-lang-2.6.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/jets3t-0.9.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/jackson-xc-1.9.13.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/commons-codec-1.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/commons-net-3.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/commons-math3-3.1.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/gson-2.2.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/log4j-1.2.17.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/commons-compress-1.4.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/commons-beanutils-1.7.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/xmlenc-0.52.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/zookeeper-3.4.6.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/avro-1.7.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/zookeeper-3.4.6.2.6.0.3-8-tests.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/asm-3.2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/curator-recipes-2.7.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/jackson-core-asl-1.9.13.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/commons-beanutils-core-1.8.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/jsr305-3.0.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/jetty-6.1.26.hwx.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/jersey-client-1.9.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/jackson-databind-2.2.3.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/jersey-server-1.9.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/java-xmlbuilder-0.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/jettison-1.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/jcip-annotations-1.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/jersey-guice-1.9.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/guava-11.0.2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/commons-lang3-3.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/xz-1.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/api-asn1-api-1.0.0-M20.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/apacheds-kerberos-codec-2.0.0-M15.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/netty-3.6.2.Final.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/curator-framework-2.7.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/curator-client-2.7.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/httpclient-4.5.2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/commons-logging-1.1.3.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/nimbus-jose-jwt-3.9.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/jersey-json-1.9.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/jsch-0.1.54.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/azure-keyvault-core-0.8.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/servlet-api-2.5.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/guice-3.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/azure-storage-4.2.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/commons-cli-1.2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/json-smart-1.1.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/lib/jetty-util-6.1.26.hwx.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/hadoop-hdfs-nfs-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/hadoop-hdfs-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/hadoop-hdfs-2.7.3.2.6.0.3-8-tests.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/commons-io-2.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/jersey-core-1.9.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/jackson-annotations-2.2.3.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/jackson-core-2.2.3.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/okhttp-2.4.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/htrace-core-3.1.0-incubating.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/xml-apis-1.3.04.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/commons-lang-2.6.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/commons-codec-1.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/log4j-1.2.17.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/xmlenc-0.52.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/xercesImpl-2.9.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/asm-3.2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/netty-all-4.0.23.Final.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/jsr305-3.0.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/jetty-6.1.26.hwx.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/jackson-databind-2.2.3.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/jersey-server-1.9.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/okio-1.4.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/guava-11.0.2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/netty-3.6.2.Final.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/servlet-api-2.5.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/commons-cli-1.2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/hdfs/lib/jetty-util-6.1.26.hwx.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/commons-io-2.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/apacheds-i18n-2.0.0-M15.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/jaxb-api-2.2.2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/httpcore-4.4.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/jetty-sslengine-6.1.26.hwx.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/commons-configuration-1.6.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/jersey-core-1.9.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/api-util-1.0.0-M20.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/snappy-java-1.0.4.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/jackson-jaxrs-1.9.13.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/paranamer-2.3.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/stax-api-1.0-2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/hadoop-rumen-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/hadoop-openstack-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/okhttp-2.4.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/commons-digester-1.8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/hadoop-auth-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/hadoop-ant-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/jackson-mapper-asl-1.9.13.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/activation-1.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/commons-collections-3.2.2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/metrics-core-3.0.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/junit-4.11.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/htrace-core-3.1.0-incubating.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/jsp-api-2.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/commons-lang-2.6.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/jets3t-0.9.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/jackson-xc-1.9.13.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/commons-codec-1.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/commons-net-3.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/commons-math3-3.1.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/gson-2.2.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/log4j-1.2.17.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/hadoop-streaming-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/jaxb-impl-2.2.3-1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/commons-compress-1.4.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/commons-beanutils-1.7.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/hadoop-sls-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/xmlenc-0.52.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/zookeeper-3.4.6.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/avro-1.7.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/mockito-all-1.8.5.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/asm-3.2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/hadoop-distcp-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/curator-recipes-2.7.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/hadoop-gridmix-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/jackson-core-asl-1.9.13.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/commons-beanutils-core-1.8.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/jsr305-3.0.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/jetty-6.1.26.hwx.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/hadoop-extras-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/jersey-server-1.9.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/okio-1.4.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/hamcrest-core-1.3.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/hadoop-datajoin-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/hadoop-archives-2.7.3.2.6.0.3-8.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/java-xmlbuilder-0.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/commons-httpclient-3.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/jettison-1.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/jcip-annotations-1.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/guava-11.0.2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/commons-lang3-3.4.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/xz-1.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/api-asn1-api-1.0.0-M20.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/apacheds-kerberos-codec-2.0.0-M15.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/netty-3.6.2.Final.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/curator-framework-2.7.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/curator-client-2.7.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/httpclient-4.5.2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/commons-logging-1.1.3.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/nimbus-jose-jwt-3.9.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/jersey-json-1.9.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/jsch-0.1.54.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/azure-keyvault-core-0.8.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/servlet-api-2.5.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/protobuf-java-2.5.0.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/commons-cli-1.2.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/json-smart-1.1.1.jar, file:/var/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/tools/lib/jetty-util-6.1.26.hwx.jar, file:/usr/hdp/2.6.0.3-8/hadoop/lib/hadoop-lzo-0.6.0.2.6.0.3-8.jar, file:/etc/hadoop/2.6.0.3-8/0/secure/, file:/usr/hadoop/yarn/local/usercache/devRht/appcache/application_1496922997306_0098/filecache/11/job.jar/job.jar, file:/usr/hadoop/yarn/local/usercache/devRht/appcache/application_1496922997306_0098/filecache/11/job.jar/classes, file:/usr/hadoop/yarn/local/usercache/devRht/appcache/application_1496922997306_0098/filecache/11/job.jar/lib/*, file:/usr/hadoop/yarn/local/usercache/devRht/appcache/application_1496922997306_0098/filecache/11/job.jar/, file:/usr/hadoop/yarn/local/usercache/devRht/filecache/837/hive-hcatalog-core.jar]
2017-06-14 12:59:31,328 INFO [main] org.apache.hadoop.hive.ql.exec.Utilities: PLAN PATH = hdfs://vbindevhadoopmaster.axisb.com:8020/tmp/hive/devRht/086c5618-7ced-43b2-a157-3e9d5df30416/hive_2017-06-14_12-58-09_651_2915098013900303882-1/-mr-10003/cb92c04a-bea4-47e3-ac7d-dd1a1d2408d5/reduce.xml
2017-06-14 12:59:31,423 INFO [main] org.apache.hadoop.hive.ql.log.PerfLogger: <PERFLOG method=deserializePlan from=org.apache.hadoop.hive.ql.exec.Utilities>
2017-06-14 12:59:31,424 INFO [main] org.apache.hadoop.hive.ql.exec.Utilities: Deserializing ReduceWork via kryo
2017-06-14 12:59:31,793 INFO [main] org.apache.hadoop.hive.ql.log.PerfLogger: </PERFLOG method=deserializePlan start=1497425371423 end=1497425371793 duration=370 from=org.apache.hadoop.hive.ql.exec.Utilities>
2017-06-14 12:59:31,902 INFO [main] ExecReducer:
<SEL>Id =0
<Children>
<FS>Id =1
<Children>
<\Children>
<Parent>Id = 0 null<\Parent>
<\FS>
<\Children>
<Parent><\Parent>
<\SEL>
2017-06-14 12:59:31,903 INFO [main] org.apache.hadoop.hive.ql.exec.SelectOperator: Initializing operator SEL[0]
2017-06-14 12:59:32,211 INFO [main] org.apache.hadoop.hive.ql.exec.SelectOperator: SELECT struct<key:struct<reducesinkkey0:struct<transactionid:bigint,bucketid:int,rowid:bigint>>,value:struct<_col0:varchar(11),_col1:char(1),_col2:char(1),_col3:varchar(8),_col4:varchar(2),_col5:varchar(9),_col6:varchar(16),_col7:varchar(16),_col8:varchar(80),_col9:varchar(10),_col10:varchar(9),_col11:varchar(10),_col12:varchar(5),_col13:char(1),_col14:varchar(5),_col15:decimal(20,4),_col16:varchar(6),_col17:char(1),_col18:varchar(5),_col19:string,_col20:char(1),_col21:string,_col22:decimal(20,4),_col23:decimal(5,0),_col24:decimal(3,0),_col25:decimal(20,4),_col26:decimal(20,4),_col27:decimal(20,4),_col28:decimal(20,4),_col29:decimal(20,4),_col30:decimal(20,4),_col31:decimal(20,4),_col32:decimal(20,4),_col33:decimal(20,4),_col34:decimal(20,4),_col35:decimal(20,4),_col36:decimal(20,4),_col37:char(1),_col38:decimal(20,4),_col39:decimal(20,4),_col40:decimal(20,4),_col41:decimal(20,4),_col42:decimal(20,4),_col43:decimal(20,4),_col44:decimal(20,4),_col45:decimal(20,4),_col46:decimal(20,4),_col47:decimal(25,4),_col48:decimal(25,4),_col49:decimal(20,4),_col50:string,_col51:varchar(5),_col52:char(1),_col53:char(1),_col54:varchar(240),_col55:char(1),_col56:char(1),_col57:varchar(5),_col58:string,_col59:decimal(20,4),_col60:char(1),_col61:char(1),_col62:string,_col63:varchar(40),_col64:varchar(15),_col65:string,_col66:varchar(15),_col67:string,_col68:varchar(12),_col69:char(1),_col70:decimal(9,6),_col71:char(1),_col72:string,_col73:decimal(21,10),_col74:varchar(5),_col75:decimal(20,4),_col76:decimal(20,4),_col77:varchar(16),_col78:decimal(25,4),_col79:decimal(25,4),_col80:varchar(3),_col81:varchar(5),_col82:char(1),_col83:varchar(3),_col84:decimal(20,4),_col85:char(1),_col86:char(1),_col87:char(1),_col88:decimal(20,4),_col89:char(1),_col90:char(1),_col91:varchar(240),_col92:string,_col93:varchar(15),_col94:varchar(3),_col95:string,_col96:string,_col97:decimal(20,4),_col98:char(1),_col99:decimal(9,6),_col100:decimal(20,4),_col101:varchar(5),_col102:char(1),_col103:char(1),_col104:varchar(5),_col105:char(1),_col106:string,_col107:char(1),_col108:char(1),_col109:char(1),_col110:varchar(11),_col111:varchar(20),_col112:varchar(80),_col113:varchar(5),_col114:varchar(10),_col115:decimal(5,0),_col116:char(1),_col117:decimal(4,0),_col118:decimal(9,6),_col119:decimal(20,4),_col120:char(1),_col121:varchar(5),_col122:varchar(20),_col123:varchar(20),_col124:string,_col125:decimal(20,4),_col126:decimal(20,4),_col127:decimal(20,4),_col128:decimal(20,4),_col129:decimal(20,4),_col130:char(1),_col131:char(1),_col132:varchar(11),_col133:varchar(50),_col134:decimal(20,4),_col135:decimal(20,4),_col136:decimal(20,4),_col137:decimal(20,4),_col138:decimal(9,6),_col139:decimal(20,4),_col140:decimal(20,4),_col141:varchar(34),_col142:varchar(5),_col143:varchar(5),_col144:decimal(20,4),_col145:decimal(20,4),_col146:varchar(12),_col147:varchar(8),_col148:varchar(5),_col149:varchar(5),_col150:varchar(5),_col151:varchar(5),_col152:char(1),_col153:varchar(2),_col154:varchar(2),_col155:char(1),_col156:varchar(10),_col157:varchar(80),_col158:char(1),_col159:char(1),_col160:decimal(2,0),_col161:decimal(2,0),_col162:char(20),_col163:decimal(5,0),_col164:string,_col165:varchar(50),_col166:varchar(30),_col167:string,_col168:varchar(50),_col169:varchar(30),_col170:varchar(10),_col171:decimal(38,4),_col172:char(1),_col173:string>>
2017-06-14 12:59:32,219 INFO [main] org.apache.hadoop.hive.ql.exec.FileSinkOperator: Initializing operator FS[1]
2017-06-14 12:59:32,219 INFO [main] org.apache.hadoop.conf.Configuration.deprecation: mapred.task.id is deprecated. Instead, use mapreduce.task.attempt.id
2017-06-14 12:59:32,231 INFO [main] org.apache.hadoop.hive.ql.exec.FileSinkOperator: Using serializer : org.apache.hadoop.hive.ql.io.orc.OrcSerde@336365bc and formatter : org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat@38eb2fb0
2017-06-14 12:59:32,231 INFO [main] org.apache.hadoop.conf.Configuration.deprecation: mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2017-06-14 12:59:32,248 INFO [main] org.apache.hadoop.hive.ql.exec.FileSinkOperator: Final Path: FS hdfs://vbindevhadoopmaster.axisb.com:8020/apps/hive/warehouse/rish.db/gam_orc/.hive-staging_hive_2017-06-14_12-58-09_853_978880535122959044-1/_tmp.-ext-10002/000000_0
2017-06-14 12:59:32,249 INFO [main] org.apache.hadoop.hive.ql.exec.FileSinkOperator: Writing to temp file: FS hdfs://vbindevhadoopmaster.axisb.com:8020/apps/hive/warehouse/rish.db/gam_orc/.hive-staging_hive_2017-06-14_12-58-09_853_978880535122959044-1/_task_tmp.-ext-10002/_tmp.000000_0
2017-06-14 12:59:32,249 INFO [main] org.apache.hadoop.hive.ql.exec.FileSinkOperator: New Final Path: FS hdfs://vbindevhadoopmaster.axisb.com:8020/apps/hive/warehouse/rish.db/gam_orc/.hive-staging_hive_2017-06-14_12-58-09_853_978880535122959044-1/_tmp.-ext-10002/000000_0
2017-06-14 12:59:32,267 INFO [main] org.apache.hadoop.hive.ql.exec.FileSinkOperator: FS[1]: records written - 1
2017-06-14 12:59:32,554 INFO [main] org.apache.hadoop.hive.ql.io.orc.WriterImpl: WIDE TABLE - Number of columns: 181 Chosen compression buffer size: 4096
2017-06-14 12:59:32,633 INFO [main] org.apache.hadoop.hive.ql.io.orc.WriterImpl: ORC writer created for path: hdfs://vbindevhadoopmaster.axisb.com:8020/apps/hive/warehouse/rish.db/gam_orc/.hive-staging_hive_2017-06-14_12-58-09_853_978880535122959044-1/_task_tmp.-ext-10002/_tmp.000000_0/delta_0000021_0000021_0001/bucket_00000 with stripeSize: 8388608 blockSize: 268435456 compression: ZLIB bufferSize: 32768
2017-06-14 12:59:32,684 INFO [main] org.apache.hadoop.hive.ql.exec.FileSinkOperator: FS[1]: records written - 10
2017-06-14 12:59:32,780 INFO [main] org.apache.hadoop.hive.ql.exec.FileSinkOperator: FS[1]: records written - 100
2017-06-14 12:59:33,288 INFO [main] org.apache.hadoop.hive.ql.exec.FileSinkOperator: FS[1]: records written - 1000
2017-06-14 12:59:35,366 INFO [main] org.apache.hadoop.hive.ql.exec.FileSinkOperator: FS[1]: records written - 10000
2017-06-14 12:59:38,225 FATAL [main] ExecReducer: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row (tag=0) {"key":{"reducesinkkey0":{"transactionid":0,"bucketid":8,"rowid":13}},"value":{"_col0":"2H83623323","_col1":"Y","_col2":"N","_col3":"349","_col4":"91","_col5":"501004521","_col6":null,"_col7":"915010045217957","_col8":"MAHENDRA KUMAR DIWAKAR","_col9":"MAHENDRA","_col10":"859504917","_col11":null,"_col12":"07001","_col13":"C","_col14":"SAPPM","_col15":0,"_col16":"SAPPM","_col17":" ","_col18":null,"_col19":"2015-09-10 00:00:00.0","_col20":"N","_col21":null,"_col22":4521.61,"_col23":0,"_col24":1,"_col25":0,"_col26":0,"_col27":0,"_col28":0,"_col29":0,"_col30":0,"_col31":0,"_col32":0,"_col33":0,"_col34":0,"_col35":0,"_col36":0,"_col37":"Y","_col38":9999999.99,"_col39":99999999999999.99,"_col40":99999999999999.99,"_col41":9999999.99,"_col42":99999999999999.99,"_col43":99999999999999.99,"_col44":99999999999999.99,"_col45":99999999999999.99,"_col46":99999999999999.99,"_col47":352395.89,"_col48":356917.5,"_col49":0,"_col50":"2017-06-13 00:00:00.0","_col51":"01","_col52":"B","_col53":"Y","_col54":"1038879474","_col55":"N","_col56":"Y","_col57":null,"_col58":"2015-09-09 00:00:00.0","_col59":0,"_col60":"Y","_col61":"Y","_col62":"2017-06-13 00:00:00.0","_col63":"1A41FB80D7FECE75BA772FFA1A062AA37C03063F","_col64":"CDCI","_col65":"2017-06-13 08:52:22.0","_col66":"CDCI","_col67":"2015-09-10 14:51:21.0","_col68":null,"_col69":" ","_col70":0,"_col71":"Y","_col72":"2015-09-09 00:00:00.0","_col73":0,"_col74":null,"_col75":0,"_col76":0,"_col77":null,"_col78":0,"_col79":0,"_col80":null,"_col81":null,"_col82":" ","_col83":"INR","_col84":0,"_col85":" ","_col86":" ","_col87":"N","_col88":0,"_col89":" ","_col90":"Y","_col91":null,"_col92":"2015-09-09 00:00:00.0","_col93":null,"_col94":"SBA","_col95":null,"_col96":"2015-11-06 07:16:50.0","_col97":0,"_col98":"N","_col99":0,"_col100":0,"_col101":null,"_col102":" ","_col103":" ","_col104":null,"_col105":"N","_col106":"1900-01-01 00:00:00.0","_col107":"N","_col108":" ","_col109":" ","_col110":null,"_col111":null,"_col112":null,"_col113":null,"_col114":"INFENG","_col115":390,"_col116":"N","_col117":0,"_col118":0,"_col119":0,"_col120":" ","_col121":"SAL","_col122":null,"_col123":null,"_col124":"2017-04-15 00:00:00.0","_col125":25000,"_col126":0,"_col127":0,"_col128":0,"_col129":0,"_col130":" ","_col131":"A","_col132":null,"_col133":"859504917","_col134":0,"_col135":0,"_col136":0,"_col137":0,"_col138":0,"_col139":0,"_col140":0,"_col141":null,"_col142":null,"_col143":null,"_col144":0,"_col145":0,"_col146":null,"_col147":"01","_col148":null,"_col149":null,"_col150":null,"_col151":null,"_col152":"N","_col153":null,"_col154":"00","_col155":" ","_col156":null,"_col157":null,"_col158":" ","_col159":" ","_col160":0,"_col161":0,"_col162":"20170612201349018185","_col163":1,"_col164":"2017-01-01 15:45:02.0","_col165":"m_FININ_general_acct_mast_table_ODS_fi_general_acc","_col166":"m_FININ_general_acct_mast_tabl","_col167":"2017-06-12 21:40:13.147284","_col168":"m_STG_fi_general_acct_mast_table_ODS_fi_general_ac","_col169":"m_STG_fi_general_acct_mast_tab","_col170":"Y","_col171":3531,"_col172":"N","_col173":"2017-06-12 20:13:49.018184"}}
at org.apache.hadoop.hive.ql.exec.mr.ExecReducer.reduce(ExecReducer.java:244)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:170)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:164)
Caused by: java.lang.ArrayIndexOutOfBoundsException: 1
at org.apache.hadoop.hive.ql.exec.FileSinkOperator.process(FileSinkOperator.java:780)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:841)
at org.apache.hadoop.hive.ql.exec.SelectOperator.process(SelectOperator.java:88)
at org.apache.hadoop.hive.ql.exec.mr.ExecReducer.reduce(ExecReducer.java:235)
... 7 more
2017-06-14 12:59:38,225 INFO [main] org.apache.hadoop.hive.ql.exec.SelectOperator: Closing operator SEL[0]
2017-06-14 12:59:38,226 INFO [main] org.apache.hadoop.hive.ql.exec.FileSinkOperator: Closing operator FS[1]
2017-06-14 12:59:38,226 INFO [main] org.apache.hadoop.hive.ql.exec.FileSinkOperator: FS[1]: records written - 25080
2017-06-14 12:59:38,226 INFO [main] org.apache.hadoop.hive.ql.exec.FileSinkOperator: RECORDS_OUT_2_rish.gam_orc:25080,
2017-06-14 12:59:38,228 WARN [main] org.apache.hadoop.mapred.YarnChild: Exception running child : java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row (tag=0) {"key":{"reducesinkkey0":{"transactionid":0,"bucketid":8,"rowid":13}},"value":{"_col0":"2H83623323","_col1":"Y","_col2":"N","_col3":"349","_col4":"91","_col5":"501004521","_col6":null,"_col7":"915010045217957","_col8":"MAHENDRA KUMAR DIWAKAR","_col9":"MAHENDRA","_col10":"859504917","_col11":null,"_col12":"07001","_col13":"C","_col14":"SAPPM","_col15":0,"_col16":"SAPPM","_col17":" ","_col18":null,"_col19":"2015-09-10 00:00:00.0","_col20":"N","_col21":null,"_col22":4521.61,"_col23":0,"_col24":1,"_col25":0,"_col26":0,"_col27":0,"_col28":0,"_col29":0,"_col30":0,"_col31":0,"_col32":0,"_col33":0,"_col34":0,"_col35":0,"_col36":0,"_col37":"Y","_col38":9999999.99,"_col39":99999999999999.99,"_col40":99999999999999.99,"_col41":9999999.99,"_col42":99999999999999.99,"_col43":99999999999999.99,"_col44":99999999999999.99,"_col45":99999999999999.99,"_col46":99999999999999.99,"_col47":352395.89,"_col48":356917.5,"_col49":0,"_col50":"2017-06-13 00:00:00.0","_col51":"01","_col52":"B","_col53":"Y","_col54":"1038879474","_col55":"N","_col56":"Y","_col57":null,"_col58":"2015-09-09 00:00:00.0","_col59":0,"_col60":"Y","_col61":"Y","_col62":"2017-06-13 00:00:00.0","_col63":"1A41FB80D7FECE75BA772FFA1A062AA37C03063F","_col64":"CDCI","_col65":"2017-06-13 08:52:22.0","_col66":"CDCI","_col67":"2015-09-10 14:51:21.0","_col68":null,"_col69":" ","_col70":0,"_col71":"Y","_col72":"2015-09-09 00:00:00.0","_col73":0,"_col74":null,"_col75":0,"_col76":0,"_col77":null,"_col78":0,"_col79":0,"_col80":null,"_col81":null,"_col82":" ","_col83":"INR","_col84":0,"_col85":" ","_col86":" ","_col87":"N","_col88":0,"_col89":" ","_col90":"Y","_col91":null,"_col92":"2015-09-09 00:00:00.0","_col93":null,"_col94":"SBA","_col95":null,"_col96":"2015-11-06 07:16:50.0","_col97":0,"_col98":"N","_col99":0,"_col100":0,"_col101":null,"_col102":" ","_col103":" ","_col104":null,"_col105":"N","_col106":"1900-01-01 00:00:00.0","_col107":"N","_col108":" ","_col109":" ","_col110":null,"_col111":null,"_col112":null,"_col113":null,"_col114":"INFENG","_col115":390,"_col116":"N","_col117":0,"_col118":0,"_col119":0,"_col120":" ","_col121":"SAL","_col122":null,"_col123":null,"_col124":"2017-04-15 00:00:00.0","_col125":25000,"_col126":0,"_col127":0,"_col128":0,"_col129":0,"_col130":" ","_col131":"A","_col132":null,"_col133":"859504917","_col134":0,"_col135":0,"_col136":0,"_col137":0,"_col138":0,"_col139":0,"_col140":0,"_col141":null,"_col142":null,"_col143":null,"_col144":0,"_col145":0,"_col146":null,"_col147":"01","_col148":null,"_col149":null,"_col150":null,"_col151":null,"_col152":"N","_col153":null,"_col154":"00","_col155":" ","_col156":null,"_col157":null,"_col158":" ","_col159":" ","_col160":0,"_col161":0,"_col162":"20170612201349018185","_col163":1,"_col164":"2017-01-01 15:45:02.0","_col165":"m_FININ_general_acct_mast_table_ODS_fi_general_acc","_col166":"m_FININ_general_acct_mast_tabl","_col167":"2017-06-12 21:40:13.147284","_col168":"m_STG_fi_general_acct_mast_table_ODS_fi_general_ac","_col169":"m_STG_fi_general_acct_mast_tab","_col170":"Y","_col171":3531,"_col172":"N","_col173":"2017-06-12 20:13:49.018184"}}
at org.apache.hadoop.hive.ql.exec.mr.ExecReducer.reduce(ExecReducer.java:256)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:170)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:164)
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row (tag=0) {"key":{"reducesinkkey0":{"transactionid":0,"bucketid":8,"rowid":13}},"value":{"_col0":"2H83623323","_col1":"Y","_col2":"N","_col3":"349","_col4":"91","_col5":"501004521","_col6":null,"_col7":"915010045217957","_col8":"MAHENDRA KUMAR DIWAKAR","_col9":"MAHENDRA","_col10":"859504917","_col11":null,"_col12":"07001","_col13":"C","_col14":"SAPPM","_col15":0,"_col16":"SAPPM","_col17":" ","_col18":null,"_col19":"2015-09-10 00:00:00.0","_col20":"N","_col21":null,"_col22":4521.61,"_col23":0,"_col24":1,"_col25":0,"_col26":0,"_col27":0,"_col28":0,"_col29":0,"_col30":0,"_col31":0,"_col32":0,"_col33":0,"_col34":0,"_col35":0,"_col36":0,"_col37":"Y","_col38":9999999.99,"_col39":99999999999999.99,"_col40":99999999999999.99,"_col41":9999999.99,"_col42":99999999999999.99,"_col43":99999999999999.99,"_col44":99999999999999.99,"_col45":99999999999999.99,"_col46":99999999999999.99,"_col47":352395.89,"_col48":356917.5,"_col49":0,"_col50":"2017-06-13 00:00:00.0","_col51":"01","_col52":"B","_col53":"Y","_col54":"1038879474","_col55":"N","_col56":"Y","_col57":null,"_col58":"2015-09-09 00:00:00.0","_col59":0,"_col60":"Y","_col61":"Y","_col62":"2017-06-13 00:00:00.0","_col63":"1A41FB80D7FECE75BA772FFA1A062AA37C03063F","_col64":"CDCI","_col65":"2017-06-13 08:52:22.0","_col66":"CDCI","_col67":"2015-09-10 14:51:21.0","_col68":null,"_col69":" ","_col70":0,"_col71":"Y","_col72":"2015-09-09 00:00:00.0","_col73":0,"_col74":null,"_col75":0,"_col76":0,"_col77":null,"_col78":0,"_col79":0,"_col80":null,"_col81":null,"_col82":" ","_col83":"INR","_col84":0,"_col85":" ","_col86":" ","_col87":"N","_col88":0,"_col89":" ","_col90":"Y","_col91":null,"_col92":"2015-09-09 00:00:00.0","_col93":null,"_col94":"SBA","_col95":null,"_col96":"2015-11-06 07:16:50.0","_col97":0,"_col98":"N","_col99":0,"_col100":0,"_col101":null,"_col102":" ","_col103":" ","_col104":null,"_col105":"N","_col106":"1900-01-01 00:00:00.0","_col107":"N","_col108":" ","_col109":" ","_col110":null,"_col111":null,"_col112":null,"_col113":null,"_col114":"INFENG","_col115":390,"_col116":"N","_col117":0,"_col118":0,"_col119":0,"_col120":" ","_col121":"SAL","_col122":null,"_col123":null,"_col124":"2017-04-15 00:00:00.0","_col125":25000,"_col126":0,"_col127":0,"_col128":0,"_col129":0,"_col130":" ","_col131":"A","_col132":null,"_col133":"859504917","_col134":0,"_col135":0,"_col136":0,"_col137":0,"_col138":0,"_col139":0,"_col140":0,"_col141":null,"_col142":null,"_col143":null,"_col144":0,"_col145":0,"_col146":null,"_col147":"01","_col148":null,"_col149":null,"_col150":null,"_col151":null,"_col152":"N","_col153":null,"_col154":"00","_col155":" ","_col156":null,"_col157":null,"_col158":" ","_col159":" ","_col160":0,"_col161":0,"_col162":"20170612201349018185","_col163":1,"_col164":"2017-01-01 15:45:02.0","_col165":"m_FININ_general_acct_mast_table_ODS_fi_general_acc","_col166":"m_FININ_general_acct_mast_tabl","_col167":"2017-06-12 21:40:13.147284","_col168":"m_STG_fi_general_acct_mast_table_ODS_fi_general_ac","_col169":"m_STG_fi_general_acct_mast_tab","_col170":"Y","_col171":3531,"_col172":"N","_col173":"2017-06-12 20:13:49.018184"}}
at org.apache.hadoop.hive.ql.exec.mr.ExecReducer.reduce(ExecReducer.java:244)
... 7 more
Caused by: java.lang.ArrayIndexOutOfBoundsException: 1
at org.apache.hadoop.hive.ql.exec.FileSinkOperator.process(FileSinkOperator.java:780)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:841)
at org.apache.hadoop.hive.ql.exec.SelectOperator.process(SelectOperator.java:88)
at org.apache.hadoop.hive.ql.exec.mr.ExecReducer.reduce(ExecReducer.java:235)
... 7 more
2017-06-14 12:59:38,231 INFO [main] org.apache.hadoop.mapred.Task: Runnning cleanup for the task
... View more
Labels:
- Labels:
-
Apache Hive
06-12-2017
08:12 AM
1 Kudo
Hi got this solved by adding below path in hiveserver2 JDBC URL jdbc:hive2://<hostname>:10000/;transportMode=binary In hive view, i was receiving error which was solved using below using below link (check WebHDFS url path) https://community.hortonworks.com/questions/80603/hdfs020-could-not-write-file-useradminhivejobshive.html#answer-80753 thanks, Rishit Shah
... View more
06-09-2017
04:23 AM
found this in hive-view logs 07 Jun 2017 10:30:09,493 INFO [pool-3-thread-1] [ ] DDLProxy:81 - Creating DDLProxy
07 Jun 2017 14:53:59,315 INFO [main] [ ] DDLProxy:81 - Creating DDLProxy
07 Jun 2017 14:54:51,179 INFO [main] [ ] DDLProxy:81 - Creating DDLProxy
07 Jun 2017 17:00:59,686 INFO [main] [ ] DDLProxy:81 - Creating DDLProxy
08 Jun 2017 13:54:36,977 ERROR [ambari-client-thread-5324] [HIVE 2.0.0 AUTO_HIVE20_INSTANCE] ServiceFormattedException:97 - Cannot open a hive connec
tion with connect string jdbc:hive2://vbindevhadoopdata1.axisb.com:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;hive.server2.p
roxy.user=admin
08 Jun 2017 13:54:36,978 ERROR [ambari-client-thread-5324] [HIVE 2.0.0 AUTO_HIVE20_INSTANCE] ServiceFormattedException:98 - org.apache.ambari.view.hi
ve20.internal.ConnectionException: Cannot open a hive connection with connect string jdbc:hive2://vbindevhadoopdata1.axisb.com:2181/;serviceDiscovery
Mode=zooKeeper;zooKeeperNamespace=hiveserver2;hive.server2.proxy.user=admin
org.apache.ambari.view.hive20.internal.ConnectionException: Cannot open a hive connection with connect string jdbc:hive2://vbindevhadoopdata1.axisb.c
om:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;hive.server2.proxy.user=admin
at org.apache.ambari.view.hive20.internal.HiveConnectionWrapper.connect(HiveConnectionWrapper.java:89)
at org.apache.ambari.view.hive20.resources.browser.ConnectionService.attemptHiveConnection(ConnectionService.java:109)
at org.apache.ambari.view.hive20.resources.browser.ConnectionService.attemptConnection(ConnectionService.java:92)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)
at com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$ResponseOutInvoker._dispatch(AbstractResourceMetho
dDispatchProvider.java:205)
at com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)
at com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:302)
at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
at com.sun.jersey.server.impl.uri.rules.SubLocatorRule.accept(SubLocatorRule.java:137)
at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
at com.sun.jersey.server.impl.uri.rules.SubLocatorRule.accept(SubLocatorRule.java:137)
at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
at com.sun.jersey.server.impl.uri.rules.SubLocatorRule.accept(SubLocatorRule.java:137)
at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
at com.sun.jersey.server.impl.uri.rules.SubLocatorRule.accept(SubLocatorRule.java:137)
at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
at com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108)
at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
at com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84)
at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1542)
at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1473)
at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1419) Caused by: java.sql.SQLException: Could not open client transport for any of the Server URI's in ZooKeeper: java.net.ConnectException: Connection ref
used
at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:219)
at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:157)
at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:107)
at java.sql.DriverManager.getConnection(DriverManager.java:664)
at java.sql.DriverManager.getConnection(DriverManager.java:247)
at org.apache.ambari.view.hive20.internal.HiveConnectionWrapper$1.run(HiveConnectionWrapper.java:78)
at org.apache.ambari.view.hive20.internal.HiveConnectionWrapper$1.run(HiveConnectionWrapper.java:75)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866)
at org.apache.ambari.view.hive20.internal.HiveConnectionWrapper.connect(HiveConnectionWrapper.java:75)
... 99 more
Caused by: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused
at org.apache.thrift.transport.TSocket.open(TSocket.java:185)
at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:248)
at org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37)
at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:195)
... View more
06-08-2017
12:10 PM
Getting below error Message: Cannot open a hive connection with connect string jdbc:hive2://vbindevhadoopdata1.axisb.com:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;hive.server2.proxy.user=admin please let me know what is to be checked?
... View more
- Tags:
- ambari-views
Labels:
- Labels:
-
Apache Ambari
06-08-2017
10:22 AM
1 Kudo
Hi, i also came across following directories sudo rm -rf /var/spool/mail/hive sudo rm -rf /var/spool/mail/zookeeper sudo rm -rf /var/spool/mail/oozie sudo rm -rf /var/spool/mail/ams sudo rm -rf /var/spool/mail/tez sudo rm -rf /var/spool/mail/livy sudo rm -rf /var/spool/mail/ambari-qa sudo rm -rf /var/spool/mail/flume sudo rm -rf /var/spool/mail/kafka sudo rm -rf /var/spool/mail/yarn sudo rm -rf /var/spool/mail/mapred sudo rm -rf /var/spool/mail/hcat sudo rm -rf /var/spool/mail/slider sudo rm -rf /var/spool/mail/sqoop sudo rm -rf /var/spool/mail/zeppelin
... View more
03-24-2017
06:50 AM
Hi @Bernhard Walter thanks for the reply. As i mentioned in other post above i even tried with date1 but got same error as key not found. is it possible that loading from oracle directly is creating any prob? thanks, Rishit Shah
... View more
03-22-2017
04:30 AM
hi @pbarna thanks for the response. date1 is dynamic partition column hence i have not declared it in table and i am trying to use the t_date column in df as date1 value. correct me if i am doing wrong? thanks, Rishit Shah
... View more
03-21-2017
12:13 PM
yes tried with same column name as well..but same error. thanks, Rishit Shah
... View more
03-21-2017
05:10 AM
Need a help in a error received. i am trying to insert into hive table from spark using following syntax. tranl1.write.mode("overwrite").partitionBy("t_date").insertInto("tran_spark_part") Note : tranl1 is DF i had created for loading data from oracle. val tranl1 = sqlContext.load("jdbc", Map("url" -> "jdbc:oracle:thin:userid/pwd@localhost:portid","dbtable" -> "(select a.*,to_char(to_date(trunc(txn_date,'DD'),'dd-MM-yy')) as t_date from table a WHERE TXN_DATE >= TRUNC(sysdate,'DD'))")) my table in hive : create table tran_spark_part(id string,amount string,creditaccount string,creditbankname string,creditvpa string,customerid string,debitaccount string,debitbankname string,debitvpa string,irc string,refid string,remarks string,rrn string,status string,txn_date string,txnid string,type string,expiry_date string,approvalnum string,msgid string,seqno string,upirc string,reversal string,trantype string) partitioned by (date1 string); However when i run tranl1.write.mode("overwrite").partitionBy("t_date").insertInto("tran_spark_part") it gives error : java.util.NoSuchElementException: key not found: date1 Please help me what i am missing or doing wrong? thanks. Rishit Shah.
... View more
Labels:
- Labels:
-
Apache Spark
01-10-2017
10:54 AM
1 Kudo
hi, i am trying to import xml data in hive. below is an example: <ns2:reqValAdd xmlns:ns2="http://www.ss.ss"></ns2:reqValAdd> CREATE TABLE xml_test4(ns2 STRING)
ROW FORMAT SERDE 'com.ibm.spss.hive.serde2.xml.XmlSerDe'
WITH SERDEPROPERTIES (
"column.xpath.ns2"="/ns2:ReqValAdd/@ns2"
)
STORED AS
INPUTFORMAT 'com.ibm.spss.hive.serde2.xml.XmlInputFormat'
OUTPUTFORMAT 'org.apache.hadoop.hive.ql.io.IgnoreKeyTextOutputFormat'
TBLPROPERTIES (
"xmlinput.start"="<ns2:reqValAdd xmlns:ns2",
"xmlinput.end"="</ns2:reqValAdd>"
); the output is coming as NULL while i am expecting "http://www.ss.ss". can you please suggest what is wrong and how to rectify? thanks, Rishit Shah
... View more
Labels:
- Labels:
-
Apache Hive
12-23-2016
05:54 AM
hi @Artem Ervits - they are already installed. the flume-env.sh set up was not proper. i added paths of lib and it got solved. But, now i get error of memory capacity full. i had tried to increase channel capacity and transaction capacity as well but same error. any advice? thanks. Rishit Shah
... View more
12-20-2016
10:02 AM
hi, it seems that all the jars need to be present in flume/lib directory. it works for me with this, but this doesnt seem to be ideal case. any suggestion? thanks, Rishit Shah
... View more
12-17-2016
07:18 AM
adding conf file for readable purposeflume-hive-hortonworks.txt pls reply as i am stuck.
... View more
12-17-2016
07:15 AM
Caused by: java.lang.ClassNotFoundException: org.apache.hive.hcatalog.streaming.RecordWriter my flume-conf file is as below: agent1.channels = ch1
agent1.sinks = HIVE
agent1.sources = sql-source
#
agent1.sources = sql-source
agent1.sources.sql-source.type = org.keedio.flume.source.SQLSource
agent1.sources.sql-source.channels = ch1
#
#
# URL to connect to database (currently only mysql is supported)
#agent1.sources.sql-source.connection.url = jdbc:oracle:thin:@<ip>:<SID> agent1.sources.sql-source.hibernate.connection.url = jdbc:oracle:thin:@<IP>:<SID> #
# # Database connection properties
agent1.sources.sql-source.hibernate.connection.user = mis_user
agent1.sources.sql-source.hibernate.connection.password = abcd_1234
agent1.sources.sql-source.table = ods_user.bb_rm_data
#agent1.sources.sql-source.database = ods_user
#
agent1.sources.sql-source.columns.to.select = *
agent1.sources.sql-source.max.rows = 100
# # Increment column properties
# # agent1.sources.sql-source.incremental.column.name = id
# # Increment value is from you want to start taking data from tables (0 will import entire table)
# agent1.sources.sql-source.incremental.value = 0
#agent1.sources.sql-source.hibernate.dialect = org.keedio.flume.source.SQLServerCustomDialect
# Query delay, each configured milisecond the query will be sent
agent1.sources.sql-source.run.query.delay=5000000
#
# Status file is used to save last readed row
agent1.sources.sql-source.status.file.path = /home/dev_Rht
agent1.sources.sql-source.status.file.name = sql-source.status
#
#channel properties
agent1.channels.ch1.type = memory
agent1.channels.ch1.capacity = 2000000
#
agent1.sinks.HIVE.type = hive
agent1.sinks.HIVE.channel = ch1
agent1.sinks.HIVE.hive.metastore = thrift://localhost:9083
agent1.sinks.HIVE.hive.database = default
agent1.sinks.HIVE.hive.table = fi_bb6
agent1.sinks.HIVE.useLocalTimeStamp = false
agent1.sinks.HIVE.round = true
agent1.sinks.HIVE.roundValue = 10
agent1.sinks.HIVE.roundUnit = minute
agent1.sinks.HIVE.serializer = DELIMITED
agent1.sinks.HIVE.serializer.delimiter = ","
agent1.sinks.HIVE.serializer.serdeSeparator = ','
agent1.sinks.HIVE.serializer.fieldnames = col1,col2,col3,col4,col5,col6,col7,col8,col9,col10,col11,col12,col13,col14,col15,col16,col17,col18,col19,col20,col21,col22,col23,col24,col25,col26,col27,col28,col29,col30
... View more
Labels:
- Labels:
-
Apache Flume
12-17-2016
06:59 AM
i am getting following error Caused by: java.lang.ClassNotFoundException: org.apache.hive.hcatalog.streaming.RecordWriter thanks, Rishit Shah
... View more
12-17-2016
06:57 AM
@hkropp can you specify where exactl we need to set add_hive_paths(){
if [ -d "${HIVE_HOME}/lib" ]; then
info "Including Hive libraries found via ($HIVE_HOME) for Hive access"
FLUME_CLASSPATH="$FLUME_CLASSPATH:$HIVE_HOME/lib/*"
fi
if [ -d "${HCAT_HOME}/share/hcatalog" ]; then
info "Including HCatalog libraries found via ($HCAT_HOME) for Hive access"
FLUME_CLASSPATH="$FLUME_CLASSPATH:${HCAT_HOME}/share/hcatalog/*"
fi
} is it in flume-env.sh? i am now just able to see # Note that the Flume conf directory is always included in the classpath.
#FLUME_CLASSPATH="" # export HIVE_HOME=/usr/lib/hive
# export HCAT_HOME=/usr/lib/hive-hcatalog kindly help.
... View more
12-02-2016
10:53 AM
@simran kaur can you please let me know if your issue is resolved? i am facing the same issue in oozie workflow/ thanks, Rishit
... View more
