Container: container_1481156388370_0012_01_000005 on xxx.net_45454 ====================================================================================== LogType:directory.info Log Upload Time:Thu Dec 15 11:16:28 -0800 2016 LogLength:25899 Log Contents: ls -l: total 208 lrwxrwxrwx 1 root root 90 Dec 15 11:16 ant-contrib-1.0b3.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/161/ant-contrib-1.0b3.jar lrwxrwxrwx 1 root root 95 Dec 15 11:16 ant-eclipse-1.0-jvm1.2.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/186/ant-eclipse-1.0-jvm1.2.jar lrwxrwxrwx 1 root root 83 Dec 15 11:16 avro-1.8.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/164/avro-1.8.0.jar lrwxrwxrwx 1 root root 98 Dec 15 11:16 avro-mapred-1.8.0-hadoop2.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/194/avro-mapred-1.8.0-hadoop2.jar lrwxrwxrwx 1 root root 90 Dec 15 11:16 commons-codec-1.4.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/175/commons-codec-1.4.jar lrwxrwxrwx 1 root root 95 Dec 15 11:16 commons-compress-1.8.1.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/179/commons-compress-1.8.1.jar lrwxrwxrwx 1 root root 87 Dec 15 11:16 commons-io-1.4.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/189/commons-io-1.4.jar lrwxrwxrwx 1 root root 91 Dec 15 11:16 commons-jexl-2.1.1.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/193/commons-jexl-2.1.1.jar lrwxrwxrwx 1 root root 90 Dec 15 11:16 commons-lang3-3.4.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/187/commons-lang3-3.4.jar lrwxrwxrwx 1 root root 94 Dec 15 11:16 commons-logging-1.1.1.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/171/commons-logging-1.1.1.jar -rw-r--r-- 1 root root 227 Dec 15 11:16 container_tokens -rwx------ 1 root root 709 Dec 15 11:16 default_container_executor_session.sh -rwx------ 1 root root 763 Dec 15 11:16 default_container_executor.sh lrwxrwxrwx 1 root root 122 Dec 15 11:16 hortonworks-teradata-connector-1.5.1.2.5.0.0-1245.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/192/hortonworks-teradata-connector-1.5.1.2.5.0.0-1245.jar lrwxrwxrwx 1 root root 88 Dec 15 11:16 hsqldb-1.8.0.10.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/176/hsqldb-1.8.0.10.jar lrwxrwxrwx 1 root root 98 Dec 15 11:16 jackson-annotations-2.3.1.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/159/jackson-annotations-2.3.1.jar lrwxrwxrwx 1 root root 91 Dec 15 11:16 jackson-core-2.3.1.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/182/jackson-core-2.3.1.jar lrwxrwxrwx 1 root root 96 Dec 15 11:16 jackson-core-asl-1.9.13.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/170/jackson-core-asl-1.9.13.jar lrwxrwxrwx 1 root root 95 Dec 15 11:16 jackson-databind-2.3.1.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/185/jackson-databind-2.3.1.jar lrwxrwxrwx 1 root root 98 Dec 15 11:16 jackson-mapper-asl-1.9.13.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/178/jackson-mapper-asl-1.9.13.jar lrwxrwxrwx 1 root root 115 Dec 15 11:16 job.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012/filecache/10/job.jar lrwxrwxrwx 1 root root 115 Dec 15 11:16 job.xml -> /usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012/filecache/11/job.xml lrwxrwxrwx 1 root root 93 Dec 15 11:16 kite-data-core-1.1.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/165/kite-data-core-1.1.0.jar lrwxrwxrwx 1 root root 93 Dec 15 11:16 kite-data-hive-1.1.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/188/kite-data-hive-1.1.0.jar lrwxrwxrwx 1 root root 98 Dec 15 11:16 kite-data-mapreduce-1.1.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/181/kite-data-mapreduce-1.1.0.jar lrwxrwxrwx 1 root root 104 Dec 15 11:16 kite-hadoop-compatibility-1.1.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/160/kite-hadoop-compatibility-1.1.0.jar -rwx------ 1 root root 32487 Dec 15 11:16 launch_container.sh lrwxrwxrwx 1 root root 69 Dec 15 11:16 mr-framework -> /usr/local/middleware/hadoop/yarn/local/filecache/11/mapreduce.tar.gz lrwxrwxrwx 1 root root 84 Dec 15 11:16 opencsv-2.3.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/166/opencsv-2.3.jar lrwxrwxrwx 1 root root 86 Dec 15 11:16 paranamer-2.7.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/183/paranamer-2.7.jar lrwxrwxrwx 1 root root 91 Dec 15 11:16 parquet-avro-1.6.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/163/parquet-avro-1.6.0.jar lrwxrwxrwx 1 root root 93 Dec 15 11:16 parquet-column-1.6.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/184/parquet-column-1.6.0.jar lrwxrwxrwx 1 root root 93 Dec 15 11:16 parquet-common-1.6.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/191/parquet-common-1.6.0.jar lrwxrwxrwx 1 root root 95 Dec 15 11:16 parquet-encoding-1.6.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/180/parquet-encoding-1.6.0.jar lrwxrwxrwx 1 root root 97 Dec 15 11:16 parquet-format-2.2.0-rc1.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/190/parquet-format-2.2.0-rc1.jar lrwxrwxrwx 1 root root 96 Dec 15 11:16 parquet-generator-1.6.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/158/parquet-generator-1.6.0.jar lrwxrwxrwx 1 root root 93 Dec 15 11:16 parquet-hadoop-1.6.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/172/parquet-hadoop-1.6.0.jar lrwxrwxrwx 1 root root 94 Dec 15 11:16 parquet-jackson-1.6.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/168/parquet-jackson-1.6.0.jar lrwxrwxrwx 1 root root 88 Dec 15 11:16 slf4j-api-1.7.7.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/174/slf4j-api-1.7.7.jar lrwxrwxrwx 1 root root 92 Dec 15 11:16 snappy-java-1.1.1.6.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/173/snappy-java-1.1.1.6.jar lrwxrwxrwx 1 root root 84 Dec 15 11:16 tdgssconfig.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/162/tdgssconfig.jar lrwxrwxrwx 1 root root 105 Dec 15 11:16 teradata-connector-1.5.1-hadoop2.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/167/teradata-connector-1.5.1-hadoop2.jar lrwxrwxrwx 1 root root 82 Dec 15 11:16 terajdbc4.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/169/terajdbc4.jar drwx--x--- 2 root root 4096 Dec 15 11:16 tmp lrwxrwxrwx 1 root root 79 Dec 15 11:16 xz-1.5.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/177/xz-1.5.jar find -L . -maxdepth 5 -ls: 44435435 4 drwx--x--- 3 root root 4096 Dec 15 11:16 . 44435249 60 -r-x------ 1 root root 58131 Dec 15 11:16 ./commons-codec-1.4.jar 44435273 36 -r-x------ 1 root root 34047 Dec 15 11:16 ./paranamer-2.7.jar 44435311 4 drwx------ 3 root root 4096 Dec 15 11:16 ./job.jar 44435309 4980 -r-x------ 1 root root 5098776 Dec 15 11:16 ./job.jar/job.jar 44435312 4 drwx------ 2 root root 4096 Dec 15 11:16 ./job.jar/lib 44435314 184 -r-x------ 1 root root 185140 Sep 7 15:18 ./job.jar/lib/commons-io-2.4.jar 44435317 1972 -r-x------ 1 root root 2019274 Sep 7 15:18 ./job.jar/lib/ant-1.9.4.jar 44435315 20 -r-x------ 1 root root 19827 Sep 7 15:18 ./job.jar/lib/opencsv-2.3.jar 44435313 32 -r-x------ 1 root root 31605 Sep 7 15:18 ./job.jar/lib/commons-logging-1.0.3.jar 44435318 4 -r-x------ 1 root root 2615 Oct 3 11:51 ./job.jar/lib/tdgssconfig.jar 44435316 612 -r-x------ 1 root root 625986 Sep 7 15:18 ./job.jar/lib/joda-time-2.9.1.jar 44435319 1068 -r-x------ 1 root root 1093618 Oct 3 11:51 ./job.jar/lib/terajdbc4.jar 44435267 1704 -r-x------ 1 root root 1744166 Dec 15 11:16 ./kite-data-mapreduce-1.1.0.jar 44435261 360 -r-x------ 1 root root 365977 Dec 15 11:16 ./commons-compress-1.8.1.jar 44435291 108 -r-x------ 1 root root 108990 Dec 15 11:16 ./commons-io-1.4.jar 44435451 4 -rw-r--r-- 1 root root 264 Dec 15 11:16 ./.launch_container.sh.crc 44435279 884 -r-x------ 1 root root 902327 Dec 15 11:16 ./jackson-databind-2.3.1.jar 44435449 32 -rwx------ 1 root root 32487 Dec 15 11:16 ./launch_container.sh 44435198 24 -r-x------ 1 root root 20728 Dec 15 11:16 ./parquet-generator-1.6.0.jar 44435246 32 -r-x------ 1 root root 29241 Dec 15 11:16 ./slf4j-api-1.7.7.jar 44435294 364 -r-x------ 1 root root 371050 Dec 15 11:16 ./parquet-format-2.2.0-rc1.jar 44435458 4 -rw-r--r-- 1 root root 16 Dec 15 11:16 ./.default_container_executor_session.sh.crc 44435285 424 -r-x------ 1 root root 430341 Dec 15 11:16 ./commons-lang3-3.4.jar 44435222 20 -r-x------ 1 root root 19816 Dec 15 11:16 ./opencsv-2.3.jar 44435321 132 -r-x------ 1 root root 132355 Dec 15 11:16 ./job.xml 44435443 4 -rw-r--r-- 1 root root 227 Dec 15 11:16 ./container_tokens 44435306 180 -r-x------ 1 root root 183770 Dec 15 11:16 ./avro-mapred-1.8.0-hadoop2.jar 44435440 4 drwx--x--- 2 root root 4096 Dec 15 11:16 ./tmp 44435252 692 -r-x------ 1 root root 706015 Dec 15 11:16 ./hsqldb-1.8.0.10.jar 44435300 24 -r-x------ 1 root root 22675 Dec 15 11:16 ./hortonworks-teradata-connector-1.5.1.2.5.0.0-1245.jar 44435213 56 -r-x------ 1 root root 53418 Dec 15 11:16 ./parquet-avro-1.6.0.jar 44435445 4 -rw-r--r-- 1 root root 12 Dec 15 11:16 ./.container_tokens.crc 44435234 228 -r-x------ 1 root root 229445 Dec 15 11:16 ./jackson-core-asl-1.9.13.jar 44435228 996 -r-x------ 1 root root 1019348 Dec 15 11:16 ./parquet-jackson-1.6.0.jar 44433794 4 drwxr-xr-x 3 root root 4096 Dec 13 11:42 ./mr-framework 44433798 4 drwxr-xr-x 9 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop 44433841 4 drwxr-xr-x 2 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/include 44433846 4 -r-xr-xr-x 1 jenkins users 3319 Nov 29 10:21 ./mr-framework/hadoop/include/TemplateFactory.hh 44433842 8 -r-xr-xr-x 1 jenkins users 6330 Nov 29 10:21 ./mr-framework/hadoop/include/Pipes.hh 44433845 8 -r-xr-xr-x 1 jenkins users 4514 Nov 29 10:21 ./mr-framework/hadoop/include/SerialUtils.hh 44433844 36 -r-xr-xr-x 1 jenkins users 33361 Nov 29 10:21 ./mr-framework/hadoop/include/hdfs.h 44433843 4 -r-xr-xr-x 1 jenkins users 2441 Nov 29 10:21 ./mr-framework/hadoop/include/StringUtils.hh 44434867 4 drwxr-xr-x 2 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/bin 44434872 8 -r-xr-xr-x 1 jenkins users 6448 Nov 29 10:21 ./mr-framework/hadoop/bin/mapred 44434871 4 -r-xr-xr-x 1 jenkins users 888 Nov 29 10:21 ./mr-framework/hadoop/bin/kill-secondary-name-node 44434876 12 -r-xr-xr-x 1 jenkins users 8786 Nov 29 10:21 ./mr-framework/hadoop/bin/hadoop.cmd 44434877 4 -r-xr-xr-x 1 jenkins users 1857 Nov 29 10:21 ./mr-framework/hadoop/bin/rcc 44434878 12 -r-xr-xr-x 1 jenkins users 12069 Nov 29 10:21 ./mr-framework/hadoop/bin/yarn.cmd 44434869 4 -r-xr-xr-x 1 jenkins users 830 Nov 29 10:21 ./mr-framework/hadoop/bin/kill-name-node 44434870 12 -r-xr-xr-x 1 jenkins users 8782 Nov 29 10:21 ./mr-framework/hadoop/bin/hdfs.cmd 44434879 8 -r-xr-xr-x 1 jenkins users 7120 Nov 29 10:21 ./mr-framework/hadoop/bin/hadoop 44434880 16 -r-xr-xr-x 1 jenkins users 12707 Nov 29 10:21 ./mr-framework/hadoop/bin/hdfs 44434868 8 -r-xr-xr-x 1 jenkins users 7465 Nov 29 10:21 ./mr-framework/hadoop/bin/mapred.cmd 44434874 124 -r-xr-xr-x 1 jenkins users 125137 Nov 29 10:21 ./mr-framework/hadoop/bin/container-executor 44434873 140 -r-xr-xr-x 1 jenkins users 139697 Nov 29 10:21 ./mr-framework/hadoop/bin/test-container-executor 44434875 16 -r-xr-xr-x 1 jenkins users 14958 Nov 29 10:21 ./mr-framework/hadoop/bin/yarn 44433848 4 drwxr-xr-x 2 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/sbin 44433861 4 -r-xr-xr-x 1 jenkins users 2291 Nov 29 10:21 ./mr-framework/hadoop/sbin/httpfs.sh 44433875 4 -r-xr-xr-x 1 jenkins users 1441 Nov 29 10:21 ./mr-framework/hadoop/sbin/hadoop-daemons.sh 44433850 4 -r-xr-xr-x 1 jenkins users 1260 Nov 29 10:21 ./mr-framework/hadoop/sbin/stop-balancer.sh 44433876 4 -r-xr-xr-x 1 jenkins users 3287 Nov 29 10:21 ./mr-framework/hadoop/sbin/stop-dfs.sh 44433857 4 -r-xr-xr-x 1 jenkins users 1543 Nov 29 10:21 ./mr-framework/hadoop/sbin/stop-all.sh 44433870 4 -r-xr-xr-x 1 jenkins users 1401 Nov 29 10:21 ./mr-framework/hadoop/sbin/start-dfs.cmd 44433866 4 -r-xr-xr-x 1 jenkins users 1428 Nov 29 10:21 ./mr-framework/hadoop/sbin/start-yarn.sh 44433858 4 -r-xr-xr-x 1 jenkins users 1209 Nov 29 10:21 ./mr-framework/hadoop/sbin/start-balancer.sh 44433863 4 -r-xr-xr-x 1 jenkins users 1421 Nov 29 10:21 ./mr-framework/hadoop/sbin/stop-secure-dns.sh 44433869 4 -r-xr-xr-x 1 jenkins users 2752 Nov 29 10:21 ./mr-framework/hadoop/sbin/distribute-exclude.sh 44433862 8 -r-xr-xr-x 1 jenkins users 6546 Nov 29 10:21 ./mr-framework/hadoop/sbin/hadoop-daemon.sh 44433853 4 -r-xr-xr-x 1 jenkins users 1571 Nov 29 10:21 ./mr-framework/hadoop/sbin/start-yarn.cmd 44433855 4 -r-xr-xr-x 1 jenkins users 3815 Nov 29 10:21 ./mr-framework/hadoop/sbin/start-dfs.sh 44433864 4 -r-xr-xr-x 1 jenkins users 1642 Nov 29 10:21 ./mr-framework/hadoop/sbin/stop-yarn.cmd 44433860 4 -r-xr-xr-x 1 jenkins users 1552 Nov 29 10:21 ./mr-framework/hadoop/sbin/start-all.sh 44433867 4 -r-xr-xr-x 1 jenkins users 3630 Nov 29 10:21 ./mr-framework/hadoop/sbin/kms.sh 44433852 4 -r-xr-xr-x 1 jenkins users 1421 Nov 29 10:21 ./mr-framework/hadoop/sbin/stop-yarn.sh 44433871 4 -r-xr-xr-x 1 jenkins users 1779 Nov 29 10:21 ./mr-framework/hadoop/sbin/start-all.cmd 44433872 8 -r-xr-xr-x 1 jenkins users 4376 Nov 29 10:21 ./mr-framework/hadoop/sbin/yarn-daemon.sh 44433874 4 -r-xr-xr-x 1 jenkins users 1729 Nov 29 10:21 ./mr-framework/hadoop/sbin/refresh-namenodes.sh 44433868 4 -r-xr-xr-x 1 jenkins users 1508 Nov 29 10:21 ./mr-framework/hadoop/sbin/hdfs-config.sh 44433873 4 -r-xr-xr-x 1 jenkins users 2226 Nov 29 10:21 ./mr-framework/hadoop/sbin/slaves.sh 44433849 4 -r-xr-xr-x 1 jenkins users 1770 Nov 29 10:21 ./mr-framework/hadoop/sbin/stop-all.cmd 44433854 4 -r-xr-xr-x 1 jenkins users 1434 Nov 29 10:21 ./mr-framework/hadoop/sbin/yarn-daemons.sh 44433859 4 -r-xr-xr-x 1 jenkins users 1455 Nov 29 10:21 ./mr-framework/hadoop/sbin/stop-dfs.cmd 44433851 8 -r-xr-xr-x 1 jenkins users 4161 Nov 29 10:21 ./mr-framework/hadoop/sbin/mr-jobhistory-daemon.sh 44433856 4 -r-xr-xr-x 1 jenkins users 1640 Nov 29 10:21 ./mr-framework/hadoop/sbin/hdfs-config.cmd 44433865 4 -r-xr-xr-x 1 jenkins users 1438 Nov 29 10:21 ./mr-framework/hadoop/sbin/start-secure-dns.sh 44434881 84 -r-xr-xr-x 1 jenkins users 84854 Nov 29 10:21 ./mr-framework/hadoop/LICENSE.txt 44433847 16 -r-xr-xr-x 1 jenkins users 15753 Nov 29 10:21 ./mr-framework/hadoop/NOTICE.txt 44433830 4 drwxr-xr-x 2 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/libexec 44433838 4 -r-xr-xr-x 1 jenkins users 1777 Nov 29 10:21 ./mr-framework/hadoop/libexec/mapred-config.cmd 44433839 12 -r-xr-xr-x 1 jenkins users 8270 Nov 29 10:21 ./mr-framework/hadoop/libexec/hadoop-config.cmd 44433840 8 -r-xr-xr-x 1 jenkins users 5749 Nov 29 10:21 ./mr-framework/hadoop/libexec/httpfs-config.sh 44433834 4 -r-xr-xr-x 1 jenkins users 2131 Nov 29 10:21 ./mr-framework/hadoop/libexec/yarn-config.cmd 44433836 4 -r-xr-xr-x 1 jenkins users 2215 Nov 29 10:21 ./mr-framework/hadoop/libexec/yarn-config.sh 44433832 4 -r-xr-xr-x 1 jenkins users 2304 Nov 29 10:21 ./mr-framework/hadoop/libexec/mapred-config.sh 44433837 4 -r-xr-xr-x 1 jenkins users 1508 Nov 29 10:21 ./mr-framework/hadoop/libexec/hdfs-config.sh 44433831 12 -r-xr-xr-x 1 jenkins users 11678 Nov 29 10:21 ./mr-framework/hadoop/libexec/hadoop-config.sh 44433833 4 -r-xr-xr-x 1 jenkins users 1640 Nov 29 10:21 ./mr-framework/hadoop/libexec/hdfs-config.cmd 44433835 8 -r-xr-xr-x 1 jenkins users 5431 Nov 29 10:21 ./mr-framework/hadoop/libexec/kms-config.sh 44433799 4 drwxr-xr-x 3 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/etc 44433800 4 drwxr-xr-x 2 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop 44433821 8 -r-xr-xr-x 1 jenkins users 4436 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/capacity-scheduler.xml 44433829 4 -r-xr-xr-x 1 jenkins users 1527 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/kms-env.sh 44433806 12 -r-xr-xr-x 1 jenkins users 9683 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/hadoop-policy.xml 44433820 4 -r-xr-xr-x 1 jenkins users 758 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/mapred-site.xml.template 44433824 4 -r-xr-xr-x 1 jenkins users 2316 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/ssl-client.xml.example 44433802 8 -r-xr-xr-x 1 jenkins users 4529 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/hadoop-env.sh 44433811 4 -r-xr-xr-x 1 jenkins users 3979 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/hadoop-env.cmd 44433812 4 -r-xr-xr-x 1 jenkins users 3518 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/kms-acls.xml 44433828 4 -r-xr-xr-x 1 jenkins users 2697 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/ssl-server.xml.example 44433823 4 -r-xr-xr-x 1 jenkins users 21 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/httpfs-signature.secret 44433826 4 -r-xr-xr-x 1 jenkins users 318 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/container-executor.cfg 44433813 4 -r-xr-xr-x 1 jenkins users 690 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/yarn-site.xml 44433801 4 -r-xr-xr-x 1 jenkins users 1631 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/kms-log4j.properties 44433810 16 -r-xr-xr-x 1 jenkins users 12302 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/log4j.properties 44433807 4 -r-xr-xr-x 1 jenkins users 775 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/hdfs-site.xml 44433817 4 -r-xr-xr-x 1 jenkins users 10 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/slaves 44433825 8 -r-xr-xr-x 1 jenkins users 4113 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/mapred-queues.xml.template 44433818 4 -r-xr-xr-x 1 jenkins users 620 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/httpfs-site.xml 44433822 4 -r-xr-xr-x 1 jenkins users 1657 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/httpfs-log4j.properties 44433809 4 -r-xr-xr-x 1 jenkins users 2598 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/hadoop-metrics2.properties 44433805 8 -r-xr-xr-x 1 jenkins users 4567 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/yarn-env.sh 44433808 4 -r-xr-xr-x 1 jenkins users 2490 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/hadoop-metrics.properties 44433804 4 -r-xr-xr-x 1 jenkins users 774 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/core-site.xml 44433827 4 -r-xr-xr-x 1 jenkins users 1335 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/configuration.xsl 44433815 4 -r-xr-xr-x 1 jenkins users 1383 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/mapred-env.sh 44433819 8 -r-xr-xr-x 1 jenkins users 5511 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/kms-site.xml 44433803 4 -r-xr-xr-x 1 jenkins users 1449 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/httpfs-env.sh 44433814 4 -r-xr-xr-x 1 jenkins users 2250 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/yarn-env.cmd 44433816 4 -r-xr-xr-x 1 jenkins users 951 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/mapred-env.cmd 44434854 4 drwxr-xr-x 3 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/lib 44434855 4 drwxr-xr-x 2 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/lib/native 44434862 1288 -r-xr-xr-x 1 jenkins users 1316074 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libhadoop.a 44434858 228 -r-xr-xr-x 1 jenkins users 229697 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libhdfs.so.0.0.0 44434861 572 -r-xr-xr-x 1 jenkins users 582360 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libhadooputils.a 44434866 1456 -r-xr-xr-x 1 jenkins users 1487204 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libhadooppipes.a 44434865 756 -r-xr-xr-x 1 jenkins users 773287 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libhadoop.so.1.0.0 44434864 360 -r-xr-xr-x 1 jenkins users 365604 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libhdfs.a 44434865 756 -r-xr-xr-x 1 jenkins users 773287 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libhadoop.so 44434863 20 -r-xr-xr-x 1 jenkins users 19848 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libsnappy.so.1 44434863 20 -r-xr-xr-x 1 jenkins users 19848 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libsnappy.so 44434858 228 -r-xr-xr-x 1 jenkins users 229697 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libhdfs.so 44434863 20 -r-xr-xr-x 1 jenkins users 19848 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libsnappy.so.1.1.4 44434882 4 -r-xr-xr-x 1 jenkins users 1366 Nov 29 10:21 ./mr-framework/hadoop/README.txt 44433877 4 drwxr-xr-x 4 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share 44433878 4 drwxr-xr-x 3 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/doc 44433879 4 drwxr-xr-x 6 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/doc/hadoop 44433891 4 drwxr-xr-x 9 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/hadoop 44434625 4 drwxr-xr-x 3 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/hadoop/kms 44434353 4 drwxr-xr-x 5 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/hadoop/mapreduce 44433892 4 drwxr-xr-x 5 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/hadoop/tools 44434761 4 drwxr-xr-x 7 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/hadoop/hdfs 44434522 4 drwxr-xr-x 6 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/hadoop/common 44434060 4 drwxr-xr-x 3 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/hadoop/httpfs 44434406 4 drwxr-xr-x 5 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/hadoop/yarn 44435460 4 -rwx------ 1 root root 763 Dec 15 11:16 ./default_container_executor.sh 44435207 220 -r-x------ 1 root root 224135 Dec 15 11:16 ./ant-contrib-1.0b3.jar 44435204 1704 -r-x------ 1 root root 1741888 Dec 15 11:16 ./kite-hadoop-compatibility-1.1.0.jar 44435288 1736 -r-x------ 1 root root 1777229 Dec 15 11:16 ./kite-data-hive-1.1.0.jar 44435303 264 -r-x------ 1 root root 266289 Dec 15 11:16 ./commons-jexl-2.1.1.jar 44435210 4 -r-x------ 1 root root 2615 Dec 15 11:16 ./tdgssconfig.jar 44435461 4 -rw-r--r-- 1 root root 16 Dec 15 11:16 ./.default_container_executor.sh.crc 44435455 4 -rwx------ 1 root root 709 Dec 15 11:16 ./default_container_executor_session.sh 44435216 1292 -r-x------ 1 root root 1322324 Dec 15 11:16 ./avro-1.8.0.jar 44435243 576 -r-x------ 1 root root 587380 Dec 15 11:16 ./snappy-java-1.1.1.6.jar 44435276 860 -r-x------ 1 root root 879155 Dec 15 11:16 ./parquet-column-1.6.0.jar 44435258 752 -r-x------ 1 root root 770013 Dec 15 11:16 ./jackson-mapper-asl-1.9.13.jar 44435201 36 -r-x------ 1 root root 35507 Dec 15 11:16 ./jackson-annotations-2.3.1.jar 44435231 1068 -r-x------ 1 root root 1093618 Dec 15 11:16 ./terajdbc4.jar 44435240 204 -r-x------ 1 root root 205028 Dec 15 11:16 ./parquet-hadoop-1.6.0.jar 44435219 2100 -r-x------ 1 root root 2149987 Dec 15 11:16 ./kite-data-core-1.1.0.jar 44435282 36 -r-x------ 1 root root 36427 Dec 15 11:16 ./ant-eclipse-1.0-jvm1.2.jar 44435237 60 -r-x------ 1 root root 60530 Dec 15 11:16 ./commons-logging-1.1.1.jar 44435270 192 -r-x------ 1 root root 195678 Dec 15 11:16 ./jackson-core-2.3.1.jar 44435255 100 -r-x------ 1 root root 99504 Dec 15 11:16 ./xz-1.5.jar 44435264 276 -r-x------ 1 root root 278936 Dec 15 11:16 ./parquet-encoding-1.6.0.jar 44435297 24 -r-x------ 1 root root 20992 Dec 15 11:16 ./parquet-common-1.6.0.jar 44435225 4980 -r-x------ 1 root root 5098776 Dec 15 11:16 ./teradata-connector-1.5.1-hadoop2.jar broken symlinks(find -L . -maxdepth 5 -type l -ls): End of LogType:directory.info LogType:launch_container.sh Log Upload Time:Thu Dec 15 11:16:28 -0800 2016 LogLength:32487 Log Contents: #!/bin/bash export HADOOP_CONF_DIR=${HADOOP_CONF_DIR:-"/appdata/hdp/2.5.3.0-37/hadoop/conf"} export STDOUT_LOGFILE_ENV="/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000005/stdout" export HADOOP_ROOT_LOGGER="INFO,console" export JAVA_HOME=${JAVA_HOME:-"/usr/java/current/"} export NM_HOST="xxx.net" export HADOOP_CLASSPATH="$PWD:job.jar/job.jar:job.jar/classes/:job.jar/lib/*:$PWD/*:/usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012/container_1481156388370_0012_01_000001:job.jar/job.jar:job.jar/classes/:job.jar/lib/*:/usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012/container_1481156388370_0012_01_000001/*:::/usr/hdp/2.5.3.0-37/sqoop/conf:/usr/hdp/current/zookeeper-server/conf::/usr/hdp/2.5.3.0-37/sqoop/lib/ant-contrib-1.0b3.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/ant-eclipse-1.0-jvm1.2.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/avro-1.8.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/avro-mapred-1.8.0-hadoop2.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/commons-codec-1.4.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/commons-compress-1.8.1.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/commons-io-1.4.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/commons-jexl-2.1.1.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/commons-lang3-3.4.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/commons-logging-1.1.1.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/hortonworks-teradata-connector-1.5.1.2.5.0.0-1245.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/hsqldb-1.8.0.10.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/jackson-annotations-2.3.1.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/jackson-core-2.3.1.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/jackson-databind-2.3.1.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/kite-data-core-1.1.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/kite-data-hive-1.1.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/kite-data-mapreduce-1.1.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/kite-hadoop-compatibility-1.1.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/opencsv-2.3.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/paranamer-2.7.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/parquet-avro-1.6.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/parquet-column-1.6.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/parquet-common-1.6.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/parquet-encoding-1.6.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/parquet-format-2.2.0-rc1.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/parquet-generator-1.6.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/parquet-hadoop-1.6.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/parquet-jackson-1.6.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/slf4j-api-1.7.7.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/snappy-java-1.1.1.6.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/tdgssconfig.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/teradata-connector-1.5.1-hadoop2.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/terajdbc4.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/xz-1.5.jar:/usr/hdp/current/hbase-master/conf:/usr/java/default/lib/tools.jar:/usr/hdp/current/hbase-master:/usr/hdp/current/hbase-master/lib/activation-1.1.jar:/usr/hdp/current/hbase-master/lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-master/lib/apacheds-i18n-2.0.0-M15.jar:/usr/hdp/current/hbase-master/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/usr/hdp/current/hbase-master/lib/api-asn1-api-1.0.0-M20.jar:/usr/hdp/current/hbase-master/lib/api-util-1.0.0-M20.jar:/usr/hdp/current/hbase-master/lib/asm-3.1.jar:/usr/hdp/current/hbase-master/lib/avro-1.7.4.jar:/usr/hdp/current/hbase-master/lib/azure-keyvault-core-0.8.0.jar:/usr/hdp/current/hbase-master/lib/azure-storage-4.2.0.jar:/usr/hdp/current/hbase-master/lib/commons-beanutils-1.7.0.jar:/usr/hdp/current/hbase-master/lib/commons-beanutils-core-1.8.0.jar:/usr/hdp/current/hbase-master/lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-master/lib/commons-codec-1.9.jar:/usr/hdp/current/hbase-master/lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-master/lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-master/lib/commons-configuration-1.6.jar:/usr/hdp/current/hbase-master/lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-master/lib/commons-digester-1.8.jar:/usr/hdp/current/hbase-master/lib/commons-el-1.0.jar:/usr/hdp/current/hbase-master/lib/commons-io-2.4.jar:/usr/hdp/current/hbase-master/lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-master/lib/commons-lang3-3.4.jar:/usr/hdp/current/hbase-master/lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-master/lib/commons-math-2.2.jar:/usr/hdp/current/hbase-master/lib/commons-math3-3.1.1.jar:/usr/hdp/current/hbase-master/lib/commons-net-3.1.jar:/usr/hdp/current/hbase-master/lib/curator-client-2.7.1.jar:/usr/hdp/current/hbase-master/lib/curator-framework-2.7.1.jar:/usr/hdp/current/hbase-master/lib/curator-recipes-2.7.1.jar:/usr/hdp/current/hbase-master/lib/disruptor-3.3.0.jar:/usr/hdp/current/hbase-master/lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-master/lib/gson-2.2.4.jar:/usr/hdp/current/hbase-master/lib/guava-12.0.1.jar:/usr/hdp/current/hbase-master/lib/guice-3.0.jar:/usr/hdp/current/hbase-master/lib/guice-servlet-3.0.jar:/usr/hdp/current/hbase-master/lib/hbase-annotations-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-annotations-1.1.2.2.5.3.0-37-tests.jar:/usr/hdp/current/hbase-master/lib/hbase-annotations.jar:/usr/hdp/current/hbase-master/lib/hbase-client-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-client.jar:/usr/hdp/current/hbase-master/lib/hbase-common-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-common-1.1.2.2.5.3.0-37-tests.jar:/usr/hdp/current/hbase-master/lib/hbase-common.jar:/usr/hdp/current/hbase-master/lib/hbase-examples-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-examples.jar:/usr/hdp/current/hbase-master/lib/hbase-hadoop2-compat-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-master/lib/hbase-hadoop-compat-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-master/lib/hbase-it-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-it-1.1.2.2.5.3.0-37-tests.jar:/usr/hdp/current/hbase-master/lib/hbase-it.jar:/usr/hdp/current/hbase-master/lib/hbase-prefix-tree-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-prefix-tree.jar:/usr/hdp/current/hbase-master/lib/hbase-procedure-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-procedure.jar:/usr/hdp/current/hbase-master/lib/hbase-protocol-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-protocol.jar:/usr/hdp/current/hbase-master/lib/hbase-resource-bundle-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-master/lib/hbase-rest-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-rest.jar:/usr/hdp/current/hbase-master/lib/hbase-rsgroup-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-rsgroup-1.1.2.2.5.3.0-37-tests.jar:/usr/hdp/current/hbase-master/lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-master/lib/hbase-server-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-server-1.1.2.2.5.3.0-37-tests.jar:/usr/hdp/current/hbase-master/lib/hbase-server.jar:/usr/hdp/current/hbase-master/lib/hbase-shell-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-shell.jar:/usr/hdp/current/hbase-master/lib/hbase-thrift-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-thrift.jar:/usr/hdp/current/hbase-master/lib/htrace-core-3.1.0-incubating.jar:/usr/hdp/current/hbase-master/lib/jackson-core-2.6.0.jar:/usr/hdp/current/hbase-master/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-master/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/current/hbase-master/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-master/lib/jackson-xc-1.9.13.jar:/usr/hdp/current/hbase-master/lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-master/lib/jasper-compiler-5.5.23.jar:/usr/hdp/current/hbase-master/lib/jasper-runtime-5.5.23.jar:/usr/hdp/current/hbase-master/lib/javax.inject-1.jar:/usr/hdp/current/hbase-master/lib/java-xmlbuilder-0.4.jar:/usr/hdp/current/hbase-master/lib/jaxb-api-2.2.2.jar:/usr/hdp/current/hbase-master/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-master/lib/jcip-annotations-1.0.jar:/usr/hdp/current/hbase-master/lib/jcodings-1.0.8.jar:/usr/hdp/current/hbase-master/lib/jersey-client-1.9.jar:/usr/hdp/current/hbase-master/lib/jersey-core-1.9.jar:/usr/hdp/current/hbase-master/lib/jersey-guice-1.9.jar:/usr/hdp/current/hbase-master/lib/jersey-json-1.9.jar:/usr/hdp/current/hbase-master/lib/jersey-server-1.9.jar:/usr/hdp/current/hbase-master/lib/jets3t-0.9.0.jar:/usr/hdp/current/hbase-master/lib/jettison-1.3.3.jar:/usr/hdp/current/hbase-master/lib/jetty-6.1.26.hwx.jar:/usr/hdp/current/hbase-master/lib/jetty-sslengine-6.1.26.hwx.jar:/usr/hdp/current/hbase-master/lib/jetty-util-6.1.26.hwx.jar:/usr/hdp/current/hbase-master/lib/joni-2.1.2.jar:/usr/hdp/current/hbase-master/lib/jruby-complete-1.6.8.jar:/usr/hdp/current/hbase-master/lib/jsch-0.1.42.jar:/usr/hdp/current/hbase-master/lib/json-smart-1.1.1.jar:/usr/hdp/current/hbase-master/lib/jsp-2.1-6.1.14.jar:/usr/hdp/current/hbase-master/lib/jsp-api-2.1-6.1.14.jar:/usr/hdp/current/hbase-master/lib/jsr305-1.3.9.jar:/usr/hdp/current/hbase-master/lib/junit-4.12.jar:/usr/hdp/current/hbase-master/lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-master/lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-master/lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-master/lib/metrics-core-2.2.0.jar:/usr/hdp/current/hbase-master/lib/netty-3.2.4.Final.jar:/usr/hdp/current/hbase-master/lib/netty-all-4.0.23.Final.jar:/usr/hdp/current/hbase-master/lib/nimbus-jose-jwt-3.9.jar:/usr/hdp/current/hbase-master/lib/ojdbc6.jar:/usr/hdp/current/hbase-master/lib/okhttp-2.4.0.jar:/usr/hdp/current/hbase-master/lib/okio-1.4.0.jar:/usr/hdp/current/hbase-master/lib/paranamer-2.3.jar:/usr/hdp/current/hbase-master/lib/phoenix-server.jar:/usr/hdp/current/hbase-master/lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-master/lib/ranger-hbase-plugin-shim-0.6.0.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/ranger-plugin-classloader-0.6.0.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/servlet-api-2.5-6.1.14.jar:/usr/hdp/current/hbase-master/lib/servlet-api-2.5.jar:/usr/hdp/current/hbase-master/lib/slf4j-api-1.7.7.jar:/usr/hdp/current/hbase-master/lib/snappy-java-1.0.4.1.jar:/usr/hdp/current/hbase-master/lib/spymemcached-2.11.6.jar:/usr/hdp/current/hbase-master/lib/xercesImpl-2.9.1.jar:/usr/hdp/current/hbase-master/lib/xml-apis-1.3.04.jar:/usr/hdp/current/hbase-master/lib/xmlenc-0.52.jar:/usr/hdp/current/hbase-master/lib/xz-1.0.jar:/usr/hdp/current/hbase-master/lib/zookeeper.jar:/appdata/hdp/2.5.3.0-37/hadoop/conf:/usr/hdp/2.5.3.0-37/hadoop/lib/*:/usr/hdp/2.5.3.0-37/hadoop/.//*:/usr/hdp/2.5.3.0-37/hadoop-hdfs/./:/usr/hdp/2.5.3.0-37/hadoop-hdfs/lib/*:/usr/hdp/2.5.3.0-37/hadoop-hdfs/.//*:/usr/hdp/2.5.3.0-37/hadoop-yarn/lib/*:/usr/hdp/2.5.3.0-37/hadoop-yarn/.//*:/usr/hdp/2.5.3.0-37/hadoop-mapreduce/lib/*:/usr/hdp/2.5.3.0-37/hadoop-mapreduce/.//*::/usr/share/java/mysql-connector-java.jar:/usr/lib/hadoop-mapreduce/*:/usr/hdp/2.5.3.0-37/tez/*:/usr/hdp/2.5.3.0-37/tez/lib/*:/usr/hdp/2.5.3.0-37/tez/conf:/usr/hdp/2.5.3.0-37/hadoop/conf:/usr/hdp/2.5.3.0-37/hadoop/*:/usr/hdp/2.5.3.0-37/hadoop/lib/*:/usr/hdp/current/zookeeper-server/*:://hadoop/conf:/usr/hdp/2.5.3.0-37/atlas/hook/hive/*:/usr/hdp/2.5.3.0-37/hive/lib/accumulo-core-1.7.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/accumulo-fate-1.7.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/accumulo-start-1.7.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/accumulo-trace-1.7.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/activation-1.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/ant-1.9.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/ant-launcher-1.9.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/antlr-2.7.7.jar:/usr/hdp/2.5.3.0-37/hive/lib/antlr-runtime-3.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/apache-log4j-extras-1.2.17.jar:/usr/hdp/2.5.3.0-37/hive/lib/asm-commons-3.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/asm-tree-3.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/avatica-1.8.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/avatica-metrics-1.8.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/avro-1.7.5.jar:/usr/hdp/2.5.3.0-37/hive/lib/bonecp-0.8.0.RELEASE.jar:/usr/hdp/2.5.3.0-37/hive/lib/calcite-core-1.2.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/calcite-linq4j-1.2.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-cli-1.2.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-codec-1.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-collections-3.2.2.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-compiler-2.7.6.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-compress-1.4.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-dbcp-1.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-httpclient-3.0.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-io-2.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-lang-2.6.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-logging-1.1.3.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-math-2.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-pool-1.5.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-vfs2-2.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/curator-client-2.6.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/curator-framework-2.6.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/curator-recipes-2.6.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/datanucleus-api-jdo-4.2.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/datanucleus-core-4.1.6.jar:/usr/hdp/2.5.3.0-37/hive/lib/datanucleus-rdbms-4.1.7.jar:/usr/hdp/2.5.3.0-37/hive/lib/derby-10.10.2.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/dropwizard-metrics-hadoop-metrics2-reporter-0.1.2.jar:/usr/hdp/2.5.3.0-37/hive/lib/eigenbase-properties-1.1.5.jar:/usr/hdp/2.5.3.0-37/hive/lib/geronimo-annotation_1.0_spec-1.1.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/geronimo-jaspic_1.0_spec-1.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/geronimo-jta_1.1_spec-1.1.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/groovy-all-2.4.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/guava-14.0.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/HikariCP-1.3.9.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-accumulo-handler-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-accumulo-handler.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-ant-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-ant.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-beeline-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-beeline.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-cli-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-cli.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-common-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-common.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-contrib-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-contrib.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-exec-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-exec.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-hbase-handler-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-hbase-handler.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-hwi-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-hwi.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-jdbc-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-jdbc-1.2.1000.2.5.3.0-37-standalone.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-jdbc.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-metastore-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-metastore.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-serde-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-serde.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-service-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-service.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-shims-0.20S-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-shims-0.23-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-shims-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-shims-common-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-shims-common.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-shims.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-shims-scheduler-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-shims-scheduler.jar:/usr/hdp/2.5.3.0-37/hive/lib/htrace-core-3.1.0-incubating.jar:/usr/hdp/2.5.3.0-37/hive/lib/httpclient-4.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/httpcore-4.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/ivy-2.4.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/jackson-annotations-2.4.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/jackson-core-2.4.2.jar:/usr/hdp/2.5.3.0-37/hive/lib/jackson-databind-2.4.2.jar:/usr/hdp/2.5.3.0-37/hive/lib/janino-2.7.6.jar:/usr/hdp/2.5.3.0-37/hive/lib/javassist-3.18.1-GA.jar:/usr/hdp/2.5.3.0-37/hive/lib/javax.jdo-3.2.0-m3.jar:/usr/hdp/2.5.3.0-37/hive/lib/jcommander-1.32.jar:/usr/hdp/2.5.3.0-37/hive/lib/jdo-api-3.0.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/jetty-all-7.6.0.v20120127.jar:/usr/hdp/2.5.3.0-37/hive/lib/jetty-all-server-7.6.0.v20120127.jar:/usr/hdp/2.5.3.0-37/hive/lib/jline-2.12.jar:/usr/hdp/2.5.3.0-37/hive/lib/joda-time-2.8.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/jpam-1.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/json-20090211.jar:/usr/hdp/2.5.3.0-37/hive/lib/jsr305-3.0.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/jta-1.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/libfb303-0.9.3.jar:/usr/hdp/2.5.3.0-37/hive/lib/libthrift-0.9.3.jar:/usr/hdp/2.5.3.0-37/hive/lib/log4j-1.2.16.jar:/usr/hdp/2.5.3.0-37/hive/lib/mail-1.4.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/maven-scm-api-1.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/maven-scm-provider-svn-commons-1.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/maven-scm-provider-svnexe-1.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/metrics-core-3.1.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/metrics-json-3.1.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/metrics-jvm-3.1.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/mysql-connector-java.jar:/usr/hdp/2.5.3.0-37/hive/lib/netty-3.7.0.Final.jar:/usr/hdp/2.5.3.0-37/hive/lib/ojdbc6.jar:/usr/hdp/2.5.3.0-37/hive/lib/opencsv-2.3.jar:/usr/hdp/2.5.3.0-37/hive/lib/oro-2.0.8.jar:/usr/hdp/2.5.3.0-37/hive/lib/paranamer-2.3.jar:/usr/hdp/2.5.3.0-37/hive/lib/parquet-hadoop-bundle-1.8.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/pentaho-aggdesigner-algorithm-5.1.5-jhyde.jar:/usr/hdp/2.5.3.0-37/hive/lib/plexus-utils-1.5.6.jar:/usr/hdp/2.5.3.0-37/hive/lib/protobuf-java-2.5.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/ranger-hive-plugin-shim-0.6.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/ranger-plugin-classloader-0.6.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/regexp-1.3.jar:/usr/hdp/2.5.3.0-37/hive/lib/servlet-api-2.5.jar:/usr/hdp/2.5.3.0-37/hive/lib/snappy-java-1.0.5.jar:/usr/hdp/2.5.3.0-37/hive/lib/ST4-4.0.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/stax-api-1.0.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/stringtemplate-3.2.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/super-csv-2.2.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/transaction-api-1.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/velocity-1.5.jar:/usr/hdp/2.5.3.0-37/hive/lib/xz-1.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/zookeeper-3.4.6.2.5.3.0-37.jar::/appdata/hdp/2.5.3.0-37/hive-hcatalog/libexec/../share/hcatalog/hive-hcatalog-core-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/conf::/usr/hdp/current/hbase-master/conf:/usr/hdp/2.5.3.0-37/sqoop/sqoop-1.4.6.2.5.3.0-37.jar::/usr/share/java/mysql-connector-java.jar:/usr/lib/hadoop-mapreduce/*:/usr/hdp/2.5.3.0-37/tez/*:/usr/hdp/2.5.3.0-37/tez/lib/*:/usr/hdp/2.5.3.0-37/tez/conf" export LD_LIBRARY_PATH="$PWD:/usr/hdp/2.5.3.0-37/hadoop/lib/native:/usr/hdp/2.5.3.0-37/hadoop/lib/native/Linux-amd64-64" export STDERR_LOGFILE_ENV="/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000005/stderr" export LOGNAME="root" export JVM_PID="$$" export PWD="/usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012/container_1481156388370_0012_01_000005" export HADOOP_CLIENT_OPTS="-Xmx128m -Xmx128m " export LOCAL_DIRS="/usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012" export SHELL="/bin/bash" export NM_HTTP_PORT="8042" export LOG_DIRS="/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000005" export NM_AUX_SERVICE_mapreduce_shuffle="AAAfkQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA= " export NM_PORT="45454" export USER="root" export HADOOP_YARN_HOME=${HADOOP_YARN_HOME:-"/usr/hdp/2.5.3.0-37/hadoop-yarn"} export CLASSPATH="$PWD:$PWD/mr-framework/hadoop/share/hadoop/mapreduce/*:$PWD/mr-framework/hadoop/share/hadoop/mapreduce/lib/*:$PWD/mr-framework/hadoop/share/hadoop/common/*:$PWD/mr-framework/hadoop/share/hadoop/common/lib/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/lib/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/lib/*:/usr/hdp/2.5.3.0-37/hadoop/lib/hadoop-lzo-0.6.0.2.5.3.0-37.jar:/etc/hadoop/conf/secure:job.jar/job.jar:job.jar/classes/:job.jar/lib/*:$PWD/*" export HADOOP_TOKEN_FILE_LOCATION="/usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012/container_1481156388370_0012_01_000005/container_tokens" export LOCAL_USER_DIRS="/usr/local/middleware/hadoop/yarn/local/usercache/root/" export HOME="/home/" export CONTAINER_ID="container_1481156388370_0012_01_000005" export MALLOC_ARENA_MAX="4" ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/188/kite-data-hive-1.1.0.jar" "kite-data-hive-1.1.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/187/commons-lang3-3.4.jar" "commons-lang3-3.4.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/174/slf4j-api-1.7.7.jar" "slf4j-api-1.7.7.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/166/opencsv-2.3.jar" "opencsv-2.3.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/172/parquet-hadoop-1.6.0.jar" "parquet-hadoop-1.6.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/176/hsqldb-1.8.0.10.jar" "hsqldb-1.8.0.10.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/189/commons-io-1.4.jar" "commons-io-1.4.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/192/hortonworks-teradata-connector-1.5.1.2.5.0.0-1245.jar" "hortonworks-teradata-connector-1.5.1.2.5.0.0-1245.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/180/parquet-encoding-1.6.0.jar" "parquet-encoding-1.6.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/182/jackson-core-2.3.1.jar" "jackson-core-2.3.1.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/191/parquet-common-1.6.0.jar" "parquet-common-1.6.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/163/parquet-avro-1.6.0.jar" "parquet-avro-1.6.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012/filecache/10/job.jar" "job.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/161/ant-contrib-1.0b3.jar" "ant-contrib-1.0b3.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/178/jackson-mapper-asl-1.9.13.jar" "jackson-mapper-asl-1.9.13.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/183/paranamer-2.7.jar" "paranamer-2.7.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/167/teradata-connector-1.5.1-hadoop2.jar" "teradata-connector-1.5.1-hadoop2.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/194/avro-mapred-1.8.0-hadoop2.jar" "avro-mapred-1.8.0-hadoop2.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/185/jackson-databind-2.3.1.jar" "jackson-databind-2.3.1.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/193/commons-jexl-2.1.1.jar" "commons-jexl-2.1.1.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/168/parquet-jackson-1.6.0.jar" "parquet-jackson-1.6.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/181/kite-data-mapreduce-1.1.0.jar" "kite-data-mapreduce-1.1.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012/filecache/11/job.xml" "job.xml" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/162/tdgssconfig.jar" "tdgssconfig.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/filecache/11/mapreduce.tar.gz" "mr-framework" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/164/avro-1.8.0.jar" "avro-1.8.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/171/commons-logging-1.1.1.jar" "commons-logging-1.1.1.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/175/commons-codec-1.4.jar" "commons-codec-1.4.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/186/ant-eclipse-1.0-jvm1.2.jar" "ant-eclipse-1.0-jvm1.2.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/160/kite-hadoop-compatibility-1.1.0.jar" "kite-hadoop-compatibility-1.1.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/158/parquet-generator-1.6.0.jar" "parquet-generator-1.6.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/169/terajdbc4.jar" "terajdbc4.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/173/snappy-java-1.1.1.6.jar" "snappy-java-1.1.1.6.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/190/parquet-format-2.2.0-rc1.jar" "parquet-format-2.2.0-rc1.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/177/xz-1.5.jar" "xz-1.5.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/165/kite-data-core-1.1.0.jar" "kite-data-core-1.1.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/179/commons-compress-1.8.1.jar" "commons-compress-1.8.1.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/159/jackson-annotations-2.3.1.jar" "jackson-annotations-2.3.1.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/184/parquet-column-1.6.0.jar" "parquet-column-1.6.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/170/jackson-core-asl-1.9.13.jar" "jackson-core-asl-1.9.13.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi # Creating copy of launch script cp "launch_container.sh" "/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000005/launch_container.sh" chmod 640 "/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000005/launch_container.sh" # Determining directory contents echo "ls -l:" 1>"/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000005/directory.info" ls -l 1>>"/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000005/directory.info" echo "find -L . -maxdepth 5 -ls:" 1>>"/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000005/directory.info" find -L . -maxdepth 5 -ls 1>>"/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000005/directory.info" echo "broken symlinks(find -L . -maxdepth 5 -type l -ls):" 1>>"/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000005/directory.info" find -L . -maxdepth 5 -type l -ls 1>>"/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000005/directory.info" exec /bin/bash -c "$JAVA_HOME/bin/java -server -XX:NewRatio=8 -Djava.library.path=/usr/hdp/current/hadoop/lib/native/ -Djava.net.preferIPv4Stack=true -Dhdp.version=2.5.3.0-37 -Xmx512m -Djava.io.tmpdir=$PWD/tmp -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000005 -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Dhadoop.root.logfile=syslog org.apache.hadoop.mapred.YarnChild 10.236.211.27 36415 attempt_1481156388370_0012_m_000003_0 5 1>/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000005/stdout 2>/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000005/stderr " hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi End of LogType:launch_container.sh LogType:stderr Log Upload Time:Thu Dec 15 11:16:28 -0800 2016 LogLength:243 Log Contents: log4j:WARN No appenders could be found for logger (org.apache.hadoop.metrics2.impl.MetricsSystemImpl). log4j:WARN Please initialize the log4j system properly. log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info. End of LogType:stderr LogType:stdout Log Upload Time:Thu Dec 15 11:16:28 -0800 2016 LogLength:0 Log Contents: End of LogType:stdout LogType:syslog Log Upload Time:Thu Dec 15 11:16:28 -0800 2016 LogLength:5500 Log Contents: 2016-12-15 11:16:14,421 WARN [main] org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2016-12-15 11:16:14,472 WARN [main] org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate configuration: tried hadoop-metrics2-maptask.properties,hadoop-metrics2.properties 2016-12-15 11:16:14,523 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s). 2016-12-15 11:16:14,524 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MapTask metrics system started 2016-12-15 11:16:14,530 INFO [main] org.apache.hadoop.mapred.YarnChild: Executing with tokens: 2016-12-15 11:16:14,530 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: mapreduce.job, Service: job_1481156388370_0012, Ident: (org.apache.hadoop.mapreduce.security.token.JobTokenIdentifier@54422e18) 2016-12-15 11:16:14,689 INFO [main] org.apache.hadoop.mapred.YarnChild: Sleeping for 0ms before retrying again. Got null now. 2016-12-15 11:16:14,877 INFO [main] org.apache.hadoop.mapred.YarnChild: mapreduce.cluster.local.dir for child: /usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012 2016-12-15 11:16:15,092 INFO [main] org.apache.hadoop.conf.Configuration.deprecation: session.id is deprecated. Instead, use dfs.metrics.session-id 2016-12-15 11:16:15,440 WARN [main] org.apache.hadoop.hdfs.shortcircuit.DomainSocketFactory: The short-circuit local reads feature cannot be used because libhadoop cannot be loaded. 2016-12-15 11:16:15,452 INFO [main] org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: File Output Committer Algorithm version is 1 2016-12-15 11:16:15,452 INFO [main] org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false 2016-12-15 11:16:15,460 INFO [main] org.apache.hadoop.mapred.Task: Using ResourceCalculatorProcessTree : [ ] 2016-12-15 11:16:15,613 INFO [main] org.apache.hadoop.mapred.MapTask: Processing split: inputSplitClass:com.teradata.connector.teradata.TeradataInputFormat$TeradataInputSplit split0:com.teradata.connector.teradata.TeradataInputFormat$TeradataInputSplit@1cb3ec38 2016-12-15 11:16:15,616 INFO [main] com.teradata.connector.common.ConnectorCombineInputFormat$ConnectorCombinePlugedinInputRecordReader: recordreader class com.teradata.connector.common.ConnectorCombineInputFormat$ConnectorCombinePlugedinInputRecordReaderinitialize time is: 1481829375616 2016-12-15 11:16:15,665 INFO [main] com.teradata.connector.teradata.TeradataInputFormat$TeradataRecordReader: recordreader class com.teradata.connector.teradata.TeradataInputFormat$TeradataRecordReaderinitialize time is: 1481829375665 2016-12-15 11:16:15,667 INFO [main] com.teradata.connector.common.ConnectorOutputFormat$ConnectorFileRecordWriter: recordwriter class com.teradata.connector.common.ConnectorOutputFormat$ConnectorFileRecordWriterinitialize time is: 1481829375667 2016-12-15 11:16:17,837 INFO [main] org.apache.hadoop.conf.Configuration.deprecation: mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout 2016-12-15 11:16:17,837 INFO [main] com.teradata.connector.common.ConnectorMMapper: keep-alive thread started 2016-12-15 11:16:18,893 INFO [main] com.teradata.connector.teradata.TeradataInputFormat$TeradataRecordReader: recordreader class com.teradata.connector.teradata.TeradataInputFormat$TeradataRecordReaderclose time is: 1481829378893 2016-12-15 11:16:18,893 INFO [main] com.teradata.connector.teradata.TeradataInputFormat$TeradataRecordReader: the total elapsed time of recordreader com.teradata.connector.teradata.TeradataInputFormat$TeradataRecordReader3s 2016-12-15 11:16:19,040 INFO [main] com.teradata.connector.common.ConnectorCombineInputFormat$ConnectorCombinePlugedinInputRecordReader: recordreader class com.teradata.connector.common.ConnectorCombineInputFormat$ConnectorCombinePlugedinInputRecordReaderclose time is: 1481829379040 2016-12-15 11:16:19,040 INFO [main] com.teradata.connector.common.ConnectorCombineInputFormat$ConnectorCombinePlugedinInputRecordReader: the total elapsed time of recordreader com.teradata.connector.common.ConnectorCombineInputFormat$ConnectorCombinePlugedinInputRecordReader3s 2016-12-15 11:16:19,045 INFO [main] com.teradata.connector.common.ConnectorOutputFormat$ConnectorFileRecordWriter: recordwriter class com.teradata.connector.common.ConnectorOutputFormat$ConnectorFileRecordWriterclose time is: 1481829379045 2016-12-15 11:16:19,045 INFO [main] com.teradata.connector.common.ConnectorOutputFormat$ConnectorFileRecordWriter: the total elapsed time of recordwriter com.teradata.connector.common.ConnectorOutputFormat$ConnectorFileRecordWriter3s 2016-12-15 11:16:19,045 INFO [main] org.apache.hadoop.mapred.Task: Task:attempt_1481156388370_0012_m_000003_0 is done. And is in the process of committing 2016-12-15 11:16:19,089 INFO [main] org.apache.hadoop.mapred.Task: Task attempt_1481156388370_0012_m_000003_0 is allowed to commit now 2016-12-15 11:16:19,095 INFO [main] org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Saved output of task 'attempt_1481156388370_0012_m_000003_0' to hdfs://xxx.net:8020/tmp/tt/status/_temporary/1/task_1481156388370_0012_m_000003 2016-12-15 11:16:19,125 INFO [main] org.apache.hadoop.mapred.Task: Task 'attempt_1481156388370_0012_m_000003_0' done. End of LogType:syslog Container: container_1481156388370_0012_01_000004 on xxx.net_45454 ====================================================================================== LogType:directory.info Log Upload Time:Thu Dec 15 11:16:28 -0800 2016 LogLength:25899 Log Contents: ls -l: total 208 lrwxrwxrwx 1 root root 90 Dec 15 11:16 ant-contrib-1.0b3.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/161/ant-contrib-1.0b3.jar lrwxrwxrwx 1 root root 95 Dec 15 11:16 ant-eclipse-1.0-jvm1.2.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/186/ant-eclipse-1.0-jvm1.2.jar lrwxrwxrwx 1 root root 83 Dec 15 11:16 avro-1.8.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/164/avro-1.8.0.jar lrwxrwxrwx 1 root root 98 Dec 15 11:16 avro-mapred-1.8.0-hadoop2.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/194/avro-mapred-1.8.0-hadoop2.jar lrwxrwxrwx 1 root root 90 Dec 15 11:16 commons-codec-1.4.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/175/commons-codec-1.4.jar lrwxrwxrwx 1 root root 95 Dec 15 11:16 commons-compress-1.8.1.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/179/commons-compress-1.8.1.jar lrwxrwxrwx 1 root root 87 Dec 15 11:16 commons-io-1.4.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/189/commons-io-1.4.jar lrwxrwxrwx 1 root root 91 Dec 15 11:16 commons-jexl-2.1.1.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/193/commons-jexl-2.1.1.jar lrwxrwxrwx 1 root root 90 Dec 15 11:16 commons-lang3-3.4.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/187/commons-lang3-3.4.jar lrwxrwxrwx 1 root root 94 Dec 15 11:16 commons-logging-1.1.1.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/171/commons-logging-1.1.1.jar -rw-r--r-- 1 root root 227 Dec 15 11:16 container_tokens -rwx------ 1 root root 709 Dec 15 11:16 default_container_executor_session.sh -rwx------ 1 root root 763 Dec 15 11:16 default_container_executor.sh lrwxrwxrwx 1 root root 122 Dec 15 11:16 hortonworks-teradata-connector-1.5.1.2.5.0.0-1245.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/192/hortonworks-teradata-connector-1.5.1.2.5.0.0-1245.jar lrwxrwxrwx 1 root root 88 Dec 15 11:16 hsqldb-1.8.0.10.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/176/hsqldb-1.8.0.10.jar lrwxrwxrwx 1 root root 98 Dec 15 11:16 jackson-annotations-2.3.1.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/159/jackson-annotations-2.3.1.jar lrwxrwxrwx 1 root root 91 Dec 15 11:16 jackson-core-2.3.1.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/182/jackson-core-2.3.1.jar lrwxrwxrwx 1 root root 96 Dec 15 11:16 jackson-core-asl-1.9.13.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/170/jackson-core-asl-1.9.13.jar lrwxrwxrwx 1 root root 95 Dec 15 11:16 jackson-databind-2.3.1.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/185/jackson-databind-2.3.1.jar lrwxrwxrwx 1 root root 98 Dec 15 11:16 jackson-mapper-asl-1.9.13.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/178/jackson-mapper-asl-1.9.13.jar lrwxrwxrwx 1 root root 115 Dec 15 11:16 job.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012/filecache/10/job.jar lrwxrwxrwx 1 root root 115 Dec 15 11:16 job.xml -> /usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012/filecache/11/job.xml lrwxrwxrwx 1 root root 93 Dec 15 11:16 kite-data-core-1.1.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/165/kite-data-core-1.1.0.jar lrwxrwxrwx 1 root root 93 Dec 15 11:16 kite-data-hive-1.1.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/188/kite-data-hive-1.1.0.jar lrwxrwxrwx 1 root root 98 Dec 15 11:16 kite-data-mapreduce-1.1.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/181/kite-data-mapreduce-1.1.0.jar lrwxrwxrwx 1 root root 104 Dec 15 11:16 kite-hadoop-compatibility-1.1.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/160/kite-hadoop-compatibility-1.1.0.jar -rwx------ 1 root root 32487 Dec 15 11:16 launch_container.sh lrwxrwxrwx 1 root root 69 Dec 15 11:16 mr-framework -> /usr/local/middleware/hadoop/yarn/local/filecache/11/mapreduce.tar.gz lrwxrwxrwx 1 root root 84 Dec 15 11:16 opencsv-2.3.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/166/opencsv-2.3.jar lrwxrwxrwx 1 root root 86 Dec 15 11:16 paranamer-2.7.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/183/paranamer-2.7.jar lrwxrwxrwx 1 root root 91 Dec 15 11:16 parquet-avro-1.6.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/163/parquet-avro-1.6.0.jar lrwxrwxrwx 1 root root 93 Dec 15 11:16 parquet-column-1.6.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/184/parquet-column-1.6.0.jar lrwxrwxrwx 1 root root 93 Dec 15 11:16 parquet-common-1.6.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/191/parquet-common-1.6.0.jar lrwxrwxrwx 1 root root 95 Dec 15 11:16 parquet-encoding-1.6.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/180/parquet-encoding-1.6.0.jar lrwxrwxrwx 1 root root 97 Dec 15 11:16 parquet-format-2.2.0-rc1.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/190/parquet-format-2.2.0-rc1.jar lrwxrwxrwx 1 root root 96 Dec 15 11:16 parquet-generator-1.6.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/158/parquet-generator-1.6.0.jar lrwxrwxrwx 1 root root 93 Dec 15 11:16 parquet-hadoop-1.6.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/172/parquet-hadoop-1.6.0.jar lrwxrwxrwx 1 root root 94 Dec 15 11:16 parquet-jackson-1.6.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/168/parquet-jackson-1.6.0.jar lrwxrwxrwx 1 root root 88 Dec 15 11:16 slf4j-api-1.7.7.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/174/slf4j-api-1.7.7.jar lrwxrwxrwx 1 root root 92 Dec 15 11:16 snappy-java-1.1.1.6.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/173/snappy-java-1.1.1.6.jar lrwxrwxrwx 1 root root 84 Dec 15 11:16 tdgssconfig.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/162/tdgssconfig.jar lrwxrwxrwx 1 root root 105 Dec 15 11:16 teradata-connector-1.5.1-hadoop2.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/167/teradata-connector-1.5.1-hadoop2.jar lrwxrwxrwx 1 root root 82 Dec 15 11:16 terajdbc4.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/169/terajdbc4.jar drwx--x--- 2 root root 4096 Dec 15 11:16 tmp lrwxrwxrwx 1 root root 79 Dec 15 11:16 xz-1.5.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/177/xz-1.5.jar find -L . -maxdepth 5 -ls: 44435422 4 drwx--x--- 3 root root 4096 Dec 15 11:16 . 44435249 60 -r-x------ 1 root root 58131 Dec 15 11:16 ./commons-codec-1.4.jar 44435273 36 -r-x------ 1 root root 34047 Dec 15 11:16 ./paranamer-2.7.jar 44435311 4 drwx------ 3 root root 4096 Dec 15 11:16 ./job.jar 44435309 4980 -r-x------ 1 root root 5098776 Dec 15 11:16 ./job.jar/job.jar 44435312 4 drwx------ 2 root root 4096 Dec 15 11:16 ./job.jar/lib 44435314 184 -r-x------ 1 root root 185140 Sep 7 15:18 ./job.jar/lib/commons-io-2.4.jar 44435317 1972 -r-x------ 1 root root 2019274 Sep 7 15:18 ./job.jar/lib/ant-1.9.4.jar 44435315 20 -r-x------ 1 root root 19827 Sep 7 15:18 ./job.jar/lib/opencsv-2.3.jar 44435313 32 -r-x------ 1 root root 31605 Sep 7 15:18 ./job.jar/lib/commons-logging-1.0.3.jar 44435318 4 -r-x------ 1 root root 2615 Oct 3 11:51 ./job.jar/lib/tdgssconfig.jar 44435316 612 -r-x------ 1 root root 625986 Sep 7 15:18 ./job.jar/lib/joda-time-2.9.1.jar 44435319 1068 -r-x------ 1 root root 1093618 Oct 3 11:51 ./job.jar/lib/terajdbc4.jar 44435267 1704 -r-x------ 1 root root 1744166 Dec 15 11:16 ./kite-data-mapreduce-1.1.0.jar 44435261 360 -r-x------ 1 root root 365977 Dec 15 11:16 ./commons-compress-1.8.1.jar 44435291 108 -r-x------ 1 root root 108990 Dec 15 11:16 ./commons-io-1.4.jar 44435444 4 -rw-r--r-- 1 root root 264 Dec 15 11:16 ./.launch_container.sh.crc 44435279 884 -r-x------ 1 root root 902327 Dec 15 11:16 ./jackson-databind-2.3.1.jar 44435442 32 -rwx------ 1 root root 32487 Dec 15 11:16 ./launch_container.sh 44435198 24 -r-x------ 1 root root 20728 Dec 15 11:16 ./parquet-generator-1.6.0.jar 44435246 32 -r-x------ 1 root root 29241 Dec 15 11:16 ./slf4j-api-1.7.7.jar 44435294 364 -r-x------ 1 root root 371050 Dec 15 11:16 ./parquet-format-2.2.0-rc1.jar 44435450 4 -rw-r--r-- 1 root root 16 Dec 15 11:16 ./.default_container_executor_session.sh.crc 44435285 424 -r-x------ 1 root root 430341 Dec 15 11:16 ./commons-lang3-3.4.jar 44435222 20 -r-x------ 1 root root 19816 Dec 15 11:16 ./opencsv-2.3.jar 44435321 132 -r-x------ 1 root root 132355 Dec 15 11:16 ./job.xml 44435434 4 -rw-r--r-- 1 root root 227 Dec 15 11:16 ./container_tokens 44435306 180 -r-x------ 1 root root 183770 Dec 15 11:16 ./avro-mapred-1.8.0-hadoop2.jar 44435426 4 drwx--x--- 2 root root 4096 Dec 15 11:16 ./tmp 44435252 692 -r-x------ 1 root root 706015 Dec 15 11:16 ./hsqldb-1.8.0.10.jar 44435300 24 -r-x------ 1 root root 22675 Dec 15 11:16 ./hortonworks-teradata-connector-1.5.1.2.5.0.0-1245.jar 44435213 56 -r-x------ 1 root root 53418 Dec 15 11:16 ./parquet-avro-1.6.0.jar 44435438 4 -rw-r--r-- 1 root root 12 Dec 15 11:16 ./.container_tokens.crc 44435234 228 -r-x------ 1 root root 229445 Dec 15 11:16 ./jackson-core-asl-1.9.13.jar 44435228 996 -r-x------ 1 root root 1019348 Dec 15 11:16 ./parquet-jackson-1.6.0.jar 44433794 4 drwxr-xr-x 3 root root 4096 Dec 13 11:42 ./mr-framework 44433798 4 drwxr-xr-x 9 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop 44433841 4 drwxr-xr-x 2 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/include 44433846 4 -r-xr-xr-x 1 jenkins users 3319 Nov 29 10:21 ./mr-framework/hadoop/include/TemplateFactory.hh 44433842 8 -r-xr-xr-x 1 jenkins users 6330 Nov 29 10:21 ./mr-framework/hadoop/include/Pipes.hh 44433845 8 -r-xr-xr-x 1 jenkins users 4514 Nov 29 10:21 ./mr-framework/hadoop/include/SerialUtils.hh 44433844 36 -r-xr-xr-x 1 jenkins users 33361 Nov 29 10:21 ./mr-framework/hadoop/include/hdfs.h 44433843 4 -r-xr-xr-x 1 jenkins users 2441 Nov 29 10:21 ./mr-framework/hadoop/include/StringUtils.hh 44434867 4 drwxr-xr-x 2 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/bin 44434872 8 -r-xr-xr-x 1 jenkins users 6448 Nov 29 10:21 ./mr-framework/hadoop/bin/mapred 44434871 4 -r-xr-xr-x 1 jenkins users 888 Nov 29 10:21 ./mr-framework/hadoop/bin/kill-secondary-name-node 44434876 12 -r-xr-xr-x 1 jenkins users 8786 Nov 29 10:21 ./mr-framework/hadoop/bin/hadoop.cmd 44434877 4 -r-xr-xr-x 1 jenkins users 1857 Nov 29 10:21 ./mr-framework/hadoop/bin/rcc 44434878 12 -r-xr-xr-x 1 jenkins users 12069 Nov 29 10:21 ./mr-framework/hadoop/bin/yarn.cmd 44434869 4 -r-xr-xr-x 1 jenkins users 830 Nov 29 10:21 ./mr-framework/hadoop/bin/kill-name-node 44434870 12 -r-xr-xr-x 1 jenkins users 8782 Nov 29 10:21 ./mr-framework/hadoop/bin/hdfs.cmd 44434879 8 -r-xr-xr-x 1 jenkins users 7120 Nov 29 10:21 ./mr-framework/hadoop/bin/hadoop 44434880 16 -r-xr-xr-x 1 jenkins users 12707 Nov 29 10:21 ./mr-framework/hadoop/bin/hdfs 44434868 8 -r-xr-xr-x 1 jenkins users 7465 Nov 29 10:21 ./mr-framework/hadoop/bin/mapred.cmd 44434874 124 -r-xr-xr-x 1 jenkins users 125137 Nov 29 10:21 ./mr-framework/hadoop/bin/container-executor 44434873 140 -r-xr-xr-x 1 jenkins users 139697 Nov 29 10:21 ./mr-framework/hadoop/bin/test-container-executor 44434875 16 -r-xr-xr-x 1 jenkins users 14958 Nov 29 10:21 ./mr-framework/hadoop/bin/yarn 44433848 4 drwxr-xr-x 2 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/sbin 44433861 4 -r-xr-xr-x 1 jenkins users 2291 Nov 29 10:21 ./mr-framework/hadoop/sbin/httpfs.sh 44433875 4 -r-xr-xr-x 1 jenkins users 1441 Nov 29 10:21 ./mr-framework/hadoop/sbin/hadoop-daemons.sh 44433850 4 -r-xr-xr-x 1 jenkins users 1260 Nov 29 10:21 ./mr-framework/hadoop/sbin/stop-balancer.sh 44433876 4 -r-xr-xr-x 1 jenkins users 3287 Nov 29 10:21 ./mr-framework/hadoop/sbin/stop-dfs.sh 44433857 4 -r-xr-xr-x 1 jenkins users 1543 Nov 29 10:21 ./mr-framework/hadoop/sbin/stop-all.sh 44433870 4 -r-xr-xr-x 1 jenkins users 1401 Nov 29 10:21 ./mr-framework/hadoop/sbin/start-dfs.cmd 44433866 4 -r-xr-xr-x 1 jenkins users 1428 Nov 29 10:21 ./mr-framework/hadoop/sbin/start-yarn.sh 44433858 4 -r-xr-xr-x 1 jenkins users 1209 Nov 29 10:21 ./mr-framework/hadoop/sbin/start-balancer.sh 44433863 4 -r-xr-xr-x 1 jenkins users 1421 Nov 29 10:21 ./mr-framework/hadoop/sbin/stop-secure-dns.sh 44433869 4 -r-xr-xr-x 1 jenkins users 2752 Nov 29 10:21 ./mr-framework/hadoop/sbin/distribute-exclude.sh 44433862 8 -r-xr-xr-x 1 jenkins users 6546 Nov 29 10:21 ./mr-framework/hadoop/sbin/hadoop-daemon.sh 44433853 4 -r-xr-xr-x 1 jenkins users 1571 Nov 29 10:21 ./mr-framework/hadoop/sbin/start-yarn.cmd 44433855 4 -r-xr-xr-x 1 jenkins users 3815 Nov 29 10:21 ./mr-framework/hadoop/sbin/start-dfs.sh 44433864 4 -r-xr-xr-x 1 jenkins users 1642 Nov 29 10:21 ./mr-framework/hadoop/sbin/stop-yarn.cmd 44433860 4 -r-xr-xr-x 1 jenkins users 1552 Nov 29 10:21 ./mr-framework/hadoop/sbin/start-all.sh 44433867 4 -r-xr-xr-x 1 jenkins users 3630 Nov 29 10:21 ./mr-framework/hadoop/sbin/kms.sh 44433852 4 -r-xr-xr-x 1 jenkins users 1421 Nov 29 10:21 ./mr-framework/hadoop/sbin/stop-yarn.sh 44433871 4 -r-xr-xr-x 1 jenkins users 1779 Nov 29 10:21 ./mr-framework/hadoop/sbin/start-all.cmd 44433872 8 -r-xr-xr-x 1 jenkins users 4376 Nov 29 10:21 ./mr-framework/hadoop/sbin/yarn-daemon.sh 44433874 4 -r-xr-xr-x 1 jenkins users 1729 Nov 29 10:21 ./mr-framework/hadoop/sbin/refresh-namenodes.sh 44433868 4 -r-xr-xr-x 1 jenkins users 1508 Nov 29 10:21 ./mr-framework/hadoop/sbin/hdfs-config.sh 44433873 4 -r-xr-xr-x 1 jenkins users 2226 Nov 29 10:21 ./mr-framework/hadoop/sbin/slaves.sh 44433849 4 -r-xr-xr-x 1 jenkins users 1770 Nov 29 10:21 ./mr-framework/hadoop/sbin/stop-all.cmd 44433854 4 -r-xr-xr-x 1 jenkins users 1434 Nov 29 10:21 ./mr-framework/hadoop/sbin/yarn-daemons.sh 44433859 4 -r-xr-xr-x 1 jenkins users 1455 Nov 29 10:21 ./mr-framework/hadoop/sbin/stop-dfs.cmd 44433851 8 -r-xr-xr-x 1 jenkins users 4161 Nov 29 10:21 ./mr-framework/hadoop/sbin/mr-jobhistory-daemon.sh 44433856 4 -r-xr-xr-x 1 jenkins users 1640 Nov 29 10:21 ./mr-framework/hadoop/sbin/hdfs-config.cmd 44433865 4 -r-xr-xr-x 1 jenkins users 1438 Nov 29 10:21 ./mr-framework/hadoop/sbin/start-secure-dns.sh 44434881 84 -r-xr-xr-x 1 jenkins users 84854 Nov 29 10:21 ./mr-framework/hadoop/LICENSE.txt 44433847 16 -r-xr-xr-x 1 jenkins users 15753 Nov 29 10:21 ./mr-framework/hadoop/NOTICE.txt 44433830 4 drwxr-xr-x 2 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/libexec 44433838 4 -r-xr-xr-x 1 jenkins users 1777 Nov 29 10:21 ./mr-framework/hadoop/libexec/mapred-config.cmd 44433839 12 -r-xr-xr-x 1 jenkins users 8270 Nov 29 10:21 ./mr-framework/hadoop/libexec/hadoop-config.cmd 44433840 8 -r-xr-xr-x 1 jenkins users 5749 Nov 29 10:21 ./mr-framework/hadoop/libexec/httpfs-config.sh 44433834 4 -r-xr-xr-x 1 jenkins users 2131 Nov 29 10:21 ./mr-framework/hadoop/libexec/yarn-config.cmd 44433836 4 -r-xr-xr-x 1 jenkins users 2215 Nov 29 10:21 ./mr-framework/hadoop/libexec/yarn-config.sh 44433832 4 -r-xr-xr-x 1 jenkins users 2304 Nov 29 10:21 ./mr-framework/hadoop/libexec/mapred-config.sh 44433837 4 -r-xr-xr-x 1 jenkins users 1508 Nov 29 10:21 ./mr-framework/hadoop/libexec/hdfs-config.sh 44433831 12 -r-xr-xr-x 1 jenkins users 11678 Nov 29 10:21 ./mr-framework/hadoop/libexec/hadoop-config.sh 44433833 4 -r-xr-xr-x 1 jenkins users 1640 Nov 29 10:21 ./mr-framework/hadoop/libexec/hdfs-config.cmd 44433835 8 -r-xr-xr-x 1 jenkins users 5431 Nov 29 10:21 ./mr-framework/hadoop/libexec/kms-config.sh 44433799 4 drwxr-xr-x 3 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/etc 44433800 4 drwxr-xr-x 2 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop 44433821 8 -r-xr-xr-x 1 jenkins users 4436 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/capacity-scheduler.xml 44433829 4 -r-xr-xr-x 1 jenkins users 1527 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/kms-env.sh 44433806 12 -r-xr-xr-x 1 jenkins users 9683 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/hadoop-policy.xml 44433820 4 -r-xr-xr-x 1 jenkins users 758 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/mapred-site.xml.template 44433824 4 -r-xr-xr-x 1 jenkins users 2316 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/ssl-client.xml.example 44433802 8 -r-xr-xr-x 1 jenkins users 4529 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/hadoop-env.sh 44433811 4 -r-xr-xr-x 1 jenkins users 3979 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/hadoop-env.cmd 44433812 4 -r-xr-xr-x 1 jenkins users 3518 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/kms-acls.xml 44433828 4 -r-xr-xr-x 1 jenkins users 2697 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/ssl-server.xml.example 44433823 4 -r-xr-xr-x 1 jenkins users 21 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/httpfs-signature.secret 44433826 4 -r-xr-xr-x 1 jenkins users 318 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/container-executor.cfg 44433813 4 -r-xr-xr-x 1 jenkins users 690 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/yarn-site.xml 44433801 4 -r-xr-xr-x 1 jenkins users 1631 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/kms-log4j.properties 44433810 16 -r-xr-xr-x 1 jenkins users 12302 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/log4j.properties 44433807 4 -r-xr-xr-x 1 jenkins users 775 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/hdfs-site.xml 44433817 4 -r-xr-xr-x 1 jenkins users 10 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/slaves 44433825 8 -r-xr-xr-x 1 jenkins users 4113 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/mapred-queues.xml.template 44433818 4 -r-xr-xr-x 1 jenkins users 620 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/httpfs-site.xml 44433822 4 -r-xr-xr-x 1 jenkins users 1657 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/httpfs-log4j.properties 44433809 4 -r-xr-xr-x 1 jenkins users 2598 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/hadoop-metrics2.properties 44433805 8 -r-xr-xr-x 1 jenkins users 4567 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/yarn-env.sh 44433808 4 -r-xr-xr-x 1 jenkins users 2490 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/hadoop-metrics.properties 44433804 4 -r-xr-xr-x 1 jenkins users 774 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/core-site.xml 44433827 4 -r-xr-xr-x 1 jenkins users 1335 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/configuration.xsl 44433815 4 -r-xr-xr-x 1 jenkins users 1383 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/mapred-env.sh 44433819 8 -r-xr-xr-x 1 jenkins users 5511 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/kms-site.xml 44433803 4 -r-xr-xr-x 1 jenkins users 1449 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/httpfs-env.sh 44433814 4 -r-xr-xr-x 1 jenkins users 2250 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/yarn-env.cmd 44433816 4 -r-xr-xr-x 1 jenkins users 951 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/mapred-env.cmd 44434854 4 drwxr-xr-x 3 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/lib 44434855 4 drwxr-xr-x 2 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/lib/native 44434862 1288 -r-xr-xr-x 1 jenkins users 1316074 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libhadoop.a 44434858 228 -r-xr-xr-x 1 jenkins users 229697 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libhdfs.so.0.0.0 44434861 572 -r-xr-xr-x 1 jenkins users 582360 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libhadooputils.a 44434866 1456 -r-xr-xr-x 1 jenkins users 1487204 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libhadooppipes.a 44434865 756 -r-xr-xr-x 1 jenkins users 773287 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libhadoop.so.1.0.0 44434864 360 -r-xr-xr-x 1 jenkins users 365604 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libhdfs.a 44434865 756 -r-xr-xr-x 1 jenkins users 773287 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libhadoop.so 44434863 20 -r-xr-xr-x 1 jenkins users 19848 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libsnappy.so.1 44434863 20 -r-xr-xr-x 1 jenkins users 19848 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libsnappy.so 44434858 228 -r-xr-xr-x 1 jenkins users 229697 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libhdfs.so 44434863 20 -r-xr-xr-x 1 jenkins users 19848 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libsnappy.so.1.1.4 44434882 4 -r-xr-xr-x 1 jenkins users 1366 Nov 29 10:21 ./mr-framework/hadoop/README.txt 44433877 4 drwxr-xr-x 4 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share 44433878 4 drwxr-xr-x 3 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/doc 44433879 4 drwxr-xr-x 6 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/doc/hadoop 44433891 4 drwxr-xr-x 9 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/hadoop 44434625 4 drwxr-xr-x 3 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/hadoop/kms 44434353 4 drwxr-xr-x 5 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/hadoop/mapreduce 44433892 4 drwxr-xr-x 5 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/hadoop/tools 44434761 4 drwxr-xr-x 7 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/hadoop/hdfs 44434522 4 drwxr-xr-x 6 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/hadoop/common 44434060 4 drwxr-xr-x 3 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/hadoop/httpfs 44434406 4 drwxr-xr-x 5 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/hadoop/yarn 44435454 4 -rwx------ 1 root root 763 Dec 15 11:16 ./default_container_executor.sh 44435207 220 -r-x------ 1 root root 224135 Dec 15 11:16 ./ant-contrib-1.0b3.jar 44435204 1704 -r-x------ 1 root root 1741888 Dec 15 11:16 ./kite-hadoop-compatibility-1.1.0.jar 44435288 1736 -r-x------ 1 root root 1777229 Dec 15 11:16 ./kite-data-hive-1.1.0.jar 44435303 264 -r-x------ 1 root root 266289 Dec 15 11:16 ./commons-jexl-2.1.1.jar 44435210 4 -r-x------ 1 root root 2615 Dec 15 11:16 ./tdgssconfig.jar 44435456 4 -rw-r--r-- 1 root root 16 Dec 15 11:16 ./.default_container_executor.sh.crc 44435448 4 -rwx------ 1 root root 709 Dec 15 11:16 ./default_container_executor_session.sh 44435216 1292 -r-x------ 1 root root 1322324 Dec 15 11:16 ./avro-1.8.0.jar 44435243 576 -r-x------ 1 root root 587380 Dec 15 11:16 ./snappy-java-1.1.1.6.jar 44435276 860 -r-x------ 1 root root 879155 Dec 15 11:16 ./parquet-column-1.6.0.jar 44435258 752 -r-x------ 1 root root 770013 Dec 15 11:16 ./jackson-mapper-asl-1.9.13.jar 44435201 36 -r-x------ 1 root root 35507 Dec 15 11:16 ./jackson-annotations-2.3.1.jar 44435231 1068 -r-x------ 1 root root 1093618 Dec 15 11:16 ./terajdbc4.jar 44435240 204 -r-x------ 1 root root 205028 Dec 15 11:16 ./parquet-hadoop-1.6.0.jar 44435219 2100 -r-x------ 1 root root 2149987 Dec 15 11:16 ./kite-data-core-1.1.0.jar 44435282 36 -r-x------ 1 root root 36427 Dec 15 11:16 ./ant-eclipse-1.0-jvm1.2.jar 44435237 60 -r-x------ 1 root root 60530 Dec 15 11:16 ./commons-logging-1.1.1.jar 44435270 192 -r-x------ 1 root root 195678 Dec 15 11:16 ./jackson-core-2.3.1.jar 44435255 100 -r-x------ 1 root root 99504 Dec 15 11:16 ./xz-1.5.jar 44435264 276 -r-x------ 1 root root 278936 Dec 15 11:16 ./parquet-encoding-1.6.0.jar 44435297 24 -r-x------ 1 root root 20992 Dec 15 11:16 ./parquet-common-1.6.0.jar 44435225 4980 -r-x------ 1 root root 5098776 Dec 15 11:16 ./teradata-connector-1.5.1-hadoop2.jar broken symlinks(find -L . -maxdepth 5 -type l -ls): End of LogType:directory.info LogType:launch_container.sh Log Upload Time:Thu Dec 15 11:16:28 -0800 2016 LogLength:32487 Log Contents: #!/bin/bash export HADOOP_CONF_DIR=${HADOOP_CONF_DIR:-"/appdata/hdp/2.5.3.0-37/hadoop/conf"} export STDOUT_LOGFILE_ENV="/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000004/stdout" export HADOOP_ROOT_LOGGER="INFO,console" export JAVA_HOME=${JAVA_HOME:-"/usr/java/current/"} export NM_HOST="xxx.net" export HADOOP_CLASSPATH="$PWD:job.jar/job.jar:job.jar/classes/:job.jar/lib/*:$PWD/*:/usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012/container_1481156388370_0012_01_000001:job.jar/job.jar:job.jar/classes/:job.jar/lib/*:/usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012/container_1481156388370_0012_01_000001/*:::/usr/hdp/2.5.3.0-37/sqoop/conf:/usr/hdp/current/zookeeper-server/conf::/usr/hdp/2.5.3.0-37/sqoop/lib/ant-contrib-1.0b3.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/ant-eclipse-1.0-jvm1.2.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/avro-1.8.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/avro-mapred-1.8.0-hadoop2.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/commons-codec-1.4.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/commons-compress-1.8.1.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/commons-io-1.4.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/commons-jexl-2.1.1.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/commons-lang3-3.4.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/commons-logging-1.1.1.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/hortonworks-teradata-connector-1.5.1.2.5.0.0-1245.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/hsqldb-1.8.0.10.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/jackson-annotations-2.3.1.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/jackson-core-2.3.1.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/jackson-databind-2.3.1.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/kite-data-core-1.1.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/kite-data-hive-1.1.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/kite-data-mapreduce-1.1.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/kite-hadoop-compatibility-1.1.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/opencsv-2.3.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/paranamer-2.7.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/parquet-avro-1.6.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/parquet-column-1.6.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/parquet-common-1.6.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/parquet-encoding-1.6.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/parquet-format-2.2.0-rc1.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/parquet-generator-1.6.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/parquet-hadoop-1.6.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/parquet-jackson-1.6.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/slf4j-api-1.7.7.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/snappy-java-1.1.1.6.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/tdgssconfig.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/teradata-connector-1.5.1-hadoop2.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/terajdbc4.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/xz-1.5.jar:/usr/hdp/current/hbase-master/conf:/usr/java/default/lib/tools.jar:/usr/hdp/current/hbase-master:/usr/hdp/current/hbase-master/lib/activation-1.1.jar:/usr/hdp/current/hbase-master/lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-master/lib/apacheds-i18n-2.0.0-M15.jar:/usr/hdp/current/hbase-master/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/usr/hdp/current/hbase-master/lib/api-asn1-api-1.0.0-M20.jar:/usr/hdp/current/hbase-master/lib/api-util-1.0.0-M20.jar:/usr/hdp/current/hbase-master/lib/asm-3.1.jar:/usr/hdp/current/hbase-master/lib/avro-1.7.4.jar:/usr/hdp/current/hbase-master/lib/azure-keyvault-core-0.8.0.jar:/usr/hdp/current/hbase-master/lib/azure-storage-4.2.0.jar:/usr/hdp/current/hbase-master/lib/commons-beanutils-1.7.0.jar:/usr/hdp/current/hbase-master/lib/commons-beanutils-core-1.8.0.jar:/usr/hdp/current/hbase-master/lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-master/lib/commons-codec-1.9.jar:/usr/hdp/current/hbase-master/lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-master/lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-master/lib/commons-configuration-1.6.jar:/usr/hdp/current/hbase-master/lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-master/lib/commons-digester-1.8.jar:/usr/hdp/current/hbase-master/lib/commons-el-1.0.jar:/usr/hdp/current/hbase-master/lib/commons-io-2.4.jar:/usr/hdp/current/hbase-master/lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-master/lib/commons-lang3-3.4.jar:/usr/hdp/current/hbase-master/lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-master/lib/commons-math-2.2.jar:/usr/hdp/current/hbase-master/lib/commons-math3-3.1.1.jar:/usr/hdp/current/hbase-master/lib/commons-net-3.1.jar:/usr/hdp/current/hbase-master/lib/curator-client-2.7.1.jar:/usr/hdp/current/hbase-master/lib/curator-framework-2.7.1.jar:/usr/hdp/current/hbase-master/lib/curator-recipes-2.7.1.jar:/usr/hdp/current/hbase-master/lib/disruptor-3.3.0.jar:/usr/hdp/current/hbase-master/lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-master/lib/gson-2.2.4.jar:/usr/hdp/current/hbase-master/lib/guava-12.0.1.jar:/usr/hdp/current/hbase-master/lib/guice-3.0.jar:/usr/hdp/current/hbase-master/lib/guice-servlet-3.0.jar:/usr/hdp/current/hbase-master/lib/hbase-annotations-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-annotations-1.1.2.2.5.3.0-37-tests.jar:/usr/hdp/current/hbase-master/lib/hbase-annotations.jar:/usr/hdp/current/hbase-master/lib/hbase-client-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-client.jar:/usr/hdp/current/hbase-master/lib/hbase-common-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-common-1.1.2.2.5.3.0-37-tests.jar:/usr/hdp/current/hbase-master/lib/hbase-common.jar:/usr/hdp/current/hbase-master/lib/hbase-examples-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-examples.jar:/usr/hdp/current/hbase-master/lib/hbase-hadoop2-compat-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-master/lib/hbase-hadoop-compat-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-master/lib/hbase-it-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-it-1.1.2.2.5.3.0-37-tests.jar:/usr/hdp/current/hbase-master/lib/hbase-it.jar:/usr/hdp/current/hbase-master/lib/hbase-prefix-tree-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-prefix-tree.jar:/usr/hdp/current/hbase-master/lib/hbase-procedure-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-procedure.jar:/usr/hdp/current/hbase-master/lib/hbase-protocol-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-protocol.jar:/usr/hdp/current/hbase-master/lib/hbase-resource-bundle-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-master/lib/hbase-rest-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-rest.jar:/usr/hdp/current/hbase-master/lib/hbase-rsgroup-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-rsgroup-1.1.2.2.5.3.0-37-tests.jar:/usr/hdp/current/hbase-master/lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-master/lib/hbase-server-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-server-1.1.2.2.5.3.0-37-tests.jar:/usr/hdp/current/hbase-master/lib/hbase-server.jar:/usr/hdp/current/hbase-master/lib/hbase-shell-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-shell.jar:/usr/hdp/current/hbase-master/lib/hbase-thrift-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-thrift.jar:/usr/hdp/current/hbase-master/lib/htrace-core-3.1.0-incubating.jar:/usr/hdp/current/hbase-master/lib/jackson-core-2.6.0.jar:/usr/hdp/current/hbase-master/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-master/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/current/hbase-master/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-master/lib/jackson-xc-1.9.13.jar:/usr/hdp/current/hbase-master/lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-master/lib/jasper-compiler-5.5.23.jar:/usr/hdp/current/hbase-master/lib/jasper-runtime-5.5.23.jar:/usr/hdp/current/hbase-master/lib/javax.inject-1.jar:/usr/hdp/current/hbase-master/lib/java-xmlbuilder-0.4.jar:/usr/hdp/current/hbase-master/lib/jaxb-api-2.2.2.jar:/usr/hdp/current/hbase-master/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-master/lib/jcip-annotations-1.0.jar:/usr/hdp/current/hbase-master/lib/jcodings-1.0.8.jar:/usr/hdp/current/hbase-master/lib/jersey-client-1.9.jar:/usr/hdp/current/hbase-master/lib/jersey-core-1.9.jar:/usr/hdp/current/hbase-master/lib/jersey-guice-1.9.jar:/usr/hdp/current/hbase-master/lib/jersey-json-1.9.jar:/usr/hdp/current/hbase-master/lib/jersey-server-1.9.jar:/usr/hdp/current/hbase-master/lib/jets3t-0.9.0.jar:/usr/hdp/current/hbase-master/lib/jettison-1.3.3.jar:/usr/hdp/current/hbase-master/lib/jetty-6.1.26.hwx.jar:/usr/hdp/current/hbase-master/lib/jetty-sslengine-6.1.26.hwx.jar:/usr/hdp/current/hbase-master/lib/jetty-util-6.1.26.hwx.jar:/usr/hdp/current/hbase-master/lib/joni-2.1.2.jar:/usr/hdp/current/hbase-master/lib/jruby-complete-1.6.8.jar:/usr/hdp/current/hbase-master/lib/jsch-0.1.42.jar:/usr/hdp/current/hbase-master/lib/json-smart-1.1.1.jar:/usr/hdp/current/hbase-master/lib/jsp-2.1-6.1.14.jar:/usr/hdp/current/hbase-master/lib/jsp-api-2.1-6.1.14.jar:/usr/hdp/current/hbase-master/lib/jsr305-1.3.9.jar:/usr/hdp/current/hbase-master/lib/junit-4.12.jar:/usr/hdp/current/hbase-master/lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-master/lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-master/lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-master/lib/metrics-core-2.2.0.jar:/usr/hdp/current/hbase-master/lib/netty-3.2.4.Final.jar:/usr/hdp/current/hbase-master/lib/netty-all-4.0.23.Final.jar:/usr/hdp/current/hbase-master/lib/nimbus-jose-jwt-3.9.jar:/usr/hdp/current/hbase-master/lib/ojdbc6.jar:/usr/hdp/current/hbase-master/lib/okhttp-2.4.0.jar:/usr/hdp/current/hbase-master/lib/okio-1.4.0.jar:/usr/hdp/current/hbase-master/lib/paranamer-2.3.jar:/usr/hdp/current/hbase-master/lib/phoenix-server.jar:/usr/hdp/current/hbase-master/lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-master/lib/ranger-hbase-plugin-shim-0.6.0.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/ranger-plugin-classloader-0.6.0.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/servlet-api-2.5-6.1.14.jar:/usr/hdp/current/hbase-master/lib/servlet-api-2.5.jar:/usr/hdp/current/hbase-master/lib/slf4j-api-1.7.7.jar:/usr/hdp/current/hbase-master/lib/snappy-java-1.0.4.1.jar:/usr/hdp/current/hbase-master/lib/spymemcached-2.11.6.jar:/usr/hdp/current/hbase-master/lib/xercesImpl-2.9.1.jar:/usr/hdp/current/hbase-master/lib/xml-apis-1.3.04.jar:/usr/hdp/current/hbase-master/lib/xmlenc-0.52.jar:/usr/hdp/current/hbase-master/lib/xz-1.0.jar:/usr/hdp/current/hbase-master/lib/zookeeper.jar:/appdata/hdp/2.5.3.0-37/hadoop/conf:/usr/hdp/2.5.3.0-37/hadoop/lib/*:/usr/hdp/2.5.3.0-37/hadoop/.//*:/usr/hdp/2.5.3.0-37/hadoop-hdfs/./:/usr/hdp/2.5.3.0-37/hadoop-hdfs/lib/*:/usr/hdp/2.5.3.0-37/hadoop-hdfs/.//*:/usr/hdp/2.5.3.0-37/hadoop-yarn/lib/*:/usr/hdp/2.5.3.0-37/hadoop-yarn/.//*:/usr/hdp/2.5.3.0-37/hadoop-mapreduce/lib/*:/usr/hdp/2.5.3.0-37/hadoop-mapreduce/.//*::/usr/share/java/mysql-connector-java.jar:/usr/lib/hadoop-mapreduce/*:/usr/hdp/2.5.3.0-37/tez/*:/usr/hdp/2.5.3.0-37/tez/lib/*:/usr/hdp/2.5.3.0-37/tez/conf:/usr/hdp/2.5.3.0-37/hadoop/conf:/usr/hdp/2.5.3.0-37/hadoop/*:/usr/hdp/2.5.3.0-37/hadoop/lib/*:/usr/hdp/current/zookeeper-server/*:://hadoop/conf:/usr/hdp/2.5.3.0-37/atlas/hook/hive/*:/usr/hdp/2.5.3.0-37/hive/lib/accumulo-core-1.7.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/accumulo-fate-1.7.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/accumulo-start-1.7.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/accumulo-trace-1.7.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/activation-1.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/ant-1.9.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/ant-launcher-1.9.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/antlr-2.7.7.jar:/usr/hdp/2.5.3.0-37/hive/lib/antlr-runtime-3.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/apache-log4j-extras-1.2.17.jar:/usr/hdp/2.5.3.0-37/hive/lib/asm-commons-3.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/asm-tree-3.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/avatica-1.8.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/avatica-metrics-1.8.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/avro-1.7.5.jar:/usr/hdp/2.5.3.0-37/hive/lib/bonecp-0.8.0.RELEASE.jar:/usr/hdp/2.5.3.0-37/hive/lib/calcite-core-1.2.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/calcite-linq4j-1.2.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-cli-1.2.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-codec-1.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-collections-3.2.2.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-compiler-2.7.6.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-compress-1.4.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-dbcp-1.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-httpclient-3.0.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-io-2.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-lang-2.6.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-logging-1.1.3.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-math-2.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-pool-1.5.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-vfs2-2.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/curator-client-2.6.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/curator-framework-2.6.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/curator-recipes-2.6.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/datanucleus-api-jdo-4.2.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/datanucleus-core-4.1.6.jar:/usr/hdp/2.5.3.0-37/hive/lib/datanucleus-rdbms-4.1.7.jar:/usr/hdp/2.5.3.0-37/hive/lib/derby-10.10.2.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/dropwizard-metrics-hadoop-metrics2-reporter-0.1.2.jar:/usr/hdp/2.5.3.0-37/hive/lib/eigenbase-properties-1.1.5.jar:/usr/hdp/2.5.3.0-37/hive/lib/geronimo-annotation_1.0_spec-1.1.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/geronimo-jaspic_1.0_spec-1.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/geronimo-jta_1.1_spec-1.1.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/groovy-all-2.4.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/guava-14.0.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/HikariCP-1.3.9.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-accumulo-handler-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-accumulo-handler.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-ant-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-ant.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-beeline-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-beeline.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-cli-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-cli.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-common-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-common.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-contrib-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-contrib.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-exec-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-exec.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-hbase-handler-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-hbase-handler.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-hwi-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-hwi.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-jdbc-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-jdbc-1.2.1000.2.5.3.0-37-standalone.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-jdbc.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-metastore-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-metastore.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-serde-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-serde.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-service-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-service.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-shims-0.20S-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-shims-0.23-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-shims-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-shims-common-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-shims-common.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-shims.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-shims-scheduler-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-shims-scheduler.jar:/usr/hdp/2.5.3.0-37/hive/lib/htrace-core-3.1.0-incubating.jar:/usr/hdp/2.5.3.0-37/hive/lib/httpclient-4.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/httpcore-4.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/ivy-2.4.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/jackson-annotations-2.4.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/jackson-core-2.4.2.jar:/usr/hdp/2.5.3.0-37/hive/lib/jackson-databind-2.4.2.jar:/usr/hdp/2.5.3.0-37/hive/lib/janino-2.7.6.jar:/usr/hdp/2.5.3.0-37/hive/lib/javassist-3.18.1-GA.jar:/usr/hdp/2.5.3.0-37/hive/lib/javax.jdo-3.2.0-m3.jar:/usr/hdp/2.5.3.0-37/hive/lib/jcommander-1.32.jar:/usr/hdp/2.5.3.0-37/hive/lib/jdo-api-3.0.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/jetty-all-7.6.0.v20120127.jar:/usr/hdp/2.5.3.0-37/hive/lib/jetty-all-server-7.6.0.v20120127.jar:/usr/hdp/2.5.3.0-37/hive/lib/jline-2.12.jar:/usr/hdp/2.5.3.0-37/hive/lib/joda-time-2.8.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/jpam-1.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/json-20090211.jar:/usr/hdp/2.5.3.0-37/hive/lib/jsr305-3.0.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/jta-1.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/libfb303-0.9.3.jar:/usr/hdp/2.5.3.0-37/hive/lib/libthrift-0.9.3.jar:/usr/hdp/2.5.3.0-37/hive/lib/log4j-1.2.16.jar:/usr/hdp/2.5.3.0-37/hive/lib/mail-1.4.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/maven-scm-api-1.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/maven-scm-provider-svn-commons-1.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/maven-scm-provider-svnexe-1.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/metrics-core-3.1.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/metrics-json-3.1.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/metrics-jvm-3.1.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/mysql-connector-java.jar:/usr/hdp/2.5.3.0-37/hive/lib/netty-3.7.0.Final.jar:/usr/hdp/2.5.3.0-37/hive/lib/ojdbc6.jar:/usr/hdp/2.5.3.0-37/hive/lib/opencsv-2.3.jar:/usr/hdp/2.5.3.0-37/hive/lib/oro-2.0.8.jar:/usr/hdp/2.5.3.0-37/hive/lib/paranamer-2.3.jar:/usr/hdp/2.5.3.0-37/hive/lib/parquet-hadoop-bundle-1.8.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/pentaho-aggdesigner-algorithm-5.1.5-jhyde.jar:/usr/hdp/2.5.3.0-37/hive/lib/plexus-utils-1.5.6.jar:/usr/hdp/2.5.3.0-37/hive/lib/protobuf-java-2.5.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/ranger-hive-plugin-shim-0.6.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/ranger-plugin-classloader-0.6.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/regexp-1.3.jar:/usr/hdp/2.5.3.0-37/hive/lib/servlet-api-2.5.jar:/usr/hdp/2.5.3.0-37/hive/lib/snappy-java-1.0.5.jar:/usr/hdp/2.5.3.0-37/hive/lib/ST4-4.0.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/stax-api-1.0.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/stringtemplate-3.2.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/super-csv-2.2.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/transaction-api-1.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/velocity-1.5.jar:/usr/hdp/2.5.3.0-37/hive/lib/xz-1.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/zookeeper-3.4.6.2.5.3.0-37.jar::/appdata/hdp/2.5.3.0-37/hive-hcatalog/libexec/../share/hcatalog/hive-hcatalog-core-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/conf::/usr/hdp/current/hbase-master/conf:/usr/hdp/2.5.3.0-37/sqoop/sqoop-1.4.6.2.5.3.0-37.jar::/usr/share/java/mysql-connector-java.jar:/usr/lib/hadoop-mapreduce/*:/usr/hdp/2.5.3.0-37/tez/*:/usr/hdp/2.5.3.0-37/tez/lib/*:/usr/hdp/2.5.3.0-37/tez/conf" export LD_LIBRARY_PATH="$PWD:/usr/hdp/2.5.3.0-37/hadoop/lib/native:/usr/hdp/2.5.3.0-37/hadoop/lib/native/Linux-amd64-64" export STDERR_LOGFILE_ENV="/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000004/stderr" export LOGNAME="root" export JVM_PID="$$" export PWD="/usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012/container_1481156388370_0012_01_000004" export HADOOP_CLIENT_OPTS="-Xmx128m -Xmx128m " export LOCAL_DIRS="/usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012" export SHELL="/bin/bash" export NM_HTTP_PORT="8042" export LOG_DIRS="/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000004" export NM_AUX_SERVICE_mapreduce_shuffle="AAAfkQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA= " export NM_PORT="45454" export USER="root" export HADOOP_YARN_HOME=${HADOOP_YARN_HOME:-"/usr/hdp/2.5.3.0-37/hadoop-yarn"} export CLASSPATH="$PWD:$PWD/mr-framework/hadoop/share/hadoop/mapreduce/*:$PWD/mr-framework/hadoop/share/hadoop/mapreduce/lib/*:$PWD/mr-framework/hadoop/share/hadoop/common/*:$PWD/mr-framework/hadoop/share/hadoop/common/lib/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/lib/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/lib/*:/usr/hdp/2.5.3.0-37/hadoop/lib/hadoop-lzo-0.6.0.2.5.3.0-37.jar:/etc/hadoop/conf/secure:job.jar/job.jar:job.jar/classes/:job.jar/lib/*:$PWD/*" export HADOOP_TOKEN_FILE_LOCATION="/usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012/container_1481156388370_0012_01_000004/container_tokens" export LOCAL_USER_DIRS="/usr/local/middleware/hadoop/yarn/local/usercache/root/" export HOME="/home/" export CONTAINER_ID="container_1481156388370_0012_01_000004" export MALLOC_ARENA_MAX="4" ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/188/kite-data-hive-1.1.0.jar" "kite-data-hive-1.1.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/187/commons-lang3-3.4.jar" "commons-lang3-3.4.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/174/slf4j-api-1.7.7.jar" "slf4j-api-1.7.7.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/166/opencsv-2.3.jar" "opencsv-2.3.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/172/parquet-hadoop-1.6.0.jar" "parquet-hadoop-1.6.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/176/hsqldb-1.8.0.10.jar" "hsqldb-1.8.0.10.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/189/commons-io-1.4.jar" "commons-io-1.4.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/192/hortonworks-teradata-connector-1.5.1.2.5.0.0-1245.jar" "hortonworks-teradata-connector-1.5.1.2.5.0.0-1245.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/180/parquet-encoding-1.6.0.jar" "parquet-encoding-1.6.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/182/jackson-core-2.3.1.jar" "jackson-core-2.3.1.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/191/parquet-common-1.6.0.jar" "parquet-common-1.6.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/163/parquet-avro-1.6.0.jar" "parquet-avro-1.6.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012/filecache/10/job.jar" "job.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/161/ant-contrib-1.0b3.jar" "ant-contrib-1.0b3.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/178/jackson-mapper-asl-1.9.13.jar" "jackson-mapper-asl-1.9.13.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/183/paranamer-2.7.jar" "paranamer-2.7.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/167/teradata-connector-1.5.1-hadoop2.jar" "teradata-connector-1.5.1-hadoop2.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/194/avro-mapred-1.8.0-hadoop2.jar" "avro-mapred-1.8.0-hadoop2.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/185/jackson-databind-2.3.1.jar" "jackson-databind-2.3.1.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/193/commons-jexl-2.1.1.jar" "commons-jexl-2.1.1.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/168/parquet-jackson-1.6.0.jar" "parquet-jackson-1.6.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/181/kite-data-mapreduce-1.1.0.jar" "kite-data-mapreduce-1.1.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012/filecache/11/job.xml" "job.xml" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/162/tdgssconfig.jar" "tdgssconfig.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/filecache/11/mapreduce.tar.gz" "mr-framework" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/164/avro-1.8.0.jar" "avro-1.8.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/171/commons-logging-1.1.1.jar" "commons-logging-1.1.1.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/175/commons-codec-1.4.jar" "commons-codec-1.4.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/186/ant-eclipse-1.0-jvm1.2.jar" "ant-eclipse-1.0-jvm1.2.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/160/kite-hadoop-compatibility-1.1.0.jar" "kite-hadoop-compatibility-1.1.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/158/parquet-generator-1.6.0.jar" "parquet-generator-1.6.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/169/terajdbc4.jar" "terajdbc4.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/173/snappy-java-1.1.1.6.jar" "snappy-java-1.1.1.6.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/190/parquet-format-2.2.0-rc1.jar" "parquet-format-2.2.0-rc1.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/177/xz-1.5.jar" "xz-1.5.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/165/kite-data-core-1.1.0.jar" "kite-data-core-1.1.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/179/commons-compress-1.8.1.jar" "commons-compress-1.8.1.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/159/jackson-annotations-2.3.1.jar" "jackson-annotations-2.3.1.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/184/parquet-column-1.6.0.jar" "parquet-column-1.6.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/170/jackson-core-asl-1.9.13.jar" "jackson-core-asl-1.9.13.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi # Creating copy of launch script cp "launch_container.sh" "/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000004/launch_container.sh" chmod 640 "/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000004/launch_container.sh" # Determining directory contents echo "ls -l:" 1>"/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000004/directory.info" ls -l 1>>"/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000004/directory.info" echo "find -L . -maxdepth 5 -ls:" 1>>"/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000004/directory.info" find -L . -maxdepth 5 -ls 1>>"/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000004/directory.info" echo "broken symlinks(find -L . -maxdepth 5 -type l -ls):" 1>>"/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000004/directory.info" find -L . -maxdepth 5 -type l -ls 1>>"/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000004/directory.info" exec /bin/bash -c "$JAVA_HOME/bin/java -server -XX:NewRatio=8 -Djava.library.path=/usr/hdp/current/hadoop/lib/native/ -Djava.net.preferIPv4Stack=true -Dhdp.version=2.5.3.0-37 -Xmx512m -Djava.io.tmpdir=$PWD/tmp -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000004 -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Dhadoop.root.logfile=syslog org.apache.hadoop.mapred.YarnChild 10.236.211.27 36415 attempt_1481156388370_0012_m_000002_0 4 1>/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000004/stdout 2>/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000004/stderr " hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi End of LogType:launch_container.sh LogType:stderr Log Upload Time:Thu Dec 15 11:16:28 -0800 2016 LogLength:243 Log Contents: log4j:WARN No appenders could be found for logger (org.apache.hadoop.metrics2.impl.MetricsSystemImpl). log4j:WARN Please initialize the log4j system properly. log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info. End of LogType:stderr LogType:stdout Log Upload Time:Thu Dec 15 11:16:28 -0800 2016 LogLength:0 Log Contents: End of LogType:stdout LogType:syslog Log Upload Time:Thu Dec 15 11:16:28 -0800 2016 LogLength:5500 Log Contents: 2016-12-15 11:16:14,357 WARN [main] org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2016-12-15 11:16:14,408 WARN [main] org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate configuration: tried hadoop-metrics2-maptask.properties,hadoop-metrics2.properties 2016-12-15 11:16:14,460 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s). 2016-12-15 11:16:14,460 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MapTask metrics system started 2016-12-15 11:16:14,467 INFO [main] org.apache.hadoop.mapred.YarnChild: Executing with tokens: 2016-12-15 11:16:14,467 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: mapreduce.job, Service: job_1481156388370_0012, Ident: (org.apache.hadoop.mapreduce.security.token.JobTokenIdentifier@54422e18) 2016-12-15 11:16:14,617 INFO [main] org.apache.hadoop.mapred.YarnChild: Sleeping for 0ms before retrying again. Got null now. 2016-12-15 11:16:14,793 INFO [main] org.apache.hadoop.mapred.YarnChild: mapreduce.cluster.local.dir for child: /usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012 2016-12-15 11:16:14,966 INFO [main] org.apache.hadoop.conf.Configuration.deprecation: session.id is deprecated. Instead, use dfs.metrics.session-id 2016-12-15 11:16:15,392 WARN [main] org.apache.hadoop.hdfs.shortcircuit.DomainSocketFactory: The short-circuit local reads feature cannot be used because libhadoop cannot be loaded. 2016-12-15 11:16:15,404 INFO [main] org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: File Output Committer Algorithm version is 1 2016-12-15 11:16:15,404 INFO [main] org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false 2016-12-15 11:16:15,427 INFO [main] org.apache.hadoop.mapred.Task: Using ResourceCalculatorProcessTree : [ ] 2016-12-15 11:16:15,583 INFO [main] org.apache.hadoop.mapred.MapTask: Processing split: inputSplitClass:com.teradata.connector.teradata.TeradataInputFormat$TeradataInputSplit split0:com.teradata.connector.teradata.TeradataInputFormat$TeradataInputSplit@1cb3ec38 2016-12-15 11:16:15,587 INFO [main] com.teradata.connector.common.ConnectorCombineInputFormat$ConnectorCombinePlugedinInputRecordReader: recordreader class com.teradata.connector.common.ConnectorCombineInputFormat$ConnectorCombinePlugedinInputRecordReaderinitialize time is: 1481829375586 2016-12-15 11:16:15,634 INFO [main] com.teradata.connector.teradata.TeradataInputFormat$TeradataRecordReader: recordreader class com.teradata.connector.teradata.TeradataInputFormat$TeradataRecordReaderinitialize time is: 1481829375634 2016-12-15 11:16:15,636 INFO [main] com.teradata.connector.common.ConnectorOutputFormat$ConnectorFileRecordWriter: recordwriter class com.teradata.connector.common.ConnectorOutputFormat$ConnectorFileRecordWriterinitialize time is: 1481829375636 2016-12-15 11:16:17,904 INFO [main] org.apache.hadoop.conf.Configuration.deprecation: mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout 2016-12-15 11:16:17,905 INFO [main] com.teradata.connector.common.ConnectorMMapper: keep-alive thread started 2016-12-15 11:16:19,409 INFO [main] com.teradata.connector.teradata.TeradataInputFormat$TeradataRecordReader: recordreader class com.teradata.connector.teradata.TeradataInputFormat$TeradataRecordReaderclose time is: 1481829379409 2016-12-15 11:16:19,409 INFO [main] com.teradata.connector.teradata.TeradataInputFormat$TeradataRecordReader: the total elapsed time of recordreader com.teradata.connector.teradata.TeradataInputFormat$TeradataRecordReader3s 2016-12-15 11:16:19,626 INFO [main] com.teradata.connector.common.ConnectorCombineInputFormat$ConnectorCombinePlugedinInputRecordReader: recordreader class com.teradata.connector.common.ConnectorCombineInputFormat$ConnectorCombinePlugedinInputRecordReaderclose time is: 1481829379626 2016-12-15 11:16:19,626 INFO [main] com.teradata.connector.common.ConnectorCombineInputFormat$ConnectorCombinePlugedinInputRecordReader: the total elapsed time of recordreader com.teradata.connector.common.ConnectorCombineInputFormat$ConnectorCombinePlugedinInputRecordReader4s 2016-12-15 11:16:19,720 INFO [main] com.teradata.connector.common.ConnectorOutputFormat$ConnectorFileRecordWriter: recordwriter class com.teradata.connector.common.ConnectorOutputFormat$ConnectorFileRecordWriterclose time is: 1481829379720 2016-12-15 11:16:19,720 INFO [main] com.teradata.connector.common.ConnectorOutputFormat$ConnectorFileRecordWriter: the total elapsed time of recordwriter com.teradata.connector.common.ConnectorOutputFormat$ConnectorFileRecordWriter4s 2016-12-15 11:16:19,720 INFO [main] org.apache.hadoop.mapred.Task: Task:attempt_1481156388370_0012_m_000002_0 is done. And is in the process of committing 2016-12-15 11:16:19,756 INFO [main] org.apache.hadoop.mapred.Task: Task attempt_1481156388370_0012_m_000002_0 is allowed to commit now 2016-12-15 11:16:19,761 INFO [main] org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Saved output of task 'attempt_1481156388370_0012_m_000002_0' to hdfs://xxx.net:8020/tmp/tt/status/_temporary/1/task_1481156388370_0012_m_000002 2016-12-15 11:16:19,792 INFO [main] org.apache.hadoop.mapred.Task: Task 'attempt_1481156388370_0012_m_000002_0' done. End of LogType:syslog Container: container_1481156388370_0012_01_000001 on xxx.net_45454 ====================================================================================== LogType:directory.info Log Upload Time:Thu Dec 15 11:16:28 -0800 2016 LogLength:26234 Log Contents: ls -l: total 212 lrwxrwxrwx 1 root root 90 Dec 15 11:16 ant-contrib-1.0b3.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/161/ant-contrib-1.0b3.jar lrwxrwxrwx 1 root root 95 Dec 15 11:16 ant-eclipse-1.0-jvm1.2.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/186/ant-eclipse-1.0-jvm1.2.jar lrwxrwxrwx 1 root root 83 Dec 15 11:16 avro-1.8.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/164/avro-1.8.0.jar lrwxrwxrwx 1 root root 98 Dec 15 11:16 avro-mapred-1.8.0-hadoop2.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/194/avro-mapred-1.8.0-hadoop2.jar lrwxrwxrwx 1 root root 90 Dec 15 11:16 commons-codec-1.4.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/175/commons-codec-1.4.jar lrwxrwxrwx 1 root root 95 Dec 15 11:16 commons-compress-1.8.1.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/179/commons-compress-1.8.1.jar lrwxrwxrwx 1 root root 87 Dec 15 11:16 commons-io-1.4.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/189/commons-io-1.4.jar lrwxrwxrwx 1 root root 91 Dec 15 11:16 commons-jexl-2.1.1.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/193/commons-jexl-2.1.1.jar lrwxrwxrwx 1 root root 90 Dec 15 11:16 commons-lang3-3.4.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/187/commons-lang3-3.4.jar lrwxrwxrwx 1 root root 94 Dec 15 11:16 commons-logging-1.1.1.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/171/commons-logging-1.1.1.jar -rw-r--r-- 1 root root 198 Dec 15 11:16 container_tokens -rwx------ 1 root root 709 Dec 15 11:16 default_container_executor_session.sh -rwx------ 1 root root 763 Dec 15 11:16 default_container_executor.sh lrwxrwxrwx 1 root root 122 Dec 15 11:16 hortonworks-teradata-connector-1.5.1.2.5.0.0-1245.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/192/hortonworks-teradata-connector-1.5.1.2.5.0.0-1245.jar lrwxrwxrwx 1 root root 88 Dec 15 11:16 hsqldb-1.8.0.10.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/176/hsqldb-1.8.0.10.jar lrwxrwxrwx 1 root root 98 Dec 15 11:16 jackson-annotations-2.3.1.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/159/jackson-annotations-2.3.1.jar lrwxrwxrwx 1 root root 91 Dec 15 11:16 jackson-core-2.3.1.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/182/jackson-core-2.3.1.jar lrwxrwxrwx 1 root root 96 Dec 15 11:16 jackson-core-asl-1.9.13.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/170/jackson-core-asl-1.9.13.jar lrwxrwxrwx 1 root root 95 Dec 15 11:16 jackson-databind-2.3.1.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/185/jackson-databind-2.3.1.jar lrwxrwxrwx 1 root root 98 Dec 15 11:16 jackson-mapper-asl-1.9.13.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/178/jackson-mapper-asl-1.9.13.jar lrwxrwxrwx 1 root root 115 Dec 15 11:16 job.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012/filecache/10/job.jar drwxr-xr-x 2 root root 4096 Dec 15 11:16 jobSubmitDir lrwxrwxrwx 1 root root 115 Dec 15 11:16 job.xml -> /usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012/filecache/11/job.xml lrwxrwxrwx 1 root root 93 Dec 15 11:16 kite-data-core-1.1.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/165/kite-data-core-1.1.0.jar lrwxrwxrwx 1 root root 93 Dec 15 11:16 kite-data-hive-1.1.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/188/kite-data-hive-1.1.0.jar lrwxrwxrwx 1 root root 98 Dec 15 11:16 kite-data-mapreduce-1.1.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/181/kite-data-mapreduce-1.1.0.jar lrwxrwxrwx 1 root root 104 Dec 15 11:16 kite-hadoop-compatibility-1.1.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/160/kite-hadoop-compatibility-1.1.0.jar -rwx------ 1 root root 32468 Dec 15 11:16 launch_container.sh lrwxrwxrwx 1 root root 69 Dec 15 11:16 mr-framework -> /usr/local/middleware/hadoop/yarn/local/filecache/11/mapreduce.tar.gz lrwxrwxrwx 1 root root 84 Dec 15 11:16 opencsv-2.3.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/166/opencsv-2.3.jar lrwxrwxrwx 1 root root 86 Dec 15 11:16 paranamer-2.7.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/183/paranamer-2.7.jar lrwxrwxrwx 1 root root 91 Dec 15 11:16 parquet-avro-1.6.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/163/parquet-avro-1.6.0.jar lrwxrwxrwx 1 root root 93 Dec 15 11:16 parquet-column-1.6.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/184/parquet-column-1.6.0.jar lrwxrwxrwx 1 root root 93 Dec 15 11:16 parquet-common-1.6.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/191/parquet-common-1.6.0.jar lrwxrwxrwx 1 root root 95 Dec 15 11:16 parquet-encoding-1.6.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/180/parquet-encoding-1.6.0.jar lrwxrwxrwx 1 root root 97 Dec 15 11:16 parquet-format-2.2.0-rc1.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/190/parquet-format-2.2.0-rc1.jar lrwxrwxrwx 1 root root 96 Dec 15 11:16 parquet-generator-1.6.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/158/parquet-generator-1.6.0.jar lrwxrwxrwx 1 root root 93 Dec 15 11:16 parquet-hadoop-1.6.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/172/parquet-hadoop-1.6.0.jar lrwxrwxrwx 1 root root 94 Dec 15 11:16 parquet-jackson-1.6.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/168/parquet-jackson-1.6.0.jar lrwxrwxrwx 1 root root 88 Dec 15 11:16 slf4j-api-1.7.7.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/174/slf4j-api-1.7.7.jar lrwxrwxrwx 1 root root 92 Dec 15 11:16 snappy-java-1.1.1.6.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/173/snappy-java-1.1.1.6.jar lrwxrwxrwx 1 root root 84 Dec 15 11:16 tdgssconfig.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/162/tdgssconfig.jar lrwxrwxrwx 1 root root 105 Dec 15 11:16 teradata-connector-1.5.1-hadoop2.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/167/teradata-connector-1.5.1-hadoop2.jar lrwxrwxrwx 1 root root 82 Dec 15 11:16 terajdbc4.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/169/terajdbc4.jar drwx--x--- 2 root root 4096 Dec 15 11:16 tmp lrwxrwxrwx 1 root root 79 Dec 15 11:16 xz-1.5.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/177/xz-1.5.jar find -L . -maxdepth 5 -ls: 44435334 4 drwx--x--- 4 root root 4096 Dec 15 11:16 . 44435249 60 -r-x------ 1 root root 58131 Dec 15 11:16 ./commons-codec-1.4.jar 44435273 36 -r-x------ 1 root root 34047 Dec 15 11:16 ./paranamer-2.7.jar 44435311 4 drwx------ 3 root root 4096 Dec 15 11:16 ./job.jar 44435309 4980 -r-x------ 1 root root 5098776 Dec 15 11:16 ./job.jar/job.jar 44435312 4 drwx------ 2 root root 4096 Dec 15 11:16 ./job.jar/lib 44435314 184 -r-x------ 1 root root 185140 Sep 7 15:18 ./job.jar/lib/commons-io-2.4.jar 44435317 1972 -r-x------ 1 root root 2019274 Sep 7 15:18 ./job.jar/lib/ant-1.9.4.jar 44435315 20 -r-x------ 1 root root 19827 Sep 7 15:18 ./job.jar/lib/opencsv-2.3.jar 44435313 32 -r-x------ 1 root root 31605 Sep 7 15:18 ./job.jar/lib/commons-logging-1.0.3.jar 44435318 4 -r-x------ 1 root root 2615 Oct 3 11:51 ./job.jar/lib/tdgssconfig.jar 44435316 612 -r-x------ 1 root root 625986 Sep 7 15:18 ./job.jar/lib/joda-time-2.9.1.jar 44435319 1068 -r-x------ 1 root root 1093618 Oct 3 11:51 ./job.jar/lib/terajdbc4.jar 44435267 1704 -r-x------ 1 root root 1744166 Dec 15 11:16 ./kite-data-mapreduce-1.1.0.jar 44435261 360 -r-x------ 1 root root 365977 Dec 15 11:16 ./commons-compress-1.8.1.jar 44435291 108 -r-x------ 1 root root 108990 Dec 15 11:16 ./commons-io-1.4.jar 44435340 4 -rw-r--r-- 1 root root 264 Dec 15 11:16 ./.launch_container.sh.crc 44435279 884 -r-x------ 1 root root 902327 Dec 15 11:16 ./jackson-databind-2.3.1.jar 44435339 32 -rwx------ 1 root root 32468 Dec 15 11:16 ./launch_container.sh 44435198 24 -r-x------ 1 root root 20728 Dec 15 11:16 ./parquet-generator-1.6.0.jar 44435246 32 -r-x------ 1 root root 29241 Dec 15 11:16 ./slf4j-api-1.7.7.jar 44435294 364 -r-x------ 1 root root 371050 Dec 15 11:16 ./parquet-format-2.2.0-rc1.jar 44435342 4 -rw-r--r-- 1 root root 16 Dec 15 11:16 ./.default_container_executor_session.sh.crc 44435285 424 -r-x------ 1 root root 430341 Dec 15 11:16 ./commons-lang3-3.4.jar 44435222 20 -r-x------ 1 root root 19816 Dec 15 11:16 ./opencsv-2.3.jar 44435321 132 -r-x------ 1 root root 132355 Dec 15 11:16 ./job.xml 44435337 4 -rw-r--r-- 1 root root 198 Dec 15 11:16 ./container_tokens 44435306 180 -r-x------ 1 root root 183770 Dec 15 11:16 ./avro-mapred-1.8.0-hadoop2.jar 44435336 4 drwx--x--- 2 root root 4096 Dec 15 11:16 ./tmp 44435252 692 -r-x------ 1 root root 706015 Dec 15 11:16 ./hsqldb-1.8.0.10.jar 44435300 24 -r-x------ 1 root root 22675 Dec 15 11:16 ./hortonworks-teradata-connector-1.5.1.2.5.0.0-1245.jar 44435213 56 -r-x------ 1 root root 53418 Dec 15 11:16 ./parquet-avro-1.6.0.jar 44435338 4 -rw-r--r-- 1 root root 12 Dec 15 11:16 ./.container_tokens.crc 44435234 228 -r-x------ 1 root root 229445 Dec 15 11:16 ./jackson-core-asl-1.9.13.jar 44435228 996 -r-x------ 1 root root 1019348 Dec 15 11:16 ./parquet-jackson-1.6.0.jar 44435354 4 drwxr-xr-x 2 root root 4096 Dec 15 11:16 ./jobSubmitDir 44435324 4 -r-x------ 1 root root 1274 Dec 15 11:16 ./jobSubmitDir/job.split 44435327 4 -r-x------ 1 root root 140 Dec 15 11:16 ./jobSubmitDir/job.splitmetainfo 44433794 4 drwxr-xr-x 3 root root 4096 Dec 13 11:42 ./mr-framework 44433798 4 drwxr-xr-x 9 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop 44433841 4 drwxr-xr-x 2 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/include 44433846 4 -r-xr-xr-x 1 jenkins users 3319 Nov 29 10:21 ./mr-framework/hadoop/include/TemplateFactory.hh 44433842 8 -r-xr-xr-x 1 jenkins users 6330 Nov 29 10:21 ./mr-framework/hadoop/include/Pipes.hh 44433845 8 -r-xr-xr-x 1 jenkins users 4514 Nov 29 10:21 ./mr-framework/hadoop/include/SerialUtils.hh 44433844 36 -r-xr-xr-x 1 jenkins users 33361 Nov 29 10:21 ./mr-framework/hadoop/include/hdfs.h 44433843 4 -r-xr-xr-x 1 jenkins users 2441 Nov 29 10:21 ./mr-framework/hadoop/include/StringUtils.hh 44434867 4 drwxr-xr-x 2 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/bin 44434872 8 -r-xr-xr-x 1 jenkins users 6448 Nov 29 10:21 ./mr-framework/hadoop/bin/mapred 44434871 4 -r-xr-xr-x 1 jenkins users 888 Nov 29 10:21 ./mr-framework/hadoop/bin/kill-secondary-name-node 44434876 12 -r-xr-xr-x 1 jenkins users 8786 Nov 29 10:21 ./mr-framework/hadoop/bin/hadoop.cmd 44434877 4 -r-xr-xr-x 1 jenkins users 1857 Nov 29 10:21 ./mr-framework/hadoop/bin/rcc 44434878 12 -r-xr-xr-x 1 jenkins users 12069 Nov 29 10:21 ./mr-framework/hadoop/bin/yarn.cmd 44434869 4 -r-xr-xr-x 1 jenkins users 830 Nov 29 10:21 ./mr-framework/hadoop/bin/kill-name-node 44434870 12 -r-xr-xr-x 1 jenkins users 8782 Nov 29 10:21 ./mr-framework/hadoop/bin/hdfs.cmd 44434879 8 -r-xr-xr-x 1 jenkins users 7120 Nov 29 10:21 ./mr-framework/hadoop/bin/hadoop 44434880 16 -r-xr-xr-x 1 jenkins users 12707 Nov 29 10:21 ./mr-framework/hadoop/bin/hdfs 44434868 8 -r-xr-xr-x 1 jenkins users 7465 Nov 29 10:21 ./mr-framework/hadoop/bin/mapred.cmd 44434874 124 -r-xr-xr-x 1 jenkins users 125137 Nov 29 10:21 ./mr-framework/hadoop/bin/container-executor 44434873 140 -r-xr-xr-x 1 jenkins users 139697 Nov 29 10:21 ./mr-framework/hadoop/bin/test-container-executor 44434875 16 -r-xr-xr-x 1 jenkins users 14958 Nov 29 10:21 ./mr-framework/hadoop/bin/yarn 44433848 4 drwxr-xr-x 2 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/sbin 44433861 4 -r-xr-xr-x 1 jenkins users 2291 Nov 29 10:21 ./mr-framework/hadoop/sbin/httpfs.sh 44433875 4 -r-xr-xr-x 1 jenkins users 1441 Nov 29 10:21 ./mr-framework/hadoop/sbin/hadoop-daemons.sh 44433850 4 -r-xr-xr-x 1 jenkins users 1260 Nov 29 10:21 ./mr-framework/hadoop/sbin/stop-balancer.sh 44433876 4 -r-xr-xr-x 1 jenkins users 3287 Nov 29 10:21 ./mr-framework/hadoop/sbin/stop-dfs.sh 44433857 4 -r-xr-xr-x 1 jenkins users 1543 Nov 29 10:21 ./mr-framework/hadoop/sbin/stop-all.sh 44433870 4 -r-xr-xr-x 1 jenkins users 1401 Nov 29 10:21 ./mr-framework/hadoop/sbin/start-dfs.cmd 44433866 4 -r-xr-xr-x 1 jenkins users 1428 Nov 29 10:21 ./mr-framework/hadoop/sbin/start-yarn.sh 44433858 4 -r-xr-xr-x 1 jenkins users 1209 Nov 29 10:21 ./mr-framework/hadoop/sbin/start-balancer.sh 44433863 4 -r-xr-xr-x 1 jenkins users 1421 Nov 29 10:21 ./mr-framework/hadoop/sbin/stop-secure-dns.sh 44433869 4 -r-xr-xr-x 1 jenkins users 2752 Nov 29 10:21 ./mr-framework/hadoop/sbin/distribute-exclude.sh 44433862 8 -r-xr-xr-x 1 jenkins users 6546 Nov 29 10:21 ./mr-framework/hadoop/sbin/hadoop-daemon.sh 44433853 4 -r-xr-xr-x 1 jenkins users 1571 Nov 29 10:21 ./mr-framework/hadoop/sbin/start-yarn.cmd 44433855 4 -r-xr-xr-x 1 jenkins users 3815 Nov 29 10:21 ./mr-framework/hadoop/sbin/start-dfs.sh 44433864 4 -r-xr-xr-x 1 jenkins users 1642 Nov 29 10:21 ./mr-framework/hadoop/sbin/stop-yarn.cmd 44433860 4 -r-xr-xr-x 1 jenkins users 1552 Nov 29 10:21 ./mr-framework/hadoop/sbin/start-all.sh 44433867 4 -r-xr-xr-x 1 jenkins users 3630 Nov 29 10:21 ./mr-framework/hadoop/sbin/kms.sh 44433852 4 -r-xr-xr-x 1 jenkins users 1421 Nov 29 10:21 ./mr-framework/hadoop/sbin/stop-yarn.sh 44433871 4 -r-xr-xr-x 1 jenkins users 1779 Nov 29 10:21 ./mr-framework/hadoop/sbin/start-all.cmd 44433872 8 -r-xr-xr-x 1 jenkins users 4376 Nov 29 10:21 ./mr-framework/hadoop/sbin/yarn-daemon.sh 44433874 4 -r-xr-xr-x 1 jenkins users 1729 Nov 29 10:21 ./mr-framework/hadoop/sbin/refresh-namenodes.sh 44433868 4 -r-xr-xr-x 1 jenkins users 1508 Nov 29 10:21 ./mr-framework/hadoop/sbin/hdfs-config.sh 44433873 4 -r-xr-xr-x 1 jenkins users 2226 Nov 29 10:21 ./mr-framework/hadoop/sbin/slaves.sh 44433849 4 -r-xr-xr-x 1 jenkins users 1770 Nov 29 10:21 ./mr-framework/hadoop/sbin/stop-all.cmd 44433854 4 -r-xr-xr-x 1 jenkins users 1434 Nov 29 10:21 ./mr-framework/hadoop/sbin/yarn-daemons.sh 44433859 4 -r-xr-xr-x 1 jenkins users 1455 Nov 29 10:21 ./mr-framework/hadoop/sbin/stop-dfs.cmd 44433851 8 -r-xr-xr-x 1 jenkins users 4161 Nov 29 10:21 ./mr-framework/hadoop/sbin/mr-jobhistory-daemon.sh 44433856 4 -r-xr-xr-x 1 jenkins users 1640 Nov 29 10:21 ./mr-framework/hadoop/sbin/hdfs-config.cmd 44433865 4 -r-xr-xr-x 1 jenkins users 1438 Nov 29 10:21 ./mr-framework/hadoop/sbin/start-secure-dns.sh 44434881 84 -r-xr-xr-x 1 jenkins users 84854 Nov 29 10:21 ./mr-framework/hadoop/LICENSE.txt 44433847 16 -r-xr-xr-x 1 jenkins users 15753 Nov 29 10:21 ./mr-framework/hadoop/NOTICE.txt 44433830 4 drwxr-xr-x 2 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/libexec 44433838 4 -r-xr-xr-x 1 jenkins users 1777 Nov 29 10:21 ./mr-framework/hadoop/libexec/mapred-config.cmd 44433839 12 -r-xr-xr-x 1 jenkins users 8270 Nov 29 10:21 ./mr-framework/hadoop/libexec/hadoop-config.cmd 44433840 8 -r-xr-xr-x 1 jenkins users 5749 Nov 29 10:21 ./mr-framework/hadoop/libexec/httpfs-config.sh 44433834 4 -r-xr-xr-x 1 jenkins users 2131 Nov 29 10:21 ./mr-framework/hadoop/libexec/yarn-config.cmd 44433836 4 -r-xr-xr-x 1 jenkins users 2215 Nov 29 10:21 ./mr-framework/hadoop/libexec/yarn-config.sh 44433832 4 -r-xr-xr-x 1 jenkins users 2304 Nov 29 10:21 ./mr-framework/hadoop/libexec/mapred-config.sh 44433837 4 -r-xr-xr-x 1 jenkins users 1508 Nov 29 10:21 ./mr-framework/hadoop/libexec/hdfs-config.sh 44433831 12 -r-xr-xr-x 1 jenkins users 11678 Nov 29 10:21 ./mr-framework/hadoop/libexec/hadoop-config.sh 44433833 4 -r-xr-xr-x 1 jenkins users 1640 Nov 29 10:21 ./mr-framework/hadoop/libexec/hdfs-config.cmd 44433835 8 -r-xr-xr-x 1 jenkins users 5431 Nov 29 10:21 ./mr-framework/hadoop/libexec/kms-config.sh 44433799 4 drwxr-xr-x 3 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/etc 44433800 4 drwxr-xr-x 2 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop 44433821 8 -r-xr-xr-x 1 jenkins users 4436 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/capacity-scheduler.xml 44433829 4 -r-xr-xr-x 1 jenkins users 1527 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/kms-env.sh 44433806 12 -r-xr-xr-x 1 jenkins users 9683 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/hadoop-policy.xml 44433820 4 -r-xr-xr-x 1 jenkins users 758 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/mapred-site.xml.template 44433824 4 -r-xr-xr-x 1 jenkins users 2316 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/ssl-client.xml.example 44433802 8 -r-xr-xr-x 1 jenkins users 4529 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/hadoop-env.sh 44433811 4 -r-xr-xr-x 1 jenkins users 3979 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/hadoop-env.cmd 44433812 4 -r-xr-xr-x 1 jenkins users 3518 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/kms-acls.xml 44433828 4 -r-xr-xr-x 1 jenkins users 2697 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/ssl-server.xml.example 44433823 4 -r-xr-xr-x 1 jenkins users 21 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/httpfs-signature.secret 44433826 4 -r-xr-xr-x 1 jenkins users 318 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/container-executor.cfg 44433813 4 -r-xr-xr-x 1 jenkins users 690 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/yarn-site.xml 44433801 4 -r-xr-xr-x 1 jenkins users 1631 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/kms-log4j.properties 44433810 16 -r-xr-xr-x 1 jenkins users 12302 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/log4j.properties 44433807 4 -r-xr-xr-x 1 jenkins users 775 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/hdfs-site.xml 44433817 4 -r-xr-xr-x 1 jenkins users 10 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/slaves 44433825 8 -r-xr-xr-x 1 jenkins users 4113 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/mapred-queues.xml.template 44433818 4 -r-xr-xr-x 1 jenkins users 620 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/httpfs-site.xml 44433822 4 -r-xr-xr-x 1 jenkins users 1657 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/httpfs-log4j.properties 44433809 4 -r-xr-xr-x 1 jenkins users 2598 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/hadoop-metrics2.properties 44433805 8 -r-xr-xr-x 1 jenkins users 4567 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/yarn-env.sh 44433808 4 -r-xr-xr-x 1 jenkins users 2490 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/hadoop-metrics.properties 44433804 4 -r-xr-xr-x 1 jenkins users 774 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/core-site.xml 44433827 4 -r-xr-xr-x 1 jenkins users 1335 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/configuration.xsl 44433815 4 -r-xr-xr-x 1 jenkins users 1383 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/mapred-env.sh 44433819 8 -r-xr-xr-x 1 jenkins users 5511 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/kms-site.xml 44433803 4 -r-xr-xr-x 1 jenkins users 1449 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/httpfs-env.sh 44433814 4 -r-xr-xr-x 1 jenkins users 2250 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/yarn-env.cmd 44433816 4 -r-xr-xr-x 1 jenkins users 951 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/mapred-env.cmd 44434854 4 drwxr-xr-x 3 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/lib 44434855 4 drwxr-xr-x 2 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/lib/native 44434862 1288 -r-xr-xr-x 1 jenkins users 1316074 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libhadoop.a 44434858 228 -r-xr-xr-x 1 jenkins users 229697 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libhdfs.so.0.0.0 44434861 572 -r-xr-xr-x 1 jenkins users 582360 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libhadooputils.a 44434866 1456 -r-xr-xr-x 1 jenkins users 1487204 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libhadooppipes.a 44434865 756 -r-xr-xr-x 1 jenkins users 773287 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libhadoop.so.1.0.0 44434864 360 -r-xr-xr-x 1 jenkins users 365604 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libhdfs.a 44434865 756 -r-xr-xr-x 1 jenkins users 773287 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libhadoop.so 44434863 20 -r-xr-xr-x 1 jenkins users 19848 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libsnappy.so.1 44434863 20 -r-xr-xr-x 1 jenkins users 19848 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libsnappy.so 44434858 228 -r-xr-xr-x 1 jenkins users 229697 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libhdfs.so 44434863 20 -r-xr-xr-x 1 jenkins users 19848 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libsnappy.so.1.1.4 44434882 4 -r-xr-xr-x 1 jenkins users 1366 Nov 29 10:21 ./mr-framework/hadoop/README.txt 44433877 4 drwxr-xr-x 4 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share 44433878 4 drwxr-xr-x 3 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/doc 44433879 4 drwxr-xr-x 6 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/doc/hadoop 44433891 4 drwxr-xr-x 9 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/hadoop 44434625 4 drwxr-xr-x 3 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/hadoop/kms 44434353 4 drwxr-xr-x 5 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/hadoop/mapreduce 44433892 4 drwxr-xr-x 5 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/hadoop/tools 44434761 4 drwxr-xr-x 7 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/hadoop/hdfs 44434522 4 drwxr-xr-x 6 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/hadoop/common 44434060 4 drwxr-xr-x 3 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/hadoop/httpfs 44434406 4 drwxr-xr-x 5 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/hadoop/yarn 44435343 4 -rwx------ 1 root root 763 Dec 15 11:16 ./default_container_executor.sh 44435207 220 -r-x------ 1 root root 224135 Dec 15 11:16 ./ant-contrib-1.0b3.jar 44435204 1704 -r-x------ 1 root root 1741888 Dec 15 11:16 ./kite-hadoop-compatibility-1.1.0.jar 44435288 1736 -r-x------ 1 root root 1777229 Dec 15 11:16 ./kite-data-hive-1.1.0.jar 44435303 264 -r-x------ 1 root root 266289 Dec 15 11:16 ./commons-jexl-2.1.1.jar 44435210 4 -r-x------ 1 root root 2615 Dec 15 11:16 ./tdgssconfig.jar 44435344 4 -rw-r--r-- 1 root root 16 Dec 15 11:16 ./.default_container_executor.sh.crc 44435341 4 -rwx------ 1 root root 709 Dec 15 11:16 ./default_container_executor_session.sh 44435216 1292 -r-x------ 1 root root 1322324 Dec 15 11:16 ./avro-1.8.0.jar 44435243 576 -r-x------ 1 root root 587380 Dec 15 11:16 ./snappy-java-1.1.1.6.jar 44435276 860 -r-x------ 1 root root 879155 Dec 15 11:16 ./parquet-column-1.6.0.jar 44435258 752 -r-x------ 1 root root 770013 Dec 15 11:16 ./jackson-mapper-asl-1.9.13.jar 44435201 36 -r-x------ 1 root root 35507 Dec 15 11:16 ./jackson-annotations-2.3.1.jar 44435231 1068 -r-x------ 1 root root 1093618 Dec 15 11:16 ./terajdbc4.jar 44435240 204 -r-x------ 1 root root 205028 Dec 15 11:16 ./parquet-hadoop-1.6.0.jar 44435219 2100 -r-x------ 1 root root 2149987 Dec 15 11:16 ./kite-data-core-1.1.0.jar 44435282 36 -r-x------ 1 root root 36427 Dec 15 11:16 ./ant-eclipse-1.0-jvm1.2.jar 44435237 60 -r-x------ 1 root root 60530 Dec 15 11:16 ./commons-logging-1.1.1.jar 44435270 192 -r-x------ 1 root root 195678 Dec 15 11:16 ./jackson-core-2.3.1.jar 44435255 100 -r-x------ 1 root root 99504 Dec 15 11:16 ./xz-1.5.jar 44435264 276 -r-x------ 1 root root 278936 Dec 15 11:16 ./parquet-encoding-1.6.0.jar 44435297 24 -r-x------ 1 root root 20992 Dec 15 11:16 ./parquet-common-1.6.0.jar 44435225 4980 -r-x------ 1 root root 5098776 Dec 15 11:16 ./teradata-connector-1.5.1-hadoop2.jar broken symlinks(find -L . -maxdepth 5 -type l -ls): End of LogType:directory.info LogType:launch_container.sh Log Upload Time:Thu Dec 15 11:16:28 -0800 2016 LogLength:32468 Log Contents: #!/bin/bash export HADOOP_CONF_DIR=${HADOOP_CONF_DIR:-"/appdata/hdp/2.5.3.0-37/hadoop/conf"} export MAX_APP_ATTEMPTS="2" export JAVA_HOME=${JAVA_HOME:-"/usr/java/current/"} export APP_SUBMIT_TIME_ENV="1481829367075" export NM_HOST="xxx.net" export HADOOP_CLASSPATH="$PWD:job.jar/job.jar:job.jar/classes/:job.jar/lib/*:$PWD/*:::/usr/hdp/2.5.3.0-37/sqoop/conf:/usr/hdp/current/zookeeper-server/conf::/usr/hdp/2.5.3.0-37/sqoop/lib/ant-contrib-1.0b3.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/ant-eclipse-1.0-jvm1.2.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/avro-1.8.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/avro-mapred-1.8.0-hadoop2.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/commons-codec-1.4.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/commons-compress-1.8.1.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/commons-io-1.4.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/commons-jexl-2.1.1.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/commons-lang3-3.4.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/commons-logging-1.1.1.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/hortonworks-teradata-connector-1.5.1.2.5.0.0-1245.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/hsqldb-1.8.0.10.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/jackson-annotations-2.3.1.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/jackson-core-2.3.1.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/jackson-databind-2.3.1.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/kite-data-core-1.1.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/kite-data-hive-1.1.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/kite-data-mapreduce-1.1.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/kite-hadoop-compatibility-1.1.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/opencsv-2.3.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/paranamer-2.7.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/parquet-avro-1.6.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/parquet-column-1.6.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/parquet-common-1.6.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/parquet-encoding-1.6.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/parquet-format-2.2.0-rc1.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/parquet-generator-1.6.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/parquet-hadoop-1.6.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/parquet-jackson-1.6.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/slf4j-api-1.7.7.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/snappy-java-1.1.1.6.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/tdgssconfig.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/teradata-connector-1.5.1-hadoop2.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/terajdbc4.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/xz-1.5.jar:/usr/hdp/current/hbase-master/conf:/usr/java/default/lib/tools.jar:/usr/hdp/current/hbase-master:/usr/hdp/current/hbase-master/lib/activation-1.1.jar:/usr/hdp/current/hbase-master/lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-master/lib/apacheds-i18n-2.0.0-M15.jar:/usr/hdp/current/hbase-master/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/usr/hdp/current/hbase-master/lib/api-asn1-api-1.0.0-M20.jar:/usr/hdp/current/hbase-master/lib/api-util-1.0.0-M20.jar:/usr/hdp/current/hbase-master/lib/asm-3.1.jar:/usr/hdp/current/hbase-master/lib/avro-1.7.4.jar:/usr/hdp/current/hbase-master/lib/azure-keyvault-core-0.8.0.jar:/usr/hdp/current/hbase-master/lib/azure-storage-4.2.0.jar:/usr/hdp/current/hbase-master/lib/commons-beanutils-1.7.0.jar:/usr/hdp/current/hbase-master/lib/commons-beanutils-core-1.8.0.jar:/usr/hdp/current/hbase-master/lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-master/lib/commons-codec-1.9.jar:/usr/hdp/current/hbase-master/lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-master/lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-master/lib/commons-configuration-1.6.jar:/usr/hdp/current/hbase-master/lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-master/lib/commons-digester-1.8.jar:/usr/hdp/current/hbase-master/lib/commons-el-1.0.jar:/usr/hdp/current/hbase-master/lib/commons-io-2.4.jar:/usr/hdp/current/hbase-master/lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-master/lib/commons-lang3-3.4.jar:/usr/hdp/current/hbase-master/lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-master/lib/commons-math-2.2.jar:/usr/hdp/current/hbase-master/lib/commons-math3-3.1.1.jar:/usr/hdp/current/hbase-master/lib/commons-net-3.1.jar:/usr/hdp/current/hbase-master/lib/curator-client-2.7.1.jar:/usr/hdp/current/hbase-master/lib/curator-framework-2.7.1.jar:/usr/hdp/current/hbase-master/lib/curator-recipes-2.7.1.jar:/usr/hdp/current/hbase-master/lib/disruptor-3.3.0.jar:/usr/hdp/current/hbase-master/lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-master/lib/gson-2.2.4.jar:/usr/hdp/current/hbase-master/lib/guava-12.0.1.jar:/usr/hdp/current/hbase-master/lib/guice-3.0.jar:/usr/hdp/current/hbase-master/lib/guice-servlet-3.0.jar:/usr/hdp/current/hbase-master/lib/hbase-annotations-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-annotations-1.1.2.2.5.3.0-37-tests.jar:/usr/hdp/current/hbase-master/lib/hbase-annotations.jar:/usr/hdp/current/hbase-master/lib/hbase-client-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-client.jar:/usr/hdp/current/hbase-master/lib/hbase-common-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-common-1.1.2.2.5.3.0-37-tests.jar:/usr/hdp/current/hbase-master/lib/hbase-common.jar:/usr/hdp/current/hbase-master/lib/hbase-examples-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-examples.jar:/usr/hdp/current/hbase-master/lib/hbase-hadoop2-compat-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-master/lib/hbase-hadoop-compat-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-master/lib/hbase-it-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-it-1.1.2.2.5.3.0-37-tests.jar:/usr/hdp/current/hbase-master/lib/hbase-it.jar:/usr/hdp/current/hbase-master/lib/hbase-prefix-tree-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-prefix-tree.jar:/usr/hdp/current/hbase-master/lib/hbase-procedure-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-procedure.jar:/usr/hdp/current/hbase-master/lib/hbase-protocol-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-protocol.jar:/usr/hdp/current/hbase-master/lib/hbase-resource-bundle-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-master/lib/hbase-rest-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-rest.jar:/usr/hdp/current/hbase-master/lib/hbase-rsgroup-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-rsgroup-1.1.2.2.5.3.0-37-tests.jar:/usr/hdp/current/hbase-master/lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-master/lib/hbase-server-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-server-1.1.2.2.5.3.0-37-tests.jar:/usr/hdp/current/hbase-master/lib/hbase-server.jar:/usr/hdp/current/hbase-master/lib/hbase-shell-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-shell.jar:/usr/hdp/current/hbase-master/lib/hbase-thrift-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-thrift.jar:/usr/hdp/current/hbase-master/lib/htrace-core-3.1.0-incubating.jar:/usr/hdp/current/hbase-master/lib/jackson-core-2.6.0.jar:/usr/hdp/current/hbase-master/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-master/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/current/hbase-master/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-master/lib/jackson-xc-1.9.13.jar:/usr/hdp/current/hbase-master/lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-master/lib/jasper-compiler-5.5.23.jar:/usr/hdp/current/hbase-master/lib/jasper-runtime-5.5.23.jar:/usr/hdp/current/hbase-master/lib/javax.inject-1.jar:/usr/hdp/current/hbase-master/lib/java-xmlbuilder-0.4.jar:/usr/hdp/current/hbase-master/lib/jaxb-api-2.2.2.jar:/usr/hdp/current/hbase-master/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-master/lib/jcip-annotations-1.0.jar:/usr/hdp/current/hbase-master/lib/jcodings-1.0.8.jar:/usr/hdp/current/hbase-master/lib/jersey-client-1.9.jar:/usr/hdp/current/hbase-master/lib/jersey-core-1.9.jar:/usr/hdp/current/hbase-master/lib/jersey-guice-1.9.jar:/usr/hdp/current/hbase-master/lib/jersey-json-1.9.jar:/usr/hdp/current/hbase-master/lib/jersey-server-1.9.jar:/usr/hdp/current/hbase-master/lib/jets3t-0.9.0.jar:/usr/hdp/current/hbase-master/lib/jettison-1.3.3.jar:/usr/hdp/current/hbase-master/lib/jetty-6.1.26.hwx.jar:/usr/hdp/current/hbase-master/lib/jetty-sslengine-6.1.26.hwx.jar:/usr/hdp/current/hbase-master/lib/jetty-util-6.1.26.hwx.jar:/usr/hdp/current/hbase-master/lib/joni-2.1.2.jar:/usr/hdp/current/hbase-master/lib/jruby-complete-1.6.8.jar:/usr/hdp/current/hbase-master/lib/jsch-0.1.42.jar:/usr/hdp/current/hbase-master/lib/json-smart-1.1.1.jar:/usr/hdp/current/hbase-master/lib/jsp-2.1-6.1.14.jar:/usr/hdp/current/hbase-master/lib/jsp-api-2.1-6.1.14.jar:/usr/hdp/current/hbase-master/lib/jsr305-1.3.9.jar:/usr/hdp/current/hbase-master/lib/junit-4.12.jar:/usr/hdp/current/hbase-master/lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-master/lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-master/lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-master/lib/metrics-core-2.2.0.jar:/usr/hdp/current/hbase-master/lib/netty-3.2.4.Final.jar:/usr/hdp/current/hbase-master/lib/netty-all-4.0.23.Final.jar:/usr/hdp/current/hbase-master/lib/nimbus-jose-jwt-3.9.jar:/usr/hdp/current/hbase-master/lib/ojdbc6.jar:/usr/hdp/current/hbase-master/lib/okhttp-2.4.0.jar:/usr/hdp/current/hbase-master/lib/okio-1.4.0.jar:/usr/hdp/current/hbase-master/lib/paranamer-2.3.jar:/usr/hdp/current/hbase-master/lib/phoenix-server.jar:/usr/hdp/current/hbase-master/lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-master/lib/ranger-hbase-plugin-shim-0.6.0.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/ranger-plugin-classloader-0.6.0.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/servlet-api-2.5-6.1.14.jar:/usr/hdp/current/hbase-master/lib/servlet-api-2.5.jar:/usr/hdp/current/hbase-master/lib/slf4j-api-1.7.7.jar:/usr/hdp/current/hbase-master/lib/snappy-java-1.0.4.1.jar:/usr/hdp/current/hbase-master/lib/spymemcached-2.11.6.jar:/usr/hdp/current/hbase-master/lib/xercesImpl-2.9.1.jar:/usr/hdp/current/hbase-master/lib/xml-apis-1.3.04.jar:/usr/hdp/current/hbase-master/lib/xmlenc-0.52.jar:/usr/hdp/current/hbase-master/lib/xz-1.0.jar:/usr/hdp/current/hbase-master/lib/zookeeper.jar:/appdata/hdp/2.5.3.0-37/hadoop/conf:/usr/hdp/2.5.3.0-37/hadoop/lib/*:/usr/hdp/2.5.3.0-37/hadoop/.//*:/usr/hdp/2.5.3.0-37/hadoop-hdfs/./:/usr/hdp/2.5.3.0-37/hadoop-hdfs/lib/*:/usr/hdp/2.5.3.0-37/hadoop-hdfs/.//*:/usr/hdp/2.5.3.0-37/hadoop-yarn/lib/*:/usr/hdp/2.5.3.0-37/hadoop-yarn/.//*:/usr/hdp/2.5.3.0-37/hadoop-mapreduce/lib/*:/usr/hdp/2.5.3.0-37/hadoop-mapreduce/.//*::/usr/share/java/mysql-connector-java.jar:/usr/lib/hadoop-mapreduce/*:/usr/hdp/2.5.3.0-37/tez/*:/usr/hdp/2.5.3.0-37/tez/lib/*:/usr/hdp/2.5.3.0-37/tez/conf:/usr/hdp/2.5.3.0-37/hadoop/conf:/usr/hdp/2.5.3.0-37/hadoop/*:/usr/hdp/2.5.3.0-37/hadoop/lib/*:/usr/hdp/current/zookeeper-server/*:://hadoop/conf:/usr/hdp/2.5.3.0-37/atlas/hook/hive/*:/usr/hdp/2.5.3.0-37/hive/lib/accumulo-core-1.7.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/accumulo-fate-1.7.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/accumulo-start-1.7.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/accumulo-trace-1.7.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/activation-1.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/ant-1.9.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/ant-launcher-1.9.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/antlr-2.7.7.jar:/usr/hdp/2.5.3.0-37/hive/lib/antlr-runtime-3.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/apache-log4j-extras-1.2.17.jar:/usr/hdp/2.5.3.0-37/hive/lib/asm-commons-3.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/asm-tree-3.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/avatica-1.8.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/avatica-metrics-1.8.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/avro-1.7.5.jar:/usr/hdp/2.5.3.0-37/hive/lib/bonecp-0.8.0.RELEASE.jar:/usr/hdp/2.5.3.0-37/hive/lib/calcite-core-1.2.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/calcite-linq4j-1.2.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-cli-1.2.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-codec-1.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-collections-3.2.2.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-compiler-2.7.6.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-compress-1.4.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-dbcp-1.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-httpclient-3.0.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-io-2.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-lang-2.6.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-logging-1.1.3.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-math-2.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-pool-1.5.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-vfs2-2.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/curator-client-2.6.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/curator-framework-2.6.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/curator-recipes-2.6.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/datanucleus-api-jdo-4.2.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/datanucleus-core-4.1.6.jar:/usr/hdp/2.5.3.0-37/hive/lib/datanucleus-rdbms-4.1.7.jar:/usr/hdp/2.5.3.0-37/hive/lib/derby-10.10.2.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/dropwizard-metrics-hadoop-metrics2-reporter-0.1.2.jar:/usr/hdp/2.5.3.0-37/hive/lib/eigenbase-properties-1.1.5.jar:/usr/hdp/2.5.3.0-37/hive/lib/geronimo-annotation_1.0_spec-1.1.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/geronimo-jaspic_1.0_spec-1.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/geronimo-jta_1.1_spec-1.1.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/groovy-all-2.4.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/guava-14.0.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/HikariCP-1.3.9.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-accumulo-handler-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-accumulo-handler.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-ant-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-ant.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-beeline-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-beeline.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-cli-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-cli.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-common-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-common.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-contrib-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-contrib.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-exec-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-exec.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-hbase-handler-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-hbase-handler.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-hwi-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-hwi.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-jdbc-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-jdbc-1.2.1000.2.5.3.0-37-standalone.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-jdbc.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-metastore-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-metastore.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-serde-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-serde.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-service-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-service.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-shims-0.20S-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-shims-0.23-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-shims-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-shims-common-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-shims-common.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-shims.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-shims-scheduler-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-shims-scheduler.jar:/usr/hdp/2.5.3.0-37/hive/lib/htrace-core-3.1.0-incubating.jar:/usr/hdp/2.5.3.0-37/hive/lib/httpclient-4.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/httpcore-4.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/ivy-2.4.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/jackson-annotations-2.4.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/jackson-core-2.4.2.jar:/usr/hdp/2.5.3.0-37/hive/lib/jackson-databind-2.4.2.jar:/usr/hdp/2.5.3.0-37/hive/lib/janino-2.7.6.jar:/usr/hdp/2.5.3.0-37/hive/lib/javassist-3.18.1-GA.jar:/usr/hdp/2.5.3.0-37/hive/lib/javax.jdo-3.2.0-m3.jar:/usr/hdp/2.5.3.0-37/hive/lib/jcommander-1.32.jar:/usr/hdp/2.5.3.0-37/hive/lib/jdo-api-3.0.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/jetty-all-7.6.0.v20120127.jar:/usr/hdp/2.5.3.0-37/hive/lib/jetty-all-server-7.6.0.v20120127.jar:/usr/hdp/2.5.3.0-37/hive/lib/jline-2.12.jar:/usr/hdp/2.5.3.0-37/hive/lib/joda-time-2.8.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/jpam-1.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/json-20090211.jar:/usr/hdp/2.5.3.0-37/hive/lib/jsr305-3.0.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/jta-1.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/libfb303-0.9.3.jar:/usr/hdp/2.5.3.0-37/hive/lib/libthrift-0.9.3.jar:/usr/hdp/2.5.3.0-37/hive/lib/log4j-1.2.16.jar:/usr/hdp/2.5.3.0-37/hive/lib/mail-1.4.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/maven-scm-api-1.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/maven-scm-provider-svn-commons-1.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/maven-scm-provider-svnexe-1.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/metrics-core-3.1.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/metrics-json-3.1.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/metrics-jvm-3.1.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/mysql-connector-java.jar:/usr/hdp/2.5.3.0-37/hive/lib/netty-3.7.0.Final.jar:/usr/hdp/2.5.3.0-37/hive/lib/ojdbc6.jar:/usr/hdp/2.5.3.0-37/hive/lib/opencsv-2.3.jar:/usr/hdp/2.5.3.0-37/hive/lib/oro-2.0.8.jar:/usr/hdp/2.5.3.0-37/hive/lib/paranamer-2.3.jar:/usr/hdp/2.5.3.0-37/hive/lib/parquet-hadoop-bundle-1.8.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/pentaho-aggdesigner-algorithm-5.1.5-jhyde.jar:/usr/hdp/2.5.3.0-37/hive/lib/plexus-utils-1.5.6.jar:/usr/hdp/2.5.3.0-37/hive/lib/protobuf-java-2.5.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/ranger-hive-plugin-shim-0.6.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/ranger-plugin-classloader-0.6.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/regexp-1.3.jar:/usr/hdp/2.5.3.0-37/hive/lib/servlet-api-2.5.jar:/usr/hdp/2.5.3.0-37/hive/lib/snappy-java-1.0.5.jar:/usr/hdp/2.5.3.0-37/hive/lib/ST4-4.0.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/stax-api-1.0.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/stringtemplate-3.2.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/super-csv-2.2.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/transaction-api-1.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/velocity-1.5.jar:/usr/hdp/2.5.3.0-37/hive/lib/xz-1.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/zookeeper-3.4.6.2.5.3.0-37.jar::/appdata/hdp/2.5.3.0-37/hive-hcatalog/libexec/../share/hcatalog/hive-hcatalog-core-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/conf::/usr/hdp/current/hbase-master/conf:/usr/hdp/2.5.3.0-37/sqoop/sqoop-1.4.6.2.5.3.0-37.jar::/usr/share/java/mysql-connector-java.jar:/usr/lib/hadoop-mapreduce/*:/usr/hdp/2.5.3.0-37/tez/*:/usr/hdp/2.5.3.0-37/tez/lib/*:/usr/hdp/2.5.3.0-37/tez/conf" export LD_LIBRARY_PATH="$PWD:$HADOOP_COMMON_HOME/lib/native" export LOGNAME="root" export JVM_PID="$$" export PWD="/usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012/container_1481156388370_0012_01_000001" export LOCAL_DIRS="/usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012" export APPLICATION_WEB_PROXY_BASE="/proxy/application_1481156388370_0012" export SHELL="/bin/bash" export NM_HTTP_PORT="8042" export LOG_DIRS="/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000001" export NM_AUX_SERVICE_mapreduce_shuffle="AAAfkQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA= " export NM_PORT="45454" export USER="root" export HADOOP_YARN_HOME=${HADOOP_YARN_HOME:-"/usr/hdp/2.5.3.0-37/hadoop-yarn"} export CLASSPATH="$PWD:$PWD/mr-framework/hadoop/share/hadoop/mapreduce/*:$PWD/mr-framework/hadoop/share/hadoop/mapreduce/lib/*:$PWD/mr-framework/hadoop/share/hadoop/common/*:$PWD/mr-framework/hadoop/share/hadoop/common/lib/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/lib/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/lib/*:/usr/hdp/2.5.3.0-37/hadoop/lib/hadoop-lzo-0.6.0.2.5.3.0-37.jar:/etc/hadoop/conf/secure:job.jar/job.jar:job.jar/classes/:job.jar/lib/*:$PWD/*" export HADOOP_TOKEN_FILE_LOCATION="/usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012/container_1481156388370_0012_01_000001/container_tokens" export LOCAL_USER_DIRS="/usr/local/middleware/hadoop/yarn/local/usercache/root/" export HOME="/home/" export CONTAINER_ID="container_1481156388370_0012_01_000001" export MALLOC_ARENA_MAX="4" ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/188/kite-data-hive-1.1.0.jar" "kite-data-hive-1.1.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/187/commons-lang3-3.4.jar" "commons-lang3-3.4.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/174/slf4j-api-1.7.7.jar" "slf4j-api-1.7.7.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/166/opencsv-2.3.jar" "opencsv-2.3.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/172/parquet-hadoop-1.6.0.jar" "parquet-hadoop-1.6.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/176/hsqldb-1.8.0.10.jar" "hsqldb-1.8.0.10.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/189/commons-io-1.4.jar" "commons-io-1.4.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/192/hortonworks-teradata-connector-1.5.1.2.5.0.0-1245.jar" "hortonworks-teradata-connector-1.5.1.2.5.0.0-1245.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi mkdir -p jobSubmitDir hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012/filecache/12/job.split" "jobSubmitDir/job.split" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/180/parquet-encoding-1.6.0.jar" "parquet-encoding-1.6.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/182/jackson-core-2.3.1.jar" "jackson-core-2.3.1.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/191/parquet-common-1.6.0.jar" "parquet-common-1.6.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/163/parquet-avro-1.6.0.jar" "parquet-avro-1.6.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012/filecache/10/job.jar" "job.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/161/ant-contrib-1.0b3.jar" "ant-contrib-1.0b3.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/178/jackson-mapper-asl-1.9.13.jar" "jackson-mapper-asl-1.9.13.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/183/paranamer-2.7.jar" "paranamer-2.7.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/167/teradata-connector-1.5.1-hadoop2.jar" "teradata-connector-1.5.1-hadoop2.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/194/avro-mapred-1.8.0-hadoop2.jar" "avro-mapred-1.8.0-hadoop2.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/185/jackson-databind-2.3.1.jar" "jackson-databind-2.3.1.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/193/commons-jexl-2.1.1.jar" "commons-jexl-2.1.1.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/168/parquet-jackson-1.6.0.jar" "parquet-jackson-1.6.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/181/kite-data-mapreduce-1.1.0.jar" "kite-data-mapreduce-1.1.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012/filecache/11/job.xml" "job.xml" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/162/tdgssconfig.jar" "tdgssconfig.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/filecache/11/mapreduce.tar.gz" "mr-framework" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/164/avro-1.8.0.jar" "avro-1.8.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/171/commons-logging-1.1.1.jar" "commons-logging-1.1.1.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/175/commons-codec-1.4.jar" "commons-codec-1.4.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/186/ant-eclipse-1.0-jvm1.2.jar" "ant-eclipse-1.0-jvm1.2.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/160/kite-hadoop-compatibility-1.1.0.jar" "kite-hadoop-compatibility-1.1.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/158/parquet-generator-1.6.0.jar" "parquet-generator-1.6.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi mkdir -p jobSubmitDir hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012/filecache/13/job.splitmetainfo" "jobSubmitDir/job.splitmetainfo" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/169/terajdbc4.jar" "terajdbc4.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/173/snappy-java-1.1.1.6.jar" "snappy-java-1.1.1.6.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/190/parquet-format-2.2.0-rc1.jar" "parquet-format-2.2.0-rc1.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/177/xz-1.5.jar" "xz-1.5.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/165/kite-data-core-1.1.0.jar" "kite-data-core-1.1.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/179/commons-compress-1.8.1.jar" "commons-compress-1.8.1.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/159/jackson-annotations-2.3.1.jar" "jackson-annotations-2.3.1.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/184/parquet-column-1.6.0.jar" "parquet-column-1.6.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/170/jackson-core-asl-1.9.13.jar" "jackson-core-asl-1.9.13.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi # Creating copy of launch script cp "launch_container.sh" "/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000001/launch_container.sh" chmod 640 "/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000001/launch_container.sh" # Determining directory contents echo "ls -l:" 1>"/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000001/directory.info" ls -l 1>>"/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000001/directory.info" echo "find -L . -maxdepth 5 -ls:" 1>>"/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000001/directory.info" find -L . -maxdepth 5 -ls 1>>"/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000001/directory.info" echo "broken symlinks(find -L . -maxdepth 5 -type l -ls):" 1>>"/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000001/directory.info" find -L . -maxdepth 5 -type l -ls 1>>"/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000001/directory.info" exec /bin/bash -c "$JAVA_HOME/bin/java -Djava.io.tmpdir=$PWD/tmp -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000001 -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Dhadoop.root.logfile=syslog -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1>/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000001/stdout 2>/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000001/stderr " hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi End of LogType:launch_container.sh LogType:stderr Log Upload Time:Thu Dec 15 11:16:28 -0800 2016 LogLength:1710 Log Contents: Dec 15, 2016 11:16:10 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register INFO: Registering org.apache.hadoop.mapreduce.v2.app.webapp.JAXBContextResolver as a provider class Dec 15, 2016 11:16:10 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class Dec 15, 2016 11:16:10 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register INFO: Registering org.apache.hadoop.mapreduce.v2.app.webapp.AMWebServices as a root resource class Dec 15, 2016 11:16:10 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' Dec 15, 2016 11:16:10 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider INFO: Binding org.apache.hadoop.mapreduce.v2.app.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" Dec 15, 2016 11:16:10 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" Dec 15, 2016 11:16:11 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider INFO: Binding org.apache.hadoop.mapreduce.v2.app.webapp.AMWebServices to GuiceManagedComponentProvider with the scope "PerRequest" log4j:WARN No appenders could be found for logger (org.apache.hadoop.ipc.Server). log4j:WARN Please initialize the log4j system properly. log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info. End of LogType:stderr LogType:stdout Log Upload Time:Thu Dec 15 11:16:28 -0800 2016 LogLength:0 Log Contents: End of LogType:stdout LogType:syslog Log Upload Time:Thu Dec 15 11:16:28 -0800 2016 LogLength:47376 Log Contents: 2016-12-15 11:16:08,817 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created MRAppMaster for application appattempt_1481156388370_0012_000001 2016-12-15 11:16:08,943 WARN [main] org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2016-12-15 11:16:08,968 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Executing with tokens: 2016-12-15 11:16:08,968 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind: YARN_AM_RM_TOKEN, Service: , Ident: (appAttemptId { application_id { id: 12 cluster_timestamp: 1481156388370 } attemptId: 1 } keyId: 980752989) 2016-12-15 11:16:09,156 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Using mapred newApiCommitter. 2016-12-15 11:16:09,157 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter set in config null 2016-12-15 11:16:09,189 INFO [main] org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: File Output Committer Algorithm version is 1 2016-12-15 11:16:09,189 INFO [main] org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false 2016-12-15 11:16:09,657 WARN [main] org.apache.hadoop.hdfs.shortcircuit.DomainSocketFactory: The short-circuit local reads feature cannot be used because libhadoop cannot be loaded. 2016-12-15 11:16:09,665 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter is org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter 2016-12-15 11:16:09,775 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.jobhistory.EventType for class org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler 2016-12-15 11:16:09,775 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.JobEventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobEventDispatcher 2016-12-15 11:16:09,776 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.TaskEventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskEventDispatcher 2016-12-15 11:16:09,776 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.TaskAttemptEventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskAttemptEventDispatcher 2016-12-15 11:16:09,777 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventType for class org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler 2016-12-15 11:16:09,777 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.speculate.Speculator$EventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$SpeculatorEventDispatcher 2016-12-15 11:16:09,778 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.rm.ContainerAllocator$EventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter 2016-12-15 11:16:09,778 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncher$EventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerLauncherRouter 2016-12-15 11:16:09,801 INFO [main] org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file system is set solely by core-default.xml therefore - ignoring 2016-12-15 11:16:09,821 INFO [main] org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file system is set solely by core-default.xml therefore - ignoring 2016-12-15 11:16:09,843 INFO [main] org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file system is set solely by core-default.xml therefore - ignoring 2016-12-15 11:16:09,856 INFO [main] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Emitting job history data to the timeline server is not enabled 2016-12-15 11:16:09,883 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.JobFinishEvent$Type for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler 2016-12-15 11:16:09,924 WARN [main] org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate configuration: tried hadoop-metrics2-mrappmaster.properties,hadoop-metrics2.properties 2016-12-15 11:16:09,990 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s). 2016-12-15 11:16:09,991 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MRAppMaster metrics system started 2016-12-15 11:16:09,996 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Adding job token for job_1481156388370_0012 to jobTokenSecretManager 2016-12-15 11:16:10,093 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Not uberizing job_1481156388370_0012 because: not enabled; 2016-12-15 11:16:10,103 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Input size for job job_1481156388370_0012 = 4. Number of splits = 4 2016-12-15 11:16:10,103 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Number of reduces for job job_1481156388370_0012 = 0 2016-12-15 11:16:10,103 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1481156388370_0012Job Transitioned from NEW to INITED 2016-12-15 11:16:10,104 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: MRAppMaster launching normal, non-uberized, multi-container job job_1481156388370_0012. 2016-12-15 11:16:10,123 INFO [main] org.apache.hadoop.ipc.CallQueueManager: Using callQueue: class java.util.concurrent.LinkedBlockingQueue scheduler: class org.apache.hadoop.ipc.DefaultRpcScheduler 2016-12-15 11:16:10,138 INFO [Socket Reader #1 for port 37856] org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 37856 2016-12-15 11:16:10,172 INFO [main] org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.mapreduce.v2.api.MRClientProtocolPB to the server 2016-12-15 11:16:10,172 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: IPC Server Responder: starting 2016-12-15 11:16:10,172 INFO [IPC Server listener on 37856] org.apache.hadoop.ipc.Server: IPC Server listener on 37856: starting 2016-12-15 11:16:10,173 INFO [main] org.apache.hadoop.mapreduce.v2.app.client.MRClientService: Instantiated MRClientService at xxx.net/10.236.211.27:37856 2016-12-15 11:16:10,233 INFO [main] org.mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2016-12-15 11:16:10,239 INFO [main] org.apache.hadoop.security.authentication.server.AuthenticationFilter: Unable to initialize FileSignerSecretProvider, falling back to use random secrets. 2016-12-15 11:16:10,242 INFO [main] org.apache.hadoop.http.HttpRequestLog: Http request log for http.requests.mapreduce is not defined 2016-12-15 11:16:10,246 INFO [main] org.apache.hadoop.http.HttpServer2: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter) 2016-12-15 11:16:10,251 INFO [main] org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to context mapreduce 2016-12-15 11:16:10,251 INFO [main] org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to context static 2016-12-15 11:16:10,253 INFO [main] org.apache.hadoop.http.HttpServer2: adding path spec: /mapreduce/* 2016-12-15 11:16:10,253 INFO [main] org.apache.hadoop.http.HttpServer2: adding path spec: /ws/* 2016-12-15 11:16:10,429 INFO [main] org.apache.hadoop.yarn.webapp.WebApps: Registered webapp guice modules 2016-12-15 11:16:10,430 INFO [main] org.apache.hadoop.http.HttpServer2: Jetty bound to port 44974 2016-12-15 11:16:10,430 INFO [main] org.mortbay.log: jetty-6.1.26.hwx 2016-12-15 11:16:10,452 INFO [main] org.mortbay.log: Extract jar:file:/appdata/middleware/hadoop/yarn/local/filecache/11/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.7.3.2.5.3.0-37.jar!/webapps/mapreduce to /usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012/container_1481156388370_0012_01_000001/tmp/Jetty_0_0_0_0_44974_mapreduce____.b0s8v1/webapp 2016-12-15 11:16:11,234 INFO [main] org.mortbay.log: Started HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:44974 2016-12-15 11:16:11,234 INFO [main] org.apache.hadoop.yarn.webapp.WebApps: Web app mapreduce started at 44974 2016-12-15 11:16:11,238 INFO [main] org.apache.hadoop.ipc.CallQueueManager: Using callQueue: class java.util.concurrent.LinkedBlockingQueue scheduler: class org.apache.hadoop.ipc.DefaultRpcScheduler 2016-12-15 11:16:11,238 INFO [Socket Reader #1 for port 36415] org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 36415 2016-12-15 11:16:11,240 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: IPC Server Responder: starting 2016-12-15 11:16:11,241 INFO [IPC Server listener on 36415] org.apache.hadoop.ipc.Server: IPC Server listener on 36415: starting 2016-12-15 11:16:11,254 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: nodeBlacklistingEnabled:true 2016-12-15 11:16:11,255 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: maxTaskFailuresPerNode is 3 2016-12-15 11:16:11,255 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: blacklistDisablePercent is 33 2016-12-15 11:16:11,281 INFO [main] org.apache.hadoop.yarn.client.RMProxy: Connecting to ResourceManager at xxx.net/10.236.211.27:8030 2016-12-15 11:16:11,344 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: maxContainerCapability: 2016-12-15 11:16:11,344 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: queue: default 2016-12-15 11:16:11,346 INFO [main] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Upper limit on the thread pool size is 500 2016-12-15 11:16:11,346 INFO [main] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: The thread pool initial size is 10 2016-12-15 11:16:11,348 INFO [main] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: yarn.client.max-cached-nodemanagers-proxies : 0 2016-12-15 11:16:11,351 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1481156388370_0012Job Transitioned from INITED to SETUP 2016-12-15 11:16:11,352 INFO [CommitterEvent Processor #0] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: JOB_SETUP 2016-12-15 11:16:11,358 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1481156388370_0012Job Transitioned from SETUP to RUNNING 2016-12-15 11:16:11,366 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved xxx.net to /default-rack 2016-12-15 11:16:11,368 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1481156388370_0012_m_000000 Task Transitioned from NEW to SCHEDULED 2016-12-15 11:16:11,368 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved xxx.net to /default-rack 2016-12-15 11:16:11,368 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1481156388370_0012_m_000001 Task Transitioned from NEW to SCHEDULED 2016-12-15 11:16:11,368 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved xxx.net to /default-rack 2016-12-15 11:16:11,368 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1481156388370_0012_m_000002 Task Transitioned from NEW to SCHEDULED 2016-12-15 11:16:11,368 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved xxx.net to /default-rack 2016-12-15 11:16:11,369 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1481156388370_0012_m_000003 Task Transitioned from NEW to SCHEDULED 2016-12-15 11:16:11,369 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1481156388370_0012_m_000000_0 TaskAttempt Transitioned from NEW to UNASSIGNED 2016-12-15 11:16:11,369 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1481156388370_0012_m_000001_0 TaskAttempt Transitioned from NEW to UNASSIGNED 2016-12-15 11:16:11,369 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1481156388370_0012_m_000002_0 TaskAttempt Transitioned from NEW to UNASSIGNED 2016-12-15 11:16:11,369 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1481156388370_0012_m_000003_0 TaskAttempt Transitioned from NEW to UNASSIGNED 2016-12-15 11:16:11,370 INFO [Thread-52] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: mapResourceRequest: 2016-12-15 11:16:11,438 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Event Writer setup for JobId: job_1481156388370_0012, File: hdfs://xxx.net:8020/user/root/.staging/job_1481156388370_0012/job_1481156388370_0012_1.jhist 2016-12-15 11:16:12,345 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before Scheduling: PendingReds:0 ScheduledMaps:4 ScheduledReds:0 AssignedMaps:0 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:0 ContRel:0 HostLocal:0 RackLocal:0 2016-12-15 11:16:12,368 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1481156388370_0012: ask=3 release= 0 newContainers=0 finishedContainers=0 resourcelimit= knownNMs=1 2016-12-15 11:16:13,378 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got allocated containers 4 2016-12-15 11:16:13,379 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container container_1481156388370_0012_01_000002 to attempt_1481156388370_0012_m_000000_0 2016-12-15 11:16:13,380 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container container_1481156388370_0012_01_000003 to attempt_1481156388370_0012_m_000001_0 2016-12-15 11:16:13,380 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container container_1481156388370_0012_01_000004 to attempt_1481156388370_0012_m_000002_0 2016-12-15 11:16:13,380 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container container_1481156388370_0012_01_000005 to attempt_1481156388370_0012_m_000003_0 2016-12-15 11:16:13,380 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:4 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:4 ContRel:0 HostLocal:4 RackLocal:0 2016-12-15 11:16:13,406 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved xxx.net to /default-rack 2016-12-15 11:16:13,416 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The job-jar file on the remote FS is hdfs://xxx.net:8020/user/root/.staging/job_1481156388370_0012/job.jar 2016-12-15 11:16:13,418 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The job-conf file on the remote FS is /user/root/.staging/job_1481156388370_0012/job.xml 2016-12-15 11:16:13,439 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Adding #0 tokens and #3 secret keys for NM use for launching container 2016-12-15 11:16:13,439 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Size of containertokens_dob is 1 2016-12-15 11:16:13,440 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Putting shuffle token in serviceData 2016-12-15 11:16:13,523 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1481156388370_0012_m_000000_0 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED 2016-12-15 11:16:13,524 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved xxx.net to /default-rack 2016-12-15 11:16:13,525 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1481156388370_0012_m_000001_0 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED 2016-12-15 11:16:13,525 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved xxx.net to /default-rack 2016-12-15 11:16:13,525 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1481156388370_0012_m_000002_0 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED 2016-12-15 11:16:13,525 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved xxx.net to /default-rack 2016-12-15 11:16:13,526 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1481156388370_0012_m_000003_0 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED 2016-12-15 11:16:13,527 INFO [ContainerLauncher #0] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_1481156388370_0012_01_000002 taskAttempt attempt_1481156388370_0012_m_000000_0 2016-12-15 11:16:13,527 INFO [ContainerLauncher #1] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_1481156388370_0012_01_000003 taskAttempt attempt_1481156388370_0012_m_000001_0 2016-12-15 11:16:13,527 INFO [ContainerLauncher #2] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_1481156388370_0012_01_000004 taskAttempt attempt_1481156388370_0012_m_000002_0 2016-12-15 11:16:13,527 INFO [ContainerLauncher #3] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_1481156388370_0012_01_000005 taskAttempt attempt_1481156388370_0012_m_000003_0 2016-12-15 11:16:13,529 INFO [ContainerLauncher #0] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching attempt_1481156388370_0012_m_000000_0 2016-12-15 11:16:13,529 INFO [ContainerLauncher #3] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching attempt_1481156388370_0012_m_000003_0 2016-12-15 11:16:13,529 INFO [ContainerLauncher #2] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching attempt_1481156388370_0012_m_000002_0 2016-12-15 11:16:13,529 INFO [ContainerLauncher #1] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching attempt_1481156388370_0012_m_000001_0 2016-12-15 11:16:13,529 INFO [ContainerLauncher #0] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : xxx.net:45454 2016-12-15 11:16:13,543 INFO [ContainerLauncher #1] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : xxx.net:45454 2016-12-15 11:16:13,544 INFO [ContainerLauncher #2] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : xxx.net:45454 2016-12-15 11:16:13,545 INFO [ContainerLauncher #3] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : xxx.net:45454 2016-12-15 11:16:13,584 INFO [ContainerLauncher #2] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port returned by ContainerManager for attempt_1481156388370_0012_m_000002_0 : 8081 2016-12-15 11:16:13,584 INFO [ContainerLauncher #3] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port returned by ContainerManager for attempt_1481156388370_0012_m_000003_0 : 8081 2016-12-15 11:16:13,584 INFO [ContainerLauncher #1] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port returned by ContainerManager for attempt_1481156388370_0012_m_000001_0 : 8081 2016-12-15 11:16:13,584 INFO [ContainerLauncher #0] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port returned by ContainerManager for attempt_1481156388370_0012_m_000000_0 : 8081 2016-12-15 11:16:13,585 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1481156388370_0012_m_000002_0] using containerId: [container_1481156388370_0012_01_000004 on NM: [xxx.net:45454] 2016-12-15 11:16:13,587 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1481156388370_0012_m_000002_0 TaskAttempt Transitioned from ASSIGNED to RUNNING 2016-12-15 11:16:13,587 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1481156388370_0012_m_000000_0] using containerId: [container_1481156388370_0012_01_000002 on NM: [xxx.net:45454] 2016-12-15 11:16:13,587 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1481156388370_0012_m_000000_0 TaskAttempt Transitioned from ASSIGNED to RUNNING 2016-12-15 11:16:13,587 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1481156388370_0012_m_000001_0] using containerId: [container_1481156388370_0012_01_000003 on NM: [xxx.net:45454] 2016-12-15 11:16:13,587 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1481156388370_0012_m_000001_0 TaskAttempt Transitioned from ASSIGNED to RUNNING 2016-12-15 11:16:13,587 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1481156388370_0012_m_000003_0] using containerId: [container_1481156388370_0012_01_000005 on NM: [xxx.net:45454] 2016-12-15 11:16:13,588 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1481156388370_0012_m_000003_0 TaskAttempt Transitioned from ASSIGNED to RUNNING 2016-12-15 11:16:13,588 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1481156388370_0012_m_000002 Task Transitioned from SCHEDULED to RUNNING 2016-12-15 11:16:13,588 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1481156388370_0012_m_000000 Task Transitioned from SCHEDULED to RUNNING 2016-12-15 11:16:13,588 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1481156388370_0012_m_000001 Task Transitioned from SCHEDULED to RUNNING 2016-12-15 11:16:13,588 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1481156388370_0012_m_000003 Task Transitioned from SCHEDULED to RUNNING 2016-12-15 11:16:14,383 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1481156388370_0012: ask=3 release= 0 newContainers=0 finishedContainers=0 resourcelimit= knownNMs=1 2016-12-15 11:16:14,726 INFO [Socket Reader #1 for port 36415] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1481156388370_0012 (auth:SIMPLE) 2016-12-15 11:16:14,741 INFO [IPC Server handler 2 on 36415] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : jvm_1481156388370_0012_m_000004 asked for a task 2016-12-15 11:16:14,742 INFO [IPC Server handler 2 on 36415] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: jvm_1481156388370_0012_m_000004 given task: attempt_1481156388370_0012_m_000002_0 2016-12-15 11:16:14,763 INFO [Socket Reader #1 for port 36415] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1481156388370_0012 (auth:SIMPLE) 2016-12-15 11:16:14,774 INFO [IPC Server handler 1 on 36415] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : jvm_1481156388370_0012_m_000002 asked for a task 2016-12-15 11:16:14,774 INFO [IPC Server handler 1 on 36415] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: jvm_1481156388370_0012_m_000002 given task: attempt_1481156388370_0012_m_000000_0 2016-12-15 11:16:14,794 INFO [Socket Reader #1 for port 36415] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1481156388370_0012 (auth:SIMPLE) 2016-12-15 11:16:14,803 INFO [IPC Server handler 14 on 36415] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : jvm_1481156388370_0012_m_000003 asked for a task 2016-12-15 11:16:14,803 INFO [IPC Server handler 14 on 36415] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: jvm_1481156388370_0012_m_000003 given task: attempt_1481156388370_0012_m_000001_0 2016-12-15 11:16:14,814 INFO [Socket Reader #1 for port 36415] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1481156388370_0012 (auth:SIMPLE) 2016-12-15 11:16:14,824 INFO [IPC Server handler 6 on 36415] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : jvm_1481156388370_0012_m_000005 asked for a task 2016-12-15 11:16:14,824 INFO [IPC Server handler 6 on 36415] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: jvm_1481156388370_0012_m_000005 given task: attempt_1481156388370_0012_m_000003_0 2016-12-15 11:16:19,037 INFO [IPC Server handler 19 on 36415] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1481156388370_0012_m_000003_0 is : 0.0 2016-12-15 11:16:19,087 INFO [IPC Server handler 9 on 36415] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit-pending state update from attempt_1481156388370_0012_m_000003_0 2016-12-15 11:16:19,088 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1481156388370_0012_m_000003_0 TaskAttempt Transitioned from RUNNING to COMMIT_PENDING 2016-12-15 11:16:19,088 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: attempt_1481156388370_0012_m_000003_0 given a go for committing the task output. 2016-12-15 11:16:19,089 INFO [IPC Server handler 26 on 36415] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit go/no-go request from attempt_1481156388370_0012_m_000003_0 2016-12-15 11:16:19,089 INFO [IPC Server handler 26 on 36415] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Result of canCommit for attempt_1481156388370_0012_m_000003_0:true 2016-12-15 11:16:19,120 INFO [IPC Server handler 22 on 36415] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1481156388370_0012_m_000003_0 is : 1.0 2016-12-15 11:16:19,124 INFO [IPC Server handler 16 on 36415] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Done acknowledgement from attempt_1481156388370_0012_m_000003_0 2016-12-15 11:16:19,125 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1481156388370_0012_m_000003_0 TaskAttempt Transitioned from COMMIT_PENDING to SUCCESS_CONTAINER_CLEANUP 2016-12-15 11:16:19,126 INFO [ContainerLauncher #4] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container container_1481156388370_0012_01_000005 taskAttempt attempt_1481156388370_0012_m_000003_0 2016-12-15 11:16:19,126 INFO [ContainerLauncher #4] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING attempt_1481156388370_0012_m_000003_0 2016-12-15 11:16:19,126 INFO [ContainerLauncher #4] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : xxx.net:45454 2016-12-15 11:16:19,139 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1481156388370_0012_m_000003_0 TaskAttempt Transitioned from SUCCESS_CONTAINER_CLEANUP to SUCCEEDED 2016-12-15 11:16:19,143 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Task succeeded with attempt attempt_1481156388370_0012_m_000003_0 2016-12-15 11:16:19,144 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1481156388370_0012_m_000003 Task Transitioned from RUNNING to SUCCEEDED 2016-12-15 11:16:19,145 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Num completed Tasks: 1 2016-12-15 11:16:19,390 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:4 AssignedReds:0 CompletedMaps:1 CompletedReds:0 ContAlloc:4 ContRel:0 HostLocal:4 RackLocal:0 2016-12-15 11:16:19,395 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received completed container container_1481156388370_0012_01_000005 2016-12-15 11:16:19,395 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:3 AssignedReds:0 CompletedMaps:1 CompletedReds:0 ContAlloc:4 ContRel:0 HostLocal:4 RackLocal:0 2016-12-15 11:16:19,396 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1481156388370_0012_m_000003_0: Container killed by the ApplicationMaster. Container killed on request. Exit code is 143 Container exited with a non-zero exit code 143 2016-12-15 11:16:19,626 INFO [IPC Server handler 19 on 36415] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1481156388370_0012_m_000002_0 is : 0.0 2016-12-15 11:16:19,753 INFO [IPC Server handler 9 on 36415] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit-pending state update from attempt_1481156388370_0012_m_000002_0 2016-12-15 11:16:19,754 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1481156388370_0012_m_000002_0 TaskAttempt Transitioned from RUNNING to COMMIT_PENDING 2016-12-15 11:16:19,754 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: attempt_1481156388370_0012_m_000002_0 given a go for committing the task output. 2016-12-15 11:16:19,755 INFO [IPC Server handler 26 on 36415] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit go/no-go request from attempt_1481156388370_0012_m_000002_0 2016-12-15 11:16:19,756 INFO [IPC Server handler 26 on 36415] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Result of canCommit for attempt_1481156388370_0012_m_000002_0:true 2016-12-15 11:16:19,788 INFO [IPC Server handler 22 on 36415] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1481156388370_0012_m_000002_0 is : 1.0 2016-12-15 11:16:19,790 INFO [IPC Server handler 16 on 36415] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Done acknowledgement from attempt_1481156388370_0012_m_000002_0 2016-12-15 11:16:19,791 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1481156388370_0012_m_000002_0 TaskAttempt Transitioned from COMMIT_PENDING to SUCCESS_CONTAINER_CLEANUP 2016-12-15 11:16:19,792 INFO [ContainerLauncher #5] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container container_1481156388370_0012_01_000004 taskAttempt attempt_1481156388370_0012_m_000002_0 2016-12-15 11:16:19,792 INFO [ContainerLauncher #5] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING attempt_1481156388370_0012_m_000002_0 2016-12-15 11:16:19,792 INFO [ContainerLauncher #5] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : xxx.net:45454 2016-12-15 11:16:19,800 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1481156388370_0012_m_000002_0 TaskAttempt Transitioned from SUCCESS_CONTAINER_CLEANUP to SUCCEEDED 2016-12-15 11:16:19,800 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Task succeeded with attempt attempt_1481156388370_0012_m_000002_0 2016-12-15 11:16:19,800 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1481156388370_0012_m_000002 Task Transitioned from RUNNING to SUCCEEDED 2016-12-15 11:16:19,800 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Num completed Tasks: 2 2016-12-15 11:16:20,115 INFO [IPC Server handler 10 on 36415] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1481156388370_0012_m_000000_0 is : 0.0 2016-12-15 11:16:20,239 INFO [IPC Server handler 12 on 36415] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit-pending state update from attempt_1481156388370_0012_m_000000_0 2016-12-15 11:16:20,240 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1481156388370_0012_m_000000_0 TaskAttempt Transitioned from RUNNING to COMMIT_PENDING 2016-12-15 11:16:20,240 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: attempt_1481156388370_0012_m_000000_0 given a go for committing the task output. 2016-12-15 11:16:20,241 INFO [IPC Server handler 21 on 36415] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit go/no-go request from attempt_1481156388370_0012_m_000000_0 2016-12-15 11:16:20,242 INFO [IPC Server handler 21 on 36415] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Result of canCommit for attempt_1481156388370_0012_m_000000_0:true 2016-12-15 11:16:20,272 INFO [IPC Server handler 18 on 36415] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1481156388370_0012_m_000000_0 is : 1.0 2016-12-15 11:16:20,275 INFO [IPC Server handler 24 on 36415] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Done acknowledgement from attempt_1481156388370_0012_m_000000_0 2016-12-15 11:16:20,275 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1481156388370_0012_m_000000_0 TaskAttempt Transitioned from COMMIT_PENDING to SUCCESS_CONTAINER_CLEANUP 2016-12-15 11:16:20,276 INFO [ContainerLauncher #6] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container container_1481156388370_0012_01_000002 taskAttempt attempt_1481156388370_0012_m_000000_0 2016-12-15 11:16:20,276 INFO [ContainerLauncher #6] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING attempt_1481156388370_0012_m_000000_0 2016-12-15 11:16:20,276 INFO [ContainerLauncher #6] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : xxx.net:45454 2016-12-15 11:16:20,283 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1481156388370_0012_m_000000_0 TaskAttempt Transitioned from SUCCESS_CONTAINER_CLEANUP to SUCCEEDED 2016-12-15 11:16:20,283 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Task succeeded with attempt attempt_1481156388370_0012_m_000000_0 2016-12-15 11:16:20,283 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1481156388370_0012_m_000000 Task Transitioned from RUNNING to SUCCEEDED 2016-12-15 11:16:20,283 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Num completed Tasks: 3 2016-12-15 11:16:20,396 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:3 AssignedReds:0 CompletedMaps:3 CompletedReds:0 ContAlloc:4 ContRel:0 HostLocal:4 RackLocal:0 2016-12-15 11:16:20,397 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received completed container container_1481156388370_0012_01_000004 2016-12-15 11:16:20,398 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received completed container container_1481156388370_0012_01_000002 2016-12-15 11:16:20,398 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:1 AssignedReds:0 CompletedMaps:3 CompletedReds:0 ContAlloc:4 ContRel:0 HostLocal:4 RackLocal:0 2016-12-15 11:16:20,398 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1481156388370_0012_m_000002_0: Container killed by the ApplicationMaster. Container killed on request. Exit code is 143 Container exited with a non-zero exit code 143 2016-12-15 11:16:20,398 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1481156388370_0012_m_000000_0: Container killed by the ApplicationMaster. Container killed on request. Exit code is 143 Container exited with a non-zero exit code 143 2016-12-15 11:16:20,715 INFO [IPC Server handler 9 on 36415] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1481156388370_0012_m_000001_0 is : 0.0 2016-12-15 11:16:20,767 INFO [IPC Server handler 22 on 36415] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit-pending state update from attempt_1481156388370_0012_m_000001_0 2016-12-15 11:16:20,768 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1481156388370_0012_m_000001_0 TaskAttempt Transitioned from RUNNING to COMMIT_PENDING 2016-12-15 11:16:20,768 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: attempt_1481156388370_0012_m_000001_0 given a go for committing the task output. 2016-12-15 11:16:20,769 INFO [IPC Server handler 16 on 36415] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit go/no-go request from attempt_1481156388370_0012_m_000001_0 2016-12-15 11:16:20,769 INFO [IPC Server handler 16 on 36415] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Result of canCommit for attempt_1481156388370_0012_m_000001_0:true 2016-12-15 11:16:20,797 INFO [IPC Server handler 10 on 36415] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1481156388370_0012_m_000001_0 is : 1.0 2016-12-15 11:16:20,800 INFO [IPC Server handler 12 on 36415] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Done acknowledgement from attempt_1481156388370_0012_m_000001_0 2016-12-15 11:16:20,801 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1481156388370_0012_m_000001_0 TaskAttempt Transitioned from COMMIT_PENDING to SUCCESS_CONTAINER_CLEANUP 2016-12-15 11:16:20,801 INFO [ContainerLauncher #7] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container container_1481156388370_0012_01_000003 taskAttempt attempt_1481156388370_0012_m_000001_0 2016-12-15 11:16:20,801 INFO [ContainerLauncher #7] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING attempt_1481156388370_0012_m_000001_0 2016-12-15 11:16:20,801 INFO [ContainerLauncher #7] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : xxx.net:45454 2016-12-15 11:16:20,808 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1481156388370_0012_m_000001_0 TaskAttempt Transitioned from SUCCESS_CONTAINER_CLEANUP to SUCCEEDED 2016-12-15 11:16:20,808 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Task succeeded with attempt attempt_1481156388370_0012_m_000001_0 2016-12-15 11:16:20,808 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1481156388370_0012_m_000001 Task Transitioned from RUNNING to SUCCEEDED 2016-12-15 11:16:20,808 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Num completed Tasks: 4 2016-12-15 11:16:20,809 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1481156388370_0012Job Transitioned from RUNNING to COMMITTING 2016-12-15 11:16:20,809 INFO [CommitterEvent Processor #1] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: JOB_COMMIT 2016-12-15 11:16:20,840 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Calling handler for JobFinishedEvent 2016-12-15 11:16:20,840 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1481156388370_0012Job Transitioned from COMMITTING to SUCCEEDED 2016-12-15 11:16:20,841 INFO [Thread-73] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: We are finishing cleanly so this is the last retry 2016-12-15 11:16:20,841 INFO [Thread-73] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify RMCommunicator isAMLastRetry: true 2016-12-15 11:16:20,841 INFO [Thread-73] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: RMCommunicator notified that shouldUnregistered is: true 2016-12-15 11:16:20,841 INFO [Thread-73] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify JHEH isAMLastRetry: true 2016-12-15 11:16:20,841 INFO [Thread-73] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: JobHistoryEventHandler notified that forceJobCompletion is true 2016-12-15 11:16:20,841 INFO [Thread-73] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Calling stop for all the services 2016-12-15 11:16:20,841 INFO [Thread-73] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopping JobHistoryEventHandler. Size of the outstanding queue size is 0 2016-12-15 11:16:21,261 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying hdfs://xxx.net:8020/user/root/.staging/job_1481156388370_0012/job_1481156388370_0012_1.jhist to hdfs://xxx.net:8020/mr-history/tmp/root/job_1481156388370_0012-1481829367075-root-TeradataSqoopImportJov-1481829380839-4-0-SUCCEEDED-default-1481829371349.jhist_tmp 2016-12-15 11:16:21,271 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied to done location: hdfs://xxx.net:8020/mr-history/tmp/root/job_1481156388370_0012-1481829367075-root-TeradataSqoopImportJov-1481829380839-4-0-SUCCEEDED-default-1481829371349.jhist_tmp 2016-12-15 11:16:21,272 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying hdfs://xxx.net:8020/user/root/.staging/job_1481156388370_0012/job_1481156388370_0012_1_conf.xml to hdfs://xxx.net:8020/mr-history/tmp/root/job_1481156388370_0012_conf.xml_tmp 2016-12-15 11:16:21,280 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied to done location: hdfs://xxx.net:8020/mr-history/tmp/root/job_1481156388370_0012_conf.xml_tmp 2016-12-15 11:16:21,282 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://xxx.net:8020/mr-history/tmp/root/job_1481156388370_0012.summary_tmp to hdfs://xxx.net:8020/mr-history/tmp/root/job_1481156388370_0012.summary 2016-12-15 11:16:21,282 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://xxx.net:8020/mr-history/tmp/root/job_1481156388370_0012_conf.xml_tmp to hdfs://xxx.net:8020/mr-history/tmp/root/job_1481156388370_0012_conf.xml 2016-12-15 11:16:21,283 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://xxx.net:8020/mr-history/tmp/root/job_1481156388370_0012-1481829367075-root-TeradataSqoopImportJov-1481829380839-4-0-SUCCEEDED-default-1481829371349.jhist_tmp to hdfs://xxx.net:8020/mr-history/tmp/root/job_1481156388370_0012-1481829367075-root-TeradataSqoopImportJov-1481829380839-4-0-SUCCEEDED-default-1481829371349.jhist 2016-12-15 11:16:21,283 INFO [Thread-73] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopped JobHistoryEventHandler. super.stop() 2016-12-15 11:16:21,286 INFO [Thread-73] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Setting job diagnostics to 2016-12-15 11:16:21,286 INFO [Thread-73] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: History url is http://xxx.net:19888/jobhistory/job/job_1481156388370_0012 2016-12-15 11:16:21,291 INFO [Thread-73] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Waiting for application to be successfully unregistered. 2016-12-15 11:16:22,292 INFO [Thread-73] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Final Stats: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:1 AssignedReds:0 CompletedMaps:3 CompletedReds:0 ContAlloc:4 ContRel:0 HostLocal:4 RackLocal:0 2016-12-15 11:16:22,293 INFO [Thread-73] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Deleting staging directory hdfs://xxx.net:8020 /user/root/.staging/job_1481156388370_0012 2016-12-15 11:16:22,294 INFO [Thread-73] org.apache.hadoop.ipc.Server: Stopping server on 36415 2016-12-15 11:16:22,295 INFO [IPC Server listener on 36415] org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 36415 2016-12-15 11:16:22,295 INFO [TaskHeartbeatHandler PingChecker] org.apache.hadoop.mapreduce.v2.app.TaskHeartbeatHandler: TaskHeartbeatHandler thread interrupted 2016-12-15 11:16:22,295 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: Stopping IPC Server Responder End of LogType:syslog Container: container_1481156388370_0012_01_000003 on xxx.net_45454 ====================================================================================== LogType:directory.info Log Upload Time:Thu Dec 15 11:16:28 -0800 2016 LogLength:25899 Log Contents: ls -l: total 208 lrwxrwxrwx 1 root root 90 Dec 15 11:16 ant-contrib-1.0b3.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/161/ant-contrib-1.0b3.jar lrwxrwxrwx 1 root root 95 Dec 15 11:16 ant-eclipse-1.0-jvm1.2.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/186/ant-eclipse-1.0-jvm1.2.jar lrwxrwxrwx 1 root root 83 Dec 15 11:16 avro-1.8.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/164/avro-1.8.0.jar lrwxrwxrwx 1 root root 98 Dec 15 11:16 avro-mapred-1.8.0-hadoop2.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/194/avro-mapred-1.8.0-hadoop2.jar lrwxrwxrwx 1 root root 90 Dec 15 11:16 commons-codec-1.4.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/175/commons-codec-1.4.jar lrwxrwxrwx 1 root root 95 Dec 15 11:16 commons-compress-1.8.1.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/179/commons-compress-1.8.1.jar lrwxrwxrwx 1 root root 87 Dec 15 11:16 commons-io-1.4.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/189/commons-io-1.4.jar lrwxrwxrwx 1 root root 91 Dec 15 11:16 commons-jexl-2.1.1.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/193/commons-jexl-2.1.1.jar lrwxrwxrwx 1 root root 90 Dec 15 11:16 commons-lang3-3.4.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/187/commons-lang3-3.4.jar lrwxrwxrwx 1 root root 94 Dec 15 11:16 commons-logging-1.1.1.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/171/commons-logging-1.1.1.jar -rw-r--r-- 1 root root 227 Dec 15 11:16 container_tokens -rwx------ 1 root root 709 Dec 15 11:16 default_container_executor_session.sh -rwx------ 1 root root 763 Dec 15 11:16 default_container_executor.sh lrwxrwxrwx 1 root root 122 Dec 15 11:16 hortonworks-teradata-connector-1.5.1.2.5.0.0-1245.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/192/hortonworks-teradata-connector-1.5.1.2.5.0.0-1245.jar lrwxrwxrwx 1 root root 88 Dec 15 11:16 hsqldb-1.8.0.10.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/176/hsqldb-1.8.0.10.jar lrwxrwxrwx 1 root root 98 Dec 15 11:16 jackson-annotations-2.3.1.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/159/jackson-annotations-2.3.1.jar lrwxrwxrwx 1 root root 91 Dec 15 11:16 jackson-core-2.3.1.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/182/jackson-core-2.3.1.jar lrwxrwxrwx 1 root root 96 Dec 15 11:16 jackson-core-asl-1.9.13.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/170/jackson-core-asl-1.9.13.jar lrwxrwxrwx 1 root root 95 Dec 15 11:16 jackson-databind-2.3.1.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/185/jackson-databind-2.3.1.jar lrwxrwxrwx 1 root root 98 Dec 15 11:16 jackson-mapper-asl-1.9.13.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/178/jackson-mapper-asl-1.9.13.jar lrwxrwxrwx 1 root root 115 Dec 15 11:16 job.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012/filecache/10/job.jar lrwxrwxrwx 1 root root 115 Dec 15 11:16 job.xml -> /usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012/filecache/11/job.xml lrwxrwxrwx 1 root root 93 Dec 15 11:16 kite-data-core-1.1.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/165/kite-data-core-1.1.0.jar lrwxrwxrwx 1 root root 93 Dec 15 11:16 kite-data-hive-1.1.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/188/kite-data-hive-1.1.0.jar lrwxrwxrwx 1 root root 98 Dec 15 11:16 kite-data-mapreduce-1.1.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/181/kite-data-mapreduce-1.1.0.jar lrwxrwxrwx 1 root root 104 Dec 15 11:16 kite-hadoop-compatibility-1.1.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/160/kite-hadoop-compatibility-1.1.0.jar -rwx------ 1 root root 32487 Dec 15 11:16 launch_container.sh lrwxrwxrwx 1 root root 69 Dec 15 11:16 mr-framework -> /usr/local/middleware/hadoop/yarn/local/filecache/11/mapreduce.tar.gz lrwxrwxrwx 1 root root 84 Dec 15 11:16 opencsv-2.3.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/166/opencsv-2.3.jar lrwxrwxrwx 1 root root 86 Dec 15 11:16 paranamer-2.7.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/183/paranamer-2.7.jar lrwxrwxrwx 1 root root 91 Dec 15 11:16 parquet-avro-1.6.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/163/parquet-avro-1.6.0.jar lrwxrwxrwx 1 root root 93 Dec 15 11:16 parquet-column-1.6.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/184/parquet-column-1.6.0.jar lrwxrwxrwx 1 root root 93 Dec 15 11:16 parquet-common-1.6.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/191/parquet-common-1.6.0.jar lrwxrwxrwx 1 root root 95 Dec 15 11:16 parquet-encoding-1.6.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/180/parquet-encoding-1.6.0.jar lrwxrwxrwx 1 root root 97 Dec 15 11:16 parquet-format-2.2.0-rc1.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/190/parquet-format-2.2.0-rc1.jar lrwxrwxrwx 1 root root 96 Dec 15 11:16 parquet-generator-1.6.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/158/parquet-generator-1.6.0.jar lrwxrwxrwx 1 root root 93 Dec 15 11:16 parquet-hadoop-1.6.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/172/parquet-hadoop-1.6.0.jar lrwxrwxrwx 1 root root 94 Dec 15 11:16 parquet-jackson-1.6.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/168/parquet-jackson-1.6.0.jar lrwxrwxrwx 1 root root 88 Dec 15 11:16 slf4j-api-1.7.7.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/174/slf4j-api-1.7.7.jar lrwxrwxrwx 1 root root 92 Dec 15 11:16 snappy-java-1.1.1.6.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/173/snappy-java-1.1.1.6.jar lrwxrwxrwx 1 root root 84 Dec 15 11:16 tdgssconfig.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/162/tdgssconfig.jar lrwxrwxrwx 1 root root 105 Dec 15 11:16 teradata-connector-1.5.1-hadoop2.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/167/teradata-connector-1.5.1-hadoop2.jar lrwxrwxrwx 1 root root 82 Dec 15 11:16 terajdbc4.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/169/terajdbc4.jar drwx--x--- 2 root root 4096 Dec 15 11:16 tmp lrwxrwxrwx 1 root root 79 Dec 15 11:16 xz-1.5.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/177/xz-1.5.jar find -L . -maxdepth 5 -ls: 44435427 4 drwx--x--- 3 root root 4096 Dec 15 11:16 . 44435249 60 -r-x------ 1 root root 58131 Dec 15 11:16 ./commons-codec-1.4.jar 44435273 36 -r-x------ 1 root root 34047 Dec 15 11:16 ./paranamer-2.7.jar 44435311 4 drwx------ 3 root root 4096 Dec 15 11:16 ./job.jar 44435309 4980 -r-x------ 1 root root 5098776 Dec 15 11:16 ./job.jar/job.jar 44435312 4 drwx------ 2 root root 4096 Dec 15 11:16 ./job.jar/lib 44435314 184 -r-x------ 1 root root 185140 Sep 7 15:18 ./job.jar/lib/commons-io-2.4.jar 44435317 1972 -r-x------ 1 root root 2019274 Sep 7 15:18 ./job.jar/lib/ant-1.9.4.jar 44435315 20 -r-x------ 1 root root 19827 Sep 7 15:18 ./job.jar/lib/opencsv-2.3.jar 44435313 32 -r-x------ 1 root root 31605 Sep 7 15:18 ./job.jar/lib/commons-logging-1.0.3.jar 44435318 4 -r-x------ 1 root root 2615 Oct 3 11:51 ./job.jar/lib/tdgssconfig.jar 44435316 612 -r-x------ 1 root root 625986 Sep 7 15:18 ./job.jar/lib/joda-time-2.9.1.jar 44435319 1068 -r-x------ 1 root root 1093618 Oct 3 11:51 ./job.jar/lib/terajdbc4.jar 44435267 1704 -r-x------ 1 root root 1744166 Dec 15 11:16 ./kite-data-mapreduce-1.1.0.jar 44435261 360 -r-x------ 1 root root 365977 Dec 15 11:16 ./commons-compress-1.8.1.jar 44435291 108 -r-x------ 1 root root 108990 Dec 15 11:16 ./commons-io-1.4.jar 44435447 4 -rw-r--r-- 1 root root 264 Dec 15 11:16 ./.launch_container.sh.crc 44435279 884 -r-x------ 1 root root 902327 Dec 15 11:16 ./jackson-databind-2.3.1.jar 44435446 32 -rwx------ 1 root root 32487 Dec 15 11:16 ./launch_container.sh 44435198 24 -r-x------ 1 root root 20728 Dec 15 11:16 ./parquet-generator-1.6.0.jar 44435246 32 -r-x------ 1 root root 29241 Dec 15 11:16 ./slf4j-api-1.7.7.jar 44435294 364 -r-x------ 1 root root 371050 Dec 15 11:16 ./parquet-format-2.2.0-rc1.jar 44435453 4 -rw-r--r-- 1 root root 16 Dec 15 11:16 ./.default_container_executor_session.sh.crc 44435285 424 -r-x------ 1 root root 430341 Dec 15 11:16 ./commons-lang3-3.4.jar 44435222 20 -r-x------ 1 root root 19816 Dec 15 11:16 ./opencsv-2.3.jar 44435321 132 -r-x------ 1 root root 132355 Dec 15 11:16 ./job.xml 44435439 4 -rw-r--r-- 1 root root 227 Dec 15 11:16 ./container_tokens 44435306 180 -r-x------ 1 root root 183770 Dec 15 11:16 ./avro-mapred-1.8.0-hadoop2.jar 44435432 4 drwx--x--- 2 root root 4096 Dec 15 11:16 ./tmp 44435252 692 -r-x------ 1 root root 706015 Dec 15 11:16 ./hsqldb-1.8.0.10.jar 44435300 24 -r-x------ 1 root root 22675 Dec 15 11:16 ./hortonworks-teradata-connector-1.5.1.2.5.0.0-1245.jar 44435213 56 -r-x------ 1 root root 53418 Dec 15 11:16 ./parquet-avro-1.6.0.jar 44435441 4 -rw-r--r-- 1 root root 12 Dec 15 11:16 ./.container_tokens.crc 44435234 228 -r-x------ 1 root root 229445 Dec 15 11:16 ./jackson-core-asl-1.9.13.jar 44435228 996 -r-x------ 1 root root 1019348 Dec 15 11:16 ./parquet-jackson-1.6.0.jar 44433794 4 drwxr-xr-x 3 root root 4096 Dec 13 11:42 ./mr-framework 44433798 4 drwxr-xr-x 9 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop 44433841 4 drwxr-xr-x 2 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/include 44433846 4 -r-xr-xr-x 1 jenkins users 3319 Nov 29 10:21 ./mr-framework/hadoop/include/TemplateFactory.hh 44433842 8 -r-xr-xr-x 1 jenkins users 6330 Nov 29 10:21 ./mr-framework/hadoop/include/Pipes.hh 44433845 8 -r-xr-xr-x 1 jenkins users 4514 Nov 29 10:21 ./mr-framework/hadoop/include/SerialUtils.hh 44433844 36 -r-xr-xr-x 1 jenkins users 33361 Nov 29 10:21 ./mr-framework/hadoop/include/hdfs.h 44433843 4 -r-xr-xr-x 1 jenkins users 2441 Nov 29 10:21 ./mr-framework/hadoop/include/StringUtils.hh 44434867 4 drwxr-xr-x 2 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/bin 44434872 8 -r-xr-xr-x 1 jenkins users 6448 Nov 29 10:21 ./mr-framework/hadoop/bin/mapred 44434871 4 -r-xr-xr-x 1 jenkins users 888 Nov 29 10:21 ./mr-framework/hadoop/bin/kill-secondary-name-node 44434876 12 -r-xr-xr-x 1 jenkins users 8786 Nov 29 10:21 ./mr-framework/hadoop/bin/hadoop.cmd 44434877 4 -r-xr-xr-x 1 jenkins users 1857 Nov 29 10:21 ./mr-framework/hadoop/bin/rcc 44434878 12 -r-xr-xr-x 1 jenkins users 12069 Nov 29 10:21 ./mr-framework/hadoop/bin/yarn.cmd 44434869 4 -r-xr-xr-x 1 jenkins users 830 Nov 29 10:21 ./mr-framework/hadoop/bin/kill-name-node 44434870 12 -r-xr-xr-x 1 jenkins users 8782 Nov 29 10:21 ./mr-framework/hadoop/bin/hdfs.cmd 44434879 8 -r-xr-xr-x 1 jenkins users 7120 Nov 29 10:21 ./mr-framework/hadoop/bin/hadoop 44434880 16 -r-xr-xr-x 1 jenkins users 12707 Nov 29 10:21 ./mr-framework/hadoop/bin/hdfs 44434868 8 -r-xr-xr-x 1 jenkins users 7465 Nov 29 10:21 ./mr-framework/hadoop/bin/mapred.cmd 44434874 124 -r-xr-xr-x 1 jenkins users 125137 Nov 29 10:21 ./mr-framework/hadoop/bin/container-executor 44434873 140 -r-xr-xr-x 1 jenkins users 139697 Nov 29 10:21 ./mr-framework/hadoop/bin/test-container-executor 44434875 16 -r-xr-xr-x 1 jenkins users 14958 Nov 29 10:21 ./mr-framework/hadoop/bin/yarn 44433848 4 drwxr-xr-x 2 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/sbin 44433861 4 -r-xr-xr-x 1 jenkins users 2291 Nov 29 10:21 ./mr-framework/hadoop/sbin/httpfs.sh 44433875 4 -r-xr-xr-x 1 jenkins users 1441 Nov 29 10:21 ./mr-framework/hadoop/sbin/hadoop-daemons.sh 44433850 4 -r-xr-xr-x 1 jenkins users 1260 Nov 29 10:21 ./mr-framework/hadoop/sbin/stop-balancer.sh 44433876 4 -r-xr-xr-x 1 jenkins users 3287 Nov 29 10:21 ./mr-framework/hadoop/sbin/stop-dfs.sh 44433857 4 -r-xr-xr-x 1 jenkins users 1543 Nov 29 10:21 ./mr-framework/hadoop/sbin/stop-all.sh 44433870 4 -r-xr-xr-x 1 jenkins users 1401 Nov 29 10:21 ./mr-framework/hadoop/sbin/start-dfs.cmd 44433866 4 -r-xr-xr-x 1 jenkins users 1428 Nov 29 10:21 ./mr-framework/hadoop/sbin/start-yarn.sh 44433858 4 -r-xr-xr-x 1 jenkins users 1209 Nov 29 10:21 ./mr-framework/hadoop/sbin/start-balancer.sh 44433863 4 -r-xr-xr-x 1 jenkins users 1421 Nov 29 10:21 ./mr-framework/hadoop/sbin/stop-secure-dns.sh 44433869 4 -r-xr-xr-x 1 jenkins users 2752 Nov 29 10:21 ./mr-framework/hadoop/sbin/distribute-exclude.sh 44433862 8 -r-xr-xr-x 1 jenkins users 6546 Nov 29 10:21 ./mr-framework/hadoop/sbin/hadoop-daemon.sh 44433853 4 -r-xr-xr-x 1 jenkins users 1571 Nov 29 10:21 ./mr-framework/hadoop/sbin/start-yarn.cmd 44433855 4 -r-xr-xr-x 1 jenkins users 3815 Nov 29 10:21 ./mr-framework/hadoop/sbin/start-dfs.sh 44433864 4 -r-xr-xr-x 1 jenkins users 1642 Nov 29 10:21 ./mr-framework/hadoop/sbin/stop-yarn.cmd 44433860 4 -r-xr-xr-x 1 jenkins users 1552 Nov 29 10:21 ./mr-framework/hadoop/sbin/start-all.sh 44433867 4 -r-xr-xr-x 1 jenkins users 3630 Nov 29 10:21 ./mr-framework/hadoop/sbin/kms.sh 44433852 4 -r-xr-xr-x 1 jenkins users 1421 Nov 29 10:21 ./mr-framework/hadoop/sbin/stop-yarn.sh 44433871 4 -r-xr-xr-x 1 jenkins users 1779 Nov 29 10:21 ./mr-framework/hadoop/sbin/start-all.cmd 44433872 8 -r-xr-xr-x 1 jenkins users 4376 Nov 29 10:21 ./mr-framework/hadoop/sbin/yarn-daemon.sh 44433874 4 -r-xr-xr-x 1 jenkins users 1729 Nov 29 10:21 ./mr-framework/hadoop/sbin/refresh-namenodes.sh 44433868 4 -r-xr-xr-x 1 jenkins users 1508 Nov 29 10:21 ./mr-framework/hadoop/sbin/hdfs-config.sh 44433873 4 -r-xr-xr-x 1 jenkins users 2226 Nov 29 10:21 ./mr-framework/hadoop/sbin/slaves.sh 44433849 4 -r-xr-xr-x 1 jenkins users 1770 Nov 29 10:21 ./mr-framework/hadoop/sbin/stop-all.cmd 44433854 4 -r-xr-xr-x 1 jenkins users 1434 Nov 29 10:21 ./mr-framework/hadoop/sbin/yarn-daemons.sh 44433859 4 -r-xr-xr-x 1 jenkins users 1455 Nov 29 10:21 ./mr-framework/hadoop/sbin/stop-dfs.cmd 44433851 8 -r-xr-xr-x 1 jenkins users 4161 Nov 29 10:21 ./mr-framework/hadoop/sbin/mr-jobhistory-daemon.sh 44433856 4 -r-xr-xr-x 1 jenkins users 1640 Nov 29 10:21 ./mr-framework/hadoop/sbin/hdfs-config.cmd 44433865 4 -r-xr-xr-x 1 jenkins users 1438 Nov 29 10:21 ./mr-framework/hadoop/sbin/start-secure-dns.sh 44434881 84 -r-xr-xr-x 1 jenkins users 84854 Nov 29 10:21 ./mr-framework/hadoop/LICENSE.txt 44433847 16 -r-xr-xr-x 1 jenkins users 15753 Nov 29 10:21 ./mr-framework/hadoop/NOTICE.txt 44433830 4 drwxr-xr-x 2 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/libexec 44433838 4 -r-xr-xr-x 1 jenkins users 1777 Nov 29 10:21 ./mr-framework/hadoop/libexec/mapred-config.cmd 44433839 12 -r-xr-xr-x 1 jenkins users 8270 Nov 29 10:21 ./mr-framework/hadoop/libexec/hadoop-config.cmd 44433840 8 -r-xr-xr-x 1 jenkins users 5749 Nov 29 10:21 ./mr-framework/hadoop/libexec/httpfs-config.sh 44433834 4 -r-xr-xr-x 1 jenkins users 2131 Nov 29 10:21 ./mr-framework/hadoop/libexec/yarn-config.cmd 44433836 4 -r-xr-xr-x 1 jenkins users 2215 Nov 29 10:21 ./mr-framework/hadoop/libexec/yarn-config.sh 44433832 4 -r-xr-xr-x 1 jenkins users 2304 Nov 29 10:21 ./mr-framework/hadoop/libexec/mapred-config.sh 44433837 4 -r-xr-xr-x 1 jenkins users 1508 Nov 29 10:21 ./mr-framework/hadoop/libexec/hdfs-config.sh 44433831 12 -r-xr-xr-x 1 jenkins users 11678 Nov 29 10:21 ./mr-framework/hadoop/libexec/hadoop-config.sh 44433833 4 -r-xr-xr-x 1 jenkins users 1640 Nov 29 10:21 ./mr-framework/hadoop/libexec/hdfs-config.cmd 44433835 8 -r-xr-xr-x 1 jenkins users 5431 Nov 29 10:21 ./mr-framework/hadoop/libexec/kms-config.sh 44433799 4 drwxr-xr-x 3 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/etc 44433800 4 drwxr-xr-x 2 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop 44433821 8 -r-xr-xr-x 1 jenkins users 4436 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/capacity-scheduler.xml 44433829 4 -r-xr-xr-x 1 jenkins users 1527 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/kms-env.sh 44433806 12 -r-xr-xr-x 1 jenkins users 9683 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/hadoop-policy.xml 44433820 4 -r-xr-xr-x 1 jenkins users 758 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/mapred-site.xml.template 44433824 4 -r-xr-xr-x 1 jenkins users 2316 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/ssl-client.xml.example 44433802 8 -r-xr-xr-x 1 jenkins users 4529 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/hadoop-env.sh 44433811 4 -r-xr-xr-x 1 jenkins users 3979 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/hadoop-env.cmd 44433812 4 -r-xr-xr-x 1 jenkins users 3518 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/kms-acls.xml 44433828 4 -r-xr-xr-x 1 jenkins users 2697 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/ssl-server.xml.example 44433823 4 -r-xr-xr-x 1 jenkins users 21 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/httpfs-signature.secret 44433826 4 -r-xr-xr-x 1 jenkins users 318 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/container-executor.cfg 44433813 4 -r-xr-xr-x 1 jenkins users 690 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/yarn-site.xml 44433801 4 -r-xr-xr-x 1 jenkins users 1631 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/kms-log4j.properties 44433810 16 -r-xr-xr-x 1 jenkins users 12302 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/log4j.properties 44433807 4 -r-xr-xr-x 1 jenkins users 775 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/hdfs-site.xml 44433817 4 -r-xr-xr-x 1 jenkins users 10 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/slaves 44433825 8 -r-xr-xr-x 1 jenkins users 4113 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/mapred-queues.xml.template 44433818 4 -r-xr-xr-x 1 jenkins users 620 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/httpfs-site.xml 44433822 4 -r-xr-xr-x 1 jenkins users 1657 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/httpfs-log4j.properties 44433809 4 -r-xr-xr-x 1 jenkins users 2598 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/hadoop-metrics2.properties 44433805 8 -r-xr-xr-x 1 jenkins users 4567 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/yarn-env.sh 44433808 4 -r-xr-xr-x 1 jenkins users 2490 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/hadoop-metrics.properties 44433804 4 -r-xr-xr-x 1 jenkins users 774 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/core-site.xml 44433827 4 -r-xr-xr-x 1 jenkins users 1335 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/configuration.xsl 44433815 4 -r-xr-xr-x 1 jenkins users 1383 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/mapred-env.sh 44433819 8 -r-xr-xr-x 1 jenkins users 5511 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/kms-site.xml 44433803 4 -r-xr-xr-x 1 jenkins users 1449 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/httpfs-env.sh 44433814 4 -r-xr-xr-x 1 jenkins users 2250 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/yarn-env.cmd 44433816 4 -r-xr-xr-x 1 jenkins users 951 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/mapred-env.cmd 44434854 4 drwxr-xr-x 3 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/lib 44434855 4 drwxr-xr-x 2 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/lib/native 44434862 1288 -r-xr-xr-x 1 jenkins users 1316074 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libhadoop.a 44434858 228 -r-xr-xr-x 1 jenkins users 229697 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libhdfs.so.0.0.0 44434861 572 -r-xr-xr-x 1 jenkins users 582360 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libhadooputils.a 44434866 1456 -r-xr-xr-x 1 jenkins users 1487204 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libhadooppipes.a 44434865 756 -r-xr-xr-x 1 jenkins users 773287 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libhadoop.so.1.0.0 44434864 360 -r-xr-xr-x 1 jenkins users 365604 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libhdfs.a 44434865 756 -r-xr-xr-x 1 jenkins users 773287 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libhadoop.so 44434863 20 -r-xr-xr-x 1 jenkins users 19848 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libsnappy.so.1 44434863 20 -r-xr-xr-x 1 jenkins users 19848 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libsnappy.so 44434858 228 -r-xr-xr-x 1 jenkins users 229697 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libhdfs.so 44434863 20 -r-xr-xr-x 1 jenkins users 19848 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libsnappy.so.1.1.4 44434882 4 -r-xr-xr-x 1 jenkins users 1366 Nov 29 10:21 ./mr-framework/hadoop/README.txt 44433877 4 drwxr-xr-x 4 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share 44433878 4 drwxr-xr-x 3 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/doc 44433879 4 drwxr-xr-x 6 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/doc/hadoop 44433891 4 drwxr-xr-x 9 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/hadoop 44434625 4 drwxr-xr-x 3 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/hadoop/kms 44434353 4 drwxr-xr-x 5 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/hadoop/mapreduce 44433892 4 drwxr-xr-x 5 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/hadoop/tools 44434761 4 drwxr-xr-x 7 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/hadoop/hdfs 44434522 4 drwxr-xr-x 6 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/hadoop/common 44434060 4 drwxr-xr-x 3 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/hadoop/httpfs 44434406 4 drwxr-xr-x 5 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/hadoop/yarn 44435457 4 -rwx------ 1 root root 763 Dec 15 11:16 ./default_container_executor.sh 44435207 220 -r-x------ 1 root root 224135 Dec 15 11:16 ./ant-contrib-1.0b3.jar 44435204 1704 -r-x------ 1 root root 1741888 Dec 15 11:16 ./kite-hadoop-compatibility-1.1.0.jar 44435288 1736 -r-x------ 1 root root 1777229 Dec 15 11:16 ./kite-data-hive-1.1.0.jar 44435303 264 -r-x------ 1 root root 266289 Dec 15 11:16 ./commons-jexl-2.1.1.jar 44435210 4 -r-x------ 1 root root 2615 Dec 15 11:16 ./tdgssconfig.jar 44435459 4 -rw-r--r-- 1 root root 16 Dec 15 11:16 ./.default_container_executor.sh.crc 44435452 4 -rwx------ 1 root root 709 Dec 15 11:16 ./default_container_executor_session.sh 44435216 1292 -r-x------ 1 root root 1322324 Dec 15 11:16 ./avro-1.8.0.jar 44435243 576 -r-x------ 1 root root 587380 Dec 15 11:16 ./snappy-java-1.1.1.6.jar 44435276 860 -r-x------ 1 root root 879155 Dec 15 11:16 ./parquet-column-1.6.0.jar 44435258 752 -r-x------ 1 root root 770013 Dec 15 11:16 ./jackson-mapper-asl-1.9.13.jar 44435201 36 -r-x------ 1 root root 35507 Dec 15 11:16 ./jackson-annotations-2.3.1.jar 44435231 1068 -r-x------ 1 root root 1093618 Dec 15 11:16 ./terajdbc4.jar 44435240 204 -r-x------ 1 root root 205028 Dec 15 11:16 ./parquet-hadoop-1.6.0.jar 44435219 2100 -r-x------ 1 root root 2149987 Dec 15 11:16 ./kite-data-core-1.1.0.jar 44435282 36 -r-x------ 1 root root 36427 Dec 15 11:16 ./ant-eclipse-1.0-jvm1.2.jar 44435237 60 -r-x------ 1 root root 60530 Dec 15 11:16 ./commons-logging-1.1.1.jar 44435270 192 -r-x------ 1 root root 195678 Dec 15 11:16 ./jackson-core-2.3.1.jar 44435255 100 -r-x------ 1 root root 99504 Dec 15 11:16 ./xz-1.5.jar 44435264 276 -r-x------ 1 root root 278936 Dec 15 11:16 ./parquet-encoding-1.6.0.jar 44435297 24 -r-x------ 1 root root 20992 Dec 15 11:16 ./parquet-common-1.6.0.jar 44435225 4980 -r-x------ 1 root root 5098776 Dec 15 11:16 ./teradata-connector-1.5.1-hadoop2.jar broken symlinks(find -L . -maxdepth 5 -type l -ls): End of LogType:directory.info LogType:launch_container.sh Log Upload Time:Thu Dec 15 11:16:28 -0800 2016 LogLength:32487 Log Contents: #!/bin/bash export HADOOP_CONF_DIR=${HADOOP_CONF_DIR:-"/appdata/hdp/2.5.3.0-37/hadoop/conf"} export STDOUT_LOGFILE_ENV="/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000003/stdout" export HADOOP_ROOT_LOGGER="INFO,console" export JAVA_HOME=${JAVA_HOME:-"/usr/java/current/"} export NM_HOST="xxx.net" export HADOOP_CLASSPATH="$PWD:job.jar/job.jar:job.jar/classes/:job.jar/lib/*:$PWD/*:/usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012/container_1481156388370_0012_01_000001:job.jar/job.jar:job.jar/classes/:job.jar/lib/*:/usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012/container_1481156388370_0012_01_000001/*:::/usr/hdp/2.5.3.0-37/sqoop/conf:/usr/hdp/current/zookeeper-server/conf::/usr/hdp/2.5.3.0-37/sqoop/lib/ant-contrib-1.0b3.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/ant-eclipse-1.0-jvm1.2.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/avro-1.8.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/avro-mapred-1.8.0-hadoop2.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/commons-codec-1.4.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/commons-compress-1.8.1.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/commons-io-1.4.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/commons-jexl-2.1.1.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/commons-lang3-3.4.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/commons-logging-1.1.1.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/hortonworks-teradata-connector-1.5.1.2.5.0.0-1245.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/hsqldb-1.8.0.10.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/jackson-annotations-2.3.1.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/jackson-core-2.3.1.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/jackson-databind-2.3.1.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/kite-data-core-1.1.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/kite-data-hive-1.1.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/kite-data-mapreduce-1.1.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/kite-hadoop-compatibility-1.1.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/opencsv-2.3.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/paranamer-2.7.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/parquet-avro-1.6.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/parquet-column-1.6.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/parquet-common-1.6.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/parquet-encoding-1.6.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/parquet-format-2.2.0-rc1.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/parquet-generator-1.6.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/parquet-hadoop-1.6.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/parquet-jackson-1.6.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/slf4j-api-1.7.7.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/snappy-java-1.1.1.6.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/tdgssconfig.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/teradata-connector-1.5.1-hadoop2.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/terajdbc4.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/xz-1.5.jar:/usr/hdp/current/hbase-master/conf:/usr/java/default/lib/tools.jar:/usr/hdp/current/hbase-master:/usr/hdp/current/hbase-master/lib/activation-1.1.jar:/usr/hdp/current/hbase-master/lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-master/lib/apacheds-i18n-2.0.0-M15.jar:/usr/hdp/current/hbase-master/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/usr/hdp/current/hbase-master/lib/api-asn1-api-1.0.0-M20.jar:/usr/hdp/current/hbase-master/lib/api-util-1.0.0-M20.jar:/usr/hdp/current/hbase-master/lib/asm-3.1.jar:/usr/hdp/current/hbase-master/lib/avro-1.7.4.jar:/usr/hdp/current/hbase-master/lib/azure-keyvault-core-0.8.0.jar:/usr/hdp/current/hbase-master/lib/azure-storage-4.2.0.jar:/usr/hdp/current/hbase-master/lib/commons-beanutils-1.7.0.jar:/usr/hdp/current/hbase-master/lib/commons-beanutils-core-1.8.0.jar:/usr/hdp/current/hbase-master/lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-master/lib/commons-codec-1.9.jar:/usr/hdp/current/hbase-master/lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-master/lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-master/lib/commons-configuration-1.6.jar:/usr/hdp/current/hbase-master/lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-master/lib/commons-digester-1.8.jar:/usr/hdp/current/hbase-master/lib/commons-el-1.0.jar:/usr/hdp/current/hbase-master/lib/commons-io-2.4.jar:/usr/hdp/current/hbase-master/lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-master/lib/commons-lang3-3.4.jar:/usr/hdp/current/hbase-master/lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-master/lib/commons-math-2.2.jar:/usr/hdp/current/hbase-master/lib/commons-math3-3.1.1.jar:/usr/hdp/current/hbase-master/lib/commons-net-3.1.jar:/usr/hdp/current/hbase-master/lib/curator-client-2.7.1.jar:/usr/hdp/current/hbase-master/lib/curator-framework-2.7.1.jar:/usr/hdp/current/hbase-master/lib/curator-recipes-2.7.1.jar:/usr/hdp/current/hbase-master/lib/disruptor-3.3.0.jar:/usr/hdp/current/hbase-master/lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-master/lib/gson-2.2.4.jar:/usr/hdp/current/hbase-master/lib/guava-12.0.1.jar:/usr/hdp/current/hbase-master/lib/guice-3.0.jar:/usr/hdp/current/hbase-master/lib/guice-servlet-3.0.jar:/usr/hdp/current/hbase-master/lib/hbase-annotations-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-annotations-1.1.2.2.5.3.0-37-tests.jar:/usr/hdp/current/hbase-master/lib/hbase-annotations.jar:/usr/hdp/current/hbase-master/lib/hbase-client-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-client.jar:/usr/hdp/current/hbase-master/lib/hbase-common-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-common-1.1.2.2.5.3.0-37-tests.jar:/usr/hdp/current/hbase-master/lib/hbase-common.jar:/usr/hdp/current/hbase-master/lib/hbase-examples-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-examples.jar:/usr/hdp/current/hbase-master/lib/hbase-hadoop2-compat-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-master/lib/hbase-hadoop-compat-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-master/lib/hbase-it-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-it-1.1.2.2.5.3.0-37-tests.jar:/usr/hdp/current/hbase-master/lib/hbase-it.jar:/usr/hdp/current/hbase-master/lib/hbase-prefix-tree-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-prefix-tree.jar:/usr/hdp/current/hbase-master/lib/hbase-procedure-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-procedure.jar:/usr/hdp/current/hbase-master/lib/hbase-protocol-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-protocol.jar:/usr/hdp/current/hbase-master/lib/hbase-resource-bundle-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-master/lib/hbase-rest-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-rest.jar:/usr/hdp/current/hbase-master/lib/hbase-rsgroup-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-rsgroup-1.1.2.2.5.3.0-37-tests.jar:/usr/hdp/current/hbase-master/lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-master/lib/hbase-server-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-server-1.1.2.2.5.3.0-37-tests.jar:/usr/hdp/current/hbase-master/lib/hbase-server.jar:/usr/hdp/current/hbase-master/lib/hbase-shell-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-shell.jar:/usr/hdp/current/hbase-master/lib/hbase-thrift-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-thrift.jar:/usr/hdp/current/hbase-master/lib/htrace-core-3.1.0-incubating.jar:/usr/hdp/current/hbase-master/lib/jackson-core-2.6.0.jar:/usr/hdp/current/hbase-master/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-master/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/current/hbase-master/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-master/lib/jackson-xc-1.9.13.jar:/usr/hdp/current/hbase-master/lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-master/lib/jasper-compiler-5.5.23.jar:/usr/hdp/current/hbase-master/lib/jasper-runtime-5.5.23.jar:/usr/hdp/current/hbase-master/lib/javax.inject-1.jar:/usr/hdp/current/hbase-master/lib/java-xmlbuilder-0.4.jar:/usr/hdp/current/hbase-master/lib/jaxb-api-2.2.2.jar:/usr/hdp/current/hbase-master/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-master/lib/jcip-annotations-1.0.jar:/usr/hdp/current/hbase-master/lib/jcodings-1.0.8.jar:/usr/hdp/current/hbase-master/lib/jersey-client-1.9.jar:/usr/hdp/current/hbase-master/lib/jersey-core-1.9.jar:/usr/hdp/current/hbase-master/lib/jersey-guice-1.9.jar:/usr/hdp/current/hbase-master/lib/jersey-json-1.9.jar:/usr/hdp/current/hbase-master/lib/jersey-server-1.9.jar:/usr/hdp/current/hbase-master/lib/jets3t-0.9.0.jar:/usr/hdp/current/hbase-master/lib/jettison-1.3.3.jar:/usr/hdp/current/hbase-master/lib/jetty-6.1.26.hwx.jar:/usr/hdp/current/hbase-master/lib/jetty-sslengine-6.1.26.hwx.jar:/usr/hdp/current/hbase-master/lib/jetty-util-6.1.26.hwx.jar:/usr/hdp/current/hbase-master/lib/joni-2.1.2.jar:/usr/hdp/current/hbase-master/lib/jruby-complete-1.6.8.jar:/usr/hdp/current/hbase-master/lib/jsch-0.1.42.jar:/usr/hdp/current/hbase-master/lib/json-smart-1.1.1.jar:/usr/hdp/current/hbase-master/lib/jsp-2.1-6.1.14.jar:/usr/hdp/current/hbase-master/lib/jsp-api-2.1-6.1.14.jar:/usr/hdp/current/hbase-master/lib/jsr305-1.3.9.jar:/usr/hdp/current/hbase-master/lib/junit-4.12.jar:/usr/hdp/current/hbase-master/lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-master/lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-master/lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-master/lib/metrics-core-2.2.0.jar:/usr/hdp/current/hbase-master/lib/netty-3.2.4.Final.jar:/usr/hdp/current/hbase-master/lib/netty-all-4.0.23.Final.jar:/usr/hdp/current/hbase-master/lib/nimbus-jose-jwt-3.9.jar:/usr/hdp/current/hbase-master/lib/ojdbc6.jar:/usr/hdp/current/hbase-master/lib/okhttp-2.4.0.jar:/usr/hdp/current/hbase-master/lib/okio-1.4.0.jar:/usr/hdp/current/hbase-master/lib/paranamer-2.3.jar:/usr/hdp/current/hbase-master/lib/phoenix-server.jar:/usr/hdp/current/hbase-master/lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-master/lib/ranger-hbase-plugin-shim-0.6.0.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/ranger-plugin-classloader-0.6.0.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/servlet-api-2.5-6.1.14.jar:/usr/hdp/current/hbase-master/lib/servlet-api-2.5.jar:/usr/hdp/current/hbase-master/lib/slf4j-api-1.7.7.jar:/usr/hdp/current/hbase-master/lib/snappy-java-1.0.4.1.jar:/usr/hdp/current/hbase-master/lib/spymemcached-2.11.6.jar:/usr/hdp/current/hbase-master/lib/xercesImpl-2.9.1.jar:/usr/hdp/current/hbase-master/lib/xml-apis-1.3.04.jar:/usr/hdp/current/hbase-master/lib/xmlenc-0.52.jar:/usr/hdp/current/hbase-master/lib/xz-1.0.jar:/usr/hdp/current/hbase-master/lib/zookeeper.jar:/appdata/hdp/2.5.3.0-37/hadoop/conf:/usr/hdp/2.5.3.0-37/hadoop/lib/*:/usr/hdp/2.5.3.0-37/hadoop/.//*:/usr/hdp/2.5.3.0-37/hadoop-hdfs/./:/usr/hdp/2.5.3.0-37/hadoop-hdfs/lib/*:/usr/hdp/2.5.3.0-37/hadoop-hdfs/.//*:/usr/hdp/2.5.3.0-37/hadoop-yarn/lib/*:/usr/hdp/2.5.3.0-37/hadoop-yarn/.//*:/usr/hdp/2.5.3.0-37/hadoop-mapreduce/lib/*:/usr/hdp/2.5.3.0-37/hadoop-mapreduce/.//*::/usr/share/java/mysql-connector-java.jar:/usr/lib/hadoop-mapreduce/*:/usr/hdp/2.5.3.0-37/tez/*:/usr/hdp/2.5.3.0-37/tez/lib/*:/usr/hdp/2.5.3.0-37/tez/conf:/usr/hdp/2.5.3.0-37/hadoop/conf:/usr/hdp/2.5.3.0-37/hadoop/*:/usr/hdp/2.5.3.0-37/hadoop/lib/*:/usr/hdp/current/zookeeper-server/*:://hadoop/conf:/usr/hdp/2.5.3.0-37/atlas/hook/hive/*:/usr/hdp/2.5.3.0-37/hive/lib/accumulo-core-1.7.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/accumulo-fate-1.7.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/accumulo-start-1.7.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/accumulo-trace-1.7.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/activation-1.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/ant-1.9.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/ant-launcher-1.9.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/antlr-2.7.7.jar:/usr/hdp/2.5.3.0-37/hive/lib/antlr-runtime-3.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/apache-log4j-extras-1.2.17.jar:/usr/hdp/2.5.3.0-37/hive/lib/asm-commons-3.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/asm-tree-3.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/avatica-1.8.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/avatica-metrics-1.8.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/avro-1.7.5.jar:/usr/hdp/2.5.3.0-37/hive/lib/bonecp-0.8.0.RELEASE.jar:/usr/hdp/2.5.3.0-37/hive/lib/calcite-core-1.2.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/calcite-linq4j-1.2.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-cli-1.2.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-codec-1.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-collections-3.2.2.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-compiler-2.7.6.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-compress-1.4.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-dbcp-1.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-httpclient-3.0.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-io-2.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-lang-2.6.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-logging-1.1.3.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-math-2.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-pool-1.5.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-vfs2-2.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/curator-client-2.6.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/curator-framework-2.6.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/curator-recipes-2.6.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/datanucleus-api-jdo-4.2.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/datanucleus-core-4.1.6.jar:/usr/hdp/2.5.3.0-37/hive/lib/datanucleus-rdbms-4.1.7.jar:/usr/hdp/2.5.3.0-37/hive/lib/derby-10.10.2.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/dropwizard-metrics-hadoop-metrics2-reporter-0.1.2.jar:/usr/hdp/2.5.3.0-37/hive/lib/eigenbase-properties-1.1.5.jar:/usr/hdp/2.5.3.0-37/hive/lib/geronimo-annotation_1.0_spec-1.1.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/geronimo-jaspic_1.0_spec-1.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/geronimo-jta_1.1_spec-1.1.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/groovy-all-2.4.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/guava-14.0.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/HikariCP-1.3.9.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-accumulo-handler-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-accumulo-handler.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-ant-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-ant.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-beeline-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-beeline.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-cli-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-cli.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-common-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-common.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-contrib-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-contrib.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-exec-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-exec.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-hbase-handler-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-hbase-handler.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-hwi-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-hwi.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-jdbc-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-jdbc-1.2.1000.2.5.3.0-37-standalone.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-jdbc.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-metastore-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-metastore.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-serde-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-serde.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-service-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-service.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-shims-0.20S-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-shims-0.23-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-shims-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-shims-common-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-shims-common.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-shims.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-shims-scheduler-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-shims-scheduler.jar:/usr/hdp/2.5.3.0-37/hive/lib/htrace-core-3.1.0-incubating.jar:/usr/hdp/2.5.3.0-37/hive/lib/httpclient-4.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/httpcore-4.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/ivy-2.4.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/jackson-annotations-2.4.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/jackson-core-2.4.2.jar:/usr/hdp/2.5.3.0-37/hive/lib/jackson-databind-2.4.2.jar:/usr/hdp/2.5.3.0-37/hive/lib/janino-2.7.6.jar:/usr/hdp/2.5.3.0-37/hive/lib/javassist-3.18.1-GA.jar:/usr/hdp/2.5.3.0-37/hive/lib/javax.jdo-3.2.0-m3.jar:/usr/hdp/2.5.3.0-37/hive/lib/jcommander-1.32.jar:/usr/hdp/2.5.3.0-37/hive/lib/jdo-api-3.0.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/jetty-all-7.6.0.v20120127.jar:/usr/hdp/2.5.3.0-37/hive/lib/jetty-all-server-7.6.0.v20120127.jar:/usr/hdp/2.5.3.0-37/hive/lib/jline-2.12.jar:/usr/hdp/2.5.3.0-37/hive/lib/joda-time-2.8.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/jpam-1.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/json-20090211.jar:/usr/hdp/2.5.3.0-37/hive/lib/jsr305-3.0.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/jta-1.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/libfb303-0.9.3.jar:/usr/hdp/2.5.3.0-37/hive/lib/libthrift-0.9.3.jar:/usr/hdp/2.5.3.0-37/hive/lib/log4j-1.2.16.jar:/usr/hdp/2.5.3.0-37/hive/lib/mail-1.4.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/maven-scm-api-1.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/maven-scm-provider-svn-commons-1.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/maven-scm-provider-svnexe-1.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/metrics-core-3.1.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/metrics-json-3.1.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/metrics-jvm-3.1.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/mysql-connector-java.jar:/usr/hdp/2.5.3.0-37/hive/lib/netty-3.7.0.Final.jar:/usr/hdp/2.5.3.0-37/hive/lib/ojdbc6.jar:/usr/hdp/2.5.3.0-37/hive/lib/opencsv-2.3.jar:/usr/hdp/2.5.3.0-37/hive/lib/oro-2.0.8.jar:/usr/hdp/2.5.3.0-37/hive/lib/paranamer-2.3.jar:/usr/hdp/2.5.3.0-37/hive/lib/parquet-hadoop-bundle-1.8.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/pentaho-aggdesigner-algorithm-5.1.5-jhyde.jar:/usr/hdp/2.5.3.0-37/hive/lib/plexus-utils-1.5.6.jar:/usr/hdp/2.5.3.0-37/hive/lib/protobuf-java-2.5.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/ranger-hive-plugin-shim-0.6.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/ranger-plugin-classloader-0.6.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/regexp-1.3.jar:/usr/hdp/2.5.3.0-37/hive/lib/servlet-api-2.5.jar:/usr/hdp/2.5.3.0-37/hive/lib/snappy-java-1.0.5.jar:/usr/hdp/2.5.3.0-37/hive/lib/ST4-4.0.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/stax-api-1.0.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/stringtemplate-3.2.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/super-csv-2.2.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/transaction-api-1.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/velocity-1.5.jar:/usr/hdp/2.5.3.0-37/hive/lib/xz-1.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/zookeeper-3.4.6.2.5.3.0-37.jar::/appdata/hdp/2.5.3.0-37/hive-hcatalog/libexec/../share/hcatalog/hive-hcatalog-core-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/conf::/usr/hdp/current/hbase-master/conf:/usr/hdp/2.5.3.0-37/sqoop/sqoop-1.4.6.2.5.3.0-37.jar::/usr/share/java/mysql-connector-java.jar:/usr/lib/hadoop-mapreduce/*:/usr/hdp/2.5.3.0-37/tez/*:/usr/hdp/2.5.3.0-37/tez/lib/*:/usr/hdp/2.5.3.0-37/tez/conf" export LD_LIBRARY_PATH="$PWD:/usr/hdp/2.5.3.0-37/hadoop/lib/native:/usr/hdp/2.5.3.0-37/hadoop/lib/native/Linux-amd64-64" export STDERR_LOGFILE_ENV="/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000003/stderr" export LOGNAME="root" export JVM_PID="$$" export PWD="/usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012/container_1481156388370_0012_01_000003" export HADOOP_CLIENT_OPTS="-Xmx128m -Xmx128m " export LOCAL_DIRS="/usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012" export SHELL="/bin/bash" export NM_HTTP_PORT="8042" export LOG_DIRS="/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000003" export NM_AUX_SERVICE_mapreduce_shuffle="AAAfkQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA= " export NM_PORT="45454" export USER="root" export HADOOP_YARN_HOME=${HADOOP_YARN_HOME:-"/usr/hdp/2.5.3.0-37/hadoop-yarn"} export CLASSPATH="$PWD:$PWD/mr-framework/hadoop/share/hadoop/mapreduce/*:$PWD/mr-framework/hadoop/share/hadoop/mapreduce/lib/*:$PWD/mr-framework/hadoop/share/hadoop/common/*:$PWD/mr-framework/hadoop/share/hadoop/common/lib/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/lib/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/lib/*:/usr/hdp/2.5.3.0-37/hadoop/lib/hadoop-lzo-0.6.0.2.5.3.0-37.jar:/etc/hadoop/conf/secure:job.jar/job.jar:job.jar/classes/:job.jar/lib/*:$PWD/*" export HADOOP_TOKEN_FILE_LOCATION="/usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012/container_1481156388370_0012_01_000003/container_tokens" export LOCAL_USER_DIRS="/usr/local/middleware/hadoop/yarn/local/usercache/root/" export HOME="/home/" export CONTAINER_ID="container_1481156388370_0012_01_000003" export MALLOC_ARENA_MAX="4" ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/188/kite-data-hive-1.1.0.jar" "kite-data-hive-1.1.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/187/commons-lang3-3.4.jar" "commons-lang3-3.4.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/174/slf4j-api-1.7.7.jar" "slf4j-api-1.7.7.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/166/opencsv-2.3.jar" "opencsv-2.3.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/172/parquet-hadoop-1.6.0.jar" "parquet-hadoop-1.6.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/176/hsqldb-1.8.0.10.jar" "hsqldb-1.8.0.10.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/189/commons-io-1.4.jar" "commons-io-1.4.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/192/hortonworks-teradata-connector-1.5.1.2.5.0.0-1245.jar" "hortonworks-teradata-connector-1.5.1.2.5.0.0-1245.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/180/parquet-encoding-1.6.0.jar" "parquet-encoding-1.6.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/182/jackson-core-2.3.1.jar" "jackson-core-2.3.1.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/191/parquet-common-1.6.0.jar" "parquet-common-1.6.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/163/parquet-avro-1.6.0.jar" "parquet-avro-1.6.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012/filecache/10/job.jar" "job.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/161/ant-contrib-1.0b3.jar" "ant-contrib-1.0b3.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/178/jackson-mapper-asl-1.9.13.jar" "jackson-mapper-asl-1.9.13.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/183/paranamer-2.7.jar" "paranamer-2.7.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/167/teradata-connector-1.5.1-hadoop2.jar" "teradata-connector-1.5.1-hadoop2.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/194/avro-mapred-1.8.0-hadoop2.jar" "avro-mapred-1.8.0-hadoop2.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/185/jackson-databind-2.3.1.jar" "jackson-databind-2.3.1.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/193/commons-jexl-2.1.1.jar" "commons-jexl-2.1.1.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/168/parquet-jackson-1.6.0.jar" "parquet-jackson-1.6.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/181/kite-data-mapreduce-1.1.0.jar" "kite-data-mapreduce-1.1.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012/filecache/11/job.xml" "job.xml" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/162/tdgssconfig.jar" "tdgssconfig.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/filecache/11/mapreduce.tar.gz" "mr-framework" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/164/avro-1.8.0.jar" "avro-1.8.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/171/commons-logging-1.1.1.jar" "commons-logging-1.1.1.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/175/commons-codec-1.4.jar" "commons-codec-1.4.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/186/ant-eclipse-1.0-jvm1.2.jar" "ant-eclipse-1.0-jvm1.2.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/160/kite-hadoop-compatibility-1.1.0.jar" "kite-hadoop-compatibility-1.1.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/158/parquet-generator-1.6.0.jar" "parquet-generator-1.6.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/169/terajdbc4.jar" "terajdbc4.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/173/snappy-java-1.1.1.6.jar" "snappy-java-1.1.1.6.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/190/parquet-format-2.2.0-rc1.jar" "parquet-format-2.2.0-rc1.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/177/xz-1.5.jar" "xz-1.5.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/165/kite-data-core-1.1.0.jar" "kite-data-core-1.1.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/179/commons-compress-1.8.1.jar" "commons-compress-1.8.1.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/159/jackson-annotations-2.3.1.jar" "jackson-annotations-2.3.1.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/184/parquet-column-1.6.0.jar" "parquet-column-1.6.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/170/jackson-core-asl-1.9.13.jar" "jackson-core-asl-1.9.13.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi # Creating copy of launch script cp "launch_container.sh" "/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000003/launch_container.sh" chmod 640 "/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000003/launch_container.sh" # Determining directory contents echo "ls -l:" 1>"/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000003/directory.info" ls -l 1>>"/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000003/directory.info" echo "find -L . -maxdepth 5 -ls:" 1>>"/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000003/directory.info" find -L . -maxdepth 5 -ls 1>>"/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000003/directory.info" echo "broken symlinks(find -L . -maxdepth 5 -type l -ls):" 1>>"/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000003/directory.info" find -L . -maxdepth 5 -type l -ls 1>>"/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000003/directory.info" exec /bin/bash -c "$JAVA_HOME/bin/java -server -XX:NewRatio=8 -Djava.library.path=/usr/hdp/current/hadoop/lib/native/ -Djava.net.preferIPv4Stack=true -Dhdp.version=2.5.3.0-37 -Xmx512m -Djava.io.tmpdir=$PWD/tmp -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000003 -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Dhadoop.root.logfile=syslog org.apache.hadoop.mapred.YarnChild 10.236.211.27 36415 attempt_1481156388370_0012_m_000001_0 3 1>/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000003/stdout 2>/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000003/stderr " hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi End of LogType:launch_container.sh LogType:stderr Log Upload Time:Thu Dec 15 11:16:28 -0800 2016 LogLength:243 Log Contents: log4j:WARN No appenders could be found for logger (org.apache.hadoop.metrics2.impl.MetricsSystemImpl). log4j:WARN Please initialize the log4j system properly. log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info. End of LogType:stderr LogType:stdout Log Upload Time:Thu Dec 15 11:16:28 -0800 2016 LogLength:0 Log Contents: End of LogType:stdout LogType:syslog Log Upload Time:Thu Dec 15 11:16:28 -0800 2016 LogLength:5500 Log Contents: 2016-12-15 11:16:14,409 WARN [main] org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2016-12-15 11:16:14,460 WARN [main] org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate configuration: tried hadoop-metrics2-maptask.properties,hadoop-metrics2.properties 2016-12-15 11:16:14,513 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s). 2016-12-15 11:16:14,513 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MapTask metrics system started 2016-12-15 11:16:14,520 INFO [main] org.apache.hadoop.mapred.YarnChild: Executing with tokens: 2016-12-15 11:16:14,520 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: mapreduce.job, Service: job_1481156388370_0012, Ident: (org.apache.hadoop.mapreduce.security.token.JobTokenIdentifier@54422e18) 2016-12-15 11:16:14,679 INFO [main] org.apache.hadoop.mapred.YarnChild: Sleeping for 0ms before retrying again. Got null now. 2016-12-15 11:16:14,853 INFO [main] org.apache.hadoop.mapred.YarnChild: mapreduce.cluster.local.dir for child: /usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012 2016-12-15 11:16:15,072 INFO [main] org.apache.hadoop.conf.Configuration.deprecation: session.id is deprecated. Instead, use dfs.metrics.session-id 2016-12-15 11:16:15,444 WARN [main] org.apache.hadoop.hdfs.shortcircuit.DomainSocketFactory: The short-circuit local reads feature cannot be used because libhadoop cannot be loaded. 2016-12-15 11:16:15,456 INFO [main] org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: File Output Committer Algorithm version is 1 2016-12-15 11:16:15,456 INFO [main] org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false 2016-12-15 11:16:15,464 INFO [main] org.apache.hadoop.mapred.Task: Using ResourceCalculatorProcessTree : [ ] 2016-12-15 11:16:15,617 INFO [main] org.apache.hadoop.mapred.MapTask: Processing split: inputSplitClass:com.teradata.connector.teradata.TeradataInputFormat$TeradataInputSplit split0:com.teradata.connector.teradata.TeradataInputFormat$TeradataInputSplit@1cb3ec38 2016-12-15 11:16:15,620 INFO [main] com.teradata.connector.common.ConnectorCombineInputFormat$ConnectorCombinePlugedinInputRecordReader: recordreader class com.teradata.connector.common.ConnectorCombineInputFormat$ConnectorCombinePlugedinInputRecordReaderinitialize time is: 1481829375620 2016-12-15 11:16:15,665 INFO [main] com.teradata.connector.teradata.TeradataInputFormat$TeradataRecordReader: recordreader class com.teradata.connector.teradata.TeradataInputFormat$TeradataRecordReaderinitialize time is: 1481829375665 2016-12-15 11:16:15,667 INFO [main] com.teradata.connector.common.ConnectorOutputFormat$ConnectorFileRecordWriter: recordwriter class com.teradata.connector.common.ConnectorOutputFormat$ConnectorFileRecordWriterinitialize time is: 1481829375667 2016-12-15 11:16:17,902 INFO [main] org.apache.hadoop.conf.Configuration.deprecation: mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout 2016-12-15 11:16:17,903 INFO [main] com.teradata.connector.common.ConnectorMMapper: keep-alive thread started 2016-12-15 11:16:20,496 INFO [main] com.teradata.connector.teradata.TeradataInputFormat$TeradataRecordReader: recordreader class com.teradata.connector.teradata.TeradataInputFormat$TeradataRecordReaderclose time is: 1481829380496 2016-12-15 11:16:20,496 INFO [main] com.teradata.connector.teradata.TeradataInputFormat$TeradataRecordReader: the total elapsed time of recordreader com.teradata.connector.teradata.TeradataInputFormat$TeradataRecordReader4s 2016-12-15 11:16:20,716 INFO [main] com.teradata.connector.common.ConnectorCombineInputFormat$ConnectorCombinePlugedinInputRecordReader: recordreader class com.teradata.connector.common.ConnectorCombineInputFormat$ConnectorCombinePlugedinInputRecordReaderclose time is: 1481829380716 2016-12-15 11:16:20,716 INFO [main] com.teradata.connector.common.ConnectorCombineInputFormat$ConnectorCombinePlugedinInputRecordReader: the total elapsed time of recordreader com.teradata.connector.common.ConnectorCombineInputFormat$ConnectorCombinePlugedinInputRecordReader5s 2016-12-15 11:16:20,721 INFO [main] com.teradata.connector.common.ConnectorOutputFormat$ConnectorFileRecordWriter: recordwriter class com.teradata.connector.common.ConnectorOutputFormat$ConnectorFileRecordWriterclose time is: 1481829380721 2016-12-15 11:16:20,721 INFO [main] com.teradata.connector.common.ConnectorOutputFormat$ConnectorFileRecordWriter: the total elapsed time of recordwriter com.teradata.connector.common.ConnectorOutputFormat$ConnectorFileRecordWriter5s 2016-12-15 11:16:20,721 INFO [main] org.apache.hadoop.mapred.Task: Task:attempt_1481156388370_0012_m_000001_0 is done. And is in the process of committing 2016-12-15 11:16:20,770 INFO [main] org.apache.hadoop.mapred.Task: Task attempt_1481156388370_0012_m_000001_0 is allowed to commit now 2016-12-15 11:16:20,775 INFO [main] org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Saved output of task 'attempt_1481156388370_0012_m_000001_0' to hdfs://xxx.net:8020/tmp/tt/status/_temporary/1/task_1481156388370_0012_m_000001 2016-12-15 11:16:20,800 INFO [main] org.apache.hadoop.mapred.Task: Task 'attempt_1481156388370_0012_m_000001_0' done. End of LogType:syslog Container: container_1481156388370_0012_01_000002 on xxx.net_45454 ====================================================================================== LogType:directory.info Log Upload Time:Thu Dec 15 11:16:28 -0800 2016 LogLength:25899 Log Contents: ls -l: total 208 lrwxrwxrwx 1 root root 90 Dec 15 11:16 ant-contrib-1.0b3.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/161/ant-contrib-1.0b3.jar lrwxrwxrwx 1 root root 95 Dec 15 11:16 ant-eclipse-1.0-jvm1.2.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/186/ant-eclipse-1.0-jvm1.2.jar lrwxrwxrwx 1 root root 83 Dec 15 11:16 avro-1.8.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/164/avro-1.8.0.jar lrwxrwxrwx 1 root root 98 Dec 15 11:16 avro-mapred-1.8.0-hadoop2.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/194/avro-mapred-1.8.0-hadoop2.jar lrwxrwxrwx 1 root root 90 Dec 15 11:16 commons-codec-1.4.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/175/commons-codec-1.4.jar lrwxrwxrwx 1 root root 95 Dec 15 11:16 commons-compress-1.8.1.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/179/commons-compress-1.8.1.jar lrwxrwxrwx 1 root root 87 Dec 15 11:16 commons-io-1.4.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/189/commons-io-1.4.jar lrwxrwxrwx 1 root root 91 Dec 15 11:16 commons-jexl-2.1.1.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/193/commons-jexl-2.1.1.jar lrwxrwxrwx 1 root root 90 Dec 15 11:16 commons-lang3-3.4.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/187/commons-lang3-3.4.jar lrwxrwxrwx 1 root root 94 Dec 15 11:16 commons-logging-1.1.1.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/171/commons-logging-1.1.1.jar -rw-r--r-- 1 root root 227 Dec 15 11:16 container_tokens -rwx------ 1 root root 709 Dec 15 11:16 default_container_executor_session.sh -rwx------ 1 root root 763 Dec 15 11:16 default_container_executor.sh lrwxrwxrwx 1 root root 122 Dec 15 11:16 hortonworks-teradata-connector-1.5.1.2.5.0.0-1245.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/192/hortonworks-teradata-connector-1.5.1.2.5.0.0-1245.jar lrwxrwxrwx 1 root root 88 Dec 15 11:16 hsqldb-1.8.0.10.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/176/hsqldb-1.8.0.10.jar lrwxrwxrwx 1 root root 98 Dec 15 11:16 jackson-annotations-2.3.1.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/159/jackson-annotations-2.3.1.jar lrwxrwxrwx 1 root root 91 Dec 15 11:16 jackson-core-2.3.1.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/182/jackson-core-2.3.1.jar lrwxrwxrwx 1 root root 96 Dec 15 11:16 jackson-core-asl-1.9.13.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/170/jackson-core-asl-1.9.13.jar lrwxrwxrwx 1 root root 95 Dec 15 11:16 jackson-databind-2.3.1.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/185/jackson-databind-2.3.1.jar lrwxrwxrwx 1 root root 98 Dec 15 11:16 jackson-mapper-asl-1.9.13.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/178/jackson-mapper-asl-1.9.13.jar lrwxrwxrwx 1 root root 115 Dec 15 11:16 job.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012/filecache/10/job.jar lrwxrwxrwx 1 root root 115 Dec 15 11:16 job.xml -> /usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012/filecache/11/job.xml lrwxrwxrwx 1 root root 93 Dec 15 11:16 kite-data-core-1.1.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/165/kite-data-core-1.1.0.jar lrwxrwxrwx 1 root root 93 Dec 15 11:16 kite-data-hive-1.1.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/188/kite-data-hive-1.1.0.jar lrwxrwxrwx 1 root root 98 Dec 15 11:16 kite-data-mapreduce-1.1.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/181/kite-data-mapreduce-1.1.0.jar lrwxrwxrwx 1 root root 104 Dec 15 11:16 kite-hadoop-compatibility-1.1.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/160/kite-hadoop-compatibility-1.1.0.jar -rwx------ 1 root root 32487 Dec 15 11:16 launch_container.sh lrwxrwxrwx 1 root root 69 Dec 15 11:16 mr-framework -> /usr/local/middleware/hadoop/yarn/local/filecache/11/mapreduce.tar.gz lrwxrwxrwx 1 root root 84 Dec 15 11:16 opencsv-2.3.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/166/opencsv-2.3.jar lrwxrwxrwx 1 root root 86 Dec 15 11:16 paranamer-2.7.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/183/paranamer-2.7.jar lrwxrwxrwx 1 root root 91 Dec 15 11:16 parquet-avro-1.6.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/163/parquet-avro-1.6.0.jar lrwxrwxrwx 1 root root 93 Dec 15 11:16 parquet-column-1.6.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/184/parquet-column-1.6.0.jar lrwxrwxrwx 1 root root 93 Dec 15 11:16 parquet-common-1.6.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/191/parquet-common-1.6.0.jar lrwxrwxrwx 1 root root 95 Dec 15 11:16 parquet-encoding-1.6.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/180/parquet-encoding-1.6.0.jar lrwxrwxrwx 1 root root 97 Dec 15 11:16 parquet-format-2.2.0-rc1.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/190/parquet-format-2.2.0-rc1.jar lrwxrwxrwx 1 root root 96 Dec 15 11:16 parquet-generator-1.6.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/158/parquet-generator-1.6.0.jar lrwxrwxrwx 1 root root 93 Dec 15 11:16 parquet-hadoop-1.6.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/172/parquet-hadoop-1.6.0.jar lrwxrwxrwx 1 root root 94 Dec 15 11:16 parquet-jackson-1.6.0.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/168/parquet-jackson-1.6.0.jar lrwxrwxrwx 1 root root 88 Dec 15 11:16 slf4j-api-1.7.7.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/174/slf4j-api-1.7.7.jar lrwxrwxrwx 1 root root 92 Dec 15 11:16 snappy-java-1.1.1.6.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/173/snappy-java-1.1.1.6.jar lrwxrwxrwx 1 root root 84 Dec 15 11:16 tdgssconfig.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/162/tdgssconfig.jar lrwxrwxrwx 1 root root 105 Dec 15 11:16 teradata-connector-1.5.1-hadoop2.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/167/teradata-connector-1.5.1-hadoop2.jar lrwxrwxrwx 1 root root 82 Dec 15 11:16 terajdbc4.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/169/terajdbc4.jar drwx--x--- 2 root root 4096 Dec 15 11:16 tmp lrwxrwxrwx 1 root root 79 Dec 15 11:16 xz-1.5.jar -> /usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/177/xz-1.5.jar find -L . -maxdepth 5 -ls: 44435404 4 drwx--x--- 3 root root 4096 Dec 15 11:16 . 44435249 60 -r-x------ 1 root root 58131 Dec 15 11:16 ./commons-codec-1.4.jar 44435273 36 -r-x------ 1 root root 34047 Dec 15 11:16 ./paranamer-2.7.jar 44435311 4 drwx------ 3 root root 4096 Dec 15 11:16 ./job.jar 44435309 4980 -r-x------ 1 root root 5098776 Dec 15 11:16 ./job.jar/job.jar 44435312 4 drwx------ 2 root root 4096 Dec 15 11:16 ./job.jar/lib 44435314 184 -r-x------ 1 root root 185140 Sep 7 15:18 ./job.jar/lib/commons-io-2.4.jar 44435317 1972 -r-x------ 1 root root 2019274 Sep 7 15:18 ./job.jar/lib/ant-1.9.4.jar 44435315 20 -r-x------ 1 root root 19827 Sep 7 15:18 ./job.jar/lib/opencsv-2.3.jar 44435313 32 -r-x------ 1 root root 31605 Sep 7 15:18 ./job.jar/lib/commons-logging-1.0.3.jar 44435318 4 -r-x------ 1 root root 2615 Oct 3 11:51 ./job.jar/lib/tdgssconfig.jar 44435316 612 -r-x------ 1 root root 625986 Sep 7 15:18 ./job.jar/lib/joda-time-2.9.1.jar 44435319 1068 -r-x------ 1 root root 1093618 Oct 3 11:51 ./job.jar/lib/terajdbc4.jar 44435267 1704 -r-x------ 1 root root 1744166 Dec 15 11:16 ./kite-data-mapreduce-1.1.0.jar 44435261 360 -r-x------ 1 root root 365977 Dec 15 11:16 ./commons-compress-1.8.1.jar 44435291 108 -r-x------ 1 root root 108990 Dec 15 11:16 ./commons-io-1.4.jar 44435419 4 -rw-r--r-- 1 root root 264 Dec 15 11:16 ./.launch_container.sh.crc 44435279 884 -r-x------ 1 root root 902327 Dec 15 11:16 ./jackson-databind-2.3.1.jar 44435416 32 -rwx------ 1 root root 32487 Dec 15 11:16 ./launch_container.sh 44435198 24 -r-x------ 1 root root 20728 Dec 15 11:16 ./parquet-generator-1.6.0.jar 44435246 32 -r-x------ 1 root root 29241 Dec 15 11:16 ./slf4j-api-1.7.7.jar 44435294 364 -r-x------ 1 root root 371050 Dec 15 11:16 ./parquet-format-2.2.0-rc1.jar 44435428 4 -rw-r--r-- 1 root root 16 Dec 15 11:16 ./.default_container_executor_session.sh.crc 44435285 424 -r-x------ 1 root root 430341 Dec 15 11:16 ./commons-lang3-3.4.jar 44435222 20 -r-x------ 1 root root 19816 Dec 15 11:16 ./opencsv-2.3.jar 44435321 132 -r-x------ 1 root root 132355 Dec 15 11:16 ./job.xml 44435410 4 -rw-r--r-- 1 root root 227 Dec 15 11:16 ./container_tokens 44435306 180 -r-x------ 1 root root 183770 Dec 15 11:16 ./avro-mapred-1.8.0-hadoop2.jar 44435406 4 drwx--x--- 2 root root 4096 Dec 15 11:16 ./tmp 44435252 692 -r-x------ 1 root root 706015 Dec 15 11:16 ./hsqldb-1.8.0.10.jar 44435300 24 -r-x------ 1 root root 22675 Dec 15 11:16 ./hortonworks-teradata-connector-1.5.1.2.5.0.0-1245.jar 44435213 56 -r-x------ 1 root root 53418 Dec 15 11:16 ./parquet-avro-1.6.0.jar 44435413 4 -rw-r--r-- 1 root root 12 Dec 15 11:16 ./.container_tokens.crc 44435234 228 -r-x------ 1 root root 229445 Dec 15 11:16 ./jackson-core-asl-1.9.13.jar 44435228 996 -r-x------ 1 root root 1019348 Dec 15 11:16 ./parquet-jackson-1.6.0.jar 44433794 4 drwxr-xr-x 3 root root 4096 Dec 13 11:42 ./mr-framework 44433798 4 drwxr-xr-x 9 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop 44433841 4 drwxr-xr-x 2 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/include 44433846 4 -r-xr-xr-x 1 jenkins users 3319 Nov 29 10:21 ./mr-framework/hadoop/include/TemplateFactory.hh 44433842 8 -r-xr-xr-x 1 jenkins users 6330 Nov 29 10:21 ./mr-framework/hadoop/include/Pipes.hh 44433845 8 -r-xr-xr-x 1 jenkins users 4514 Nov 29 10:21 ./mr-framework/hadoop/include/SerialUtils.hh 44433844 36 -r-xr-xr-x 1 jenkins users 33361 Nov 29 10:21 ./mr-framework/hadoop/include/hdfs.h 44433843 4 -r-xr-xr-x 1 jenkins users 2441 Nov 29 10:21 ./mr-framework/hadoop/include/StringUtils.hh 44434867 4 drwxr-xr-x 2 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/bin 44434872 8 -r-xr-xr-x 1 jenkins users 6448 Nov 29 10:21 ./mr-framework/hadoop/bin/mapred 44434871 4 -r-xr-xr-x 1 jenkins users 888 Nov 29 10:21 ./mr-framework/hadoop/bin/kill-secondary-name-node 44434876 12 -r-xr-xr-x 1 jenkins users 8786 Nov 29 10:21 ./mr-framework/hadoop/bin/hadoop.cmd 44434877 4 -r-xr-xr-x 1 jenkins users 1857 Nov 29 10:21 ./mr-framework/hadoop/bin/rcc 44434878 12 -r-xr-xr-x 1 jenkins users 12069 Nov 29 10:21 ./mr-framework/hadoop/bin/yarn.cmd 44434869 4 -r-xr-xr-x 1 jenkins users 830 Nov 29 10:21 ./mr-framework/hadoop/bin/kill-name-node 44434870 12 -r-xr-xr-x 1 jenkins users 8782 Nov 29 10:21 ./mr-framework/hadoop/bin/hdfs.cmd 44434879 8 -r-xr-xr-x 1 jenkins users 7120 Nov 29 10:21 ./mr-framework/hadoop/bin/hadoop 44434880 16 -r-xr-xr-x 1 jenkins users 12707 Nov 29 10:21 ./mr-framework/hadoop/bin/hdfs 44434868 8 -r-xr-xr-x 1 jenkins users 7465 Nov 29 10:21 ./mr-framework/hadoop/bin/mapred.cmd 44434874 124 -r-xr-xr-x 1 jenkins users 125137 Nov 29 10:21 ./mr-framework/hadoop/bin/container-executor 44434873 140 -r-xr-xr-x 1 jenkins users 139697 Nov 29 10:21 ./mr-framework/hadoop/bin/test-container-executor 44434875 16 -r-xr-xr-x 1 jenkins users 14958 Nov 29 10:21 ./mr-framework/hadoop/bin/yarn 44433848 4 drwxr-xr-x 2 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/sbin 44433861 4 -r-xr-xr-x 1 jenkins users 2291 Nov 29 10:21 ./mr-framework/hadoop/sbin/httpfs.sh 44433875 4 -r-xr-xr-x 1 jenkins users 1441 Nov 29 10:21 ./mr-framework/hadoop/sbin/hadoop-daemons.sh 44433850 4 -r-xr-xr-x 1 jenkins users 1260 Nov 29 10:21 ./mr-framework/hadoop/sbin/stop-balancer.sh 44433876 4 -r-xr-xr-x 1 jenkins users 3287 Nov 29 10:21 ./mr-framework/hadoop/sbin/stop-dfs.sh 44433857 4 -r-xr-xr-x 1 jenkins users 1543 Nov 29 10:21 ./mr-framework/hadoop/sbin/stop-all.sh 44433870 4 -r-xr-xr-x 1 jenkins users 1401 Nov 29 10:21 ./mr-framework/hadoop/sbin/start-dfs.cmd 44433866 4 -r-xr-xr-x 1 jenkins users 1428 Nov 29 10:21 ./mr-framework/hadoop/sbin/start-yarn.sh 44433858 4 -r-xr-xr-x 1 jenkins users 1209 Nov 29 10:21 ./mr-framework/hadoop/sbin/start-balancer.sh 44433863 4 -r-xr-xr-x 1 jenkins users 1421 Nov 29 10:21 ./mr-framework/hadoop/sbin/stop-secure-dns.sh 44433869 4 -r-xr-xr-x 1 jenkins users 2752 Nov 29 10:21 ./mr-framework/hadoop/sbin/distribute-exclude.sh 44433862 8 -r-xr-xr-x 1 jenkins users 6546 Nov 29 10:21 ./mr-framework/hadoop/sbin/hadoop-daemon.sh 44433853 4 -r-xr-xr-x 1 jenkins users 1571 Nov 29 10:21 ./mr-framework/hadoop/sbin/start-yarn.cmd 44433855 4 -r-xr-xr-x 1 jenkins users 3815 Nov 29 10:21 ./mr-framework/hadoop/sbin/start-dfs.sh 44433864 4 -r-xr-xr-x 1 jenkins users 1642 Nov 29 10:21 ./mr-framework/hadoop/sbin/stop-yarn.cmd 44433860 4 -r-xr-xr-x 1 jenkins users 1552 Nov 29 10:21 ./mr-framework/hadoop/sbin/start-all.sh 44433867 4 -r-xr-xr-x 1 jenkins users 3630 Nov 29 10:21 ./mr-framework/hadoop/sbin/kms.sh 44433852 4 -r-xr-xr-x 1 jenkins users 1421 Nov 29 10:21 ./mr-framework/hadoop/sbin/stop-yarn.sh 44433871 4 -r-xr-xr-x 1 jenkins users 1779 Nov 29 10:21 ./mr-framework/hadoop/sbin/start-all.cmd 44433872 8 -r-xr-xr-x 1 jenkins users 4376 Nov 29 10:21 ./mr-framework/hadoop/sbin/yarn-daemon.sh 44433874 4 -r-xr-xr-x 1 jenkins users 1729 Nov 29 10:21 ./mr-framework/hadoop/sbin/refresh-namenodes.sh 44433868 4 -r-xr-xr-x 1 jenkins users 1508 Nov 29 10:21 ./mr-framework/hadoop/sbin/hdfs-config.sh 44433873 4 -r-xr-xr-x 1 jenkins users 2226 Nov 29 10:21 ./mr-framework/hadoop/sbin/slaves.sh 44433849 4 -r-xr-xr-x 1 jenkins users 1770 Nov 29 10:21 ./mr-framework/hadoop/sbin/stop-all.cmd 44433854 4 -r-xr-xr-x 1 jenkins users 1434 Nov 29 10:21 ./mr-framework/hadoop/sbin/yarn-daemons.sh 44433859 4 -r-xr-xr-x 1 jenkins users 1455 Nov 29 10:21 ./mr-framework/hadoop/sbin/stop-dfs.cmd 44433851 8 -r-xr-xr-x 1 jenkins users 4161 Nov 29 10:21 ./mr-framework/hadoop/sbin/mr-jobhistory-daemon.sh 44433856 4 -r-xr-xr-x 1 jenkins users 1640 Nov 29 10:21 ./mr-framework/hadoop/sbin/hdfs-config.cmd 44433865 4 -r-xr-xr-x 1 jenkins users 1438 Nov 29 10:21 ./mr-framework/hadoop/sbin/start-secure-dns.sh 44434881 84 -r-xr-xr-x 1 jenkins users 84854 Nov 29 10:21 ./mr-framework/hadoop/LICENSE.txt 44433847 16 -r-xr-xr-x 1 jenkins users 15753 Nov 29 10:21 ./mr-framework/hadoop/NOTICE.txt 44433830 4 drwxr-xr-x 2 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/libexec 44433838 4 -r-xr-xr-x 1 jenkins users 1777 Nov 29 10:21 ./mr-framework/hadoop/libexec/mapred-config.cmd 44433839 12 -r-xr-xr-x 1 jenkins users 8270 Nov 29 10:21 ./mr-framework/hadoop/libexec/hadoop-config.cmd 44433840 8 -r-xr-xr-x 1 jenkins users 5749 Nov 29 10:21 ./mr-framework/hadoop/libexec/httpfs-config.sh 44433834 4 -r-xr-xr-x 1 jenkins users 2131 Nov 29 10:21 ./mr-framework/hadoop/libexec/yarn-config.cmd 44433836 4 -r-xr-xr-x 1 jenkins users 2215 Nov 29 10:21 ./mr-framework/hadoop/libexec/yarn-config.sh 44433832 4 -r-xr-xr-x 1 jenkins users 2304 Nov 29 10:21 ./mr-framework/hadoop/libexec/mapred-config.sh 44433837 4 -r-xr-xr-x 1 jenkins users 1508 Nov 29 10:21 ./mr-framework/hadoop/libexec/hdfs-config.sh 44433831 12 -r-xr-xr-x 1 jenkins users 11678 Nov 29 10:21 ./mr-framework/hadoop/libexec/hadoop-config.sh 44433833 4 -r-xr-xr-x 1 jenkins users 1640 Nov 29 10:21 ./mr-framework/hadoop/libexec/hdfs-config.cmd 44433835 8 -r-xr-xr-x 1 jenkins users 5431 Nov 29 10:21 ./mr-framework/hadoop/libexec/kms-config.sh 44433799 4 drwxr-xr-x 3 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/etc 44433800 4 drwxr-xr-x 2 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop 44433821 8 -r-xr-xr-x 1 jenkins users 4436 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/capacity-scheduler.xml 44433829 4 -r-xr-xr-x 1 jenkins users 1527 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/kms-env.sh 44433806 12 -r-xr-xr-x 1 jenkins users 9683 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/hadoop-policy.xml 44433820 4 -r-xr-xr-x 1 jenkins users 758 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/mapred-site.xml.template 44433824 4 -r-xr-xr-x 1 jenkins users 2316 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/ssl-client.xml.example 44433802 8 -r-xr-xr-x 1 jenkins users 4529 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/hadoop-env.sh 44433811 4 -r-xr-xr-x 1 jenkins users 3979 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/hadoop-env.cmd 44433812 4 -r-xr-xr-x 1 jenkins users 3518 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/kms-acls.xml 44433828 4 -r-xr-xr-x 1 jenkins users 2697 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/ssl-server.xml.example 44433823 4 -r-xr-xr-x 1 jenkins users 21 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/httpfs-signature.secret 44433826 4 -r-xr-xr-x 1 jenkins users 318 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/container-executor.cfg 44433813 4 -r-xr-xr-x 1 jenkins users 690 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/yarn-site.xml 44433801 4 -r-xr-xr-x 1 jenkins users 1631 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/kms-log4j.properties 44433810 16 -r-xr-xr-x 1 jenkins users 12302 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/log4j.properties 44433807 4 -r-xr-xr-x 1 jenkins users 775 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/hdfs-site.xml 44433817 4 -r-xr-xr-x 1 jenkins users 10 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/slaves 44433825 8 -r-xr-xr-x 1 jenkins users 4113 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/mapred-queues.xml.template 44433818 4 -r-xr-xr-x 1 jenkins users 620 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/httpfs-site.xml 44433822 4 -r-xr-xr-x 1 jenkins users 1657 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/httpfs-log4j.properties 44433809 4 -r-xr-xr-x 1 jenkins users 2598 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/hadoop-metrics2.properties 44433805 8 -r-xr-xr-x 1 jenkins users 4567 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/yarn-env.sh 44433808 4 -r-xr-xr-x 1 jenkins users 2490 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/hadoop-metrics.properties 44433804 4 -r-xr-xr-x 1 jenkins users 774 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/core-site.xml 44433827 4 -r-xr-xr-x 1 jenkins users 1335 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/configuration.xsl 44433815 4 -r-xr-xr-x 1 jenkins users 1383 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/mapred-env.sh 44433819 8 -r-xr-xr-x 1 jenkins users 5511 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/kms-site.xml 44433803 4 -r-xr-xr-x 1 jenkins users 1449 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/httpfs-env.sh 44433814 4 -r-xr-xr-x 1 jenkins users 2250 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/yarn-env.cmd 44433816 4 -r-xr-xr-x 1 jenkins users 951 Nov 29 10:21 ./mr-framework/hadoop/etc/hadoop/mapred-env.cmd 44434854 4 drwxr-xr-x 3 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/lib 44434855 4 drwxr-xr-x 2 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/lib/native 44434862 1288 -r-xr-xr-x 1 jenkins users 1316074 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libhadoop.a 44434858 228 -r-xr-xr-x 1 jenkins users 229697 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libhdfs.so.0.0.0 44434861 572 -r-xr-xr-x 1 jenkins users 582360 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libhadooputils.a 44434866 1456 -r-xr-xr-x 1 jenkins users 1487204 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libhadooppipes.a 44434865 756 -r-xr-xr-x 1 jenkins users 773287 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libhadoop.so.1.0.0 44434864 360 -r-xr-xr-x 1 jenkins users 365604 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libhdfs.a 44434865 756 -r-xr-xr-x 1 jenkins users 773287 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libhadoop.so 44434863 20 -r-xr-xr-x 1 jenkins users 19848 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libsnappy.so.1 44434863 20 -r-xr-xr-x 1 jenkins users 19848 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libsnappy.so 44434858 228 -r-xr-xr-x 1 jenkins users 229697 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libhdfs.so 44434863 20 -r-xr-xr-x 1 jenkins users 19848 Nov 29 10:21 ./mr-framework/hadoop/lib/native/libsnappy.so.1.1.4 44434882 4 -r-xr-xr-x 1 jenkins users 1366 Nov 29 10:21 ./mr-framework/hadoop/README.txt 44433877 4 drwxr-xr-x 4 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share 44433878 4 drwxr-xr-x 3 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/doc 44433879 4 drwxr-xr-x 6 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/doc/hadoop 44433891 4 drwxr-xr-x 9 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/hadoop 44434625 4 drwxr-xr-x 3 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/hadoop/kms 44434353 4 drwxr-xr-x 5 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/hadoop/mapreduce 44433892 4 drwxr-xr-x 5 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/hadoop/tools 44434761 4 drwxr-xr-x 7 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/hadoop/hdfs 44434522 4 drwxr-xr-x 6 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/hadoop/common 44434060 4 drwxr-xr-x 3 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/hadoop/httpfs 44434406 4 drwxr-xr-x 5 jenkins users 4096 Nov 29 10:21 ./mr-framework/hadoop/share/hadoop/yarn 44435433 4 -rwx------ 1 root root 763 Dec 15 11:16 ./default_container_executor.sh 44435207 220 -r-x------ 1 root root 224135 Dec 15 11:16 ./ant-contrib-1.0b3.jar 44435204 1704 -r-x------ 1 root root 1741888 Dec 15 11:16 ./kite-hadoop-compatibility-1.1.0.jar 44435288 1736 -r-x------ 1 root root 1777229 Dec 15 11:16 ./kite-data-hive-1.1.0.jar 44435303 264 -r-x------ 1 root root 266289 Dec 15 11:16 ./commons-jexl-2.1.1.jar 44435210 4 -r-x------ 1 root root 2615 Dec 15 11:16 ./tdgssconfig.jar 44435436 4 -rw-r--r-- 1 root root 16 Dec 15 11:16 ./.default_container_executor.sh.crc 44435425 4 -rwx------ 1 root root 709 Dec 15 11:16 ./default_container_executor_session.sh 44435216 1292 -r-x------ 1 root root 1322324 Dec 15 11:16 ./avro-1.8.0.jar 44435243 576 -r-x------ 1 root root 587380 Dec 15 11:16 ./snappy-java-1.1.1.6.jar 44435276 860 -r-x------ 1 root root 879155 Dec 15 11:16 ./parquet-column-1.6.0.jar 44435258 752 -r-x------ 1 root root 770013 Dec 15 11:16 ./jackson-mapper-asl-1.9.13.jar 44435201 36 -r-x------ 1 root root 35507 Dec 15 11:16 ./jackson-annotations-2.3.1.jar 44435231 1068 -r-x------ 1 root root 1093618 Dec 15 11:16 ./terajdbc4.jar 44435240 204 -r-x------ 1 root root 205028 Dec 15 11:16 ./parquet-hadoop-1.6.0.jar 44435219 2100 -r-x------ 1 root root 2149987 Dec 15 11:16 ./kite-data-core-1.1.0.jar 44435282 36 -r-x------ 1 root root 36427 Dec 15 11:16 ./ant-eclipse-1.0-jvm1.2.jar 44435237 60 -r-x------ 1 root root 60530 Dec 15 11:16 ./commons-logging-1.1.1.jar 44435270 192 -r-x------ 1 root root 195678 Dec 15 11:16 ./jackson-core-2.3.1.jar 44435255 100 -r-x------ 1 root root 99504 Dec 15 11:16 ./xz-1.5.jar 44435264 276 -r-x------ 1 root root 278936 Dec 15 11:16 ./parquet-encoding-1.6.0.jar 44435297 24 -r-x------ 1 root root 20992 Dec 15 11:16 ./parquet-common-1.6.0.jar 44435225 4980 -r-x------ 1 root root 5098776 Dec 15 11:16 ./teradata-connector-1.5.1-hadoop2.jar broken symlinks(find -L . -maxdepth 5 -type l -ls): End of LogType:directory.info LogType:launch_container.sh Log Upload Time:Thu Dec 15 11:16:28 -0800 2016 LogLength:32487 Log Contents: #!/bin/bash export HADOOP_CONF_DIR=${HADOOP_CONF_DIR:-"/appdata/hdp/2.5.3.0-37/hadoop/conf"} export STDOUT_LOGFILE_ENV="/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000002/stdout" export HADOOP_ROOT_LOGGER="INFO,console" export JAVA_HOME=${JAVA_HOME:-"/usr/java/current/"} export NM_HOST="xxx.net" export HADOOP_CLASSPATH="$PWD:job.jar/job.jar:job.jar/classes/:job.jar/lib/*:$PWD/*:/usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012/container_1481156388370_0012_01_000001:job.jar/job.jar:job.jar/classes/:job.jar/lib/*:/usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012/container_1481156388370_0012_01_000001/*:::/usr/hdp/2.5.3.0-37/sqoop/conf:/usr/hdp/current/zookeeper-server/conf::/usr/hdp/2.5.3.0-37/sqoop/lib/ant-contrib-1.0b3.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/ant-eclipse-1.0-jvm1.2.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/avro-1.8.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/avro-mapred-1.8.0-hadoop2.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/commons-codec-1.4.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/commons-compress-1.8.1.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/commons-io-1.4.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/commons-jexl-2.1.1.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/commons-lang3-3.4.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/commons-logging-1.1.1.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/hortonworks-teradata-connector-1.5.1.2.5.0.0-1245.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/hsqldb-1.8.0.10.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/jackson-annotations-2.3.1.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/jackson-core-2.3.1.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/jackson-databind-2.3.1.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/kite-data-core-1.1.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/kite-data-hive-1.1.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/kite-data-mapreduce-1.1.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/kite-hadoop-compatibility-1.1.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/opencsv-2.3.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/paranamer-2.7.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/parquet-avro-1.6.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/parquet-column-1.6.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/parquet-common-1.6.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/parquet-encoding-1.6.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/parquet-format-2.2.0-rc1.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/parquet-generator-1.6.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/parquet-hadoop-1.6.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/parquet-jackson-1.6.0.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/slf4j-api-1.7.7.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/snappy-java-1.1.1.6.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/tdgssconfig.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/teradata-connector-1.5.1-hadoop2.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/terajdbc4.jar:/usr/hdp/2.5.3.0-37/sqoop/lib/xz-1.5.jar:/usr/hdp/current/hbase-master/conf:/usr/java/default/lib/tools.jar:/usr/hdp/current/hbase-master:/usr/hdp/current/hbase-master/lib/activation-1.1.jar:/usr/hdp/current/hbase-master/lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-master/lib/apacheds-i18n-2.0.0-M15.jar:/usr/hdp/current/hbase-master/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/usr/hdp/current/hbase-master/lib/api-asn1-api-1.0.0-M20.jar:/usr/hdp/current/hbase-master/lib/api-util-1.0.0-M20.jar:/usr/hdp/current/hbase-master/lib/asm-3.1.jar:/usr/hdp/current/hbase-master/lib/avro-1.7.4.jar:/usr/hdp/current/hbase-master/lib/azure-keyvault-core-0.8.0.jar:/usr/hdp/current/hbase-master/lib/azure-storage-4.2.0.jar:/usr/hdp/current/hbase-master/lib/commons-beanutils-1.7.0.jar:/usr/hdp/current/hbase-master/lib/commons-beanutils-core-1.8.0.jar:/usr/hdp/current/hbase-master/lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-master/lib/commons-codec-1.9.jar:/usr/hdp/current/hbase-master/lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-master/lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-master/lib/commons-configuration-1.6.jar:/usr/hdp/current/hbase-master/lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-master/lib/commons-digester-1.8.jar:/usr/hdp/current/hbase-master/lib/commons-el-1.0.jar:/usr/hdp/current/hbase-master/lib/commons-io-2.4.jar:/usr/hdp/current/hbase-master/lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-master/lib/commons-lang3-3.4.jar:/usr/hdp/current/hbase-master/lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-master/lib/commons-math-2.2.jar:/usr/hdp/current/hbase-master/lib/commons-math3-3.1.1.jar:/usr/hdp/current/hbase-master/lib/commons-net-3.1.jar:/usr/hdp/current/hbase-master/lib/curator-client-2.7.1.jar:/usr/hdp/current/hbase-master/lib/curator-framework-2.7.1.jar:/usr/hdp/current/hbase-master/lib/curator-recipes-2.7.1.jar:/usr/hdp/current/hbase-master/lib/disruptor-3.3.0.jar:/usr/hdp/current/hbase-master/lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-master/lib/gson-2.2.4.jar:/usr/hdp/current/hbase-master/lib/guava-12.0.1.jar:/usr/hdp/current/hbase-master/lib/guice-3.0.jar:/usr/hdp/current/hbase-master/lib/guice-servlet-3.0.jar:/usr/hdp/current/hbase-master/lib/hbase-annotations-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-annotations-1.1.2.2.5.3.0-37-tests.jar:/usr/hdp/current/hbase-master/lib/hbase-annotations.jar:/usr/hdp/current/hbase-master/lib/hbase-client-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-client.jar:/usr/hdp/current/hbase-master/lib/hbase-common-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-common-1.1.2.2.5.3.0-37-tests.jar:/usr/hdp/current/hbase-master/lib/hbase-common.jar:/usr/hdp/current/hbase-master/lib/hbase-examples-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-examples.jar:/usr/hdp/current/hbase-master/lib/hbase-hadoop2-compat-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-master/lib/hbase-hadoop-compat-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-master/lib/hbase-it-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-it-1.1.2.2.5.3.0-37-tests.jar:/usr/hdp/current/hbase-master/lib/hbase-it.jar:/usr/hdp/current/hbase-master/lib/hbase-prefix-tree-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-prefix-tree.jar:/usr/hdp/current/hbase-master/lib/hbase-procedure-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-procedure.jar:/usr/hdp/current/hbase-master/lib/hbase-protocol-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-protocol.jar:/usr/hdp/current/hbase-master/lib/hbase-resource-bundle-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-master/lib/hbase-rest-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-rest.jar:/usr/hdp/current/hbase-master/lib/hbase-rsgroup-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-rsgroup-1.1.2.2.5.3.0-37-tests.jar:/usr/hdp/current/hbase-master/lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-master/lib/hbase-server-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-server-1.1.2.2.5.3.0-37-tests.jar:/usr/hdp/current/hbase-master/lib/hbase-server.jar:/usr/hdp/current/hbase-master/lib/hbase-shell-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-shell.jar:/usr/hdp/current/hbase-master/lib/hbase-thrift-1.1.2.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/hbase-thrift.jar:/usr/hdp/current/hbase-master/lib/htrace-core-3.1.0-incubating.jar:/usr/hdp/current/hbase-master/lib/jackson-core-2.6.0.jar:/usr/hdp/current/hbase-master/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-master/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/current/hbase-master/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-master/lib/jackson-xc-1.9.13.jar:/usr/hdp/current/hbase-master/lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-master/lib/jasper-compiler-5.5.23.jar:/usr/hdp/current/hbase-master/lib/jasper-runtime-5.5.23.jar:/usr/hdp/current/hbase-master/lib/javax.inject-1.jar:/usr/hdp/current/hbase-master/lib/java-xmlbuilder-0.4.jar:/usr/hdp/current/hbase-master/lib/jaxb-api-2.2.2.jar:/usr/hdp/current/hbase-master/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-master/lib/jcip-annotations-1.0.jar:/usr/hdp/current/hbase-master/lib/jcodings-1.0.8.jar:/usr/hdp/current/hbase-master/lib/jersey-client-1.9.jar:/usr/hdp/current/hbase-master/lib/jersey-core-1.9.jar:/usr/hdp/current/hbase-master/lib/jersey-guice-1.9.jar:/usr/hdp/current/hbase-master/lib/jersey-json-1.9.jar:/usr/hdp/current/hbase-master/lib/jersey-server-1.9.jar:/usr/hdp/current/hbase-master/lib/jets3t-0.9.0.jar:/usr/hdp/current/hbase-master/lib/jettison-1.3.3.jar:/usr/hdp/current/hbase-master/lib/jetty-6.1.26.hwx.jar:/usr/hdp/current/hbase-master/lib/jetty-sslengine-6.1.26.hwx.jar:/usr/hdp/current/hbase-master/lib/jetty-util-6.1.26.hwx.jar:/usr/hdp/current/hbase-master/lib/joni-2.1.2.jar:/usr/hdp/current/hbase-master/lib/jruby-complete-1.6.8.jar:/usr/hdp/current/hbase-master/lib/jsch-0.1.42.jar:/usr/hdp/current/hbase-master/lib/json-smart-1.1.1.jar:/usr/hdp/current/hbase-master/lib/jsp-2.1-6.1.14.jar:/usr/hdp/current/hbase-master/lib/jsp-api-2.1-6.1.14.jar:/usr/hdp/current/hbase-master/lib/jsr305-1.3.9.jar:/usr/hdp/current/hbase-master/lib/junit-4.12.jar:/usr/hdp/current/hbase-master/lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-master/lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-master/lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-master/lib/metrics-core-2.2.0.jar:/usr/hdp/current/hbase-master/lib/netty-3.2.4.Final.jar:/usr/hdp/current/hbase-master/lib/netty-all-4.0.23.Final.jar:/usr/hdp/current/hbase-master/lib/nimbus-jose-jwt-3.9.jar:/usr/hdp/current/hbase-master/lib/ojdbc6.jar:/usr/hdp/current/hbase-master/lib/okhttp-2.4.0.jar:/usr/hdp/current/hbase-master/lib/okio-1.4.0.jar:/usr/hdp/current/hbase-master/lib/paranamer-2.3.jar:/usr/hdp/current/hbase-master/lib/phoenix-server.jar:/usr/hdp/current/hbase-master/lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-master/lib/ranger-hbase-plugin-shim-0.6.0.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/ranger-plugin-classloader-0.6.0.2.5.3.0-37.jar:/usr/hdp/current/hbase-master/lib/servlet-api-2.5-6.1.14.jar:/usr/hdp/current/hbase-master/lib/servlet-api-2.5.jar:/usr/hdp/current/hbase-master/lib/slf4j-api-1.7.7.jar:/usr/hdp/current/hbase-master/lib/snappy-java-1.0.4.1.jar:/usr/hdp/current/hbase-master/lib/spymemcached-2.11.6.jar:/usr/hdp/current/hbase-master/lib/xercesImpl-2.9.1.jar:/usr/hdp/current/hbase-master/lib/xml-apis-1.3.04.jar:/usr/hdp/current/hbase-master/lib/xmlenc-0.52.jar:/usr/hdp/current/hbase-master/lib/xz-1.0.jar:/usr/hdp/current/hbase-master/lib/zookeeper.jar:/appdata/hdp/2.5.3.0-37/hadoop/conf:/usr/hdp/2.5.3.0-37/hadoop/lib/*:/usr/hdp/2.5.3.0-37/hadoop/.//*:/usr/hdp/2.5.3.0-37/hadoop-hdfs/./:/usr/hdp/2.5.3.0-37/hadoop-hdfs/lib/*:/usr/hdp/2.5.3.0-37/hadoop-hdfs/.//*:/usr/hdp/2.5.3.0-37/hadoop-yarn/lib/*:/usr/hdp/2.5.3.0-37/hadoop-yarn/.//*:/usr/hdp/2.5.3.0-37/hadoop-mapreduce/lib/*:/usr/hdp/2.5.3.0-37/hadoop-mapreduce/.//*::/usr/share/java/mysql-connector-java.jar:/usr/lib/hadoop-mapreduce/*:/usr/hdp/2.5.3.0-37/tez/*:/usr/hdp/2.5.3.0-37/tez/lib/*:/usr/hdp/2.5.3.0-37/tez/conf:/usr/hdp/2.5.3.0-37/hadoop/conf:/usr/hdp/2.5.3.0-37/hadoop/*:/usr/hdp/2.5.3.0-37/hadoop/lib/*:/usr/hdp/current/zookeeper-server/*:://hadoop/conf:/usr/hdp/2.5.3.0-37/atlas/hook/hive/*:/usr/hdp/2.5.3.0-37/hive/lib/accumulo-core-1.7.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/accumulo-fate-1.7.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/accumulo-start-1.7.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/accumulo-trace-1.7.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/activation-1.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/ant-1.9.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/ant-launcher-1.9.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/antlr-2.7.7.jar:/usr/hdp/2.5.3.0-37/hive/lib/antlr-runtime-3.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/apache-log4j-extras-1.2.17.jar:/usr/hdp/2.5.3.0-37/hive/lib/asm-commons-3.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/asm-tree-3.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/avatica-1.8.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/avatica-metrics-1.8.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/avro-1.7.5.jar:/usr/hdp/2.5.3.0-37/hive/lib/bonecp-0.8.0.RELEASE.jar:/usr/hdp/2.5.3.0-37/hive/lib/calcite-core-1.2.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/calcite-linq4j-1.2.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-cli-1.2.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-codec-1.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-collections-3.2.2.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-compiler-2.7.6.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-compress-1.4.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-dbcp-1.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-httpclient-3.0.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-io-2.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-lang-2.6.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-logging-1.1.3.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-math-2.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-pool-1.5.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/commons-vfs2-2.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/curator-client-2.6.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/curator-framework-2.6.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/curator-recipes-2.6.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/datanucleus-api-jdo-4.2.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/datanucleus-core-4.1.6.jar:/usr/hdp/2.5.3.0-37/hive/lib/datanucleus-rdbms-4.1.7.jar:/usr/hdp/2.5.3.0-37/hive/lib/derby-10.10.2.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/dropwizard-metrics-hadoop-metrics2-reporter-0.1.2.jar:/usr/hdp/2.5.3.0-37/hive/lib/eigenbase-properties-1.1.5.jar:/usr/hdp/2.5.3.0-37/hive/lib/geronimo-annotation_1.0_spec-1.1.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/geronimo-jaspic_1.0_spec-1.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/geronimo-jta_1.1_spec-1.1.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/groovy-all-2.4.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/guava-14.0.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/HikariCP-1.3.9.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-accumulo-handler-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-accumulo-handler.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-ant-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-ant.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-beeline-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-beeline.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-cli-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-cli.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-common-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-common.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-contrib-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-contrib.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-exec-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-exec.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-hbase-handler-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-hbase-handler.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-hwi-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-hwi.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-jdbc-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-jdbc-1.2.1000.2.5.3.0-37-standalone.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-jdbc.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-metastore-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-metastore.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-serde-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-serde.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-service-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-service.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-shims-0.20S-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-shims-0.23-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-shims-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-shims-common-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-shims-common.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-shims.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-shims-scheduler-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/hive-shims-scheduler.jar:/usr/hdp/2.5.3.0-37/hive/lib/htrace-core-3.1.0-incubating.jar:/usr/hdp/2.5.3.0-37/hive/lib/httpclient-4.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/httpcore-4.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/ivy-2.4.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/jackson-annotations-2.4.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/jackson-core-2.4.2.jar:/usr/hdp/2.5.3.0-37/hive/lib/jackson-databind-2.4.2.jar:/usr/hdp/2.5.3.0-37/hive/lib/janino-2.7.6.jar:/usr/hdp/2.5.3.0-37/hive/lib/javassist-3.18.1-GA.jar:/usr/hdp/2.5.3.0-37/hive/lib/javax.jdo-3.2.0-m3.jar:/usr/hdp/2.5.3.0-37/hive/lib/jcommander-1.32.jar:/usr/hdp/2.5.3.0-37/hive/lib/jdo-api-3.0.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/jetty-all-7.6.0.v20120127.jar:/usr/hdp/2.5.3.0-37/hive/lib/jetty-all-server-7.6.0.v20120127.jar:/usr/hdp/2.5.3.0-37/hive/lib/jline-2.12.jar:/usr/hdp/2.5.3.0-37/hive/lib/joda-time-2.8.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/jpam-1.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/json-20090211.jar:/usr/hdp/2.5.3.0-37/hive/lib/jsr305-3.0.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/jta-1.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/libfb303-0.9.3.jar:/usr/hdp/2.5.3.0-37/hive/lib/libthrift-0.9.3.jar:/usr/hdp/2.5.3.0-37/hive/lib/log4j-1.2.16.jar:/usr/hdp/2.5.3.0-37/hive/lib/mail-1.4.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/maven-scm-api-1.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/maven-scm-provider-svn-commons-1.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/maven-scm-provider-svnexe-1.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/metrics-core-3.1.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/metrics-json-3.1.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/metrics-jvm-3.1.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/mysql-connector-java.jar:/usr/hdp/2.5.3.0-37/hive/lib/netty-3.7.0.Final.jar:/usr/hdp/2.5.3.0-37/hive/lib/ojdbc6.jar:/usr/hdp/2.5.3.0-37/hive/lib/opencsv-2.3.jar:/usr/hdp/2.5.3.0-37/hive/lib/oro-2.0.8.jar:/usr/hdp/2.5.3.0-37/hive/lib/paranamer-2.3.jar:/usr/hdp/2.5.3.0-37/hive/lib/parquet-hadoop-bundle-1.8.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/pentaho-aggdesigner-algorithm-5.1.5-jhyde.jar:/usr/hdp/2.5.3.0-37/hive/lib/plexus-utils-1.5.6.jar:/usr/hdp/2.5.3.0-37/hive/lib/protobuf-java-2.5.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/ranger-hive-plugin-shim-0.6.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/ranger-plugin-classloader-0.6.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/lib/regexp-1.3.jar:/usr/hdp/2.5.3.0-37/hive/lib/servlet-api-2.5.jar:/usr/hdp/2.5.3.0-37/hive/lib/snappy-java-1.0.5.jar:/usr/hdp/2.5.3.0-37/hive/lib/ST4-4.0.4.jar:/usr/hdp/2.5.3.0-37/hive/lib/stax-api-1.0.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/stringtemplate-3.2.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/super-csv-2.2.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/transaction-api-1.1.jar:/usr/hdp/2.5.3.0-37/hive/lib/velocity-1.5.jar:/usr/hdp/2.5.3.0-37/hive/lib/xz-1.0.jar:/usr/hdp/2.5.3.0-37/hive/lib/zookeeper-3.4.6.2.5.3.0-37.jar::/appdata/hdp/2.5.3.0-37/hive-hcatalog/libexec/../share/hcatalog/hive-hcatalog-core-1.2.1000.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/hive/conf::/usr/hdp/current/hbase-master/conf:/usr/hdp/2.5.3.0-37/sqoop/sqoop-1.4.6.2.5.3.0-37.jar::/usr/share/java/mysql-connector-java.jar:/usr/lib/hadoop-mapreduce/*:/usr/hdp/2.5.3.0-37/tez/*:/usr/hdp/2.5.3.0-37/tez/lib/*:/usr/hdp/2.5.3.0-37/tez/conf" export LD_LIBRARY_PATH="$PWD:/usr/hdp/2.5.3.0-37/hadoop/lib/native:/usr/hdp/2.5.3.0-37/hadoop/lib/native/Linux-amd64-64" export STDERR_LOGFILE_ENV="/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000002/stderr" export LOGNAME="root" export JVM_PID="$$" export PWD="/usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012/container_1481156388370_0012_01_000002" export HADOOP_CLIENT_OPTS="-Xmx128m -Xmx128m " export LOCAL_DIRS="/usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012" export SHELL="/bin/bash" export NM_HTTP_PORT="8042" export LOG_DIRS="/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000002" export NM_AUX_SERVICE_mapreduce_shuffle="AAAfkQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA= " export NM_PORT="45454" export USER="root" export HADOOP_YARN_HOME=${HADOOP_YARN_HOME:-"/usr/hdp/2.5.3.0-37/hadoop-yarn"} export CLASSPATH="$PWD:$PWD/mr-framework/hadoop/share/hadoop/mapreduce/*:$PWD/mr-framework/hadoop/share/hadoop/mapreduce/lib/*:$PWD/mr-framework/hadoop/share/hadoop/common/*:$PWD/mr-framework/hadoop/share/hadoop/common/lib/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/lib/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/lib/*:/usr/hdp/2.5.3.0-37/hadoop/lib/hadoop-lzo-0.6.0.2.5.3.0-37.jar:/etc/hadoop/conf/secure:job.jar/job.jar:job.jar/classes/:job.jar/lib/*:$PWD/*" export HADOOP_TOKEN_FILE_LOCATION="/usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012/container_1481156388370_0012_01_000002/container_tokens" export LOCAL_USER_DIRS="/usr/local/middleware/hadoop/yarn/local/usercache/root/" export HOME="/home/" export CONTAINER_ID="container_1481156388370_0012_01_000002" export MALLOC_ARENA_MAX="4" ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/188/kite-data-hive-1.1.0.jar" "kite-data-hive-1.1.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/187/commons-lang3-3.4.jar" "commons-lang3-3.4.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/174/slf4j-api-1.7.7.jar" "slf4j-api-1.7.7.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/166/opencsv-2.3.jar" "opencsv-2.3.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/172/parquet-hadoop-1.6.0.jar" "parquet-hadoop-1.6.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/176/hsqldb-1.8.0.10.jar" "hsqldb-1.8.0.10.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/189/commons-io-1.4.jar" "commons-io-1.4.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/192/hortonworks-teradata-connector-1.5.1.2.5.0.0-1245.jar" "hortonworks-teradata-connector-1.5.1.2.5.0.0-1245.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/180/parquet-encoding-1.6.0.jar" "parquet-encoding-1.6.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/182/jackson-core-2.3.1.jar" "jackson-core-2.3.1.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/191/parquet-common-1.6.0.jar" "parquet-common-1.6.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/163/parquet-avro-1.6.0.jar" "parquet-avro-1.6.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012/filecache/10/job.jar" "job.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/161/ant-contrib-1.0b3.jar" "ant-contrib-1.0b3.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/178/jackson-mapper-asl-1.9.13.jar" "jackson-mapper-asl-1.9.13.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/183/paranamer-2.7.jar" "paranamer-2.7.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/167/teradata-connector-1.5.1-hadoop2.jar" "teradata-connector-1.5.1-hadoop2.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/194/avro-mapred-1.8.0-hadoop2.jar" "avro-mapred-1.8.0-hadoop2.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/185/jackson-databind-2.3.1.jar" "jackson-databind-2.3.1.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/193/commons-jexl-2.1.1.jar" "commons-jexl-2.1.1.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/168/parquet-jackson-1.6.0.jar" "parquet-jackson-1.6.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/181/kite-data-mapreduce-1.1.0.jar" "kite-data-mapreduce-1.1.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012/filecache/11/job.xml" "job.xml" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/162/tdgssconfig.jar" "tdgssconfig.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/filecache/11/mapreduce.tar.gz" "mr-framework" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/164/avro-1.8.0.jar" "avro-1.8.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/171/commons-logging-1.1.1.jar" "commons-logging-1.1.1.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/175/commons-codec-1.4.jar" "commons-codec-1.4.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/186/ant-eclipse-1.0-jvm1.2.jar" "ant-eclipse-1.0-jvm1.2.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/160/kite-hadoop-compatibility-1.1.0.jar" "kite-hadoop-compatibility-1.1.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/158/parquet-generator-1.6.0.jar" "parquet-generator-1.6.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/169/terajdbc4.jar" "terajdbc4.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/173/snappy-java-1.1.1.6.jar" "snappy-java-1.1.1.6.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/190/parquet-format-2.2.0-rc1.jar" "parquet-format-2.2.0-rc1.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/177/xz-1.5.jar" "xz-1.5.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/165/kite-data-core-1.1.0.jar" "kite-data-core-1.1.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/179/commons-compress-1.8.1.jar" "commons-compress-1.8.1.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/159/jackson-annotations-2.3.1.jar" "jackson-annotations-2.3.1.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/184/parquet-column-1.6.0.jar" "parquet-column-1.6.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/usr/local/middleware/hadoop/yarn/local/usercache/root/filecache/170/jackson-core-asl-1.9.13.jar" "jackson-core-asl-1.9.13.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi # Creating copy of launch script cp "launch_container.sh" "/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000002/launch_container.sh" chmod 640 "/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000002/launch_container.sh" # Determining directory contents echo "ls -l:" 1>"/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000002/directory.info" ls -l 1>>"/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000002/directory.info" echo "find -L . -maxdepth 5 -ls:" 1>>"/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000002/directory.info" find -L . -maxdepth 5 -ls 1>>"/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000002/directory.info" echo "broken symlinks(find -L . -maxdepth 5 -type l -ls):" 1>>"/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000002/directory.info" find -L . -maxdepth 5 -type l -ls 1>>"/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000002/directory.info" exec /bin/bash -c "$JAVA_HOME/bin/java -server -XX:NewRatio=8 -Djava.library.path=/usr/hdp/current/hadoop/lib/native/ -Djava.net.preferIPv4Stack=true -Dhdp.version=2.5.3.0-37 -Xmx512m -Djava.io.tmpdir=$PWD/tmp -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000002 -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Dhadoop.root.logfile=syslog org.apache.hadoop.mapred.YarnChild 10.236.211.27 36415 attempt_1481156388370_0012_m_000000_0 2 1>/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000002/stdout 2>/usr/local/middleware/hadoop/yarn/logs/application_1481156388370_0012/container_1481156388370_0012_01_000002/stderr " hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi End of LogType:launch_container.sh LogType:stderr Log Upload Time:Thu Dec 15 11:16:28 -0800 2016 LogLength:243 Log Contents: log4j:WARN No appenders could be found for logger (org.apache.hadoop.metrics2.impl.MetricsSystemImpl). log4j:WARN Please initialize the log4j system properly. log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info. End of LogType:stderr LogType:stdout Log Upload Time:Thu Dec 15 11:16:28 -0800 2016 LogLength:0 Log Contents: End of LogType:stdout LogType:syslog Log Upload Time:Thu Dec 15 11:16:28 -0800 2016 LogLength:5500 Log Contents: 2016-12-15 11:16:14,379 WARN [main] org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2016-12-15 11:16:14,431 WARN [main] org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate configuration: tried hadoop-metrics2-maptask.properties,hadoop-metrics2.properties 2016-12-15 11:16:14,484 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s). 2016-12-15 11:16:14,484 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MapTask metrics system started 2016-12-15 11:16:14,491 INFO [main] org.apache.hadoop.mapred.YarnChild: Executing with tokens: 2016-12-15 11:16:14,491 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: mapreduce.job, Service: job_1481156388370_0012, Ident: (org.apache.hadoop.mapreduce.security.token.JobTokenIdentifier@54422e18) 2016-12-15 11:16:14,645 INFO [main] org.apache.hadoop.mapred.YarnChild: Sleeping for 0ms before retrying again. Got null now. 2016-12-15 11:16:14,827 INFO [main] org.apache.hadoop.mapred.YarnChild: mapreduce.cluster.local.dir for child: /usr/local/middleware/hadoop/yarn/local/usercache/root/appcache/application_1481156388370_0012 2016-12-15 11:16:15,008 INFO [main] org.apache.hadoop.conf.Configuration.deprecation: session.id is deprecated. Instead, use dfs.metrics.session-id 2016-12-15 11:16:15,425 WARN [main] org.apache.hadoop.hdfs.shortcircuit.DomainSocketFactory: The short-circuit local reads feature cannot be used because libhadoop cannot be loaded. 2016-12-15 11:16:15,438 INFO [main] org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: File Output Committer Algorithm version is 1 2016-12-15 11:16:15,438 INFO [main] org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false 2016-12-15 11:16:15,445 INFO [main] org.apache.hadoop.mapred.Task: Using ResourceCalculatorProcessTree : [ ] 2016-12-15 11:16:15,604 INFO [main] org.apache.hadoop.mapred.MapTask: Processing split: inputSplitClass:com.teradata.connector.teradata.TeradataInputFormat$TeradataInputSplit split0:com.teradata.connector.teradata.TeradataInputFormat$TeradataInputSplit@1cb3ec38 2016-12-15 11:16:15,608 INFO [main] com.teradata.connector.common.ConnectorCombineInputFormat$ConnectorCombinePlugedinInputRecordReader: recordreader class com.teradata.connector.common.ConnectorCombineInputFormat$ConnectorCombinePlugedinInputRecordReaderinitialize time is: 1481829375608 2016-12-15 11:16:15,657 INFO [main] com.teradata.connector.teradata.TeradataInputFormat$TeradataRecordReader: recordreader class com.teradata.connector.teradata.TeradataInputFormat$TeradataRecordReaderinitialize time is: 1481829375657 2016-12-15 11:16:15,659 INFO [main] com.teradata.connector.common.ConnectorOutputFormat$ConnectorFileRecordWriter: recordwriter class com.teradata.connector.common.ConnectorOutputFormat$ConnectorFileRecordWriterinitialize time is: 1481829375659 2016-12-15 11:16:17,902 INFO [main] org.apache.hadoop.conf.Configuration.deprecation: mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout 2016-12-15 11:16:17,902 INFO [main] com.teradata.connector.common.ConnectorMMapper: keep-alive thread started 2016-12-15 11:16:19,949 INFO [main] com.teradata.connector.teradata.TeradataInputFormat$TeradataRecordReader: recordreader class com.teradata.connector.teradata.TeradataInputFormat$TeradataRecordReaderclose time is: 1481829379949 2016-12-15 11:16:19,949 INFO [main] com.teradata.connector.teradata.TeradataInputFormat$TeradataRecordReader: the total elapsed time of recordreader com.teradata.connector.teradata.TeradataInputFormat$TeradataRecordReader4s 2016-12-15 11:16:20,116 INFO [main] com.teradata.connector.common.ConnectorCombineInputFormat$ConnectorCombinePlugedinInputRecordReader: recordreader class com.teradata.connector.common.ConnectorCombineInputFormat$ConnectorCombinePlugedinInputRecordReaderclose time is: 1481829380116 2016-12-15 11:16:20,116 INFO [main] com.teradata.connector.common.ConnectorCombineInputFormat$ConnectorCombinePlugedinInputRecordReader: the total elapsed time of recordreader com.teradata.connector.common.ConnectorCombineInputFormat$ConnectorCombinePlugedinInputRecordReader4s 2016-12-15 11:16:20,205 INFO [main] com.teradata.connector.common.ConnectorOutputFormat$ConnectorFileRecordWriter: recordwriter class com.teradata.connector.common.ConnectorOutputFormat$ConnectorFileRecordWriterclose time is: 1481829380205 2016-12-15 11:16:20,205 INFO [main] com.teradata.connector.common.ConnectorOutputFormat$ConnectorFileRecordWriter: the total elapsed time of recordwriter com.teradata.connector.common.ConnectorOutputFormat$ConnectorFileRecordWriter4s 2016-12-15 11:16:20,205 INFO [main] org.apache.hadoop.mapred.Task: Task:attempt_1481156388370_0012_m_000000_0 is done. And is in the process of committing 2016-12-15 11:16:20,242 INFO [main] org.apache.hadoop.mapred.Task: Task attempt_1481156388370_0012_m_000000_0 is allowed to commit now 2016-12-15 11:16:20,247 INFO [main] org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Saved output of task 'attempt_1481156388370_0012_m_000000_0' to hdfs://xxx.net:8020/tmp/tt/status/_temporary/1/task_1481156388370_0012_m_000000 2016-12-15 11:16:20,275 INFO [main] org.apache.hadoop.mapred.Task: Task 'attempt_1481156388370_0012_m_000000_0' done. End of LogType:syslog