Container: container_e134_1515765548943_7803_02_000001 on ks-dmp05.kyivstar.ua_45454_1516175454392 LogAggregationType: AGGREGATED ================================================================================================== LogType:directory.info LogLastModifiedTime:Wed Jan 17 09:50:54 +0200 2018 LogLength:38972 LogContents: ls -l: total 32 lrwxrwxrwx 1 yarn hadoop 58 Jan 17 09:50 activation-1.1.jar -> /grid/0/hadoop/yarn/local/filecache/284/activation-1.1.jar lrwxrwxrwx 1 yarn hadoop 53 Jan 17 09:50 ant-1.9.1.jar -> /grid/1/hadoop/yarn/local/filecache/297/ant-1.9.1.jar lrwxrwxrwx 1 yarn hadoop 62 Jan 17 09:50 ant-launcher-1.9.1.jar -> /grid/9/hadoop/yarn/local/filecache/326/ant-launcher-1.9.1.jar lrwxrwxrwx 1 yarn hadoop 55 Jan 17 09:50 antlr-2.7.7.jar -> /grid/6/hadoop/yarn/local/filecache/352/antlr-2.7.7.jar lrwxrwxrwx 1 yarn hadoop 61 Jan 17 09:50 antlr-runtime-3.4.jar -> /grid/5/hadoop/yarn/local/filecache/318/antlr-runtime-3.4.jar lrwxrwxrwx 1 yarn hadoop 70 Jan 17 09:50 apache-log4j-extras-1.2.17.jar -> /grid/8/hadoop/yarn/local/filecache/308/apache-log4j-extras-1.2.17.jar lrwxrwxrwx 1 yarn hadoop 51 Jan 17 09:50 asm-3.1.jar -> /grid/2/hadoop/yarn/local/filecache/321/asm-3.1.jar lrwxrwxrwx 1 yarn hadoop 60 Jan 17 09:50 asm-commons-3.1.jar -> /grid/10/hadoop/yarn/local/filecache/327/asm-commons-3.1.jar lrwxrwxrwx 1 yarn hadoop 56 Jan 17 09:50 asm-tree-3.1.jar -> /grid/6/hadoop/yarn/local/filecache/262/asm-tree-3.1.jar lrwxrwxrwx 1 yarn hadoop 55 Jan 17 09:50 avro-1.7.5.jar -> /grid/10/hadoop/yarn/local/filecache/349/avro-1.7.5.jar lrwxrwxrwx 1 yarn hadoop 68 Jan 17 09:50 aws-java-sdk-core-1.10.6.jar -> /grid/0/hadoop/yarn/local/filecache/316/aws-java-sdk-core-1.10.6.jar lrwxrwxrwx 1 yarn hadoop 68 Jan 17 09:50 aws-java-sdk-kms-1.10.6.jar -> /grid/10/hadoop/yarn/local/filecache/295/aws-java-sdk-kms-1.10.6.jar lrwxrwxrwx 1 yarn hadoop 66 Jan 17 09:50 aws-java-sdk-s3-1.10.6.jar -> /grid/2/hadoop/yarn/local/filecache/328/aws-java-sdk-s3-1.10.6.jar lrwxrwxrwx 1 yarn hadoop 75 Jan 17 09:50 azure-data-lake-store-sdk-2.1.4.jar -> /grid/7/hadoop/yarn/local/filecache/281/azure-data-lake-store-sdk-2.1.4.jar lrwxrwxrwx 1 yarn hadoop 69 Jan 17 09:50 azure-keyvault-core-0.8.0.jar -> /grid/0/hadoop/yarn/local/filecache/344/azure-keyvault-core-0.8.0.jar lrwxrwxrwx 1 yarn hadoop 64 Jan 17 09:50 azure-storage-4.2.0.jar -> /grid/11/hadoop/yarn/local/filecache/275/azure-storage-4.2.0.jar lrwxrwxrwx 1 yarn hadoop 65 Jan 17 09:50 bonecp-0.8.0.RELEASE.jar -> /grid/10/hadoop/yarn/local/filecache/298/bonecp-0.8.0.RELEASE.jar lrwxrwxrwx 1 yarn hadoop 59 Jan 17 09:50 commons-cli-1.2.jar -> /grid/6/hadoop/yarn/local/filecache/336/commons-cli-1.2.jar lrwxrwxrwx 1 yarn hadoop 61 Jan 17 09:50 commons-codec-1.4.jar -> /grid/3/hadoop/yarn/local/filecache/345/commons-codec-1.4.jar lrwxrwxrwx 1 yarn hadoop 66 Jan 17 09:50 commons-compress-1.4.1.jar -> /grid/7/hadoop/yarn/local/filecache/320/commons-compress-1.4.1.jar lrwxrwxrwx 1 yarn hadoop 60 Jan 17 09:50 commons-dbcp-1.4.jar -> /grid/5/hadoop/yarn/local/filecache/334/commons-dbcp-1.4.jar lrwxrwxrwx 1 yarn hadoop 58 Jan 17 09:50 commons-io-2.4.jar -> /grid/7/hadoop/yarn/local/filecache/339/commons-io-2.4.jar lrwxrwxrwx 1 yarn hadoop 60 Jan 17 09:50 commons-lang-2.4.jar -> /grid/4/hadoop/yarn/local/filecache/291/commons-lang-2.4.jar lrwxrwxrwx 1 yarn hadoop 61 Jan 17 09:50 commons-lang3-3.4.jar -> /grid/3/hadoop/yarn/local/filecache/279/commons-lang3-3.4.jar lrwxrwxrwx 1 yarn hadoop 63 Jan 17 09:50 commons-logging-1.1.jar -> /grid/6/hadoop/yarn/local/filecache/353/commons-logging-1.1.jar lrwxrwxrwx 1 yarn hadoop 62 Jan 17 09:50 commons-pool-1.5.4.jar -> /grid/3/hadoop/yarn/local/filecache/306/commons-pool-1.5.4.jar -rw-r--r-- 1 yarn hadoop 255 Jan 17 09:50 container_tokens lrwxrwxrwx 1 yarn hadoop 64 Jan 17 09:50 curator-client-2.6.0.jar -> /grid/7/hadoop/yarn/local/filecache/294/curator-client-2.6.0.jar lrwxrwxrwx 1 yarn hadoop 67 Jan 17 09:50 curator-framework-2.6.0.jar -> /grid/5/hadoop/yarn/local/filecache/350/curator-framework-2.6.0.jar lrwxrwxrwx 1 yarn hadoop 65 Jan 17 09:50 curator-recipes-2.5.0.jar -> /grid/5/hadoop/yarn/local/filecache/347/curator-recipes-2.5.0.jar lrwxrwxrwx 1 yarn hadoop 69 Jan 17 09:50 datanucleus-api-jdo-4.2.1.jar -> /grid/1/hadoop/yarn/local/filecache/331/datanucleus-api-jdo-4.2.1.jar lrwxrwxrwx 1 yarn hadoop 66 Jan 17 09:50 datanucleus-core-4.1.6.jar -> /grid/3/hadoop/yarn/local/filecache/283/datanucleus-core-4.1.6.jar lrwxrwxrwx 1 yarn hadoop 67 Jan 17 09:50 datanucleus-rdbms-4.1.7.jar -> /grid/2/hadoop/yarn/local/filecache/338/datanucleus-rdbms-4.1.7.jar -rwx------ 1 yarn hadoop 701 Jan 17 09:50 default_container_executor_session.sh -rwx------ 1 yarn hadoop 755 Jan 17 09:50 default_container_executor.sh lrwxrwxrwx 1 yarn hadoop 93 Jan 17 09:50 dropwizard-metrics-hadoop-metrics2-reporter-0.1.2.jar -> /grid/6/hadoop/yarn/local/filecache/348/dropwizard-metrics-hadoop-metrics2-reporter-0.1.2.jar lrwxrwxrwx 1 yarn hadoop 52 Jan 17 09:50 fst-2.24.jar -> /grid/1/hadoop/yarn/local/filecache/257/fst-2.24.jar lrwxrwxrwx 1 yarn hadoop 78 Jan 17 09:50 geronimo-annotation_1.0_spec-1.1.1.jar -> /grid/2/hadoop/yarn/local/filecache/287/geronimo-annotation_1.0_spec-1.1.1.jar lrwxrwxrwx 1 yarn hadoop 72 Jan 17 09:50 geronimo-jaspic_1.0_spec-1.0.jar -> /grid/3/hadoop/yarn/local/filecache/264/geronimo-jaspic_1.0_spec-1.0.jar lrwxrwxrwx 1 yarn hadoop 71 Jan 17 09:50 geronimo-jta_1.1_spec-1.1.1.jar -> /grid/0/hadoop/yarn/local/filecache/270/geronimo-jta_1.1_spec-1.1.1.jar lrwxrwxrwx 1 yarn hadoop 56 Jan 17 09:50 guava-11.0.2.jar -> /grid/5/hadoop/yarn/local/filecache/302/guava-11.0.2.jar lrwxrwxrwx 1 yarn hadoop 61 Jan 17 09:50 guice-servlet-3.0.jar -> /grid/3/hadoop/yarn/local/filecache/319/guice-servlet-3.0.jar lrwxrwxrwx 1 yarn hadoop 70 Jan 17 09:50 hadoop-aws-2.7.3.2.6.0.3-8.jar -> /grid/2/hadoop/yarn/local/filecache/309/hadoop-aws-2.7.3.2.6.0.3-8.jar lrwxrwxrwx 1 yarn hadoop 72 Jan 17 09:50 hadoop-azure-2.7.3.2.6.0.3-8.jar -> /grid/1/hadoop/yarn/local/filecache/293/hadoop-azure-2.7.3.2.6.0.3-8.jar lrwxrwxrwx 1 yarn hadoop 81 Jan 17 09:50 hadoop-azure-datalake-2.7.3.2.6.0.3-8.jar -> /grid/2/hadoop/yarn/local/filecache/288/hadoop-azure-datalake-2.7.3.2.6.0.3-8.jar lrwxrwxrwx 1 yarn hadoop 105 Jan 17 09:50 hadoop-yarn-server-applicationhistoryservice-2.7.3.2.6.0.3-8.jar -> /grid/11/hadoop/yarn/local/filecache/285/hadoop-yarn-server-applicationhistoryservice-2.7.3.2.6.0.3-8.jar lrwxrwxrwx 1 yarn hadoop 94 Jan 17 09:50 hadoop-yarn-server-resourcemanager-2.7.3.2.6.0.3-8.jar -> /grid/7/hadoop/yarn/local/filecache/263/hadoop-yarn-server-resourcemanager-2.7.3.2.6.0.3-8.jar lrwxrwxrwx 1 yarn hadoop 88 Jan 17 09:50 hadoop-yarn-server-web-proxy-2.7.3.2.6.0.3-8.jar -> /grid/1/hadoop/yarn/local/filecache/273/hadoop-yarn-server-web-proxy-2.7.3.2.6.0.3-8.jar lrwxrwxrwx 1 yarn hadoop 58 Jan 17 09:50 HikariCP-2.5.1.jar -> /grid/4/hadoop/yarn/local/filecache/312/HikariCP-2.5.1.jar lrwxrwxrwx 1 yarn hadoop 75 Jan 17 09:50 hive-beeline-1.2.1000.2.6.0.3-8.jar -> /grid/4/hadoop/yarn/local/filecache/329/hive-beeline-1.2.1000.2.6.0.3-8.jar lrwxrwxrwx 1 yarn hadoop 71 Jan 17 09:50 hive-cli-1.2.1000.2.6.0.3-8.jar -> /grid/0/hadoop/yarn/local/filecache/300/hive-cli-1.2.1000.2.6.0.3-8.jar lrwxrwxrwx 1 yarn hadoop 74 Jan 17 09:50 hive-common-1.2.1000.2.6.0.3-8.jar -> /grid/3/hadoop/yarn/local/filecache/261/hive-common-1.2.1000.2.6.0.3-8.jar lrwxrwxrwx 1 yarn hadoop 72 Jan 17 09:50 hive-jdbc-1.2.1000.2.6.0.3-8.jar -> /grid/4/hadoop/yarn/local/filecache/301/hive-jdbc-1.2.1000.2.6.0.3-8.jar lrwxrwxrwx 1 yarn hadoop 77 Jan 17 09:50 hive-metastore-1.2.1000.2.6.0.3-8.jar -> /grid/1/hadoop/yarn/local/filecache/335/hive-metastore-1.2.1000.2.6.0.3-8.jar lrwxrwxrwx 1 yarn hadoop 74 Jan 17 09:50 hive-serde-1.2.1000.2.6.0.3-8.jar -> /grid/10/hadoop/yarn/local/filecache/304/hive-serde-1.2.1000.2.6.0.3-8.jar lrwxrwxrwx 1 yarn hadoop 75 Jan 17 09:50 hive-service-1.2.1000.2.6.0.3-8.jar -> /grid/3/hadoop/yarn/local/filecache/267/hive-service-1.2.1000.2.6.0.3-8.jar lrwxrwxrwx 1 yarn hadoop 79 Jan 17 09:50 hive-shims-0.20S-1.2.1000.2.6.0.3-8.jar -> /grid/2/hadoop/yarn/local/filecache/280/hive-shims-0.20S-1.2.1000.2.6.0.3-8.jar lrwxrwxrwx 1 yarn hadoop 78 Jan 17 09:50 hive-shims-0.23-1.2.1000.2.6.0.3-8.jar -> /grid/6/hadoop/yarn/local/filecache/325/hive-shims-0.23-1.2.1000.2.6.0.3-8.jar lrwxrwxrwx 1 yarn hadoop 73 Jan 17 09:50 hive-shims-1.2.1000.2.6.0.3-8.jar -> /grid/9/hadoop/yarn/local/filecache/342/hive-shims-1.2.1000.2.6.0.3-8.jar lrwxrwxrwx 1 yarn hadoop 80 Jan 17 09:50 hive-shims-common-1.2.1000.2.6.0.3-8.jar -> /grid/6/hadoop/yarn/local/filecache/269/hive-shims-common-1.2.1000.2.6.0.3-8.jar lrwxrwxrwx 1 yarn hadoop 83 Jan 17 09:50 hive-shims-scheduler-1.2.1000.2.6.0.3-8.jar -> /grid/9/hadoop/yarn/local/filecache/290/hive-shims-scheduler-1.2.1000.2.6.0.3-8.jar lrwxrwxrwx 1 yarn hadoop 58 Jan 17 09:50 httpclient-4.4.jar -> /grid/8/hadoop/yarn/local/filecache/311/httpclient-4.4.jar lrwxrwxrwx 1 yarn hadoop 57 Jan 17 09:50 httpcore-4.4.jar -> /grid/10/hadoop/yarn/local/filecache/299/httpcore-4.4.jar lrwxrwxrwx 1 yarn hadoop 69 Jan 17 09:50 jackson-annotations-2.4.0.jar -> /grid/5/hadoop/yarn/local/filecache/340/jackson-annotations-2.4.0.jar lrwxrwxrwx 1 yarn hadoop 62 Jan 17 09:50 jackson-core-2.4.4.jar -> /grid/2/hadoop/yarn/local/filecache/266/jackson-core-2.4.4.jar lrwxrwxrwx 1 yarn hadoop 66 Jan 17 09:50 jackson-databind-2.4.4.jar -> /grid/1/hadoop/yarn/local/filecache/346/jackson-databind-2.4.4.jar lrwxrwxrwx 1 yarn hadoop 63 Jan 17 09:50 javassist-3.18.1-GA.jar -> /grid/2/hadoop/yarn/local/filecache/289/javassist-3.18.1-GA.jar lrwxrwxrwx 1 yarn hadoop 62 Jan 17 09:50 javax.jdo-3.2.0-m3.jar -> /grid/8/hadoop/yarn/local/filecache/282/javax.jdo-3.2.0-m3.jar lrwxrwxrwx 1 yarn hadoop 57 Jan 17 09:50 jdo-api-3.0.1.jar -> /grid/7/hadoop/yarn/local/filecache/322/jdo-api-3.0.1.jar lrwxrwxrwx 1 yarn hadoop 69 Jan 17 09:50 jetty-all-7.6.0.v20120127.jar -> /grid/2/hadoop/yarn/local/filecache/313/jetty-all-7.6.0.v20120127.jar lrwxrwxrwx 1 yarn hadoop 54 Jan 17 09:50 jline-2.12.jar -> /grid/4/hadoop/yarn/local/filecache/323/jline-2.12.jar drwxr-xr-x 2 yarn hadoop 60 Jan 17 09:50 jobSubmitDir lrwxrwxrwx 1 yarn hadoop 113 Jan 17 09:50 job.xml -> /grid/7/hadoop/yarn/local/usercache/dmitro.vasilenko/appcache/application_1515765548943_7803/filecache/11/job.xml lrwxrwxrwx 1 yarn hadoop 59 Jan 17 09:50 joda-time-2.9.6.jar -> /grid/3/hadoop/yarn/local/filecache/351/joda-time-2.9.6.jar lrwxrwxrwx 1 yarn hadoop 53 Jan 17 09:50 jpam-1.1.jar -> /grid/11/hadoop/yarn/local/filecache/315/jpam-1.1.jar lrwxrwxrwx 1 yarn hadoop 57 Jan 17 09:50 json-20090211.jar -> /grid/9/hadoop/yarn/local/filecache/341/json-20090211.jar lrwxrwxrwx 1 yarn hadoop 59 Jan 17 09:50 json-simple-1.1.jar -> /grid/7/hadoop/yarn/local/filecache/333/json-simple-1.1.jar lrwxrwxrwx 1 yarn hadoop 57 Jan 17 09:50 jsr305-3.0.0.jar -> /grid/10/hadoop/yarn/local/filecache/286/jsr305-3.0.0.jar lrwxrwxrwx 1 yarn hadoop 51 Jan 17 09:50 jta-1.1.jar -> /grid/3/hadoop/yarn/local/filecache/332/jta-1.1.jar -rwx------ 1 yarn hadoop 18252 Jan 17 09:50 launch_container.sh lrwxrwxrwx 1 yarn hadoop 59 Jan 17 09:50 libfb303-0.9.3.jar -> /grid/10/hadoop/yarn/local/filecache/258/libfb303-0.9.3.jar lrwxrwxrwx 1 yarn hadoop 59 Jan 17 09:50 libthrift-0.9.3.jar -> /grid/2/hadoop/yarn/local/filecache/268/libthrift-0.9.3.jar lrwxrwxrwx 1 yarn hadoop 52 Jan 17 09:50 mail-1.4.jar -> /grid/3/hadoop/yarn/local/filecache/277/mail-1.4.jar lrwxrwxrwx 1 yarn hadoop 62 Jan 17 09:50 metrics-core-3.1.0.jar -> /grid/0/hadoop/yarn/local/filecache/265/metrics-core-3.1.0.jar lrwxrwxrwx 1 yarn hadoop 63 Jan 17 09:50 metrics-json-3.1.0.jar -> /grid/10/hadoop/yarn/local/filecache/276/metrics-json-3.1.0.jar lrwxrwxrwx 1 yarn hadoop 61 Jan 17 09:50 metrics-jvm-3.1.0.jar -> /grid/1/hadoop/yarn/local/filecache/305/metrics-jvm-3.1.0.jar lrwxrwxrwx 1 yarn hadoop 55 Jan 17 09:50 mr-framework -> /grid/8/hadoop/yarn/local/filecache/52/mapreduce.tar.gz lrwxrwxrwx 1 yarn hadoop 57 Jan 17 09:50 objenesis-2.1.jar -> /grid/7/hadoop/yarn/local/filecache/271/objenesis-2.1.jar lrwxrwxrwx 1 yarn hadoop 56 Jan 17 09:50 okhttp-2.4.0.jar -> /grid/7/hadoop/yarn/local/filecache/317/okhttp-2.4.0.jar lrwxrwxrwx 1 yarn hadoop 54 Jan 17 09:50 okio-1.4.0.jar -> /grid/5/hadoop/yarn/local/filecache/278/okio-1.4.0.jar lrwxrwxrwx 1 yarn hadoop 87 Jan 17 09:50 oozie-hadoop-utils-hadoop-2-4.2.0.2.6.0.3-8.jar -> /grid/2/hadoop/yarn/local/filecache/310/oozie-hadoop-utils-hadoop-2-4.2.0.2.6.0.3-8.jar lrwxrwxrwx 1 yarn hadoop 81 Jan 17 09:50 oozie-sharelib-hive2-4.2.0.2.6.0.3-8.jar -> /grid/11/hadoop/yarn/local/filecache/292/oozie-sharelib-hive2-4.2.0.2.6.0.3-8.jar lrwxrwxrwx 1 yarn hadoop 80 Jan 17 09:50 oozie-sharelib-oozie-4.2.0.2.6.0.3-8.jar -> /grid/2/hadoop/yarn/local/filecache/314/oozie-sharelib-oozie-4.2.0.2.6.0.3-8.jar lrwxrwxrwx 1 yarn hadoop 55 Jan 17 09:50 opencsv-2.3.jar -> /grid/7/hadoop/yarn/local/filecache/337/opencsv-2.3.jar lrwxrwxrwx 1 yarn hadoop 57 Jan 17 09:50 paranamer-2.3.jar -> /grid/3/hadoop/yarn/local/filecache/260/paranamer-2.3.jar lrwxrwxrwx 1 yarn hadoop 71 Jan 17 09:50 parquet-hadoop-bundle-1.8.1.jar -> /grid/3/hadoop/yarn/local/filecache/303/parquet-hadoop-bundle-1.8.1.jar lrwxrwxrwx 1 yarn hadoop 59 Jan 17 09:50 slf4j-api-1.6.6.jar -> /grid/8/hadoop/yarn/local/filecache/330/slf4j-api-1.6.6.jar lrwxrwxrwx 1 yarn hadoop 63 Jan 17 09:50 slf4j-log4j12-1.6.6.jar -> /grid/9/hadoop/yarn/local/filecache/343/slf4j-log4j12-1.6.6.jar lrwxrwxrwx 1 yarn hadoop 62 Jan 17 09:50 snappy-java-1.0.5.jar -> /grid/10/hadoop/yarn/local/filecache/274/snappy-java-1.0.5.jar lrwxrwxrwx 1 yarn hadoop 65 Jan 17 09:50 stringtemplate-3.2.1.jar -> /grid/11/hadoop/yarn/local/filecache/296/stringtemplate-3.2.1.jar lrwxrwxrwx 1 yarn hadoop 59 Jan 17 09:50 super-csv-2.2.0.jar -> /grid/1/hadoop/yarn/local/filecache/324/super-csv-2.2.0.jar drwx--x--- 2 yarn hadoop 10 Jan 17 09:50 tmp lrwxrwxrwx 1 yarn hadoop 63 Jan 17 09:50 transaction-api-1.1.jar -> /grid/1/hadoop/yarn/local/filecache/272/transaction-api-1.1.jar lrwxrwxrwx 1 yarn hadoop 50 Jan 17 09:50 xz-1.0.jar -> /grid/7/hadoop/yarn/local/filecache/307/xz-1.0.jar lrwxrwxrwx 1 yarn hadoop 76 Jan 17 09:50 zookeeper-3.4.6.2.6.0.3-8-tests.jar -> /grid/10/hadoop/yarn/local/filecache/259/zookeeper-3.4.6.2.6.0.3-8-tests.jar find -L . -maxdepth 5 -ls: 15075550336 12 drwx--x--- 4 yarn hadoop 8192 Jan 17 09:50 . 2147494955 0 drwx--x--- 2 yarn hadoop 10 Jan 17 09:50 ./tmp 15075550339 4 -rw-r--r-- 1 yarn hadoop 255 Jan 17 09:50 ./container_tokens 15075550340 4 -rw-r--r-- 1 yarn hadoop 12 Jan 17 09:50 ./.container_tokens.crc 15075550341 20 -rwx------ 1 yarn hadoop 18252 Jan 17 09:50 ./launch_container.sh 15075550342 4 -rw-r--r-- 1 yarn hadoop 152 Jan 17 09:50 ./.launch_container.sh.crc 15075550345 4 -rwx------ 1 yarn hadoop 701 Jan 17 09:50 ./default_container_executor_session.sh 15075550346 4 -rw-r--r-- 1 yarn hadoop 16 Jan 17 09:50 ./.default_container_executor_session.sh.crc 15075550347 4 -rwx------ 1 yarn hadoop 755 Jan 17 09:50 ./default_container_executor.sh 15075550348 4 -rw-r--r-- 1 yarn hadoop 16 Jan 17 09:50 ./.default_container_executor.sh.crc 357721500 16 -r-xr-xr-x 1 yarn hadoop 15823 Jan 17 09:50 ./metrics-json-3.1.0.jar 12884910835 12 -r-xr-xr-x 1 yarn hadoop 10464 Jan 17 09:50 ./hive-shims-1.2.1000.2.6.0.3-8.jar 15250995566 1964 -r-xr-xr-x 1 yarn hadoop 2009163 Jan 17 09:50 ./datanucleus-core-4.1.6.jar 12884912506 112 -r-xr-xr-x 1 yarn hadoop 110600 Jan 17 09:50 ./bonecp-0.8.0.RELEASE.jar 12884911389 184 -r-xr-xr-x 1 yarn hadoop 185245 Jan 17 09:50 ./curator-framework-2.6.0.jar 6442456488 200 -r-xr-xr-x 1 yarn hadoop 201124 Jan 17 09:50 ./jdo-api-3.0.1.jar 90265898 244 -r-xr-xr-x 1 yarn hadoop 249292 Jan 17 09:50 ./hadoop-yarn-server-applicationhistoryservice-2.7.3.2.6.0.3-8.jar 2147498749 12 -r-xr-xr-x 1 yarn hadoop 10092 Jan 17 09:50 ./azure-keyvault-core-0.8.0.jar 6442462298 360 -r-xr-xr-x 1 yarn hadoop 366565 Jan 17 09:50 ./datanucleus-api-jdo-4.2.1.jar 8594115920 240 -r-xr-xr-x 1 yarn hadoop 244782 Jan 17 09:50 ./curator-recipes-2.5.0.jar 2147510630 92 -r-xr-xr-x 1 yarn hadoop 93210 Jan 17 09:50 ./super-csv-2.2.0.jar 6442457838 64 -r-xr-xr-x 1 yarn hadoop 62983 Jan 17 09:50 ./activation-1.1.jar 12884909842 1224 -r-xr-xr-x 1 yarn hadoop 1251514 Jan 17 09:50 ./snappy-java-1.0.5.jar 8594114612 16 -r-xr-xr-x 1 yarn hadoop 12452 Jan 17 09:50 ./geronimo-annotation_1.0_spec-1.1.1.jar 196803174 704 -r-xr-xr-x 1 yarn hadoop 719304 Jan 17 09:50 ./httpclient-4.4.jar 12884910003 1644 -r-xr-xr-x 1 yarn hadoop 1681148 Jan 17 09:50 ./jetty-all-7.6.0.v20120127.jar 2147498725 16 -r-xr-xr-x 1 yarn hadoop 16030 Jan 17 09:50 ./geronimo-jta_1.1_spec-1.1.1.jar 10737429561 336 -r-xr-xr-x 1 yarn hadoop 340884 Jan 17 09:50 ./fst-2.24.jar 323469123 160 -r-xr-xr-x 1 yarn hadoop 160519 Jan 17 09:50 ./commons-dbcp-1.4.jar 8594117287 16 -r-xr-xr-x 1 yarn hadoop 12942 Jan 17 09:50 ./oozie-hadoop-utils-hadoop-2-4.2.0.2.6.0.3-8.jar 12884910221 1848 -r-xr-xr-x 1 yarn hadoop 1888550 Jan 17 09:50 ./datanucleus-rdbms-4.1.7.jar 8594115521 48 -r-xr-xr-x 1 yarn hadoop 45944 Jan 17 09:50 ./json-20090211.jar 4294974996 308 -r-xr-xr-x 1 yarn hadoop 313702 Jan 17 09:50 ./libfb303-0.9.3.jar 10737421558 96 -r-xr-xr-x 1 yarn hadoop 94672 Jan 17 09:50 ./xz-1.0.jar 63322082 12 -r-xr-xr-x 1 yarn hadoop 9711 Jan 17 09:50 ./slf4j-log4j12-1.6.6.jar 12884909998 24 -r-xr-xr-x 1 yarn hadoop 23838 Jan 17 09:50 ./hadoop-azure-datalake-2.7.3.2.6.0.3-8.jar 4294973206 136 -r-xr-xr-x 1 yarn hadoop 136363 Jan 17 09:50 ./HikariCP-2.5.1.jar 4294973851 20 -r-xr-xr-x 1 yarn hadoop 17345 Jan 17 09:50 ./oozie-sharelib-hive2-4.2.0.2.6.0.3-8.jar 4294977220 32 -r-xr-xr-x 1 yarn hadoop 32388 Jan 17 09:50 ./hive-shims-0.20S-1.2.1000.2.6.0.3-8.jar 4294974785 28 -r-xr-xr-x 1 yarn hadoop 26176 Jan 17 09:50 ./slf4j-api-1.6.6.jar 8594117689 148 -r-xr-xr-x 1 yarn hadoop 148627 Jan 17 09:50 ./stringtemplate-3.2.1.jar 2147492753 1968 -r-xr-xr-x 1 yarn hadoop 2013060 Jan 17 09:50 ./hive-service-1.2.1000.2.6.0.3-8.jar 15187126859 504 -r-xr-xr-x 1 yarn hadoop 516062 Jan 17 09:50 ./aws-java-sdk-core-1.10.6.jar 4294977230 44 -r-xr-xr-x 1 yarn hadoop 43033 Jan 17 09:50 ./asm-3.1.jar 4294984402 40 -r-xr-xr-x 1 yarn hadoop 38605 Jan 17 09:50 ./jackson-annotations-2.4.0.jar 6442457254 96 -r-xr-xr-x 1 yarn hadoop 96221 Jan 17 09:50 ./commons-pool-1.5.4.jar 8594113990 256 -r-xr-xr-x 1 yarn hadoop 258578 Jan 17 09:50 ./aws-java-sdk-kms-1.10.6.jar 6442462293 212 -r-xr-xr-x 1 yarn hadoop 213786 Jan 17 09:50 ./hadoop-azure-2.7.3.2.6.0.3-8.jar 6442455994 52 -r-xr-xr-x 1 yarn hadoop 52915 Jan 17 09:50 ./commons-logging-1.1.jar 2147495184 112 -r-xr-xr-x 1 yarn hadoop 112833 Jan 17 09:50 ./hive-shims-common-1.2.1000.2.6.0.3-8.jar 314326654 700 -r-xr-xr-x 1 yarn hadoop 714194 Jan 17 09:50 ./javassist-3.18.1-GA.jar 60987960 16 -r-xr-xr-x 1 yarn hadoop 13608 Jan 17 09:50 ./hive-shims-scheduler-1.2.1000.2.6.0.3-8.jar 15303356040 16 -r-xr-xr-x 1 yarn hadoop 15071 Jan 17 09:50 ./transaction-api-1.1.jar 8594113462 212 -r-xr-xr-x 1 yarn hadoop 213854 Jan 17 09:50 ./jline-2.12.jar 4294975069 36 -r-xr-xr-x 1 yarn hadoop 33031 Jan 17 09:50 ./jsr305-3.0.0.jar 2147492923 236 -r-xr-xr-x 1 yarn hadoop 241367 Jan 17 09:50 ./commons-compress-1.4.1.jar 10737431111 0 drwxrwxrwx 3 yarn hadoop 28 Nov 23 14:07 ./mr-framework 12884906238 0 drwxrwxrwx 9 yarn hadoop 193 Oct 30 04:43 ./mr-framework/hadoop 12884906622 4 -rwxrwxrwx 1 yarn hadoop 1366 Oct 30 04:43 ./mr-framework/hadoop/README.txt 15042350332 0 drwxrwxrwx 2 yarn hadoop 130 Oct 30 04:43 ./mr-framework/hadoop/include 15042426326 4 -rwxrwxrwx 1 yarn hadoop 3319 Oct 30 04:43 ./mr-framework/hadoop/include/TemplateFactory.hh 15042426342 8 -rwxrwxrwx 1 yarn hadoop 6330 Oct 30 04:43 ./mr-framework/hadoop/include/Pipes.hh 15042527998 36 -rwxrwxrwx 1 yarn hadoop 33361 Oct 30 04:43 ./mr-framework/hadoop/include/hdfs.h 15042528001 4 -rwxrwxrwx 1 yarn hadoop 2441 Oct 30 04:43 ./mr-framework/hadoop/include/StringUtils.hh 15042614756 8 -rwxrwxrwx 1 yarn hadoop 4514 Oct 30 04:43 ./mr-framework/hadoop/include/SerialUtils.hh 1434363101 0 drwxrwxrwx 4 yarn hadoop 43 Oct 30 04:43 ./mr-framework/hadoop/share 2487443821 0 drwxrwxrwx 9 yarn hadoop 131 Oct 30 04:43 ./mr-framework/hadoop/share/hadoop 4294969764 0 drwxrwxrwx 3 yarn hadoop 28 Oct 30 04:43 ./mr-framework/hadoop/share/hadoop/kms 4294969768 4 drwxrwxrwx 6 yarn hadoop 4096 Oct 30 04:43 ./mr-framework/hadoop/share/hadoop/common 15042648135 0 drwxrwxrwx 3 yarn hadoop 20 Oct 30 04:43 ./mr-framework/hadoop/share/hadoop/httpfs 2462627531 0 drwxrwxrwx 7 yarn hadoop 246 Oct 30 04:43 ./mr-framework/hadoop/share/hadoop/hdfs 12885420369 0 drwxrwxrwx 5 yarn hadoop 59 Oct 30 04:43 ./mr-framework/hadoop/share/hadoop/tools 2462627535 4 drwxrwxrwx 5 yarn hadoop 4096 Oct 30 04:43 ./mr-framework/hadoop/share/hadoop/yarn 10737422191 4 drwxrwxrwx 5 yarn hadoop 4096 Oct 30 04:43 ./mr-framework/hadoop/share/hadoop/mapreduce 2147487106 0 drwxrwxrwx 3 yarn hadoop 28 Oct 30 04:43 ./mr-framework/hadoop/share/doc 4294970193 0 drwxrwxrwx 6 yarn hadoop 81 Oct 30 04:43 ./mr-framework/hadoop/share/doc/hadoop 12885421207 16 -rwxrwxrwx 1 yarn hadoop 15753 Oct 30 04:43 ./mr-framework/hadoop/NOTICE.txt 12885421208 88 -rwxrwxrwx 1 yarn hadoop 87303 Oct 30 04:43 ./mr-framework/hadoop/LICENSE.txt 15046418316 0 drwxrwxrwx 2 yarn hadoop 304 Oct 30 04:43 ./mr-framework/hadoop/bin 15046418329 4 -rwxrwxrwx 1 yarn hadoop 888 Oct 30 04:43 ./mr-framework/hadoop/bin/kill-secondary-name-node 15046988262 212 -rwxrwxrwx 1 yarn hadoop 216194 Oct 30 04:43 ./mr-framework/hadoop/bin/test-container-executor 15046988267 4 -rwxrwxrwx 1 yarn hadoop 830 Oct 30 04:43 ./mr-framework/hadoop/bin/kill-name-node 15046988313 12 -rwxrwxrwx 1 yarn hadoop 8782 Oct 30 04:43 ./mr-framework/hadoop/bin/hdfs.cmd 15046990364 8 -rwxrwxrwx 1 yarn hadoop 6448 Oct 30 04:43 ./mr-framework/hadoop/bin/mapred 15046991587 8 -rwxrwxrwx 1 yarn hadoop 7120 Oct 30 04:43 ./mr-framework/hadoop/bin/hadoop 15046991595 12 -rwxrwxrwx 1 yarn hadoop 8786 Oct 30 04:43 ./mr-framework/hadoop/bin/hadoop.cmd 15046991596 16 -rwxrwxrwx 1 yarn hadoop 12707 Oct 30 04:43 ./mr-framework/hadoop/bin/hdfs 15046991621 12 -rwxrwxrwx 1 yarn hadoop 12069 Oct 30 04:43 ./mr-framework/hadoop/bin/yarn.cmd 15046991631 184 -rwxrwxrwx 1 yarn hadoop 187504 Oct 30 04:43 ./mr-framework/hadoop/bin/container-executor 15047005097 8 -rwxrwxrwx 1 yarn hadoop 7465 Oct 30 04:43 ./mr-framework/hadoop/bin/mapred.cmd 15047005109 4 -rwxrwxrwx 1 yarn hadoop 1857 Oct 30 04:43 ./mr-framework/hadoop/bin/rcc 15047005125 16 -rwxrwxrwx 1 yarn hadoop 14958 Oct 30 04:43 ./mr-framework/hadoop/bin/yarn 102867 4 drwxrwxrwx 2 yarn hadoop 4096 Oct 30 04:43 ./mr-framework/hadoop/sbin 102871 4 -rwxrwxrwx 1 yarn hadoop 1770 Oct 30 04:43 ./mr-framework/hadoop/sbin/stop-all.cmd 102877 4 -rwxrwxrwx 1 yarn hadoop 1508 Oct 30 04:43 ./mr-framework/hadoop/sbin/hdfs-config.sh 103218 4 -rwxrwxrwx 1 yarn hadoop 1455 Oct 30 04:43 ./mr-framework/hadoop/sbin/stop-dfs.cmd 103226 8 -rwxrwxrwx 1 yarn hadoop 4376 Oct 30 04:43 ./mr-framework/hadoop/sbin/yarn-daemon.sh 103248 4 -rwxrwxrwx 1 yarn hadoop 1421 Oct 30 04:43 ./mr-framework/hadoop/sbin/stop-secure-dns.sh 112866 4 -rwxrwxrwx 1 yarn hadoop 1260 Oct 30 04:43 ./mr-framework/hadoop/sbin/stop-balancer.sh 112869 4 -rwxrwxrwx 1 yarn hadoop 3630 Oct 30 04:43 ./mr-framework/hadoop/sbin/kms.sh 154787 4 -rwxrwxrwx 1 yarn hadoop 1543 Oct 30 04:43 ./mr-framework/hadoop/sbin/stop-all.sh 154797 4 -rwxrwxrwx 1 yarn hadoop 3287 Oct 30 04:43 ./mr-framework/hadoop/sbin/stop-dfs.sh 154799 4 -rwxrwxrwx 1 yarn hadoop 1640 Oct 30 04:43 ./mr-framework/hadoop/sbin/hdfs-config.cmd 154806 4 -rwxrwxrwx 1 yarn hadoop 1434 Oct 30 04:43 ./mr-framework/hadoop/sbin/yarn-daemons.sh 164548 4 -rwxrwxrwx 1 yarn hadoop 2752 Oct 30 04:43 ./mr-framework/hadoop/sbin/distribute-exclude.sh 164563 4 -rwxrwxrwx 1 yarn hadoop 1401 Oct 30 04:43 ./mr-framework/hadoop/sbin/start-dfs.cmd 164570 4 -rwxrwxrwx 1 yarn hadoop 1428 Oct 30 04:43 ./mr-framework/hadoop/sbin/start-yarn.sh 164571 8 -rwxrwxrwx 1 yarn hadoop 6546 Oct 30 04:43 ./mr-framework/hadoop/sbin/hadoop-daemon.sh 933775 4 -rwxrwxrwx 1 yarn hadoop 1209 Oct 30 04:43 ./mr-framework/hadoop/sbin/start-balancer.sh 933819 8 -rwxrwxrwx 1 yarn hadoop 4215 Oct 30 04:43 ./mr-framework/hadoop/sbin/mr-jobhistory-daemon.sh 1133263 4 -rwxrwxrwx 1 yarn hadoop 1642 Oct 30 04:43 ./mr-framework/hadoop/sbin/stop-yarn.cmd 1133269 4 -rwxrwxrwx 1 yarn hadoop 1779 Oct 30 04:43 ./mr-framework/hadoop/sbin/start-all.cmd 1133273 4 -rwxrwxrwx 1 yarn hadoop 1729 Oct 30 04:43 ./mr-framework/hadoop/sbin/refresh-namenodes.sh 1133274 4 -rwxrwxrwx 1 yarn hadoop 1421 Oct 30 04:43 ./mr-framework/hadoop/sbin/stop-yarn.sh 1133277 4 -rwxrwxrwx 1 yarn hadoop 2291 Oct 30 04:43 ./mr-framework/hadoop/sbin/httpfs.sh 1133280 4 -rwxrwxrwx 1 yarn hadoop 1552 Oct 30 04:43 ./mr-framework/hadoop/sbin/start-all.sh 1133282 4 -rwxrwxrwx 1 yarn hadoop 2226 Oct 30 04:43 ./mr-framework/hadoop/sbin/slaves.sh 1133283 4 -rwxrwxrwx 1 yarn hadoop 3815 Oct 30 04:43 ./mr-framework/hadoop/sbin/start-dfs.sh 1133284 4 -rwxrwxrwx 1 yarn hadoop 1438 Oct 30 04:43 ./mr-framework/hadoop/sbin/start-secure-dns.sh 1133288 4 -rwxrwxrwx 1 yarn hadoop 1441 Oct 30 04:43 ./mr-framework/hadoop/sbin/hadoop-daemons.sh 1133292 4 -rwxrwxrwx 1 yarn hadoop 1571 Oct 30 04:43 ./mr-framework/hadoop/sbin/start-yarn.cmd 2147487107 0 drwxrwxrwx 3 yarn hadoop 28 Oct 30 04:43 ./mr-framework/hadoop/lib 4294970522 0 drwxrwxrwx 2 yarn hadoop 294 Oct 30 04:43 ./mr-framework/hadoop/lib/native 4294970708 24 -rwxrwxrwx 1 yarn hadoop 23800 Oct 30 04:43 ./mr-framework/hadoop/lib/native/libsnappy.so 4294970708 24 -rwxrwxrwx 1 yarn hadoop 23800 Oct 30 04:43 ./mr-framework/hadoop/lib/native/libsnappy.so.1 4294970702 428 -rwxrwxrwx 1 yarn hadoop 434532 Oct 30 04:43 ./mr-framework/hadoop/lib/native/libhdfs.a 4294970706 268 -rwxrwxrwx 1 yarn hadoop 272810 Oct 30 04:43 ./mr-framework/hadoop/lib/native/libhdfs.so 4294970704 1412 -rwxrwxrwx 1 yarn hadoop 1443266 Oct 30 04:43 ./mr-framework/hadoop/lib/native/libhadoop.a 4294970707 816 -rwxrwxrwx 1 yarn hadoop 832037 Oct 30 04:43 ./mr-framework/hadoop/lib/native/libhadoop.so 4294970706 268 -rwxrwxrwx 1 yarn hadoop 272810 Oct 30 04:43 ./mr-framework/hadoop/lib/native/libhdfs.so.0.0.0 4294970707 816 -rwxrwxrwx 1 yarn hadoop 832037 Oct 30 04:43 ./mr-framework/hadoop/lib/native/libhadoop.so.1.0.0 4294970708 24 -rwxrwxrwx 1 yarn hadoop 23800 Oct 30 04:43 ./mr-framework/hadoop/lib/native/libsnappy.so.1.1.4 4294970710 1572 -rwxrwxrwx 1 yarn hadoop 1607184 Oct 30 04:43 ./mr-framework/hadoop/lib/native/libhadooppipes.a 4294970713 468 -rwxrwxrwx 1 yarn hadoop 475338 Oct 30 04:43 ./mr-framework/hadoop/lib/native/libhadooputils.a 6442462586 0 drwxrwxrwx 3 yarn hadoop 28 Oct 30 04:43 ./mr-framework/hadoop/etc 8594118824 4 drwxrwxrwx 2 yarn hadoop 4096 Oct 30 04:43 ./mr-framework/hadoop/etc/hadoop 8594118825 12 -rwxrwxrwx 1 yarn hadoop 9683 Oct 30 04:43 ./mr-framework/hadoop/etc/hadoop/hadoop-policy.xml 8594118827 4 -rwxrwxrwx 1 yarn hadoop 951 Oct 30 04:43 ./mr-framework/hadoop/etc/hadoop/mapred-env.cmd 8594118831 4 -rwxrwxrwx 1 yarn hadoop 775 Oct 30 04:43 ./mr-framework/hadoop/etc/hadoop/hdfs-site.xml 8594118832 8 -rwxrwxrwx 1 yarn hadoop 5511 Oct 30 04:43 ./mr-framework/hadoop/etc/hadoop/kms-site.xml 8594118834 4 -rwxrwxrwx 1 yarn hadoop 620 Oct 30 04:43 ./mr-framework/hadoop/etc/hadoop/httpfs-site.xml 8594118835 8 -rwxrwxrwx 1 yarn hadoop 4436 Oct 30 04:43 ./mr-framework/hadoop/etc/hadoop/capacity-scheduler.xml 8594118836 8 -rwxrwxrwx 1 yarn hadoop 4113 Oct 30 04:43 ./mr-framework/hadoop/etc/hadoop/mapred-queues.xml.template 8594118844 4 -rwxrwxrwx 1 yarn hadoop 2250 Oct 30 04:43 ./mr-framework/hadoop/etc/hadoop/yarn-env.cmd 8594118845 4 -rwxrwxrwx 1 yarn hadoop 10 Oct 30 04:43 ./mr-framework/hadoop/etc/hadoop/slaves 8594119768 16 -rwxrwxrwx 1 yarn hadoop 12302 Oct 30 04:43 ./mr-framework/hadoop/etc/hadoop/log4j.properties 8594119769 8 -rwxrwxrwx 1 yarn hadoop 4567 Oct 30 04:43 ./mr-framework/hadoop/etc/hadoop/yarn-env.sh 8594119807 4 -rwxrwxrwx 1 yarn hadoop 690 Oct 30 04:43 ./mr-framework/hadoop/etc/hadoop/yarn-site.xml 8594120602 8 -rwxrwxrwx 1 yarn hadoop 4529 Oct 30 04:43 ./mr-framework/hadoop/etc/hadoop/hadoop-env.sh 8594120617 4 -rwxrwxrwx 1 yarn hadoop 318 Oct 30 04:43 ./mr-framework/hadoop/etc/hadoop/container-executor.cfg 8594120618 4 -rwxrwxrwx 1 yarn hadoop 1536 Oct 30 04:43 ./mr-framework/hadoop/etc/hadoop/httpfs-env.sh 8594120623 4 -rwxrwxrwx 1 yarn hadoop 3518 Oct 30 04:43 ./mr-framework/hadoop/etc/hadoop/kms-acls.xml 8594120626 4 -rwxrwxrwx 1 yarn hadoop 1335 Oct 30 04:43 ./mr-framework/hadoop/etc/hadoop/configuration.xsl 8594120628 4 -rwxrwxrwx 1 yarn hadoop 2598 Oct 30 04:43 ./mr-framework/hadoop/etc/hadoop/hadoop-metrics2.properties 8594120629 4 -rwxrwxrwx 1 yarn hadoop 2316 Oct 30 04:43 ./mr-framework/hadoop/etc/hadoop/ssl-client.xml.example 8594120630 4 -rwxrwxrwx 1 yarn hadoop 774 Oct 30 04:43 ./mr-framework/hadoop/etc/hadoop/core-site.xml 8594120633 4 -rwxrwxrwx 1 yarn hadoop 1527 Oct 30 04:43 ./mr-framework/hadoop/etc/hadoop/kms-env.sh 8594120634 4 -rwxrwxrwx 1 yarn hadoop 1383 Oct 30 04:43 ./mr-framework/hadoop/etc/hadoop/mapred-env.sh 8594120636 4 -rwxrwxrwx 1 yarn hadoop 21 Oct 30 04:43 ./mr-framework/hadoop/etc/hadoop/httpfs-signature.secret 8594120637 4 -rwxrwxrwx 1 yarn hadoop 1631 Oct 30 04:43 ./mr-framework/hadoop/etc/hadoop/kms-log4j.properties 8594120638 4 -rwxrwxrwx 1 yarn hadoop 2490 Oct 30 04:43 ./mr-framework/hadoop/etc/hadoop/hadoop-metrics.properties 8594120639 4 -rwxrwxrwx 1 yarn hadoop 2697 Oct 30 04:43 ./mr-framework/hadoop/etc/hadoop/ssl-server.xml.example 8594120800 4 -rwxrwxrwx 1 yarn hadoop 3979 Oct 30 04:43 ./mr-framework/hadoop/etc/hadoop/hadoop-env.cmd 8594120801 4 -rwxrwxrwx 1 yarn hadoop 1657 Oct 30 04:43 ./mr-framework/hadoop/etc/hadoop/httpfs-log4j.properties 8594120802 4 -rwxrwxrwx 1 yarn hadoop 758 Oct 30 04:43 ./mr-framework/hadoop/etc/hadoop/mapred-site.xml.template 10737423115 0 drwxrwxrwx 2 yarn hadoop 283 Oct 30 04:43 ./mr-framework/hadoop/libexec 10737423135 4 -rwxrwxrwx 1 yarn hadoop 1508 Oct 30 04:43 ./mr-framework/hadoop/libexec/hdfs-config.sh 10737423150 4 -rwxrwxrwx 1 yarn hadoop 1640 Oct 30 04:43 ./mr-framework/hadoop/libexec/hdfs-config.cmd 10737423166 4 -rwxrwxrwx 1 yarn hadoop 2131 Oct 30 04:43 ./mr-framework/hadoop/libexec/yarn-config.cmd 10737423690 4 -rwxrwxrwx 1 yarn hadoop 2304 Oct 30 04:43 ./mr-framework/hadoop/libexec/mapred-config.sh 10737423699 12 -rwxrwxrwx 1 yarn hadoop 11678 Oct 30 04:43 ./mr-framework/hadoop/libexec/hadoop-config.sh 10737423707 4 -rwxrwxrwx 1 yarn hadoop 1777 Oct 30 04:43 ./mr-framework/hadoop/libexec/mapred-config.cmd 10737423712 8 -rwxrwxrwx 1 yarn hadoop 5431 Oct 30 04:43 ./mr-framework/hadoop/libexec/kms-config.sh 10737423716 8 -rwxrwxrwx 1 yarn hadoop 6016 Oct 30 04:43 ./mr-framework/hadoop/libexec/httpfs-config.sh 10737423727 12 -rwxrwxrwx 1 yarn hadoop 8270 Oct 30 04:43 ./mr-framework/hadoop/libexec/hadoop-config.cmd 10737423728 4 -rwxrwxrwx 1 yarn hadoop 2215 Oct 30 04:43 ./mr-framework/hadoop/libexec/yarn-config.sh 2147491097 80 -r-xr-xr-x 1 yarn hadoop 78849 Jan 17 09:50 ./azure-data-lake-store-sdk-2.1.4.jar 15215575741 20 -r-xr-xr-x 1 yarn hadoop 19827 Jan 17 09:50 ./opencsv-2.3.jar 15184969013 112 -r-xr-xr-x 1 yarn hadoop 111908 Jan 17 09:50 ./metrics-core-3.1.0.jar 12884913170 392 -r-xr-xr-x 1 yarn hadoop 400680 Jan 17 09:50 ./avro-1.7.5.jar 2147494178 2836 -r-xr-xr-x 1 yarn hadoop 2902379 Jan 17 09:50 ./parquet-hadoop-bundle-1.8.1.jar 12884905792 728 -r-xr-xr-x 1 yarn hadoop 745325 Jan 17 09:50 ./azure-storage-4.2.0.jar 4294976400 0 drwxr-xr-x 2 yarn hadoop 60 Jan 17 09:50 ./jobSubmitDir 6442456051 4 -r-x------ 1 yarn hadoop 74 Jan 17 09:50 ./jobSubmitDir/job.split 4294974788 4 -r-x------ 1 yarn hadoop 13 Jan 17 09:50 ./jobSubmitDir/job.splitmetainfo 12884907249 148 -r-xr-xr-x 1 yarn hadoop 148367 Jan 17 09:50 ./hive-beeline-1.2.1000.2.6.0.3-8.jar 6442455991 64 -r-xr-xr-x 1 yarn hadoop 62368 Jan 17 09:50 ./hive-shims-0.23-1.2.1000.2.6.0.3-8.jar 4294976354 904 -r-xr-xr-x 1 yarn hadoop 925187 Jan 17 09:50 ./hive-serde-1.2.1000.2.6.0.3-8.jar 8594113547 532 -r-xr-xr-x 1 yarn hadoop 542614 Jan 17 09:50 ./zookeeper-3.4.6.2.6.0.3-8-tests.jar 15214158873 312 -r-xr-xr-x 1 yarn hadoop 319099 Jan 17 09:50 ./okhttp-2.4.0.jar 6442457245 32 -r-xr-xr-x 1 yarn hadoop 29555 Jan 17 09:50 ./paranamer-2.3.jar 10737421433 1428 -r-xr-xr-x 1 yarn hadoop 1459051 Jan 17 09:50 ./hadoop-yarn-server-resourcemanager-2.7.3.2.6.0.3-8.jar 10737427619 44 -r-xr-xr-x 1 yarn hadoop 41123 Jan 17 09:50 ./commons-cli-1.2.jar 15285535258 24 -r-xr-xr-x 1 yarn hadoop 21879 Jan 17 09:50 ./asm-tree-3.1.jar 4294980115 64 -r-xr-xr-x 1 yarn hadoop 64661 Jan 17 09:50 ./okio-1.4.0.jar 15303356054 36 -r-xr-xr-x 1 yarn hadoop 35907 Jan 17 09:50 ./metrics-jvm-3.1.0.jar 10737429672 6036 -r-xr-xr-x 1 yarn hadoop 6178022 Jan 17 09:50 ./hive-metastore-1.2.1000.2.6.0.3-8.jar 295930861 232 -r-xr-xr-x 1 yarn hadoop 234201 Jan 17 09:50 ./libthrift-0.9.3.jar 10737425299 64 -r-xr-xr-x 1 yarn hadoop 65012 Jan 17 09:50 ./guice-servlet-3.0.jar 8594115353 1612 -r-xr-xr-x 1 yarn hadoop 1648200 Jan 17 09:50 ./guava-11.0.2.jar 12884910545 164 -r-xr-xr-x 1 yarn hadoop 164368 Jan 17 09:50 ./antlr-runtime-3.4.jar 287022451 112 -r-xr-xr-x 1 yarn hadoop 111724 Jan 17 09:50 ./hive-jdbc-1.2.1000.2.6.0.3-8.jar 10737425282 428 -r-xr-xr-x 1 yarn hadoop 434678 Jan 17 09:50 ./commons-lang3-3.4.jar 8594117641 32 -r-xr-xr-x 1 yarn hadoop 32693 Jan 17 09:50 ./asm-commons-3.1.jar 8594117305 560 -r-xr-xr-x 1 yarn hadoop 570101 Jan 17 09:50 ./aws-java-sdk-s3-1.10.6.jar 2147507199 36 -r-xr-xr-x 1 yarn hadoop 36247 Jan 17 09:50 ./hadoop-yarn-server-web-proxy-2.7.3.2.6.0.3-8.jar 12884951218 440 -r-xr-xr-x 1 yarn hadoop 448794 Jan 17 09:50 ./apache-log4j-extras-1.2.17.jar 2147494940 60 -r-xr-xr-x 1 yarn hadoop 58160 Jan 17 09:50 ./commons-codec-1.4.jar 4294977226 212 -r-xr-xr-x 1 yarn hadoop 216419 Jan 17 09:50 ./hadoop-aws-2.7.3.2.6.0.3-8.jar 15303356063 1052 -r-xr-xr-x 1 yarn hadoop 1076926 Jan 17 09:50 ./jackson-databind-2.4.4.jar 365550257 316 -r-xr-xr-x 1 yarn hadoop 321639 Jan 17 09:50 ./httpcore-4.4.jar 200013755 16 -r-xr-xr-x 1 yarn hadoop 15935 Jan 17 09:50 ./dropwizard-metrics-hadoop-metrics2-reporter-0.1.2.jar 2147493714 176 -r-x------ 1 yarn hadoop 177811 Jan 17 09:50 ./job.xml 10737424082 352 -r-xr-xr-x 1 yarn hadoop 356454 Jan 17 09:50 ./hive-common-1.2.1000.2.6.0.3-8.jar 10737432935 40 -r-xr-xr-x 1 yarn hadoop 40120 Jan 17 09:50 ./hive-cli-1.2.1000.2.6.0.3-8.jar 10737429665 1952 -r-xr-xr-x 1 yarn hadoop 1997485 Jan 17 09:50 ./ant-1.9.1.jar 334598205 52 -r-xr-xr-x 1 yarn hadoop 52693 Jan 17 09:50 ./oozie-sharelib-oozie-4.2.0.2.6.0.3-8.jar 6442457260 620 -r-xr-xr-x 1 yarn hadoop 632283 Jan 17 09:50 ./joda-time-2.9.6.jar 12884909072 224 -r-xr-xr-x 1 yarn hadoop 225302 Jan 17 09:50 ./jackson-core-2.4.4.jar 6442456390 68 -r-xr-xr-x 1 yarn hadoop 68866 Jan 17 09:50 ./curator-client-2.6.0.jar 12884907233 256 -r-xr-xr-x 1 yarn hadoop 261809 Jan 17 09:50 ./commons-lang-2.4.jar 15250995580 16 -r-xr-xr-x 1 yarn hadoop 15071 Jan 17 09:50 ./jta-1.1.jar 2147493249 184 -r-xr-xr-x 1 yarn hadoop 185140 Jan 17 09:50 ./commons-io-2.4.jar 8594116296 244 -r-xr-xr-x 1 yarn hadoop 249790 Jan 17 09:50 ./javax.jdo-3.2.0-m3.jar 15214158853 44 -r-xr-xr-x 1 yarn hadoop 41755 Jan 17 09:50 ./objenesis-2.1.jar 6442457250 380 -r-xr-xr-x 1 yarn hadoop 388864 Jan 17 09:50 ./mail-1.4.jar 4294976736 20 -r-xr-xr-x 1 yarn hadoop 18336 Jan 17 09:50 ./ant-launcher-1.9.1.jar 15250995527 32 -r-xr-xr-x 1 yarn hadoop 30548 Jan 17 09:50 ./geronimo-jaspic_1.0_spec-1.0.jar 2147495188 436 -r-xr-xr-x 1 yarn hadoop 445288 Jan 17 09:50 ./antlr-2.7.7.jar 12884905798 12 -r-xr-xr-x 1 yarn hadoop 12131 Jan 17 09:50 ./jpam-1.1.jar 10737421938 16 -r-xr-xr-x 1 yarn hadoop 16046 Jan 17 09:50 ./json-simple-1.1.jar broken symlinks(find -L . -maxdepth 5 -type l -ls): End of LogType:directory.info ******************************************************************************* Container: container_e134_1515765548943_7803_02_000001 on ks-dmp05.kyivstar.ua_45454_1516175454392 LogAggregationType: AGGREGATED ================================================================================================== LogType:launch_container.sh LogLastModifiedTime:Wed Jan 17 09:50:54 +0200 2018 LogLength:18252 LogContents: #!/bin/bash set -o pipefail -e export PRELAUNCH_OUT="/grid/0/hadoop/yarn/log/application_1515765548943_7803/container_e134_1515765548943_7803_02_000001/prelaunch.out" exec >"${PRELAUNCH_OUT}" export PRELAUNCH_ERR="/grid/0/hadoop/yarn/log/application_1515765548943_7803/container_e134_1515765548943_7803_02_000001/prelaunch.err" exec 2>"${PRELAUNCH_ERR}" echo "Setting up env variables" export PATH="/usr/sbin:/sbin:/usr/lib/ambari-server/*:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/var/lib/ambari-agent" export HADOOP_CONF_DIR=${HADOOP_CONF_DIR:-"/usr/hdp/current/hadoop-client/conf"} export MAX_APP_ATTEMPTS="2" export JAVA_HOME=${JAVA_HOME:-"/usr/jdk64/jdk1.8.0_77"} export LANG="en_US.UTF-8" export APP_SUBMIT_TIME_ENV="1516175420294" export NM_HOST="ks-dmp05.kyivstar.ua" export HADOOP_CLASSPATH="$PWD:job.jar/job.jar:job.jar/classes/:job.jar/lib/*:$PWD/*:null" export LD_LIBRARY_PATH="$PWD:$HADOOP_COMMON_HOME/lib/native" export LOGNAME="dmitro.vasilenko" export JVM_PID="$$" export PWD="/grid/10/hadoop/yarn/local/usercache/dmitro.vasilenko/appcache/application_1515765548943_7803/container_e134_1515765548943_7803_02_000001" export LOCAL_DIRS="/grid/0/hadoop/yarn/local/usercache/dmitro.vasilenko/appcache/application_1515765548943_7803,/grid/1/hadoop/yarn/local/usercache/dmitro.vasilenko/appcache/application_1515765548943_7803,/grid/2/hadoop/yarn/local/usercache/dmitro.vasilenko/appcache/application_1515765548943_7803,/grid/3/hadoop/yarn/local/usercache/dmitro.vasilenko/appcache/application_1515765548943_7803,/grid/4/hadoop/yarn/local/usercache/dmitro.vasilenko/appcache/application_1515765548943_7803,/grid/5/hadoop/yarn/local/usercache/dmitro.vasilenko/appcache/application_1515765548943_7803,/grid/6/hadoop/yarn/local/usercache/dmitro.vasilenko/appcache/application_1515765548943_7803,/grid/7/hadoop/yarn/local/usercache/dmitro.vasilenko/appcache/application_1515765548943_7803,/grid/8/hadoop/yarn/local/usercache/dmitro.vasilenko/appcache/application_1515765548943_7803,/grid/9/hadoop/yarn/local/usercache/dmitro.vasilenko/appcache/application_1515765548943_7803,/grid/10/hadoop/yarn/local/usercache/dmitro.vasilenko/appcache/application_1515765548943_7803,/grid/11/hadoop/yarn/local/usercache/dmitro.vasilenko/appcache/application_1515765548943_7803" export APPLICATION_WEB_PROXY_BASE="/proxy/application_1515765548943_7803" export SHELL="/bin/bash" export NM_HTTP_PORT="8042" export LOG_DIRS="/grid/0/hadoop/yarn/log/application_1515765548943_7803/container_e134_1515765548943_7803_02_000001,/grid/1/hadoop/yarn/log/application_1515765548943_7803/container_e134_1515765548943_7803_02_000001,/grid/2/hadoop/yarn/log/application_1515765548943_7803/container_e134_1515765548943_7803_02_000001,/grid/3/hadoop/yarn/log/application_1515765548943_7803/container_e134_1515765548943_7803_02_000001,/grid/4/hadoop/yarn/log/application_1515765548943_7803/container_e134_1515765548943_7803_02_000001,/grid/5/hadoop/yarn/log/application_1515765548943_7803/container_e134_1515765548943_7803_02_000001,/grid/6/hadoop/yarn/log/application_1515765548943_7803/container_e134_1515765548943_7803_02_000001,/grid/7/hadoop/yarn/log/application_1515765548943_7803/container_e134_1515765548943_7803_02_000001,/grid/8/hadoop/yarn/log/application_1515765548943_7803/container_e134_1515765548943_7803_02_000001,/grid/9/hadoop/yarn/log/application_1515765548943_7803/container_e134_1515765548943_7803_02_000001,/grid/10/hadoop/yarn/log/application_1515765548943_7803/container_e134_1515765548943_7803_02_000001,/grid/11/hadoop/yarn/log/application_1515765548943_7803/container_e134_1515765548943_7803_02_000001" export NM_AUX_SERVICE_mapreduce_shuffle="AAA0+gAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA= " export NM_PORT="45454" export USER="dmitro.vasilenko" export HADOOP_YARN_HOME=${HADOOP_YARN_HOME:-"/usr/hdp/current/hadoop-yarn-nodemanager"} export CLASSPATH="$PWD:job.jar/job.jar:job.jar/classes/:job.jar/lib/*:$PWD/*:$PWD/mr-framework/hadoop/share/hadoop/mapreduce/*:$PWD/mr-framework/hadoop/share/hadoop/mapreduce/lib/*:$PWD/mr-framework/hadoop/share/hadoop/common/*:$PWD/mr-framework/hadoop/share/hadoop/common/lib/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/lib/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/lib/*:$PWD/mr-framework/hadoop/share/hadoop/tools/lib/*:/usr/hdp/2.6.3.0-235/hadoop/lib/hadoop-lzo-0.6.0.2.6.3.0-235.jar:/etc/hadoop/conf/secure" export HADOOP_TOKEN_FILE_LOCATION="/grid/10/hadoop/yarn/local/usercache/dmitro.vasilenko/appcache/application_1515765548943_7803/container_e134_1515765548943_7803_02_000001/container_tokens" export NM_AUX_SERVICE_spark_shuffle="" export LOCAL_USER_DIRS="/grid/0/hadoop/yarn/local/usercache/dmitro.vasilenko/,/grid/1/hadoop/yarn/local/usercache/dmitro.vasilenko/,/grid/2/hadoop/yarn/local/usercache/dmitro.vasilenko/,/grid/3/hadoop/yarn/local/usercache/dmitro.vasilenko/,/grid/4/hadoop/yarn/local/usercache/dmitro.vasilenko/,/grid/5/hadoop/yarn/local/usercache/dmitro.vasilenko/,/grid/6/hadoop/yarn/local/usercache/dmitro.vasilenko/,/grid/7/hadoop/yarn/local/usercache/dmitro.vasilenko/,/grid/8/hadoop/yarn/local/usercache/dmitro.vasilenko/,/grid/9/hadoop/yarn/local/usercache/dmitro.vasilenko/,/grid/10/hadoop/yarn/local/usercache/dmitro.vasilenko/,/grid/11/hadoop/yarn/local/usercache/dmitro.vasilenko/" export HADOOP_HOME="/usr/hdp/2.6.3.0-235/hadoop" export HOME="/home/" export NM_AUX_SERVICE_spark2_shuffle="" export CONTAINER_ID="container_e134_1515765548943_7803_02_000001" export MALLOC_ARENA_MAX="4" echo "Setting up job resources" ln -sf "/grid/10/hadoop/yarn/local/filecache/276/metrics-json-3.1.0.jar" "metrics-json-3.1.0.jar" ln -sf "/grid/9/hadoop/yarn/local/filecache/342/hive-shims-1.2.1000.2.6.0.3-8.jar" "hive-shims-1.2.1000.2.6.0.3-8.jar" ln -sf "/grid/3/hadoop/yarn/local/filecache/283/datanucleus-core-4.1.6.jar" "datanucleus-core-4.1.6.jar" ln -sf "/grid/10/hadoop/yarn/local/filecache/298/bonecp-0.8.0.RELEASE.jar" "bonecp-0.8.0.RELEASE.jar" ln -sf "/grid/5/hadoop/yarn/local/filecache/350/curator-framework-2.6.0.jar" "curator-framework-2.6.0.jar" ln -sf "/grid/7/hadoop/yarn/local/filecache/322/jdo-api-3.0.1.jar" "jdo-api-3.0.1.jar" ln -sf "/grid/11/hadoop/yarn/local/filecache/285/hadoop-yarn-server-applicationhistoryservice-2.7.3.2.6.0.3-8.jar" "hadoop-yarn-server-applicationhistoryservice-2.7.3.2.6.0.3-8.jar" ln -sf "/grid/0/hadoop/yarn/local/filecache/344/azure-keyvault-core-0.8.0.jar" "azure-keyvault-core-0.8.0.jar" ln -sf "/grid/1/hadoop/yarn/local/filecache/331/datanucleus-api-jdo-4.2.1.jar" "datanucleus-api-jdo-4.2.1.jar" ln -sf "/grid/5/hadoop/yarn/local/filecache/347/curator-recipes-2.5.0.jar" "curator-recipes-2.5.0.jar" ln -sf "/grid/1/hadoop/yarn/local/filecache/324/super-csv-2.2.0.jar" "super-csv-2.2.0.jar" ln -sf "/grid/0/hadoop/yarn/local/filecache/284/activation-1.1.jar" "activation-1.1.jar" ln -sf "/grid/10/hadoop/yarn/local/filecache/274/snappy-java-1.0.5.jar" "snappy-java-1.0.5.jar" ln -sf "/grid/2/hadoop/yarn/local/filecache/287/geronimo-annotation_1.0_spec-1.1.1.jar" "geronimo-annotation_1.0_spec-1.1.1.jar" ln -sf "/grid/8/hadoop/yarn/local/filecache/311/httpclient-4.4.jar" "httpclient-4.4.jar" ln -sf "/grid/2/hadoop/yarn/local/filecache/313/jetty-all-7.6.0.v20120127.jar" "jetty-all-7.6.0.v20120127.jar" ln -sf "/grid/0/hadoop/yarn/local/filecache/270/geronimo-jta_1.1_spec-1.1.1.jar" "geronimo-jta_1.1_spec-1.1.1.jar" ln -sf "/grid/1/hadoop/yarn/local/filecache/257/fst-2.24.jar" "fst-2.24.jar" ln -sf "/grid/5/hadoop/yarn/local/filecache/334/commons-dbcp-1.4.jar" "commons-dbcp-1.4.jar" ln -sf "/grid/2/hadoop/yarn/local/filecache/310/oozie-hadoop-utils-hadoop-2-4.2.0.2.6.0.3-8.jar" "oozie-hadoop-utils-hadoop-2-4.2.0.2.6.0.3-8.jar" ln -sf "/grid/2/hadoop/yarn/local/filecache/338/datanucleus-rdbms-4.1.7.jar" "datanucleus-rdbms-4.1.7.jar" ln -sf "/grid/9/hadoop/yarn/local/filecache/341/json-20090211.jar" "json-20090211.jar" ln -sf "/grid/10/hadoop/yarn/local/filecache/258/libfb303-0.9.3.jar" "libfb303-0.9.3.jar" ln -sf "/grid/7/hadoop/yarn/local/filecache/307/xz-1.0.jar" "xz-1.0.jar" ln -sf "/grid/9/hadoop/yarn/local/filecache/343/slf4j-log4j12-1.6.6.jar" "slf4j-log4j12-1.6.6.jar" ln -sf "/grid/2/hadoop/yarn/local/filecache/288/hadoop-azure-datalake-2.7.3.2.6.0.3-8.jar" "hadoop-azure-datalake-2.7.3.2.6.0.3-8.jar" ln -sf "/grid/4/hadoop/yarn/local/filecache/312/HikariCP-2.5.1.jar" "HikariCP-2.5.1.jar" ln -sf "/grid/11/hadoop/yarn/local/filecache/292/oozie-sharelib-hive2-4.2.0.2.6.0.3-8.jar" "oozie-sharelib-hive2-4.2.0.2.6.0.3-8.jar" ln -sf "/grid/2/hadoop/yarn/local/filecache/280/hive-shims-0.20S-1.2.1000.2.6.0.3-8.jar" "hive-shims-0.20S-1.2.1000.2.6.0.3-8.jar" ln -sf "/grid/8/hadoop/yarn/local/filecache/330/slf4j-api-1.6.6.jar" "slf4j-api-1.6.6.jar" ln -sf "/grid/11/hadoop/yarn/local/filecache/296/stringtemplate-3.2.1.jar" "stringtemplate-3.2.1.jar" ln -sf "/grid/3/hadoop/yarn/local/filecache/267/hive-service-1.2.1000.2.6.0.3-8.jar" "hive-service-1.2.1000.2.6.0.3-8.jar" ln -sf "/grid/0/hadoop/yarn/local/filecache/316/aws-java-sdk-core-1.10.6.jar" "aws-java-sdk-core-1.10.6.jar" ln -sf "/grid/2/hadoop/yarn/local/filecache/321/asm-3.1.jar" "asm-3.1.jar" ln -sf "/grid/5/hadoop/yarn/local/filecache/340/jackson-annotations-2.4.0.jar" "jackson-annotations-2.4.0.jar" ln -sf "/grid/3/hadoop/yarn/local/filecache/306/commons-pool-1.5.4.jar" "commons-pool-1.5.4.jar" ln -sf "/grid/10/hadoop/yarn/local/filecache/295/aws-java-sdk-kms-1.10.6.jar" "aws-java-sdk-kms-1.10.6.jar" ln -sf "/grid/1/hadoop/yarn/local/filecache/293/hadoop-azure-2.7.3.2.6.0.3-8.jar" "hadoop-azure-2.7.3.2.6.0.3-8.jar" ln -sf "/grid/6/hadoop/yarn/local/filecache/353/commons-logging-1.1.jar" "commons-logging-1.1.jar" ln -sf "/grid/6/hadoop/yarn/local/filecache/269/hive-shims-common-1.2.1000.2.6.0.3-8.jar" "hive-shims-common-1.2.1000.2.6.0.3-8.jar" ln -sf "/grid/2/hadoop/yarn/local/filecache/289/javassist-3.18.1-GA.jar" "javassist-3.18.1-GA.jar" ln -sf "/grid/9/hadoop/yarn/local/filecache/290/hive-shims-scheduler-1.2.1000.2.6.0.3-8.jar" "hive-shims-scheduler-1.2.1000.2.6.0.3-8.jar" ln -sf "/grid/1/hadoop/yarn/local/filecache/272/transaction-api-1.1.jar" "transaction-api-1.1.jar" ln -sf "/grid/4/hadoop/yarn/local/filecache/323/jline-2.12.jar" "jline-2.12.jar" ln -sf "/grid/10/hadoop/yarn/local/filecache/286/jsr305-3.0.0.jar" "jsr305-3.0.0.jar" ln -sf "/grid/7/hadoop/yarn/local/filecache/320/commons-compress-1.4.1.jar" "commons-compress-1.4.1.jar" ln -sf "/grid/8/hadoop/yarn/local/filecache/52/mapreduce.tar.gz" "mr-framework" ln -sf "/grid/7/hadoop/yarn/local/filecache/281/azure-data-lake-store-sdk-2.1.4.jar" "azure-data-lake-store-sdk-2.1.4.jar" ln -sf "/grid/7/hadoop/yarn/local/filecache/337/opencsv-2.3.jar" "opencsv-2.3.jar" ln -sf "/grid/0/hadoop/yarn/local/filecache/265/metrics-core-3.1.0.jar" "metrics-core-3.1.0.jar" ln -sf "/grid/10/hadoop/yarn/local/filecache/349/avro-1.7.5.jar" "avro-1.7.5.jar" ln -sf "/grid/3/hadoop/yarn/local/filecache/303/parquet-hadoop-bundle-1.8.1.jar" "parquet-hadoop-bundle-1.8.1.jar" ln -sf "/grid/11/hadoop/yarn/local/filecache/275/azure-storage-4.2.0.jar" "azure-storage-4.2.0.jar" mkdir -p jobSubmitDir ln -sf "/grid/6/hadoop/yarn/local/usercache/dmitro.vasilenko/appcache/application_1515765548943_7803/filecache/10/job.split" "jobSubmitDir/job.split" ln -sf "/grid/4/hadoop/yarn/local/filecache/329/hive-beeline-1.2.1000.2.6.0.3-8.jar" "hive-beeline-1.2.1000.2.6.0.3-8.jar" ln -sf "/grid/6/hadoop/yarn/local/filecache/325/hive-shims-0.23-1.2.1000.2.6.0.3-8.jar" "hive-shims-0.23-1.2.1000.2.6.0.3-8.jar" ln -sf "/grid/10/hadoop/yarn/local/filecache/304/hive-serde-1.2.1000.2.6.0.3-8.jar" "hive-serde-1.2.1000.2.6.0.3-8.jar" ln -sf "/grid/10/hadoop/yarn/local/filecache/259/zookeeper-3.4.6.2.6.0.3-8-tests.jar" "zookeeper-3.4.6.2.6.0.3-8-tests.jar" ln -sf "/grid/7/hadoop/yarn/local/filecache/317/okhttp-2.4.0.jar" "okhttp-2.4.0.jar" ln -sf "/grid/3/hadoop/yarn/local/filecache/260/paranamer-2.3.jar" "paranamer-2.3.jar" ln -sf "/grid/7/hadoop/yarn/local/filecache/263/hadoop-yarn-server-resourcemanager-2.7.3.2.6.0.3-8.jar" "hadoop-yarn-server-resourcemanager-2.7.3.2.6.0.3-8.jar" ln -sf "/grid/6/hadoop/yarn/local/filecache/336/commons-cli-1.2.jar" "commons-cli-1.2.jar" ln -sf "/grid/6/hadoop/yarn/local/filecache/262/asm-tree-3.1.jar" "asm-tree-3.1.jar" ln -sf "/grid/5/hadoop/yarn/local/filecache/278/okio-1.4.0.jar" "okio-1.4.0.jar" ln -sf "/grid/1/hadoop/yarn/local/filecache/305/metrics-jvm-3.1.0.jar" "metrics-jvm-3.1.0.jar" ln -sf "/grid/1/hadoop/yarn/local/filecache/335/hive-metastore-1.2.1000.2.6.0.3-8.jar" "hive-metastore-1.2.1000.2.6.0.3-8.jar" ln -sf "/grid/2/hadoop/yarn/local/filecache/268/libthrift-0.9.3.jar" "libthrift-0.9.3.jar" ln -sf "/grid/3/hadoop/yarn/local/filecache/319/guice-servlet-3.0.jar" "guice-servlet-3.0.jar" ln -sf "/grid/5/hadoop/yarn/local/filecache/302/guava-11.0.2.jar" "guava-11.0.2.jar" ln -sf "/grid/5/hadoop/yarn/local/filecache/318/antlr-runtime-3.4.jar" "antlr-runtime-3.4.jar" ln -sf "/grid/4/hadoop/yarn/local/filecache/301/hive-jdbc-1.2.1000.2.6.0.3-8.jar" "hive-jdbc-1.2.1000.2.6.0.3-8.jar" ln -sf "/grid/3/hadoop/yarn/local/filecache/279/commons-lang3-3.4.jar" "commons-lang3-3.4.jar" ln -sf "/grid/10/hadoop/yarn/local/filecache/327/asm-commons-3.1.jar" "asm-commons-3.1.jar" ln -sf "/grid/2/hadoop/yarn/local/filecache/328/aws-java-sdk-s3-1.10.6.jar" "aws-java-sdk-s3-1.10.6.jar" ln -sf "/grid/1/hadoop/yarn/local/filecache/273/hadoop-yarn-server-web-proxy-2.7.3.2.6.0.3-8.jar" "hadoop-yarn-server-web-proxy-2.7.3.2.6.0.3-8.jar" ln -sf "/grid/8/hadoop/yarn/local/filecache/308/apache-log4j-extras-1.2.17.jar" "apache-log4j-extras-1.2.17.jar" ln -sf "/grid/3/hadoop/yarn/local/filecache/345/commons-codec-1.4.jar" "commons-codec-1.4.jar" ln -sf "/grid/2/hadoop/yarn/local/filecache/309/hadoop-aws-2.7.3.2.6.0.3-8.jar" "hadoop-aws-2.7.3.2.6.0.3-8.jar" ln -sf "/grid/1/hadoop/yarn/local/filecache/346/jackson-databind-2.4.4.jar" "jackson-databind-2.4.4.jar" ln -sf "/grid/10/hadoop/yarn/local/filecache/299/httpcore-4.4.jar" "httpcore-4.4.jar" ln -sf "/grid/6/hadoop/yarn/local/filecache/348/dropwizard-metrics-hadoop-metrics2-reporter-0.1.2.jar" "dropwizard-metrics-hadoop-metrics2-reporter-0.1.2.jar" ln -sf "/grid/7/hadoop/yarn/local/usercache/dmitro.vasilenko/appcache/application_1515765548943_7803/filecache/11/job.xml" "job.xml" ln -sf "/grid/3/hadoop/yarn/local/filecache/261/hive-common-1.2.1000.2.6.0.3-8.jar" "hive-common-1.2.1000.2.6.0.3-8.jar" ln -sf "/grid/0/hadoop/yarn/local/filecache/300/hive-cli-1.2.1000.2.6.0.3-8.jar" "hive-cli-1.2.1000.2.6.0.3-8.jar" ln -sf "/grid/1/hadoop/yarn/local/filecache/297/ant-1.9.1.jar" "ant-1.9.1.jar" ln -sf "/grid/2/hadoop/yarn/local/filecache/314/oozie-sharelib-oozie-4.2.0.2.6.0.3-8.jar" "oozie-sharelib-oozie-4.2.0.2.6.0.3-8.jar" ln -sf "/grid/2/hadoop/yarn/local/filecache/266/jackson-core-2.4.4.jar" "jackson-core-2.4.4.jar" ln -sf "/grid/3/hadoop/yarn/local/filecache/351/joda-time-2.9.6.jar" "joda-time-2.9.6.jar" mkdir -p jobSubmitDir ln -sf "/grid/8/hadoop/yarn/local/usercache/dmitro.vasilenko/appcache/application_1515765548943_7803/filecache/12/job.splitmetainfo" "jobSubmitDir/job.splitmetainfo" ln -sf "/grid/7/hadoop/yarn/local/filecache/294/curator-client-2.6.0.jar" "curator-client-2.6.0.jar" ln -sf "/grid/4/hadoop/yarn/local/filecache/291/commons-lang-2.4.jar" "commons-lang-2.4.jar" ln -sf "/grid/3/hadoop/yarn/local/filecache/332/jta-1.1.jar" "jta-1.1.jar" ln -sf "/grid/7/hadoop/yarn/local/filecache/339/commons-io-2.4.jar" "commons-io-2.4.jar" ln -sf "/grid/8/hadoop/yarn/local/filecache/282/javax.jdo-3.2.0-m3.jar" "javax.jdo-3.2.0-m3.jar" ln -sf "/grid/7/hadoop/yarn/local/filecache/271/objenesis-2.1.jar" "objenesis-2.1.jar" ln -sf "/grid/3/hadoop/yarn/local/filecache/277/mail-1.4.jar" "mail-1.4.jar" ln -sf "/grid/9/hadoop/yarn/local/filecache/326/ant-launcher-1.9.1.jar" "ant-launcher-1.9.1.jar" ln -sf "/grid/3/hadoop/yarn/local/filecache/264/geronimo-jaspic_1.0_spec-1.0.jar" "geronimo-jaspic_1.0_spec-1.0.jar" ln -sf "/grid/6/hadoop/yarn/local/filecache/352/antlr-2.7.7.jar" "antlr-2.7.7.jar" ln -sf "/grid/11/hadoop/yarn/local/filecache/315/jpam-1.1.jar" "jpam-1.1.jar" ln -sf "/grid/7/hadoop/yarn/local/filecache/333/json-simple-1.1.jar" "json-simple-1.1.jar" echo "Copying debugging information" # Creating copy of launch script cp "launch_container.sh" "/grid/0/hadoop/yarn/log/application_1515765548943_7803/container_e134_1515765548943_7803_02_000001/launch_container.sh" chmod 640 "/grid/0/hadoop/yarn/log/application_1515765548943_7803/container_e134_1515765548943_7803_02_000001/launch_container.sh" # Determining directory contents echo "ls -l:" 1>"/grid/0/hadoop/yarn/log/application_1515765548943_7803/container_e134_1515765548943_7803_02_000001/directory.info" ls -l 1>>"/grid/0/hadoop/yarn/log/application_1515765548943_7803/container_e134_1515765548943_7803_02_000001/directory.info" echo "find -L . -maxdepth 5 -ls:" 1>>"/grid/0/hadoop/yarn/log/application_1515765548943_7803/container_e134_1515765548943_7803_02_000001/directory.info" find -L . -maxdepth 5 -ls 1>>"/grid/0/hadoop/yarn/log/application_1515765548943_7803/container_e134_1515765548943_7803_02_000001/directory.info" echo "broken symlinks(find -L . -maxdepth 5 -type l -ls):" 1>>"/grid/0/hadoop/yarn/log/application_1515765548943_7803/container_e134_1515765548943_7803_02_000001/directory.info" find -L . -maxdepth 5 -type l -ls 1>>"/grid/0/hadoop/yarn/log/application_1515765548943_7803/container_e134_1515765548943_7803_02_000001/directory.info" echo "Launching container" exec /bin/bash -c "$JAVA_HOME/bin/java -Djava.io.tmpdir=$PWD/tmp -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=/grid/6/hadoop/yarn/log/application_1515765548943_7803/container_e134_1515765548943_7803_02_000001 -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=ERROR,CLA -Dhadoop.root.logfile=syslog -Dhdp.version=2.6.3.0-235 -Xmx4915m -Dhdp.version=2.6.3.0-235 -Djava.io.tmpdir=./tmp org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1>/grid/6/hadoop/yarn/log/application_1515765548943_7803/container_e134_1515765548943_7803_02_000001/stdout 2>/grid/6/hadoop/yarn/log/application_1515765548943_7803/container_e134_1515765548943_7803_02_000001/stderr " End of LogType:launch_container.sh ************************************************************************************ End of LogType:prelaunch.err ****************************************************************************** Container: container_e134_1515765548943_7803_02_000001 on ks-dmp05.kyivstar.ua_45454_1516175454392 LogAggregationType: AGGREGATED ================================================================================================== LogType:prelaunch.out LogLastModifiedTime:Wed Jan 17 09:50:54 +0200 2018 LogLength:100 LogContents: Setting up env variables Setting up job resources Copying debugging information Launching container End of LogType:prelaunch.out ****************************************************************************** Container: container_e134_1515765548943_7803_02_000001 on ks-dmp05.kyivstar.ua_45454_1516175454392 LogAggregationType: AGGREGATED ================================================================================================== LogType:stderr LogLastModifiedTime:Wed Jan 17 09:50:54 +0200 2018 LogLength:770 LogContents: SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/grid/9/hadoop/yarn/local/filecache/343/slf4j-log4j12-1.6.6.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/grid/8/hadoop/yarn/local/filecache/52/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] log4j:WARN No appenders could be found for logger (org.apache.hadoop.mapreduce.v2.app.MRAppMaster). log4j:WARN Please initialize the log4j system properly. log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info. End of LogType:stderr *********************************************************************** End of LogType:stdout *********************************************************************** End of LogType:syslog ***********************************************************************