Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

MapReduce failure when using Druid indexing

MapReduce failure when using Druid indexing

New Contributor

I've installed the cluster on EC2 machine using the ambari cluster wizard all seems fine.

But when I try the first time to launch Druid index using Hadoop I get the well know error that mapreduce.tar.gz is corrupted and I've checked it's corrupted. So I've followed the guide

Here

I'ce copied the files mapreduce.tar.gz from /usr/hdp/current/hadoop-client/mapreduce.tar.gz TO /hdp/apps/<hdp_version>/mapreduce/

Ok I do not received anymore the previous error but now I get this

There is nothing like that anywhere on internet

Thanks for any help

Log Type: syslog
Log Upload Time: Tue Feb 27 12:13:07 +0000 2018
Log Length: 35518
2018-02-27 12:13:07,511 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created MRAppMaster for application appattempt_1519733252350_0001_000002
2018-02-27 12:13:07,660 WARN [main] org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2018-02-27 12:13:07,684 INFO [main] org.apache.hadoop.security.SecurityUtil: Updating Configuration
2018-02-27 12:13:07,693 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Executing with tokens:
2018-02-27 12:13:07,693 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind: YARN_AM_RM_TOKEN, Service: , Ident: (appAttemptId { application_id { id: 1 cluster_timestamp: 1519733252350 } attemptId: 2 } keyId: 1970200207)
2018-02-27 12:13:07,896 INFO [main] org.apache.hadoop.mapreduce.v2.util.MRApps: Creating job classloader
2018-02-27 12:13:07,910 INFO [main] org.apache.hadoop.util.ApplicationClassLoader: classpath: [file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/jackson-module-jaxb-annotations-2.4.6.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/jetty-server-9.3.19.v20170502.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/zookeeper-3.4.6.2.6.4.0-91.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/icu4j-54.1.1.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/avatica-metrics-1.9.0.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/asm-5.2.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/commons-cli-1.2.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/aopalliance-1.0.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/classmate-1.0.0.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/hadoop-mapreduce-client-jobclient-2.7.3.2.6.4.0-91.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/jdbi-2.63.1.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/jetty-io-9.3.19.v20170502.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/jboss-logging-3.1.3.GA.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/commons-io-2.5.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/aws-java-sdk-ec2-1.10.77.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/spymemcached-2.12.3.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/jcl-over-slf4j-1.7.12.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/java-util-0.10.1.2.6.4.0-91.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/maven-settings-builder-3.1.1.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/commons-digester-1.8.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/commons-math3-3.6.1.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/gson-2.2.4.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/netty-all-4.1.11.Final.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/curator-x-discovery-2.11.0.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/druid-indexing-hadoop-0.10.1.2.6.4.0-91.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/servlet-api-2.5.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/guice-servlet-4.1.0.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/validation-api-1.1.0.Final.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/hadoop-annotations-2.6.0.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/aws-java-sdk-core-1.10.77.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/jaxb-api-2.2.2.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/azure-storage-5.4.0.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/curator-client-2.11.0.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/geoip2-0.4.0.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/commons-dbcp-1.4.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/druid-services-0.10.1.2.6.4.0-91.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/jetty-proxy-9.3.19.v20170502.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/jetty-continuation-9.3.19.v20170502.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/sketches-core-0.8.4.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/RoaringBitmap-0.5.18.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/config-magic-0.9.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/jackson-datatype-joda-2.4.6.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/jline-0.9.94.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/lz4-1.3.0.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/derbyclient-10.11.1.1.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/activation-1.1.1.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/guice-4.1.0.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/javax.servlet-api-3.1.0.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/log4j-1.2-api-2.5.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/hadoop-yarn-registry-2.7.3.2.6.4.0-91.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/mapdb-1.0.8.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/asm-tree-5.2.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/xz-1.0.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/extendedset-0.10.1.2.6.4.0-91.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/druid-sql-0.10.1.2.6.4.0-91.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/jersey-servlet-1.19.3.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/druid-indexing-service-0.10.1.2.6.4.0-91.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/jetty-servlet-9.3.19.v20170502.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/jsr311-api-1.1.1.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/commons-logging-1.1.1.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/hadoop-mapreduce-client-core-2.7.3.2.6.4.0-91.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/netty-3.10.6.Final.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/avatica-server-1.9.0.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/derbynet-10.11.1.1.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/apacheds-i18n-2.0.0-M15.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/disruptor-3.3.6.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/calcite-core-1.12.0.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/httpcore-4.4.3.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/maxminddb-0.2.0.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/api-util-1.0.0-M20.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/jets3t-0.9.4.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/log4j-slf4j-impl-2.5.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/xmlenc-0.52.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/okio-1.4.0.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/hadoop-yarn-common-2.7.3.2.6.4.0-91.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/curator-recipes-2.11.0.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/jackson-dataformat-smile-2.4.6.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/jetty-security-9.3.19.v20170502.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/hadoop-yarn-server-common-2.7.3.2.6.4.0-91.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/bytebuffer-collections-0.10.1.2.6.4.0-91.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/commons-lang-2.6.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/jackson-jaxrs-1.9.13.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/commons-lang3-3.4.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/commons-beanutils-1.7.0.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/aether-spi-0.9.0.M2.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/slf4j-api-1.6.4.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/http-client-1.1.0.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/httpclient-4.5.1.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/commons-collections-3.2.2.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/guice-multibindings-4.1.0.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/jackson-core-asl-1.9.13.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/commons-dbcp2-2.0.1.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/hadoop-mapreduce-client-shuffle-2.7.3.2.6.4.0-91.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/maven-aether-provider-3.1.1.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/api-asn1-api-1.0.0-M20.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/okhttp-1.0.2.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/base64-2.3.8.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/hibernate-validator-5.1.3.Final.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/aws-java-sdk-s3-1.10.77.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/aws-java-sdk-kms-1.10.77.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/maven-repository-metadata-3.1.1.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/fastutil-7.2.0.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/java-util-0.28.2.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/memory-0.8.4.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/druid-aws-common-0.10.1.2.6.4.0-91.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/hadoop-mapreduce-client-app-2.7.3.2.6.4.0-91.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/janino-2.7.6.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/maven-settings-3.1.1.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/jackson-dataformat-cbor-2.5.3.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/druid-console-0.0.2.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/javax.el-3.0.0.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/commons-beanutils-core-1.8.0.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/druid-common-0.10.1.2.6.4.0-91.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/hadoop-yarn-api-2.7.3.2.6.4.0-91.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/curator-framework-2.11.0.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/jackson-jaxrs-json-provider-2.4.6.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/leveldbjni-all-1.8.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/hadoop-aws-2.7.3.2.6.4.0-91.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/hadoop-yarn-client-2.7.3.2.6.4.0-91.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/calcite-linq4j-1.12.0.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/paranamer-2.3.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/aether-util-0.9.0.M2.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/antlr4-runtime-4.5.1.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/commons-compiler-2.7.6.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/plexus-utils-3.0.15.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/log4j-api-2.5.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/rhino-1.7R5.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/json-smart-1.1.1.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/jackson-databind-2.4.6.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/server-metrics-0.2.8.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/commons-pool-1.6.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/tesla-aether-0.0.5.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/guava-16.0.1.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/plexus-interpolation-1.19.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/jersey-core-1.19.3.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/druid-api-0.10.1.2.6.4.0-91.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/druid-hll-0.10.1.2.6.4.0-91.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/jackson-jaxrs-smile-provider-2.4.6.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/joda-time-2.9.9.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/aether-api-0.9.0.M2.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/apacheds-kerberos-codec-2.0.0-M15.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/commons-compress-1.4.1.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/maven-model-builder-3.1.1.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/airline-0.7.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/wagon-provider-api-2.4.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/jetty-util-9.3.19.v20170502.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/log4j-jul-2.5.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/javax.el-api-3.0.0.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/json-path-2.1.0.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/netty-3.6.2.Final.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/maven-model-3.1.1.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/jackson-annotations-2.4.6.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/compress-lzf-1.0.3.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/java-xmlbuilder-1.1.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/jcip-annotations-1.0.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/jetty-sslengine-6.1.26.hwx.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/protobuf-java-3.1.0.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/aggdesigner-algorithm-6.0.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/druid-datasketches-0.10.1.2.6.4.0-91.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/commons-pool2-2.2.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/jersey-server-1.19.3.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/jersey-client-1.9.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/jackson-mapper-asl-1.9.13.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/aether-connector-file-0.9.0.M2.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/xercesImpl-2.9.1.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/jackson-jaxrs-base-2.4.6.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/jackson-xc-1.9.13.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/hadoop-hdfs-2.7.3.2.6.4.0-91.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/aether-connector-okhttp-0.0.9.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/commons-codec-1.7.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/nimbus-jose-jwt-3.9.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/derby-10.11.1.1.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/javax.inject-1.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/htrace-core-3.1.0-incubating.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/jersey-guice-1.19.3.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/jackson-datatype-guava-2.4.6.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/druid-hdfs-storage-0.10.1.2.6.4.0-91.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/druid-processing-0.10.1.2.6.4.0-91.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/druid-server-0.10.1.2.6.4.0-91.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/jetty-http-9.3.19.v20170502.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/opencsv-2.3.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/xml-apis-1.3.04.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/log4j-core-2.5.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/snappy-java-1.0.4.1.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/jetty-servlets-9.3.19.v20170502.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/hadoop-client-2.7.3.2.6.4.0-91.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/avro-1.7.4.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/jackson-core-2.4.6.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/azure-keyvault-core-0.8.0.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/irc-api-1.0-0014.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/jsr305-2.0.1.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/hadoop-mapreduce-client-common-2.7.3.2.6.4.0-91.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/asm-commons-5.2.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/commons-configuration-1.6.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/commons-lang3-3.2.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/stax-api-1.0-2.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/bcprov-jdk15on-1.52.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/hadoop-auth-2.7.3.2.6.4.0-91.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/jsp-api-2.1.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/ambari-metrics-common-2.4.1.0.22.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/ambari-metrics-emitter-0.10.1.2.6.4.0-91.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/hadoop-common-2.7.3.2.6.4.0-91.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/okhttp-2.4.0.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/jetty-client-9.3.19.v20170502.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/commons-net-3.1.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/avatica-core-1.9.0.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/aether-impl-0.9.0.M2.jar, file:/hadoop/yarn/local/usercache/druid/appcache/application_1519733252350_0001/container_e01_1519733252350_0001_02_000001/emitter-0.4.5.jar]
2018-02-27 12:13:07,911 INFO [main] org.apache.hadoop.util.ApplicationClassLoader: system classes: [-javax.validation., java., javax., org.apache.commons.logging., org.apache.log4j., org.apache.hadoop.]
2018-02-27 12:13:07,920 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Using mapred newApiCommitter.
2018-02-27 12:13:07,921 INFO [main] org.apache.hadoop.mapreduce.v2.util.MRApps: Setting classloader org.apache.hadoop.util.ApplicationClassLoader on the configuration and as the thread context classloader


2018-02-27 12:13:07,921 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter set in config null
2018-02-27 12:13:07,980 INFO [main] org.apache.hadoop.mapreduce.v2.util.MRApps: Setting classloader sun.misc.Launcher$AppClassLoader on the configuration and as the thread context classloader
2018-02-27 12:13:07,981 FATAL [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Error starting MRAppMaster
java.lang.LinkageError: loader constraint violation: when resolving overridden method "org.apache.xerces.jaxp.DocumentBuilderImpl.newDocument()Lorg/w3c/dom/Document;" the class loader (instance of org/apache/hadoop/util/ApplicationClassLoader) of the current class, org/apache/xerces/jaxp/DocumentBuilderImpl, and its superclass loader (instance of <bootloader>), have different Class objects for the type org/w3c/dom/Document used in the signature
	at org.apache.xerces.jaxp.DocumentBuilderFactoryImpl.newDocumentBuilder(Unknown Source)
	at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2604)
	at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2566)
	at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2451)
	at org.apache.hadoop.conf.Configuration.get(Configuration.java:1253)
	at org.apache.hadoop.yarn.factory.providers.RecordFactoryProvider.getRecordFactory(RecordFactoryProvider.java:49)
	at org.apache.hadoop.mapreduce.TypeConverter.<clinit>(TypeConverter.java:63)
	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$2.call(MRAppMaster.java:514)
	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$2.call(MRAppMaster.java:501)
	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.callWithJobClassLoader(MRAppMaster.java:1640)
	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.createOutputCommitter(MRAppMaster.java:501)
	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.serviceInit(MRAppMaster.java:287)
	at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$5.run(MRAppMaster.java:1598)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1869)
	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1595)
	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1526)
2018-02-27 12:13:07,984 INFO [main] org.apache.hadoop.util.ExitUtil: Exiting with status 1
1 REPLY 1
Highlighted

Re: MapReduce failure when using Druid indexing

Expert Contributor

do you see this only with druid indexing jobs ?

Don't have an account?
Coming from Hortonworks? Activate your account here