Support Questions

Find answers, ask questions, and share your expertise
Announcements
Check out our newest addition to the community, the Cloudera Data Analytics (CDA) group hub.

My druid on cluster was working fine until I cleaned the extensions of druid and manually added them. Now it is showing this error while indexing.

New Contributor
2019-02-06T14:05:02,671 INFO [main] org.eclipse.jetty.server.handler.ContextHandler - Started o.e.j.s.ServletContextHandler@632d4cf2{/,null,AVAILABLE}
2019-02-06T14:05:02,688 INFO [main] org.eclipse.jetty.server.AbstractConnector - Started ServerConnector@58fbcb71{HTTP/1.1,[http/1.1]}{0.0.0.0:8100}
2019-02-06T14:05:02,688 INFO [main] org.eclipse.jetty.server.Server - Started @8561ms
2019-02-06T14:05:02,689 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.query.lookup.LookupReferencesManager.start()] on object[io.druid.query.lookup.LookupReferencesManager@4a122e68].
2019-02-06T14:05:02,689 INFO [main] io.druid.query.lookup.LookupReferencesManager - LookupReferencesManager is starting.
2019-02-06T14:05:02,693 INFO [main] io.druid.java.util.http.client.pool.ChannelResourceFactory - Generating: http://master1.hadoop.com:8081
2019-02-06T14:05:02,694 INFO [main] io.druid.java.util.http.client.pool.ChannelResourceFactory - Generating: http://master1.hadoop.com:8081
2019-02-06T14:05:02,694 INFO [main] io.druid.java.util.http.client.pool.ChannelResourceFactory - Generating: http://master1.hadoop.com:8081
2019-02-06T14:05:02,694 INFO [main] io.druid.java.util.http.client.pool.ChannelResourceFactory - Generating: http://master1.hadoop.com:8081
2019-02-06T14:05:02,694 INFO [main] io.druid.java.util.http.client.pool.ChannelResourceFactory - Generating: http://master1.hadoop.com:8081
2019-02-06T14:05:02,695 INFO [main] io.druid.java.util.http.client.pool.ChannelResourceFactory - Generating: http://master1.hadoop.com:8081
2019-02-06T14:05:02,696 INFO [main] io.druid.java.util.http.client.pool.ChannelResourceFactory - Generating: http://master1.hadoop.com:8081
2019-02-06T14:05:02,697 INFO [main] io.druid.java.util.http.client.pool.ChannelResourceFactory - Generating: http://master1.hadoop.com:8081
2019-02-06T14:05:02,699 INFO [main] io.druid.java.util.http.client.pool.ChannelResourceFactory - Generating: http://master1.hadoop.com:8081
2019-02-06T14:05:02,699 INFO [main] io.druid.java.util.http.client.pool.ChannelResourceFactory - Generating: http://master1.hadoop.com:8081
2019-02-06T14:05:02,699 INFO [main] io.druid.java.util.http.client.pool.ChannelResourceFactory - Generating: http://master1.hadoop.com:8081
2019-02-06T14:05:02,699 INFO [main] io.druid.java.util.http.client.pool.ChannelResourceFactory - Generating: http://master1.hadoop.com:8081
2019-02-06T14:05:02,699 INFO [main] io.druid.java.util.http.client.pool.ChannelResourceFactory - Generating: http://master1.hadoop.com:8081
2019-02-06T14:05:02,699 INFO [main] io.druid.java.util.http.client.pool.ChannelResourceFactory - Generating: http://master1.hadoop.com:8081
2019-02-06T14:05:02,700 INFO [main] io.druid.java.util.http.client.pool.ChannelResourceFactory - Generating: http://master1.hadoop.com:8081
2019-02-06T14:05:02,700 INFO [main] io.druid.java.util.http.client.pool.ChannelResourceFactory - Generating: http://master1.hadoop.com:8081
2019-02-06T14:05:02,700 INFO [main] io.druid.java.util.http.client.pool.ChannelResourceFactory - Generating: http://master1.hadoop.com:8081
2019-02-06T14:05:02,700 INFO [main] io.druid.java.util.http.client.pool.ChannelResourceFactory - Generating: http://master1.hadoop.com:8081
2019-02-06T14:05:02,700 INFO [main] io.druid.java.util.http.client.pool.ChannelResourceFactory - Generating: http://master1.hadoop.com:8081
2019-02-06T14:05:02,700 INFO [main] io.druid.java.util.http.client.pool.ChannelResourceFactory - Generating: http://master1.hadoop.com:8081
2019-02-06T14:05:02,708 WARN [main] io.druid.query.lookup.LookupReferencesManager - No lookups found for tier [__default], response [io.druid.java.util.http.client.response.FullResponseHolder@28fa541]
2019-02-06T14:05:02,708 INFO [main] io.druid.query.lookup.LookupReferencesManager - Coordinator is unavailable. Loading saved snapshot instead
2019-02-06T14:05:02,708 INFO [main] io.druid.query.lookup.LookupReferencesManager - No lookups to be loaded at this point
2019-02-06T14:05:02,869 INFO [main] io.druid.query.lookup.LookupReferencesManager - LookupReferencesManager is started.
2019-02-06T14:05:02,870 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.server.listener.announcer.ListenerResourceAnnouncer.start()] on object[io.druid.query.lookup.LookupResourceListenerAnnouncer@4aab7195].
2019-02-06T14:05:02,904 INFO [main] io.druid.server.listener.announcer.ListenerResourceAnnouncer - Announcing start time on [/druid/listeners/lookups/__default/http:worker4.hadoop.com:8100]
2019-02-06T14:05:03,028 INFO [task-runner-0-priority-0] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties
2019-02-06T14:05:03,031 INFO [task-runner-0-priority-0] io.druid.guice.PropertiesModule - Loading properties from runtime.properties
2019-02-06T14:05:03,079 INFO [task-runner-0-priority-0] org.hibernate.validator.internal.util.Version - HV000001: Hibernate Validator 5.1.3.Final
2019-02-06T14:05:03,730 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.common.config.NullValueHandlingConfig] from props[druid.generic.] as [io.druid.common.config.NullValueHandlingConfig@38ce970f]
2019-02-06T14:05:03,744 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ModulesConfig] from props[druid.modules.] as [ModulesConfig{excludeList=[]}]
2019-02-06T14:05:03,895 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, directory='/usr/hdp/current/druid-middlemanager/extensions', hadoopDependenciesDir='/usr/hdp/current/druid-middlemanager/hadoop-dependencies', hadoopContainerDruidClasspath='null', addExtensionsToHadoopContainer=false, loadList=[druid-datasketches, druid-hdfs-storage, druid-kafka-indexing-service, mysql-metadata-storage, druid-avro-extensions, druid-parquet-extensions]}]
2019-02-06T14:05:03,899 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Adding implementation [io.druid.query.aggregation.datasketches.theta.SketchModule] for class [interface io.druid.initialization.DruidModule] from classpath extension
2019-02-06T14:05:03,900 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Adding implementation [io.druid.query.aggregation.datasketches.theta.oldapi.OldApiSketchModule] for class [interface io.druid.initialization.DruidModule] from classpath extension
2019-02-06T14:05:03,902 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Adding implementation [io.druid.storage.hdfs.HdfsStorageDruidModule] for class [interface io.druid.initialization.DruidModule] from classpath extension
2019-02-06T14:05:03,903 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Adding implementation [io.druid.indexing.kafka.KafkaIndexTaskModule] for class [interface io.druid.initialization.DruidModule] from classpath extension
2019-02-06T14:05:03,904 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Adding implementation [io.druid.metadata.storage.mysql.MySQLMetadataStorageModule] for class [interface io.druid.initialization.DruidModule] from classpath extension
2019-02-06T14:05:03,905 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Adding implementation [io.druid.data.input.avro.AvroExtensionsModule] for class [interface io.druid.initialization.DruidModule] from classpath extension
2019-02-06T14:05:03,906 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Adding implementation [io.druid.data.input.parquet.ParquetExtensionsModule] for class [interface io.druid.initialization.DruidModule] from classpath extension
2019-02-06T14:05:03,906 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Loading extension [druid-datasketches] for class [interface io.druid.initialization.DruidModule]
2019-02-06T14:05:03,916 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-datasketches/druid-datasketches-0.11.0.jar]
2019-02-06T14:05:03,916 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-datasketches/sketches-core-0.8.4.jar]
2019-02-06T14:05:03,916 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-datasketches/memory-0.8.4.jar]
2019-02-06T14:05:03,919 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Loading extension [druid-hdfs-storage] for class [interface io.druid.initialization.DruidModule]
2019-02-06T14:05:03,920 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/druid-hdfs-storage-0.12.1.jar]
2019-02-06T14:05:03,920 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-client-2.7.3.jar]
2019-02-06T14:05:03,920 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-common-2.7.3.jar]
2019-02-06T14:05:03,920 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/guava-16.0.1.jar]
2019-02-06T14:05:03,920 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/commons-math3-3.6.1.jar]
2019-02-06T14:05:03,920 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/xmlenc-0.52.jar]
2019-02-06T14:05:03,920 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/commons-net-3.1.jar]
2019-02-06T14:05:03,920 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/commons-collections-3.2.2.jar]
2019-02-06T14:05:03,920 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jsp-api-2.1.jar]
2019-02-06T14:05:03,920 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/commons-configuration-1.6.jar]
2019-02-06T14:05:03,920 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/commons-digester-1.8.jar]
2019-02-06T14:05:03,920 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/commons-beanutils-1.7.0.jar]
2019-02-06T14:05:03,920 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/commons-beanutils-core-1.8.0.jar]
2019-02-06T14:05:03,921 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/gson-2.2.4.jar]
2019-02-06T14:05:03,921 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-auth-2.7.3.jar]
2019-02-06T14:05:03,921 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/apacheds-kerberos-codec-2.0.0-M15.jar]
2019-02-06T14:05:03,921 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/apacheds-i18n-2.0.0-M15.jar]
2019-02-06T14:05:03,921 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/api-asn1-api-1.0.0-M20.jar]
2019-02-06T14:05:03,921 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/api-util-1.0.0-M20.jar]
2019-02-06T14:05:03,921 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/curator-framework-4.0.0.jar]
2019-02-06T14:05:03,921 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/curator-client-4.0.0.jar]
2019-02-06T14:05:03,921 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/curator-recipes-4.0.0.jar]
2019-02-06T14:05:03,921 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/htrace-core-3.1.0-incubating.jar]
2019-02-06T14:05:03,921 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/commons-compress-1.4.1.jar]
2019-02-06T14:05:03,921 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/xz-1.0.jar]
2019-02-06T14:05:03,921 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-hdfs-2.7.3.jar]
2019-02-06T14:05:03,922 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/netty-3.10.6.Final.jar]
2019-02-06T14:05:03,922 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/netty-all-4.0.52.Final.jar]
2019-02-06T14:05:03,922 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/xercesImpl-2.9.1.jar]
2019-02-06T14:05:03,922 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/xml-apis-1.3.04.jar]
2019-02-06T14:05:03,922 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/leveldbjni-all-1.8.jar]
2019-02-06T14:05:03,922 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-mapreduce-client-app-2.7.3.jar]
2019-02-06T14:05:03,922 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-mapreduce-client-common-2.7.3.jar]
2019-02-06T14:05:03,922 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-yarn-client-2.7.3.jar]
2019-02-06T14:05:03,922 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-yarn-server-common-2.7.3.jar]
2019-02-06T14:05:03,922 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-mapreduce-client-shuffle-2.7.3.jar]
2019-02-06T14:05:03,922 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-yarn-api-2.7.3.jar]
2019-02-06T14:05:03,922 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-mapreduce-client-core-2.7.3.jar]
2019-02-06T14:05:03,922 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-yarn-common-2.7.3.jar]
2019-02-06T14:05:03,922 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jaxb-api-2.2.2.jar]
2019-02-06T14:05:03,922 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/stax-api-1.0-2.jar]
2019-02-06T14:05:03,923 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/servlet-api-2.5.jar]
2019-02-06T14:05:03,923 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jersey-client-1.9.jar]
2019-02-06T14:05:03,923 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jackson-jaxrs-1.9.13.jar]
2019-02-06T14:05:03,923 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jackson-xc-1.9.13.jar]
2019-02-06T14:05:03,923 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-mapreduce-client-jobclient-2.7.3.jar]
2019-02-06T14:05:03,923 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-aws-2.7.3.jar]
2019-02-06T14:05:03,923 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jackson-databind-2.4.6.jar]
2019-02-06T14:05:03,923 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jackson-core-2.4.6.jar]
2019-02-06T14:05:03,923 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jackson-annotations-2.4.6.jar]
2019-02-06T14:05:03,923 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/aws-java-sdk-s3-1.10.77.jar]
2019-02-06T14:05:03,923 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/aws-java-sdk-kms-1.10.77.jar]
2019-02-06T14:05:03,923 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/aws-java-sdk-core-1.10.77.jar]
2019-02-06T14:05:03,923 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/commons-logging-1.1.1.jar]
2019-02-06T14:05:03,923 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/httpclient-4.5.1.jar]
2019-02-06T14:05:03,923 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/httpcore-4.4.3.jar]
2019-02-06T14:05:03,924 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jackson-dataformat-cbor-2.5.3.jar]
2019-02-06T14:05:03,924 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/joda-time-2.9.9.jar]
2019-02-06T14:05:03,931 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Loading extension [druid-kafka-indexing-service] for class [interface io.druid.initialization.DruidModule]
2019-02-06T14:05:03,931 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-kafka-indexing-service/druid-kafka-indexing-service-0.12.1.jar]
2019-02-06T14:05:03,932 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-kafka-indexing-service/kafka-clients-0.10.2.0.jar]
2019-02-06T14:05:03,932 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-kafka-indexing-service/lz4-1.3.0.jar]
2019-02-06T14:05:03,932 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-kafka-indexing-service/snappy-java-1.1.2.6.jar]
2019-02-06T14:05:03,932 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-kafka-indexing-service/slf4j-api-1.6.4.jar]
2019-02-06T14:05:03,934 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Loading extension [mysql-metadata-storage] for class [interface io.druid.initialization.DruidModule]
2019-02-06T14:05:03,934 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/mysql-metadata-storage/mysql-metadata-storage-0.12.1.jar]
2019-02-06T14:05:03,934 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/mysql-metadata-storage/mysql-connector-java-5.1.38.jar]
2019-02-06T14:05:03,934 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/mysql-metadata-storage/mysql-connector-java.jar]
2019-02-06T14:05:03,936 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Loading extension [druid-avro-extensions] for class [interface io.druid.initialization.DruidModule]
2019-02-06T14:05:03,937 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/druid-avro-extensions-0.11.0.jar]
2019-02-06T14:05:03,937 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/avro-mapred-1.7.7-hadoop2.jar]
2019-02-06T14:05:03,937 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/avro-ipc-1.7.7.jar]
2019-02-06T14:05:03,937 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/jetty-6.1.26.jar]
2019-02-06T14:05:03,937 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/jetty-util-6.1.26.jar]
2019-02-06T14:05:03,937 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/netty-3.4.0.Final.jar]
2019-02-06T14:05:03,937 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/velocity-1.7.jar]
2019-02-06T14:05:03,937 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/commons-collections-3.2.1.jar]
2019-02-06T14:05:03,937 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/commons-lang-2.6.jar]
2019-02-06T14:05:03,937 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/servlet-api-2.5-20081211.jar]
2019-02-06T14:05:03,937 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/avro-ipc-1.7.7-tests.jar]
2019-02-06T14:05:03,937 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/jackson-core-asl-1.9.13.jar]
2019-02-06T14:05:03,937 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/jackson-mapper-asl-1.9.13.jar]
2019-02-06T14:05:03,937 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/slf4j-api-1.6.4.jar]
2019-02-06T14:05:03,937 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/schema-repo-api-0.1.3.jar]
2019-02-06T14:05:03,938 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/schema-repo-common-0.1.3.jar]
2019-02-06T14:05:03,938 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/gson-2.3.1.jar]
2019-02-06T14:05:03,938 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/guava-16.0.1.jar]
2019-02-06T14:05:03,938 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/schema-repo-client-0.1.3.jar]
2019-02-06T14:05:03,938 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/jersey-client-1.15.jar]
2019-02-06T14:05:03,938 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/jersey-core-1.19.3.jar]
2019-02-06T14:05:03,938 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/jsr311-api-1.1.1.jar]
2019-02-06T14:05:03,938 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/schema-repo-avro-0.1.3.jar]
2019-02-06T14:05:03,938 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/avro-1.7.7.jar]
2019-02-06T14:05:03,938 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/paranamer-2.3.jar]
2019-02-06T14:05:03,938 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/snappy-java-1.0.5.jar]
2019-02-06T14:05:03,938 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/commons-compress-1.4.1.jar]
2019-02-06T14:05:03,938 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/xz-1.0.jar]
2019-02-06T14:05:03,938 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/kafka-schema-registry-client-3.0.1.jar]
2019-02-06T14:05:03,938 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/jackson-databind-2.4.6.jar]
2019-02-06T14:05:03,938 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/jackson-annotations-2.4.6.jar]
2019-02-06T14:05:03,938 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/jackson-core-2.4.6.jar]
2019-02-06T14:05:03,943 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Loading extension [druid-parquet-extensions] for class [interface io.druid.initialization.DruidModule]
2019-02-06T14:05:03,943 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-parquet-extensions/druid-parquet-extensions-0.11.0.jar]
2019-02-06T14:05:03,944 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-parquet-extensions/parquet-avro-1.8.2.jar]
2019-02-06T14:05:03,944 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-parquet-extensions/parquet-column-1.8.2.jar]
2019-02-06T14:05:03,944 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-parquet-extensions/parquet-common-1.8.2.jar]
2019-02-06T14:05:03,944 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-parquet-extensions/parquet-encoding-1.8.2.jar]
2019-02-06T14:05:03,944 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-parquet-extensions/commons-codec-1.7.jar]
2019-02-06T14:05:03,944 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-parquet-extensions/parquet-hadoop-1.8.2.jar]
2019-02-06T14:05:03,944 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-parquet-extensions/parquet-jackson-1.8.2.jar]
2019-02-06T14:05:03,944 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-parquet-extensions/jackson-mapper-asl-1.9.13.jar]
2019-02-06T14:05:03,944 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-parquet-extensions/jackson-core-asl-1.9.13.jar]
2019-02-06T14:05:03,944 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-parquet-extensions/snappy-java-1.1.1.6.jar]
2019-02-06T14:05:03,944 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-parquet-extensions/parquet-format-2.3.1.jar]
2019-02-06T14:05:03,944 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-parquet-extensions/avro-1.8.0.jar]
2019-02-06T14:05:03,944 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-parquet-extensions/paranamer-2.7.jar]
2019-02-06T14:05:03,944 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-parquet-extensions/commons-compress-1.8.1.jar]
2019-02-06T14:05:03,944 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-parquet-extensions/xz-1.5.jar]
2019-02-06T14:05:03,945 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-parquet-extensions/slf4j-api-1.6.4.jar]
2019-02-06T14:05:03,945 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-parquet-extensions/fastutil-7.2.0.jar]
2019-02-06T14:05:04,394 WARN [task-runner-0-priority-0] org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2019-02-06T14:05:05,207 WARN [task-runner-0-priority-0] org.apache.hadoop.hdfs.shortcircuit.DomainSocketFactory - The short-circuit local reads feature cannot be used because libhadoop cannot be loaded.
2019-02-06T14:05:05,566 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.server.security.Escalator] from props[druid.escalator.] as [io.druid.server.security.NoopEscalator@69fe6af9]
2019-02-06T14:05:05,576 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.curator.CuratorConfig] from props[druid.zk.service.] as [io.druid.curator.CuratorConfig@1d420374]
2019-02-06T14:05:05,582 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.curator.ExhibitorConfig] from props[druid.exhibitor.service.] as [io.druid.curator.ExhibitorConfig@30e0ff9b]
2019-02-06T14:05:05,640 INFO [task-runner-0-priority-0] org.apache.curator.utils.Compatibility - Running in ZooKeeper 3.4.x compatibility mode
2019-02-06T14:05:05,642 WARN [task-runner-0-priority-0] org.apache.curator.retry.ExponentialBackoffRetry - maxRetries too large (30). Pinning to 29
2019-02-06T14:05:05,677 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.ZkPathsConfig] from props[druid.zk.paths.] as [io.druid.server.initialization.ZkPathsConfig@22e2266d]
2019-02-06T14:05:05,686 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.security.AuthConfig] from props[druid.auth.] as [AuthConfig{authenticatorChain=null, authorizers=null, unsecuredPaths=[], allowUnauthenticatedHttpOptions=false}]
2019-02-06T14:05:05,731 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.DruidMonitorSchedulerConfig] from props[druid.monitoring.] as [io.druid.server.metrics.DruidMonitorSchedulerConfig@3ae52daa]
2019-02-06T14:05:05,739 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.MonitorsConfig] from props[druid.monitoring.] as [MonitorsConfig{monitors=[class io.druid.java.util.metrics.JvmMonitor]}]
2019-02-06T14:05:05,739 INFO [task-runner-0-priority-0] io.druid.server.emitter.EmitterModule - Underlying emitter for ServiceEmitter: io.druid.java.util.emitter.core.NoopEmitter@2df24889
2019-02-06T14:05:05,739 INFO [task-runner-0-priority-0] io.druid.server.emitter.EmitterModule - Extra service dimensions: {version=0.12.1.3.0.1.0-187}
2019-02-06T14:05:05,757 INFO [task-runner-0-priority-0] io.druid.server.metrics.MetricsModule - Adding monitor[io.druid.java.util.metrics.JvmMonitor@16e3e89c]
2019-02-06T14:05:05,757 INFO [task-runner-0-priority-0] io.druid.server.metrics.MetricsModule - Adding monitor[io.druid.server.initialization.jetty.JettyServerModule$JettyMonitor@670447aa]
2019-02-06T14:05:05,763 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.segment.writeout.SegmentWriteOutMediumFactory] from props[druid.peon.defaultSegmentWriteOutMediumFactory.] as [io.druid.segment.writeout.TmpFileSegmentWriteOutMediumFactory@328cdc03]
2019-02-06T14:05:05,766 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Assigning value [256000000] for [druid.processing.buffer.sizeBytes] on [io.druid.query.DruidProcessingConfig#intermediateComputeSizeBytes()]
2019-02-06T14:05:05,769 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.computation.buffer.poolCacheMaxCount, ${base_path}.buffer.poolCacheMaxCount] on [io.druid.query.DruidProcessingConfig#poolCacheMaxCount()]
2019-02-06T14:05:05,770 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.numMergeBuffers] on [io.druid.query.DruidProcessingConfig#getNumMergeBuffersConfigured()]
2019-02-06T14:05:05,770 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.columnCache.sizeBytes] on [io.druid.query.DruidProcessingConfig#columnCacheSizeBytes()]
2019-02-06T14:05:05,770 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Assigning value [4] for [druid.processing.numThreads] on [io.druid.query.DruidProcessingConfig#getNumThreadsConfigured()]
2019-02-06T14:05:05,771 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.tmpDir] on [io.druid.query.DruidProcessingConfig#getTmpDir()]
2019-02-06T14:05:05,771 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.fifo] on [io.druid.query.DruidProcessingConfig#isFifo()]
2019-02-06T14:05:05,771 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Assigning default value [processing-%s] for [${base_path}.formatString] on [io.druid.java.util.common.concurrent.ExecutorServiceConfig#getFormatString()]
2019-02-06T14:05:05,884 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.indexer.HadoopKerberosConfig] from props[druid.hadoop.security.kerberos.] as [io.druid.indexer.HadoopKerberosConfig@0]
2019-02-06T14:05:05,887 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.storage.hdfs.HdfsDataSegmentPusherConfig] from props[druid.storage.] as [io.druid.storage.hdfs.HdfsDataSegmentPusherConfig@8099df3]
2019-02-06T14:05:05,890 INFO [task-runner-0-priority-0] io.druid.storage.hdfs.HdfsDataSegmentPusher - Configured HDFS as deep storage
2019-02-06T14:05:06,111 INFO [task-runner-0-priority-0] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties
2019-02-06T14:05:06,111 INFO [task-runner-0-priority-0] io.druid.guice.PropertiesModule - Loading properties from runtime.properties
2019-02-06T14:05:06,125 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.common.config.NullValueHandlingConfig] from props[druid.generic.] as [io.druid.common.config.NullValueHandlingConfig@dd075ae]
2019-02-06T14:05:06,132 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, directory='/usr/hdp/current/druid-middlemanager/extensions', hadoopDependenciesDir='/usr/hdp/current/druid-middlemanager/hadoop-dependencies', hadoopContainerDruidClasspath='null', addExtensionsToHadoopContainer=false, loadList=[druid-datasketches, druid-hdfs-storage, druid-kafka-indexing-service, mysql-metadata-storage, druid-avro-extensions, druid-parquet-extensions]}]
2019-02-06T14:05:06,134 INFO [task-runner-0-priority-0] io.druid.indexing.common.task.HadoopIndexTask - Starting a hadoop determine configuration job...
2019-02-06T14:05:06,203 INFO [task-runner-0-priority-0] io.druid.indexer.path.StaticPathSpec - Adding paths[/data/sandbox/input_data/v2/union_packets/2017/eclss_only/001_100/TM--DMS--MMC_Gnd_Tlm_Pkt_ECLSS1_DMC.parquet]
2019-02-06T14:05:07,137 INFO [task-runner-0-priority-0] io.druid.indexer.path.StaticPathSpec - Adding paths[/data/sandbox/input_data/v2/union_packets/2017/eclss_only/001_100/TM--DMS--MMC_Gnd_Tlm_Pkt_ECLSS1_DMC.parquet]
2019-02-06T14:05:07,580 INFO [task-runner-0-priority-0] org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl - Timeline service address: http://worker1.hadoop.com:8188/ws/v1/timeline/
2019-02-06T14:05:07,592 INFO [task-runner-0-priority-0] org.apache.hadoop.yarn.client.RMProxy - Connecting to ResourceManager at master1.hadoop.com/10.156.0.7:8050
2019-02-06T14:05:07,887 WARN [task-runner-0-priority-0] org.apache.hadoop.mapreduce.JobResourceUploader - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2019-02-06T14:05:07,898 WARN [task-runner-0-priority-0] org.apache.hadoop.mapreduce.JobResourceUploader - No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
2019-02-06T14:05:08,429 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.lib.input.FileInputFormat - Total input paths to process : 98
2019-02-06T14:05:08,429 INFO [task-runner-0-priority-0] org.apache.parquet.hadoop.ParquetInputFormat - Total input paths to process : 98
2019-02-06T14:05:08,727 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.JobSubmitter - number of splits:98
2019-02-06T14:05:08,849 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.JobSubmitter - Submitting tokens for job: job_1549359187544_0030
2019-02-06T14:05:08,990 INFO [task-runner-0-priority-0] org.apache.hadoop.mapred.YARNRunner - Job jar is not present. Not adding any jar to the list of resources.
2019-02-06T14:05:10,167 INFO [task-runner-0-priority-0] org.apache.hadoop.yarn.client.api.impl.YarnClientImpl - Submitted application application_1549359187544_0030
2019-02-06T14:05:10,206 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job - The url to track the job: http://master1.hadoop.com:8088/proxy/application_1549359187544_0030/
2019-02-06T14:05:10,207 INFO [task-runner-0-priority-0] io.druid.indexer.DetermineHashedPartitionsJob - Job parquet_test_17_18_ECLSS1_DMC-determine_partitions_hashed-Optional.of([2017-01-01T00:00:00.000Z/2017-05-01T00:00:00.000Z]) submitted, status available at: http://master1.hadoop.com:8088/proxy/application_1549359187544_0030/
2019-02-06T14:05:10,207 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job - Running job: job_1549359187544_0030
2019-02-06T14:05:17,300 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job - Job job_1549359187544_0030 running in uber mode : false
2019-02-06T14:05:17,301 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job -  map 0% reduce 0%
2019-02-06T14:05:52,575 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job - Task Id : attempt_1549359187544_0030_m_000002_0, Status : FAILED
Error: com.google.inject.CreationException: Unable to create injector, see the following errors:

1) null returned by binding at io.druid.guice.JsonConfigProvider.bind(JsonConfigProvider.java:134)
 but io.druid.common.config.NullHandling.INSTANCE(NullHandling.java:32) is not @Nullable
  while locating io.druid.common.config.NullValueHandlingConfig
    for field at io.druid.common.config.NullHandling.INSTANCE(NullHandling.java:32)

2) Error in custom provider, java.lang.NullPointerException
  at io.druid.guice.JsonConfigProvider.bind(JsonConfigProvider.java:133)
  at io.druid.guice.JsonConfigProvider.bind(JsonConfigProvider.java:133)
  while locating com.google.common.base.Supplier<io.druid.common.config.NullValueHandlingConfig>
  at io.druid.guice.JsonConfigProvider.bind(JsonConfigProvider.java:134)
  while locating io.druid.common.config.NullValueHandlingConfig
    for field at io.druid.common.config.NullHandling.INSTANCE(NullHandling.java:32)
Caused by: java.lang.NullPointerException
	at io.druid.guice.JsonConfigProvider.get(JsonConfigProvider.java:200)
	at io.druid.guice.JsonConfigProvider.get(JsonConfigProvider.java:80)
	at com.google.inject.internal.ProviderInternalFactory.provision(ProviderInternalFactory.java:81)
	at com.google.inject.internal.InternalFactoryToInitializableAdapter.provision(InternalFactoryToInitializableAdapter.java:53)
	at com.google.inject.internal.ProviderInternalFactory.circularGet(ProviderInternalFactory.java:61)
	at com.google.inject.internal.InternalFactoryToInitializableAdapter.get(InternalFactoryToInitializableAdapter.java:45)
	at com.google.inject.internal.ProviderToInternalFactoryAdapter$1.call(ProviderToInternalFactoryAdapter.java:46)
	at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1092)
	at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40)
	at com.google.inject.internal.SingletonScope$1.get(SingletonScope.java:194)
	at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:41)
	at com.google.inject.internal.InjectorImpl$2$1.call(InjectorImpl.java:1019)
	at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1092)
	at com.google.inject.internal.InjectorImpl$2.get(InjectorImpl.java:1015)
	at io.druid.guice.SupplierProvider.get(SupplierProvider.java:52)
	at com.google.inject.internal.ProviderInternalFactory.provision(ProviderInternalFactory.java:81)
	at com.google.inject.internal.InternalFactoryToInitializableAdapter.provision(InternalFactoryToInitializableAdapter.java:53)
	at com.google.inject.internal.ProviderInternalFactory.circularGet(ProviderInternalFactory.java:61)
	at com.google.inject.internal.InternalFactoryToInitializableAdapter.get(InternalFactoryToInitializableAdapter.java:45)
	at com.google.inject.internal.SingleFieldInjector.inject(SingleFieldInjector.java:54)
	at com.google.inject.internal.InjectionRequestProcessor$StaticInjection$1.call(InjectionRequestProcessor.java:123)
	at com.google.inject.internal.InjectionRequestProcessor$StaticInjection$1.call(InjectionRequestProcessor.java:117)
	at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1085)
	at com.google.inject.internal.InjectionRequestProcessor$StaticInjection.injectMembers(InjectionRequestProcessor.java:117)
	at com.google.inject.internal.InjectionRequestProcessor.injectMembers(InjectionRequestProcessor.java:79)
	at com.google.inject.internal.InternalInjectorCreator.injectDynamically(InternalInjectorCreator.java:171)
	at com.google.inject.internal.InternalInjectorCreator.build(InternalInjectorCreator.java:110)
	at com.google.inject.Guice.createInjector(Guice.java:99)
	at com.google.inject.Guice.createInjector(Guice.java:73)
	at io.druid.guice.GuiceInjectors.makeStartupInjector(GuiceInjectors.java:61)
	at io.druid.indexer.HadoopDruidIndexerConfig.<clinit>(HadoopDruidIndexerConfig.java:106)
	at io.druid.indexer.DetermineHashedPartitionsJob$DetermineHashedPartitionsPartitioner.setConf(DetermineHashedPartitionsJob.java:415)
	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:77)
	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:137)
	at org.apache.hadoop.mapred.MapTask$NewOutputCollector.<init>(MapTask.java:714)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:782)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:347)
	at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:174)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1730)
	at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:168)

3) Error in custom provider, java.lang.VerifyError: Cannot inherit from final class
  at io.druid.jackson.JacksonModule.jsonMapper(JacksonModule.java:46)
  at io.druid.jackson.JacksonModule.jsonMapper(JacksonModule.java:46)
  while locating com.fasterxml.jackson.databind.ObjectMapper annotated with interface io.druid.guice.annotations.Json
  while locating com.fasterxml.jackson.databind.ObjectMapper
    for the 1st parameter of io.druid.guice.JsonConfigurator.<init>(JsonConfigurator.java:67)
  at io.druid.guice.ConfigModule.configure(ConfigModule.java:40)
  while locating io.druid.guice.JsonConfigurator
    for the 2nd parameter of io.druid.guice.JsonConfigProvider.inject(JsonConfigProvider.java:188)
  at io.druid.guice.JsonConfigProvider.bind(JsonConfigProvider.java:133)
  at io.druid.guice.JsonConfigProvider.bind(JsonConfigProvider.java:133)
  while locating com.google.common.base.Supplier<io.druid.common.config.NullValueHandlingConfig>
  at io.druid.guice.JsonConfigProvider.bind(JsonConfigProvider.java:134)
  while locating io.druid.common.config.NullValueHandlingConfig
    for field at io.druid.common.config.NullHandling.INSTANCE(NullHandling.java:32)
Caused by: java.lang.VerifyError: Cannot inherit from final class
	at java.lang.ClassLoader.defineClass1(Native Method)
	at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
	at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
	at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
	at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
	at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
	at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
	at java.security.AccessController.doPrivileged(Native Method)
	at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
	at org.apache.hadoop.util.ApplicationClassLoader.loadClass(ApplicationClassLoader.java:176)
	at org.apache.hadoop.util.ApplicationClassLoader.loadClass(ApplicationClassLoader.java:157)
	at com.fasterxml.jackson.datatype.guava.GuavaModule.setupModule(GuavaModule.java:55)
	at com.fasterxml.jackson.databind.ObjectMapper.registerModule(ObjectMapper.java:549)
	at io.druid.jackson.DefaultObjectMapper.<init>(DefaultObjectMapper.java:47)
	at io.druid.jackson.DefaultObjectMapper.<init>(DefaultObjectMapper.java:35)
	at io.druid.jackson.JacksonModule.jsonMapper(JacksonModule.java:46)
	at io.druid.jackson.JacksonModule$FastClassByGuice$fa1bdb70.invoke(<generated>)
	at com.google.inject.internal.ProviderMethod$FastClassProviderMethod.doProvision(ProviderMethod.java:264)
	at com.google.inject.internal.ProviderMethod$Factory.provision(ProviderMethod.java:401)
	at com.google.inject.internal.ProviderMethod$Factory.get(ProviderMethod.java:376)
	at com.google.inject.internal.ProviderToInternalFactoryAdapter$1.call(ProviderToInternalFactoryAdapter.java:46)
	at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1092)
	at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40)
	at com.google.inject.internal.SingletonScope$1.get(SingletonScope.java:194)
	at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:41)
	at com.google.inject.internal.FactoryProxy.get(FactoryProxy.java:56)
	at com.google.inject.internal.SingleParameterInjector.inject(SingleParameterInjector.java:38)
	at com.google.inject.internal.SingleParameterInjector.getAll(SingleParameterInjector.java:62)
	at com.google.inject.internal.ConstructorInjector.provision(ConstructorInjector.java:110)
	at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:90)
	at com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:268)
	at com.google.inject.internal.ProviderToInternalFactoryAdapter$1.call(ProviderToInternalFactoryAdapter.java:46)
	at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1092)
	at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40)
	at com.google.inject.internal.SingletonScope$1.get(SingletonScope.java:194)
	at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:41)
	at com.google.inject.internal.SingleParameterInjector.inject(SingleParameterInjector.java:38)
	at com.google.inject.internal.SingleParameterInjector.getAll(SingleParameterInjector.java:62)
	at com.google.inject.internal.SingleMethodInjector.inject(SingleMethodInjector.java:82)
	at com.google.inject.internal.MembersInjectorImpl.injectMembers(MembersInjectorImpl.java:132)
	at com.google.inject.internal.MembersInjectorImpl$1.call(MembersInjectorImpl.java:93)
	at com.google.inject.internal.MembersInjectorImpl$1.call(MembersInjectorImpl.java:80)
	at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1092)
	at com.google.inject.internal.MembersInjectorImpl.injectAndNotify(MembersInjectorImpl.java:80)
	at com.google.inject.internal.Initializer$InjectableReference.get(Initializer.java:223)
	at com.google.inject.internal.InternalFactoryToInitializableAdapter.get(InternalFactoryToInitializableAdapter.java:45)
	at com.google.inject.internal.ProviderToInternalFactoryAdapter$1.call(ProviderToInternalFactoryAdapter.java:46)
	at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1092)
	at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40)
	at com.google.inject.internal.SingletonScope$1.get(SingletonScope.java:194)
	at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:41)
	at com.google.inject.internal.InjectorImpl$2$1.call(InjectorImpl.java:1019)
	at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1092)
	at com.google.inject.internal.InjectorImpl$2.get(InjectorImpl.java:1015)
	at io.druid.guice.SupplierProvider.get(SupplierProvider.java:52)
	at com.google.inject.internal.ProviderInternalFactory.provision(ProviderInternalFactory.java:81)
	at com.google.inject.internal.InternalFactoryToInitializableAdapter.provision(InternalFactoryToInitializableAdapter.java:53)
	at com.google.inject.internal.ProviderInternalFactory.circularGet(ProviderInternalFactory.java:61)
	at com.google.inject.internal.InternalFactoryToInitializableAdapter.get(InternalFactoryToInitializableAdapter.java:45)
	at com.google.inject.internal.SingleFieldInjector.inject(SingleFieldInjector.java:54)
	at com.google.inject.internal.InjectionRequestProcessor$StaticInjection$1.call(InjectionRequestProcessor.java:123)
	at com.google.inject.internal.InjectionRequestProcessor$StaticInjection$1.call(InjectionRequestProcessor.java:117)
	at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1085)
	at com.google.inject.internal.InjectionRequestProcessor$StaticInjection.injectMembers(InjectionRequestProcessor.java:117)
	at com.google.inject.internal.InjectionRequestProcessor.injectMembers(InjectionRequestProcessor.java:79)
	at com.google.inject.internal.InternalInjectorCreator.injectDynamically(InternalInjectorCreator.java:171)
	at com.google.inject.internal.InternalInjectorCreator.build(InternalInjectorCreator.java:110)
	at com.google.inject.Guice.createInjector(Guice.java:99)
	at com.google.inject.Guice.createInjector(Guice.java:73)
	at io.druid.guice.GuiceInjectors.makeStartupInjector(GuiceInjectors.java:61)
	at io.druid.indexer.HadoopDruidIndexerConfig.<clinit>(HadoopDruidIndexerConfig.java:106)
	at io.druid.indexer.DetermineHashedPartitionsJob$DetermineHashedPartitionsPartitioner.setConf(DetermineHashedPartitionsJob.java:415)
	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:77)
	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:137)
	at org.apache.hadoop.mapred.MapTask$NewOutputCollector.<init>(MapTask.java:714)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:782)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:347)
	at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:174)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1730)
	at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:168)

4) Error in custom provider, java.lang.VerifyError: Cannot inherit from final class
  at io.druid.jackson.JacksonModule.jsonMapper(JacksonModule.java:46)
  at io.druid.jackson.JacksonModule.jsonMapper(JacksonModule.java:46)
  while locating com.fasterxml.jackson.databind.ObjectMapper annotated with interface io.druid.guice.annotations.Json
  while locating com.fasterxml.jackson.databind.ObjectMapper
    for the 1st parameter of io.druid.guice.JsonConfigurator.<init>(JsonConfigurator.java:67)
  at io.druid.guice.ConfigModule.configure(ConfigModule.java:40)
  while locating io.druid.guice.JsonConfigurator
    for the 2nd parameter of io.druid.guice.JsonConfigProvider.inject(JsonConfigProvider.java:188)
  at io.druid.guice.JsonConfigProvider.bind(JsonConfigProvider.java:133)
Caused by: java.lang.VerifyError: Cannot inherit from final class
	at java.lang.ClassLoader.defineClass1(Native Method)
	at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
	at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
	at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
	at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
	at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
	at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
	at java.security.AccessController.doPrivileged(Native Method)
	at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
	at org.apache.hadoop.util.ApplicationClassLoader.loadClass(ApplicationClassLoader.java:176)
	at org.apache.hadoop.util.ApplicationClassLoader.loadClass(ApplicationClassLoader.java:157)
	at com.fasterxml.jackson.datatype.guava.GuavaModule.setupModule(GuavaModule.java:55)
	at com.fasterxml.jackson.databind.ObjectMapper.registerModule(ObjectMapper.java:549)
	at io.druid.jackson.DefaultObjectMapper.<init>(DefaultObjectMapper.java:47)
	at io.druid.jackson.DefaultObjectMapper.<init>(DefaultObjectMapper.java:35)
	at io.druid.jackson.JacksonModule.jsonMapper(JacksonModule.java:46)
	at io.druid.jackson.JacksonModule$FastClassByGuice$fa1bdb70.invoke(<generated>)
	at com.google.inject.internal.ProviderMethod$FastClassProviderMethod.doProvision(ProviderMethod.java:264)
	at com.google.inject.internal.ProviderMethod$Factory.provision(ProviderMethod.java:401)
	at com.google.inject.internal.ProviderMethod$Factory.get(ProviderMethod.java:376)
	at com.google.inject.internal.ProviderToInternalFactoryAdapter$1.call(ProviderToInternalFactoryAdapter.java:46)
	at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1092)
	at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40)
	at com.google.inject.internal.SingletonScope$1.get(SingletonScope.java:194)
	at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:41)
	at com.google.inject.internal.FactoryProxy.get(FactoryProxy.java:56)
	at com.google.inject.internal.SingleParameterInjector.inject(SingleParameterInjector.java:38)
	at com.google.inject.internal.SingleParameterInjector.getAll(SingleParameterInjector.java:62)
	at com.google.inject.internal.ConstructorInjector.provision(ConstructorInjector.java:110)
	at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:90)
	at com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:268)
	at com.google.inject.internal.ProviderToInternalFactoryAdapter$1.call(ProviderToInternalFactoryAdapter.java:46)
	at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1092)
	at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40)
	at com.google.inject.internal.SingletonScope$1.get(SingletonScope.java:194)
	at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:41)
	at com.google.inject.internal.SingleParameterInjector.inject(SingleParameterInjector.java:38)
	at com.google.inject.internal.SingleParameterInjector.getAll(SingleParameterInjector.java:62)
	at com.google.inject.internal.SingleMethodInjector.inject(SingleMethodInjector.java:82)
	at com.google.inject.internal.MembersInjectorImpl.injectMembers(MembersInjectorImpl.java:132)
	at com.google.inject.internal.MembersInjectorImpl$1.call(MembersInjectorImpl.java:93)
	at com.google.inject.internal.MembersInjectorImpl$1.call(MembersInjectorImpl.java:80)
	at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1085)
	at com.google.inject.internal.MembersInjectorImpl.injectAndNotify(MembersInjectorImpl.java:80)
	at com.google.inject.internal.Initializer$InjectableReference.get(Initializer.java:223)
	at com.google.inject.internal.Initializer.injectAll(Initializer.java:132)
	at com.google.inject.internal.InternalInjectorCreator.injectDynamically(InternalInjectorCreator.java:174)
	at com.google.inject.internal.InternalInjectorCreator.build(InternalInjectorCreator.java:110)
	at com.google.inject.Guice.createInjector(Guice.java:99)
	at com.google.inject.Guice.createInjector(Guice.java:73)
	at io.druid.guice.GuiceInjectors.makeStartupInjector(GuiceInjectors.java:61)
	at io.druid.indexer.HadoopDruidIndexerConfig.<clinit>(HadoopDruidIndexerConfig.java:106)
	at io.druid.indexer.DetermineHashedPartitionsJob$DetermineHashedPartitionsPartitioner.setConf(DetermineHashedPartitionsJob.java:415)
	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:77)
	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:137)
	at org.apache.hadoop.mapred.MapTask$NewOutputCollector.<init>(MapTask.java:714)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:782)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:347)
	at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:174)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1730)
	at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:168)

5) Error in custom provider, java.lang.VerifyError: Cannot inherit from final class
  at io.druid.jackson.JacksonModule.jsonMapper(JacksonModule.java:46)
  at io.druid.jackson.JacksonModule.jsonMapper(JacksonModule.java:46)
  while locating com.fasterxml.jackson.databind.ObjectMapper annotated with interface io.druid.guice.annotations.Json
  while locating com.fasterxml.jackson.databind.ObjectMapper
    for the 1st parameter of io.druid.guice.JsonConfigurator.<init>(JsonConfigurator.java:67)
  at io.druid.guice.ConfigModule.configure(ConfigModule.java:40)
  while locating io.druid.guice.JsonConfigurator
    for the 2nd parameter of io.druid.guice.JsonConfigProvider.inject(JsonConfigProvider.java:188)
  at io.druid.guice.JsonConfigProvider.bind(JsonConfigProvider.java:133)
Caused by: java.lang.VerifyError (same stack trace as error #4)
5 errors
	at com.google.inject.internal.Errors.throwCreationExceptionIfErrorsExist(Errors.java:470)
	at com.google.inject.internal.InternalInjectorCreator.injectDynamically(InternalInjectorCreator.java:176)
	at com.google.inject.internal.InternalInjectorCreator.build(InternalInjectorCreator.java:110)
	at com.google.inject.Guice.createInjector(Guice.java:99)
	at com.google.inject.Guice.createInjector(Guice.java:73)
	at io.druid.guice.GuiceInjectors.makeStartupInjector(GuiceInjectors.java:61)
	at io.druid.indexer.HadoopDruidIndexerConfig.<clinit>(HadoopDruidIndexerConfig.java:106)
	at io.druid.indexer.DetermineHashedPartitionsJob$DetermineHashedPartitionsPartitioner.setConf(DetermineHashedPartitionsJob.java:415)
	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:77)
	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:137)
	at org.apache.hadoop.mapred.MapTask$NewOutputCollector.<init>(MapTask.java:714)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:782)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:347)
	at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:174)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1730) 

2 REPLIES 2

Explorer

@Sumeet Chauhan can you add more details on how you manually added the extensions and what all extensions you deleted on first place?

New Contributor

@Nishant Bangarwa Thanks for reply. I have cleaned all the extensions using clean pull-deps command and then added these extensions ["druid-datasketches", "druid-hdfs-storage", "druid-kafka-indexing-service", "mysql-metadata-storage", "druid-avro-extensions", "druid-parquet-extensions"] using pull-deps command. I am using HDP 3.0.1 with Druid 0.12.1

java -classpath "/my/druid/lib/*" org.apache.druid.cli.Main tools pull-deps --clean -c org.apache.druid.extensions:
io.druid.extensions:druid-hdfs-storage:0.12.1

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.