2019-02-06T14:05:02,671 INFO [main] org.eclipse.jetty.server.handler.ContextHandler - Started o.e.j.s.ServletContextHandler@632d4cf2{/,null,AVAILABLE} 2019-02-06T14:05:02,688 INFO [main] org.eclipse.jetty.server.AbstractConnector - Started ServerConnector@58fbcb71{HTTP/1.1,[http/1.1]}{0.0.0.0:8100} 2019-02-06T14:05:02,688 INFO [main] org.eclipse.jetty.server.Server - Started @8561ms 2019-02-06T14:05:02,689 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.query.lookup.LookupReferencesManager.start()] on object[io.druid.query.lookup.LookupReferencesManager@4a122e68]. 2019-02-06T14:05:02,689 INFO [main] io.druid.query.lookup.LookupReferencesManager - LookupReferencesManager is starting. 2019-02-06T14:05:02,693 INFO [main] io.druid.java.util.http.client.pool.ChannelResourceFactory - Generating: http://master1.hadoop.com:8081 2019-02-06T14:05:02,694 INFO [main] io.druid.java.util.http.client.pool.ChannelResourceFactory - Generating: http://master1.hadoop.com:8081 2019-02-06T14:05:02,694 INFO [main] io.druid.java.util.http.client.pool.ChannelResourceFactory - Generating: http://master1.hadoop.com:8081 2019-02-06T14:05:02,694 INFO [main] io.druid.java.util.http.client.pool.ChannelResourceFactory - Generating: http://master1.hadoop.com:8081 2019-02-06T14:05:02,694 INFO [main] io.druid.java.util.http.client.pool.ChannelResourceFactory - Generating: http://master1.hadoop.com:8081 2019-02-06T14:05:02,695 INFO [main] io.druid.java.util.http.client.pool.ChannelResourceFactory - Generating: http://master1.hadoop.com:8081 2019-02-06T14:05:02,696 INFO [main] io.druid.java.util.http.client.pool.ChannelResourceFactory - Generating: http://master1.hadoop.com:8081 2019-02-06T14:05:02,697 INFO [main] io.druid.java.util.http.client.pool.ChannelResourceFactory - Generating: http://master1.hadoop.com:8081 2019-02-06T14:05:02,699 INFO [main] io.druid.java.util.http.client.pool.ChannelResourceFactory - Generating: http://master1.hadoop.com:8081 2019-02-06T14:05:02,699 INFO [main] io.druid.java.util.http.client.pool.ChannelResourceFactory - Generating: http://master1.hadoop.com:8081 2019-02-06T14:05:02,699 INFO [main] io.druid.java.util.http.client.pool.ChannelResourceFactory - Generating: http://master1.hadoop.com:8081 2019-02-06T14:05:02,699 INFO [main] io.druid.java.util.http.client.pool.ChannelResourceFactory - Generating: http://master1.hadoop.com:8081 2019-02-06T14:05:02,699 INFO [main] io.druid.java.util.http.client.pool.ChannelResourceFactory - Generating: http://master1.hadoop.com:8081 2019-02-06T14:05:02,699 INFO [main] io.druid.java.util.http.client.pool.ChannelResourceFactory - Generating: http://master1.hadoop.com:8081 2019-02-06T14:05:02,700 INFO [main] io.druid.java.util.http.client.pool.ChannelResourceFactory - Generating: http://master1.hadoop.com:8081 2019-02-06T14:05:02,700 INFO [main] io.druid.java.util.http.client.pool.ChannelResourceFactory - Generating: http://master1.hadoop.com:8081 2019-02-06T14:05:02,700 INFO [main] io.druid.java.util.http.client.pool.ChannelResourceFactory - Generating: http://master1.hadoop.com:8081 2019-02-06T14:05:02,700 INFO [main] io.druid.java.util.http.client.pool.ChannelResourceFactory - Generating: http://master1.hadoop.com:8081 2019-02-06T14:05:02,700 INFO [main] io.druid.java.util.http.client.pool.ChannelResourceFactory - Generating: http://master1.hadoop.com:8081 2019-02-06T14:05:02,700 INFO [main] io.druid.java.util.http.client.pool.ChannelResourceFactory - Generating: http://master1.hadoop.com:8081 2019-02-06T14:05:02,708 WARN [main] io.druid.query.lookup.LookupReferencesManager - No lookups found for tier [__default], response [io.druid.java.util.http.client.response.FullResponseHolder@28fa541] 2019-02-06T14:05:02,708 INFO [main] io.druid.query.lookup.LookupReferencesManager - Coordinator is unavailable. Loading saved snapshot instead 2019-02-06T14:05:02,708 INFO [main] io.druid.query.lookup.LookupReferencesManager - No lookups to be loaded at this point 2019-02-06T14:05:02,869 INFO [main] io.druid.query.lookup.LookupReferencesManager - LookupReferencesManager is started. 2019-02-06T14:05:02,870 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.server.listener.announcer.ListenerResourceAnnouncer.start()] on object[io.druid.query.lookup.LookupResourceListenerAnnouncer@4aab7195]. 2019-02-06T14:05:02,904 INFO [main] io.druid.server.listener.announcer.ListenerResourceAnnouncer - Announcing start time on [/druid/listeners/lookups/__default/http:worker4.hadoop.com:8100] 2019-02-06T14:05:03,028 INFO [task-runner-0-priority-0] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties 2019-02-06T14:05:03,031 INFO [task-runner-0-priority-0] io.druid.guice.PropertiesModule - Loading properties from runtime.properties 2019-02-06T14:05:03,079 INFO [task-runner-0-priority-0] org.hibernate.validator.internal.util.Version - HV000001: Hibernate Validator 5.1.3.Final 2019-02-06T14:05:03,730 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.common.config.NullValueHandlingConfig] from props[druid.generic.] as [io.druid.common.config.NullValueHandlingConfig@38ce970f] 2019-02-06T14:05:03,744 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ModulesConfig] from props[druid.modules.] as [ModulesConfig{excludeList=[]}] 2019-02-06T14:05:03,895 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, directory='/usr/hdp/current/druid-middlemanager/extensions', hadoopDependenciesDir='/usr/hdp/current/druid-middlemanager/hadoop-dependencies', hadoopContainerDruidClasspath='null', addExtensionsToHadoopContainer=false, loadList=[druid-datasketches, druid-hdfs-storage, druid-kafka-indexing-service, mysql-metadata-storage, druid-avro-extensions, druid-parquet-extensions]}] 2019-02-06T14:05:03,899 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Adding implementation [io.druid.query.aggregation.datasketches.theta.SketchModule] for class [interface io.druid.initialization.DruidModule] from classpath extension 2019-02-06T14:05:03,900 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Adding implementation [io.druid.query.aggregation.datasketches.theta.oldapi.OldApiSketchModule] for class [interface io.druid.initialization.DruidModule] from classpath extension 2019-02-06T14:05:03,902 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Adding implementation [io.druid.storage.hdfs.HdfsStorageDruidModule] for class [interface io.druid.initialization.DruidModule] from classpath extension 2019-02-06T14:05:03,903 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Adding implementation [io.druid.indexing.kafka.KafkaIndexTaskModule] for class [interface io.druid.initialization.DruidModule] from classpath extension 2019-02-06T14:05:03,904 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Adding implementation [io.druid.metadata.storage.mysql.MySQLMetadataStorageModule] for class [interface io.druid.initialization.DruidModule] from classpath extension 2019-02-06T14:05:03,905 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Adding implementation [io.druid.data.input.avro.AvroExtensionsModule] for class [interface io.druid.initialization.DruidModule] from classpath extension 2019-02-06T14:05:03,906 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Adding implementation [io.druid.data.input.parquet.ParquetExtensionsModule] for class [interface io.druid.initialization.DruidModule] from classpath extension 2019-02-06T14:05:03,906 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Loading extension [druid-datasketches] for class [interface io.druid.initialization.DruidModule] 2019-02-06T14:05:03,916 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-datasketches/druid-datasketches-0.11.0.jar] 2019-02-06T14:05:03,916 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-datasketches/sketches-core-0.8.4.jar] 2019-02-06T14:05:03,916 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-datasketches/memory-0.8.4.jar] 2019-02-06T14:05:03,919 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Loading extension [druid-hdfs-storage] for class [interface io.druid.initialization.DruidModule] 2019-02-06T14:05:03,920 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/druid-hdfs-storage-0.12.1.jar] 2019-02-06T14:05:03,920 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-client-2.7.3.jar] 2019-02-06T14:05:03,920 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-common-2.7.3.jar] 2019-02-06T14:05:03,920 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/guava-16.0.1.jar] 2019-02-06T14:05:03,920 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/commons-math3-3.6.1.jar] 2019-02-06T14:05:03,920 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/xmlenc-0.52.jar] 2019-02-06T14:05:03,920 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/commons-net-3.1.jar] 2019-02-06T14:05:03,920 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/commons-collections-3.2.2.jar] 2019-02-06T14:05:03,920 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jsp-api-2.1.jar] 2019-02-06T14:05:03,920 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/commons-configuration-1.6.jar] 2019-02-06T14:05:03,920 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/commons-digester-1.8.jar] 2019-02-06T14:05:03,920 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/commons-beanutils-1.7.0.jar] 2019-02-06T14:05:03,920 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/commons-beanutils-core-1.8.0.jar] 2019-02-06T14:05:03,921 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/gson-2.2.4.jar] 2019-02-06T14:05:03,921 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-auth-2.7.3.jar] 2019-02-06T14:05:03,921 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/apacheds-kerberos-codec-2.0.0-M15.jar] 2019-02-06T14:05:03,921 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/apacheds-i18n-2.0.0-M15.jar] 2019-02-06T14:05:03,921 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/api-asn1-api-1.0.0-M20.jar] 2019-02-06T14:05:03,921 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/api-util-1.0.0-M20.jar] 2019-02-06T14:05:03,921 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/curator-framework-4.0.0.jar] 2019-02-06T14:05:03,921 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/curator-client-4.0.0.jar] 2019-02-06T14:05:03,921 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/curator-recipes-4.0.0.jar] 2019-02-06T14:05:03,921 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/htrace-core-3.1.0-incubating.jar] 2019-02-06T14:05:03,921 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/commons-compress-1.4.1.jar] 2019-02-06T14:05:03,921 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/xz-1.0.jar] 2019-02-06T14:05:03,921 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-hdfs-2.7.3.jar] 2019-02-06T14:05:03,922 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/netty-3.10.6.Final.jar] 2019-02-06T14:05:03,922 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/netty-all-4.0.52.Final.jar] 2019-02-06T14:05:03,922 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/xercesImpl-2.9.1.jar] 2019-02-06T14:05:03,922 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/xml-apis-1.3.04.jar] 2019-02-06T14:05:03,922 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/leveldbjni-all-1.8.jar] 2019-02-06T14:05:03,922 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-mapreduce-client-app-2.7.3.jar] 2019-02-06T14:05:03,922 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-mapreduce-client-common-2.7.3.jar] 2019-02-06T14:05:03,922 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-yarn-client-2.7.3.jar] 2019-02-06T14:05:03,922 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-yarn-server-common-2.7.3.jar] 2019-02-06T14:05:03,922 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-mapreduce-client-shuffle-2.7.3.jar] 2019-02-06T14:05:03,922 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-yarn-api-2.7.3.jar] 2019-02-06T14:05:03,922 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-mapreduce-client-core-2.7.3.jar] 2019-02-06T14:05:03,922 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-yarn-common-2.7.3.jar] 2019-02-06T14:05:03,922 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jaxb-api-2.2.2.jar] 2019-02-06T14:05:03,922 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/stax-api-1.0-2.jar] 2019-02-06T14:05:03,923 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/servlet-api-2.5.jar] 2019-02-06T14:05:03,923 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jersey-client-1.9.jar] 2019-02-06T14:05:03,923 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jackson-jaxrs-1.9.13.jar] 2019-02-06T14:05:03,923 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jackson-xc-1.9.13.jar] 2019-02-06T14:05:03,923 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-mapreduce-client-jobclient-2.7.3.jar] 2019-02-06T14:05:03,923 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-aws-2.7.3.jar] 2019-02-06T14:05:03,923 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jackson-databind-2.4.6.jar] 2019-02-06T14:05:03,923 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jackson-core-2.4.6.jar] 2019-02-06T14:05:03,923 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jackson-annotations-2.4.6.jar] 2019-02-06T14:05:03,923 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/aws-java-sdk-s3-1.10.77.jar] 2019-02-06T14:05:03,923 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/aws-java-sdk-kms-1.10.77.jar] 2019-02-06T14:05:03,923 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/aws-java-sdk-core-1.10.77.jar] 2019-02-06T14:05:03,923 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/commons-logging-1.1.1.jar] 2019-02-06T14:05:03,923 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/httpclient-4.5.1.jar] 2019-02-06T14:05:03,923 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/httpcore-4.4.3.jar] 2019-02-06T14:05:03,924 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jackson-dataformat-cbor-2.5.3.jar] 2019-02-06T14:05:03,924 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/joda-time-2.9.9.jar] 2019-02-06T14:05:03,931 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Loading extension [druid-kafka-indexing-service] for class [interface io.druid.initialization.DruidModule] 2019-02-06T14:05:03,931 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-kafka-indexing-service/druid-kafka-indexing-service-0.12.1.jar] 2019-02-06T14:05:03,932 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-kafka-indexing-service/kafka-clients-0.10.2.0.jar] 2019-02-06T14:05:03,932 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-kafka-indexing-service/lz4-1.3.0.jar] 2019-02-06T14:05:03,932 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-kafka-indexing-service/snappy-java-1.1.2.6.jar] 2019-02-06T14:05:03,932 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-kafka-indexing-service/slf4j-api-1.6.4.jar] 2019-02-06T14:05:03,934 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Loading extension [mysql-metadata-storage] for class [interface io.druid.initialization.DruidModule] 2019-02-06T14:05:03,934 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/mysql-metadata-storage/mysql-metadata-storage-0.12.1.jar] 2019-02-06T14:05:03,934 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/mysql-metadata-storage/mysql-connector-java-5.1.38.jar] 2019-02-06T14:05:03,934 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/mysql-metadata-storage/mysql-connector-java.jar] 2019-02-06T14:05:03,936 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Loading extension [druid-avro-extensions] for class [interface io.druid.initialization.DruidModule] 2019-02-06T14:05:03,937 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/druid-avro-extensions-0.11.0.jar] 2019-02-06T14:05:03,937 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/avro-mapred-1.7.7-hadoop2.jar] 2019-02-06T14:05:03,937 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/avro-ipc-1.7.7.jar] 2019-02-06T14:05:03,937 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/jetty-6.1.26.jar] 2019-02-06T14:05:03,937 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/jetty-util-6.1.26.jar] 2019-02-06T14:05:03,937 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/netty-3.4.0.Final.jar] 2019-02-06T14:05:03,937 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/velocity-1.7.jar] 2019-02-06T14:05:03,937 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/commons-collections-3.2.1.jar] 2019-02-06T14:05:03,937 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/commons-lang-2.6.jar] 2019-02-06T14:05:03,937 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/servlet-api-2.5-20081211.jar] 2019-02-06T14:05:03,937 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/avro-ipc-1.7.7-tests.jar] 2019-02-06T14:05:03,937 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/jackson-core-asl-1.9.13.jar] 2019-02-06T14:05:03,937 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/jackson-mapper-asl-1.9.13.jar] 2019-02-06T14:05:03,937 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/slf4j-api-1.6.4.jar] 2019-02-06T14:05:03,937 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/schema-repo-api-0.1.3.jar] 2019-02-06T14:05:03,938 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/schema-repo-common-0.1.3.jar] 2019-02-06T14:05:03,938 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/gson-2.3.1.jar] 2019-02-06T14:05:03,938 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/guava-16.0.1.jar] 2019-02-06T14:05:03,938 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/schema-repo-client-0.1.3.jar] 2019-02-06T14:05:03,938 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/jersey-client-1.15.jar] 2019-02-06T14:05:03,938 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/jersey-core-1.19.3.jar] 2019-02-06T14:05:03,938 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/jsr311-api-1.1.1.jar] 2019-02-06T14:05:03,938 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/schema-repo-avro-0.1.3.jar] 2019-02-06T14:05:03,938 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/avro-1.7.7.jar] 2019-02-06T14:05:03,938 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/paranamer-2.3.jar] 2019-02-06T14:05:03,938 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/snappy-java-1.0.5.jar] 2019-02-06T14:05:03,938 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/commons-compress-1.4.1.jar] 2019-02-06T14:05:03,938 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/xz-1.0.jar] 2019-02-06T14:05:03,938 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/kafka-schema-registry-client-3.0.1.jar] 2019-02-06T14:05:03,938 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/jackson-databind-2.4.6.jar] 2019-02-06T14:05:03,938 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/jackson-annotations-2.4.6.jar] 2019-02-06T14:05:03,938 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-avro-extensions/jackson-core-2.4.6.jar] 2019-02-06T14:05:03,943 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Loading extension [druid-parquet-extensions] for class [interface io.druid.initialization.DruidModule] 2019-02-06T14:05:03,943 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-parquet-extensions/druid-parquet-extensions-0.11.0.jar] 2019-02-06T14:05:03,944 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-parquet-extensions/parquet-avro-1.8.2.jar] 2019-02-06T14:05:03,944 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-parquet-extensions/parquet-column-1.8.2.jar] 2019-02-06T14:05:03,944 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-parquet-extensions/parquet-common-1.8.2.jar] 2019-02-06T14:05:03,944 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-parquet-extensions/parquet-encoding-1.8.2.jar] 2019-02-06T14:05:03,944 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-parquet-extensions/commons-codec-1.7.jar] 2019-02-06T14:05:03,944 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-parquet-extensions/parquet-hadoop-1.8.2.jar] 2019-02-06T14:05:03,944 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-parquet-extensions/parquet-jackson-1.8.2.jar] 2019-02-06T14:05:03,944 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-parquet-extensions/jackson-mapper-asl-1.9.13.jar] 2019-02-06T14:05:03,944 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-parquet-extensions/jackson-core-asl-1.9.13.jar] 2019-02-06T14:05:03,944 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-parquet-extensions/snappy-java-1.1.1.6.jar] 2019-02-06T14:05:03,944 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-parquet-extensions/parquet-format-2.3.1.jar] 2019-02-06T14:05:03,944 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-parquet-extensions/avro-1.8.0.jar] 2019-02-06T14:05:03,944 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-parquet-extensions/paranamer-2.7.jar] 2019-02-06T14:05:03,944 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-parquet-extensions/commons-compress-1.8.1.jar] 2019-02-06T14:05:03,944 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-parquet-extensions/xz-1.5.jar] 2019-02-06T14:05:03,945 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-parquet-extensions/slf4j-api-1.6.4.jar] 2019-02-06T14:05:03,945 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-parquet-extensions/fastutil-7.2.0.jar] 2019-02-06T14:05:04,394 WARN [task-runner-0-priority-0] org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2019-02-06T14:05:05,207 WARN [task-runner-0-priority-0] org.apache.hadoop.hdfs.shortcircuit.DomainSocketFactory - The short-circuit local reads feature cannot be used because libhadoop cannot be loaded. 2019-02-06T14:05:05,566 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.server.security.Escalator] from props[druid.escalator.] as [io.druid.server.security.NoopEscalator@69fe6af9] 2019-02-06T14:05:05,576 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.curator.CuratorConfig] from props[druid.zk.service.] as [io.druid.curator.CuratorConfig@1d420374] 2019-02-06T14:05:05,582 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.curator.ExhibitorConfig] from props[druid.exhibitor.service.] as [io.druid.curator.ExhibitorConfig@30e0ff9b] 2019-02-06T14:05:05,640 INFO [task-runner-0-priority-0] org.apache.curator.utils.Compatibility - Running in ZooKeeper 3.4.x compatibility mode 2019-02-06T14:05:05,642 WARN [task-runner-0-priority-0] org.apache.curator.retry.ExponentialBackoffRetry - maxRetries too large (30). Pinning to 29 2019-02-06T14:05:05,677 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.ZkPathsConfig] from props[druid.zk.paths.] as [io.druid.server.initialization.ZkPathsConfig@22e2266d] 2019-02-06T14:05:05,686 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.security.AuthConfig] from props[druid.auth.] as [AuthConfig{authenticatorChain=null, authorizers=null, unsecuredPaths=[], allowUnauthenticatedHttpOptions=false}] 2019-02-06T14:05:05,731 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.DruidMonitorSchedulerConfig] from props[druid.monitoring.] as [io.druid.server.metrics.DruidMonitorSchedulerConfig@3ae52daa] 2019-02-06T14:05:05,739 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.MonitorsConfig] from props[druid.monitoring.] as [MonitorsConfig{monitors=[class io.druid.java.util.metrics.JvmMonitor]}] 2019-02-06T14:05:05,739 INFO [task-runner-0-priority-0] io.druid.server.emitter.EmitterModule - Underlying emitter for ServiceEmitter: io.druid.java.util.emitter.core.NoopEmitter@2df24889 2019-02-06T14:05:05,739 INFO [task-runner-0-priority-0] io.druid.server.emitter.EmitterModule - Extra service dimensions: {version=0.12.1.3.0.1.0-187} 2019-02-06T14:05:05,757 INFO [task-runner-0-priority-0] io.druid.server.metrics.MetricsModule - Adding monitor[io.druid.java.util.metrics.JvmMonitor@16e3e89c] 2019-02-06T14:05:05,757 INFO [task-runner-0-priority-0] io.druid.server.metrics.MetricsModule - Adding monitor[io.druid.server.initialization.jetty.JettyServerModule$JettyMonitor@670447aa] 2019-02-06T14:05:05,763 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.segment.writeout.SegmentWriteOutMediumFactory] from props[druid.peon.defaultSegmentWriteOutMediumFactory.] as [io.druid.segment.writeout.TmpFileSegmentWriteOutMediumFactory@328cdc03] 2019-02-06T14:05:05,766 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Assigning value [256000000] for [druid.processing.buffer.sizeBytes] on [io.druid.query.DruidProcessingConfig#intermediateComputeSizeBytes()] 2019-02-06T14:05:05,769 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.computation.buffer.poolCacheMaxCount, ${base_path}.buffer.poolCacheMaxCount] on [io.druid.query.DruidProcessingConfig#poolCacheMaxCount()] 2019-02-06T14:05:05,770 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.numMergeBuffers] on [io.druid.query.DruidProcessingConfig#getNumMergeBuffersConfigured()] 2019-02-06T14:05:05,770 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.columnCache.sizeBytes] on [io.druid.query.DruidProcessingConfig#columnCacheSizeBytes()] 2019-02-06T14:05:05,770 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Assigning value [4] for [druid.processing.numThreads] on [io.druid.query.DruidProcessingConfig#getNumThreadsConfigured()] 2019-02-06T14:05:05,771 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.tmpDir] on [io.druid.query.DruidProcessingConfig#getTmpDir()] 2019-02-06T14:05:05,771 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.fifo] on [io.druid.query.DruidProcessingConfig#isFifo()] 2019-02-06T14:05:05,771 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Assigning default value [processing-%s] for [${base_path}.formatString] on [io.druid.java.util.common.concurrent.ExecutorServiceConfig#getFormatString()] 2019-02-06T14:05:05,884 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.indexer.HadoopKerberosConfig] from props[druid.hadoop.security.kerberos.] as [io.druid.indexer.HadoopKerberosConfig@0] 2019-02-06T14:05:05,887 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.storage.hdfs.HdfsDataSegmentPusherConfig] from props[druid.storage.] as [io.druid.storage.hdfs.HdfsDataSegmentPusherConfig@8099df3] 2019-02-06T14:05:05,890 INFO [task-runner-0-priority-0] io.druid.storage.hdfs.HdfsDataSegmentPusher - Configured HDFS as deep storage 2019-02-06T14:05:06,111 INFO [task-runner-0-priority-0] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties 2019-02-06T14:05:06,111 INFO [task-runner-0-priority-0] io.druid.guice.PropertiesModule - Loading properties from runtime.properties 2019-02-06T14:05:06,125 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.common.config.NullValueHandlingConfig] from props[druid.generic.] as [io.druid.common.config.NullValueHandlingConfig@dd075ae] 2019-02-06T14:05:06,132 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, directory='/usr/hdp/current/druid-middlemanager/extensions', hadoopDependenciesDir='/usr/hdp/current/druid-middlemanager/hadoop-dependencies', hadoopContainerDruidClasspath='null', addExtensionsToHadoopContainer=false, loadList=[druid-datasketches, druid-hdfs-storage, druid-kafka-indexing-service, mysql-metadata-storage, druid-avro-extensions, druid-parquet-extensions]}] 2019-02-06T14:05:06,134 INFO [task-runner-0-priority-0] io.druid.indexing.common.task.HadoopIndexTask - Starting a hadoop determine configuration job... 2019-02-06T14:05:06,203 INFO [task-runner-0-priority-0] io.druid.indexer.path.StaticPathSpec - Adding paths[/data/sandbox/input_data/v2/union_packets/2017/eclss_only/001_100/TM--DMS--MMC_Gnd_Tlm_Pkt_ECLSS1_DMC.parquet] 2019-02-06T14:05:07,137 INFO [task-runner-0-priority-0] io.druid.indexer.path.StaticPathSpec - Adding paths[/data/sandbox/input_data/v2/union_packets/2017/eclss_only/001_100/TM--DMS--MMC_Gnd_Tlm_Pkt_ECLSS1_DMC.parquet] 2019-02-06T14:05:07,580 INFO [task-runner-0-priority-0] org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl - Timeline service address: http://worker1.hadoop.com:8188/ws/v1/timeline/ 2019-02-06T14:05:07,592 INFO [task-runner-0-priority-0] org.apache.hadoop.yarn.client.RMProxy - Connecting to ResourceManager at master1.hadoop.com/10.156.0.7:8050 2019-02-06T14:05:07,887 WARN [task-runner-0-priority-0] org.apache.hadoop.mapreduce.JobResourceUploader - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2019-02-06T14:05:07,898 WARN [task-runner-0-priority-0] org.apache.hadoop.mapreduce.JobResourceUploader - No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2019-02-06T14:05:08,429 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.lib.input.FileInputFormat - Total input paths to process : 98 2019-02-06T14:05:08,429 INFO [task-runner-0-priority-0] org.apache.parquet.hadoop.ParquetInputFormat - Total input paths to process : 98 2019-02-06T14:05:08,727 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.JobSubmitter - number of splits:98 2019-02-06T14:05:08,849 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.JobSubmitter - Submitting tokens for job: job_1549359187544_0030 2019-02-06T14:05:08,990 INFO [task-runner-0-priority-0] org.apache.hadoop.mapred.YARNRunner - Job jar is not present. Not adding any jar to the list of resources. 2019-02-06T14:05:10,167 INFO [task-runner-0-priority-0] org.apache.hadoop.yarn.client.api.impl.YarnClientImpl - Submitted application application_1549359187544_0030 2019-02-06T14:05:10,206 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job - The url to track the job: http://master1.hadoop.com:8088/proxy/application_1549359187544_0030/ 2019-02-06T14:05:10,207 INFO [task-runner-0-priority-0] io.druid.indexer.DetermineHashedPartitionsJob - Job parquet_test_17_18_ECLSS1_DMC-determine_partitions_hashed-Optional.of([2017-01-01T00:00:00.000Z/2017-05-01T00:00:00.000Z]) submitted, status available at: http://master1.hadoop.com:8088/proxy/application_1549359187544_0030/ 2019-02-06T14:05:10,207 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job - Running job: job_1549359187544_0030 2019-02-06T14:05:17,300 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job - Job job_1549359187544_0030 running in uber mode : false 2019-02-06T14:05:17,301 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job - map 0% reduce 0% 2019-02-06T14:05:52,575 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job - Task Id : attempt_1549359187544_0030_m_000002_0, Status : FAILED Error: com.google.inject.CreationException: Unable to create injector, see the following errors: 1) null returned by binding at io.druid.guice.JsonConfigProvider.bind(JsonConfigProvider.java:134) but io.druid.common.config.NullHandling.INSTANCE(NullHandling.java:32) is not @Nullable while locating io.druid.common.config.NullValueHandlingConfig for field at io.druid.common.config.NullHandling.INSTANCE(NullHandling.java:32) 2) Error in custom provider, java.lang.NullPointerException at io.druid.guice.JsonConfigProvider.bind(JsonConfigProvider.java:133) at io.druid.guice.JsonConfigProvider.bind(JsonConfigProvider.java:133) while locating com.google.common.base.Supplier<io.druid.common.config.NullValueHandlingConfig> at io.druid.guice.JsonConfigProvider.bind(JsonConfigProvider.java:134) while locating io.druid.common.config.NullValueHandlingConfig for field at io.druid.common.config.NullHandling.INSTANCE(NullHandling.java:32) Caused by: java.lang.NullPointerException at io.druid.guice.JsonConfigProvider.get(JsonConfigProvider.java:200) at io.druid.guice.JsonConfigProvider.get(JsonConfigProvider.java:80) at com.google.inject.internal.ProviderInternalFactory.provision(ProviderInternalFactory.java:81) at com.google.inject.internal.InternalFactoryToInitializableAdapter.provision(InternalFactoryToInitializableAdapter.java:53) at com.google.inject.internal.ProviderInternalFactory.circularGet(ProviderInternalFactory.java:61) at com.google.inject.internal.InternalFactoryToInitializableAdapter.get(InternalFactoryToInitializableAdapter.java:45) at com.google.inject.internal.ProviderToInternalFactoryAdapter$1.call(ProviderToInternalFactoryAdapter.java:46) at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1092) at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40) at com.google.inject.internal.SingletonScope$1.get(SingletonScope.java:194) at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:41) at com.google.inject.internal.InjectorImpl$2$1.call(InjectorImpl.java:1019) at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1092) at com.google.inject.internal.InjectorImpl$2.get(InjectorImpl.java:1015) at io.druid.guice.SupplierProvider.get(SupplierProvider.java:52) at com.google.inject.internal.ProviderInternalFactory.provision(ProviderInternalFactory.java:81) at com.google.inject.internal.InternalFactoryToInitializableAdapter.provision(InternalFactoryToInitializableAdapter.java:53) at com.google.inject.internal.ProviderInternalFactory.circularGet(ProviderInternalFactory.java:61) at com.google.inject.internal.InternalFactoryToInitializableAdapter.get(InternalFactoryToInitializableAdapter.java:45) at com.google.inject.internal.SingleFieldInjector.inject(SingleFieldInjector.java:54) at com.google.inject.internal.InjectionRequestProcessor$StaticInjection$1.call(InjectionRequestProcessor.java:123) at com.google.inject.internal.InjectionRequestProcessor$StaticInjection$1.call(InjectionRequestProcessor.java:117) at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1085) at com.google.inject.internal.InjectionRequestProcessor$StaticInjection.injectMembers(InjectionRequestProcessor.java:117) at com.google.inject.internal.InjectionRequestProcessor.injectMembers(InjectionRequestProcessor.java:79) at com.google.inject.internal.InternalInjectorCreator.injectDynamically(InternalInjectorCreator.java:171) at com.google.inject.internal.InternalInjectorCreator.build(InternalInjectorCreator.java:110) at com.google.inject.Guice.createInjector(Guice.java:99) at com.google.inject.Guice.createInjector(Guice.java:73) at io.druid.guice.GuiceInjectors.makeStartupInjector(GuiceInjectors.java:61) at io.druid.indexer.HadoopDruidIndexerConfig.<clinit>(HadoopDruidIndexerConfig.java:106) at io.druid.indexer.DetermineHashedPartitionsJob$DetermineHashedPartitionsPartitioner.setConf(DetermineHashedPartitionsJob.java:415) at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:77) at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:137) at org.apache.hadoop.mapred.MapTask$NewOutputCollector.<init>(MapTask.java:714) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:782) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:347) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:174) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1730) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:168) 3) Error in custom provider, java.lang.VerifyError: Cannot inherit from final class at io.druid.jackson.JacksonModule.jsonMapper(JacksonModule.java:46) at io.druid.jackson.JacksonModule.jsonMapper(JacksonModule.java:46) while locating com.fasterxml.jackson.databind.ObjectMapper annotated with interface io.druid.guice.annotations.Json while locating com.fasterxml.jackson.databind.ObjectMapper for the 1st parameter of io.druid.guice.JsonConfigurator.<init>(JsonConfigurator.java:67) at io.druid.guice.ConfigModule.configure(ConfigModule.java:40) while locating io.druid.guice.JsonConfigurator for the 2nd parameter of io.druid.guice.JsonConfigProvider.inject(JsonConfigProvider.java:188) at io.druid.guice.JsonConfigProvider.bind(JsonConfigProvider.java:133) at io.druid.guice.JsonConfigProvider.bind(JsonConfigProvider.java:133) while locating com.google.common.base.Supplier<io.druid.common.config.NullValueHandlingConfig> at io.druid.guice.JsonConfigProvider.bind(JsonConfigProvider.java:134) while locating io.druid.common.config.NullValueHandlingConfig for field at io.druid.common.config.NullHandling.INSTANCE(NullHandling.java:32) Caused by: java.lang.VerifyError: Cannot inherit from final class at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass(ClassLoader.java:763) at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142) at java.net.URLClassLoader.defineClass(URLClassLoader.java:467) at java.net.URLClassLoader.access$100(URLClassLoader.java:73) at java.net.URLClassLoader$1.run(URLClassLoader.java:368) at java.net.URLClassLoader$1.run(URLClassLoader.java:362) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:361) at org.apache.hadoop.util.ApplicationClassLoader.loadClass(ApplicationClassLoader.java:176) at org.apache.hadoop.util.ApplicationClassLoader.loadClass(ApplicationClassLoader.java:157) at com.fasterxml.jackson.datatype.guava.GuavaModule.setupModule(GuavaModule.java:55) at com.fasterxml.jackson.databind.ObjectMapper.registerModule(ObjectMapper.java:549) at io.druid.jackson.DefaultObjectMapper.<init>(DefaultObjectMapper.java:47) at io.druid.jackson.DefaultObjectMapper.<init>(DefaultObjectMapper.java:35) at io.druid.jackson.JacksonModule.jsonMapper(JacksonModule.java:46) at io.druid.jackson.JacksonModule$FastClassByGuice$fa1bdb70.invoke(<generated>) at com.google.inject.internal.ProviderMethod$FastClassProviderMethod.doProvision(ProviderMethod.java:264) at com.google.inject.internal.ProviderMethod$Factory.provision(ProviderMethod.java:401) at com.google.inject.internal.ProviderMethod$Factory.get(ProviderMethod.java:376) at com.google.inject.internal.ProviderToInternalFactoryAdapter$1.call(ProviderToInternalFactoryAdapter.java:46) at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1092) at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40) at com.google.inject.internal.SingletonScope$1.get(SingletonScope.java:194) at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:41) at com.google.inject.internal.FactoryProxy.get(FactoryProxy.java:56) at com.google.inject.internal.SingleParameterInjector.inject(SingleParameterInjector.java:38) at com.google.inject.internal.SingleParameterInjector.getAll(SingleParameterInjector.java:62) at com.google.inject.internal.ConstructorInjector.provision(ConstructorInjector.java:110) at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:90) at com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:268) at com.google.inject.internal.ProviderToInternalFactoryAdapter$1.call(ProviderToInternalFactoryAdapter.java:46) at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1092) at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40) at com.google.inject.internal.SingletonScope$1.get(SingletonScope.java:194) at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:41) at com.google.inject.internal.SingleParameterInjector.inject(SingleParameterInjector.java:38) at com.google.inject.internal.SingleParameterInjector.getAll(SingleParameterInjector.java:62) at com.google.inject.internal.SingleMethodInjector.inject(SingleMethodInjector.java:82) at com.google.inject.internal.MembersInjectorImpl.injectMembers(MembersInjectorImpl.java:132) at com.google.inject.internal.MembersInjectorImpl$1.call(MembersInjectorImpl.java:93) at com.google.inject.internal.MembersInjectorImpl$1.call(MembersInjectorImpl.java:80) at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1092) at com.google.inject.internal.MembersInjectorImpl.injectAndNotify(MembersInjectorImpl.java:80) at com.google.inject.internal.Initializer$InjectableReference.get(Initializer.java:223) at com.google.inject.internal.InternalFactoryToInitializableAdapter.get(InternalFactoryToInitializableAdapter.java:45) at com.google.inject.internal.ProviderToInternalFactoryAdapter$1.call(ProviderToInternalFactoryAdapter.java:46) at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1092) at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40) at com.google.inject.internal.SingletonScope$1.get(SingletonScope.java:194) at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:41) at com.google.inject.internal.InjectorImpl$2$1.call(InjectorImpl.java:1019) at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1092) at com.google.inject.internal.InjectorImpl$2.get(InjectorImpl.java:1015) at io.druid.guice.SupplierProvider.get(SupplierProvider.java:52) at com.google.inject.internal.ProviderInternalFactory.provision(ProviderInternalFactory.java:81) at com.google.inject.internal.InternalFactoryToInitializableAdapter.provision(InternalFactoryToInitializableAdapter.java:53) at com.google.inject.internal.ProviderInternalFactory.circularGet(ProviderInternalFactory.java:61) at com.google.inject.internal.InternalFactoryToInitializableAdapter.get(InternalFactoryToInitializableAdapter.java:45) at com.google.inject.internal.SingleFieldInjector.inject(SingleFieldInjector.java:54) at com.google.inject.internal.InjectionRequestProcessor$StaticInjection$1.call(InjectionRequestProcessor.java:123) at com.google.inject.internal.InjectionRequestProcessor$StaticInjection$1.call(InjectionRequestProcessor.java:117) at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1085) at com.google.inject.internal.InjectionRequestProcessor$StaticInjection.injectMembers(InjectionRequestProcessor.java:117) at com.google.inject.internal.InjectionRequestProcessor.injectMembers(InjectionRequestProcessor.java:79) at com.google.inject.internal.InternalInjectorCreator.injectDynamically(InternalInjectorCreator.java:171) at com.google.inject.internal.InternalInjectorCreator.build(InternalInjectorCreator.java:110) at com.google.inject.Guice.createInjector(Guice.java:99) at com.google.inject.Guice.createInjector(Guice.java:73) at io.druid.guice.GuiceInjectors.makeStartupInjector(GuiceInjectors.java:61) at io.druid.indexer.HadoopDruidIndexerConfig.<clinit>(HadoopDruidIndexerConfig.java:106) at io.druid.indexer.DetermineHashedPartitionsJob$DetermineHashedPartitionsPartitioner.setConf(DetermineHashedPartitionsJob.java:415) at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:77) at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:137) at org.apache.hadoop.mapred.MapTask$NewOutputCollector.<init>(MapTask.java:714) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:782) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:347) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:174) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1730) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:168) 4) Error in custom provider, java.lang.VerifyError: Cannot inherit from final class at io.druid.jackson.JacksonModule.jsonMapper(JacksonModule.java:46) at io.druid.jackson.JacksonModule.jsonMapper(JacksonModule.java:46) while locating com.fasterxml.jackson.databind.ObjectMapper annotated with interface io.druid.guice.annotations.Json while locating com.fasterxml.jackson.databind.ObjectMapper for the 1st parameter of io.druid.guice.JsonConfigurator.<init>(JsonConfigurator.java:67) at io.druid.guice.ConfigModule.configure(ConfigModule.java:40) while locating io.druid.guice.JsonConfigurator for the 2nd parameter of io.druid.guice.JsonConfigProvider.inject(JsonConfigProvider.java:188) at io.druid.guice.JsonConfigProvider.bind(JsonConfigProvider.java:133) Caused by: java.lang.VerifyError: Cannot inherit from final class at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass(ClassLoader.java:763) at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142) at java.net.URLClassLoader.defineClass(URLClassLoader.java:467) at java.net.URLClassLoader.access$100(URLClassLoader.java:73) at java.net.URLClassLoader$1.run(URLClassLoader.java:368) at java.net.URLClassLoader$1.run(URLClassLoader.java:362) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:361) at org.apache.hadoop.util.ApplicationClassLoader.loadClass(ApplicationClassLoader.java:176) at org.apache.hadoop.util.ApplicationClassLoader.loadClass(ApplicationClassLoader.java:157) at com.fasterxml.jackson.datatype.guava.GuavaModule.setupModule(GuavaModule.java:55) at com.fasterxml.jackson.databind.ObjectMapper.registerModule(ObjectMapper.java:549) at io.druid.jackson.DefaultObjectMapper.<init>(DefaultObjectMapper.java:47) at io.druid.jackson.DefaultObjectMapper.<init>(DefaultObjectMapper.java:35) at io.druid.jackson.JacksonModule.jsonMapper(JacksonModule.java:46) at io.druid.jackson.JacksonModule$FastClassByGuice$fa1bdb70.invoke(<generated>) at com.google.inject.internal.ProviderMethod$FastClassProviderMethod.doProvision(ProviderMethod.java:264) at com.google.inject.internal.ProviderMethod$Factory.provision(ProviderMethod.java:401) at com.google.inject.internal.ProviderMethod$Factory.get(ProviderMethod.java:376) at com.google.inject.internal.ProviderToInternalFactoryAdapter$1.call(ProviderToInternalFactoryAdapter.java:46) at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1092) at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40) at com.google.inject.internal.SingletonScope$1.get(SingletonScope.java:194) at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:41) at com.google.inject.internal.FactoryProxy.get(FactoryProxy.java:56) at com.google.inject.internal.SingleParameterInjector.inject(SingleParameterInjector.java:38) at com.google.inject.internal.SingleParameterInjector.getAll(SingleParameterInjector.java:62) at com.google.inject.internal.ConstructorInjector.provision(ConstructorInjector.java:110) at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:90) at com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:268) at com.google.inject.internal.ProviderToInternalFactoryAdapter$1.call(ProviderToInternalFactoryAdapter.java:46) at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1092) at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40) at com.google.inject.internal.SingletonScope$1.get(SingletonScope.java:194) at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:41) at com.google.inject.internal.SingleParameterInjector.inject(SingleParameterInjector.java:38) at com.google.inject.internal.SingleParameterInjector.getAll(SingleParameterInjector.java:62) at com.google.inject.internal.SingleMethodInjector.inject(SingleMethodInjector.java:82) at com.google.inject.internal.MembersInjectorImpl.injectMembers(MembersInjectorImpl.java:132) at com.google.inject.internal.MembersInjectorImpl$1.call(MembersInjectorImpl.java:93) at com.google.inject.internal.MembersInjectorImpl$1.call(MembersInjectorImpl.java:80) at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1085) at com.google.inject.internal.MembersInjectorImpl.injectAndNotify(MembersInjectorImpl.java:80) at com.google.inject.internal.Initializer$InjectableReference.get(Initializer.java:223) at com.google.inject.internal.Initializer.injectAll(Initializer.java:132) at com.google.inject.internal.InternalInjectorCreator.injectDynamically(InternalInjectorCreator.java:174) at com.google.inject.internal.InternalInjectorCreator.build(InternalInjectorCreator.java:110) at com.google.inject.Guice.createInjector(Guice.java:99) at com.google.inject.Guice.createInjector(Guice.java:73) at io.druid.guice.GuiceInjectors.makeStartupInjector(GuiceInjectors.java:61) at io.druid.indexer.HadoopDruidIndexerConfig.<clinit>(HadoopDruidIndexerConfig.java:106) at io.druid.indexer.DetermineHashedPartitionsJob$DetermineHashedPartitionsPartitioner.setConf(DetermineHashedPartitionsJob.java:415) at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:77) at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:137) at org.apache.hadoop.mapred.MapTask$NewOutputCollector.<init>(MapTask.java:714) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:782) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:347) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:174) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1730) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:168) 5) Error in custom provider, java.lang.VerifyError: Cannot inherit from final class at io.druid.jackson.JacksonModule.jsonMapper(JacksonModule.java:46) at io.druid.jackson.JacksonModule.jsonMapper(JacksonModule.java:46) while locating com.fasterxml.jackson.databind.ObjectMapper annotated with interface io.druid.guice.annotations.Json while locating com.fasterxml.jackson.databind.ObjectMapper for the 1st parameter of io.druid.guice.JsonConfigurator.<init>(JsonConfigurator.java:67) at io.druid.guice.ConfigModule.configure(ConfigModule.java:40) while locating io.druid.guice.JsonConfigurator for the 2nd parameter of io.druid.guice.JsonConfigProvider.inject(JsonConfigProvider.java:188) at io.druid.guice.JsonConfigProvider.bind(JsonConfigProvider.java:133) Caused by: java.lang.VerifyError (same stack trace as error #4) 5 errors at com.google.inject.internal.Errors.throwCreationExceptionIfErrorsExist(Errors.java:470) at com.google.inject.internal.InternalInjectorCreator.injectDynamically(InternalInjectorCreator.java:176) at com.google.inject.internal.InternalInjectorCreator.build(InternalInjectorCreator.java:110) at com.google.inject.Guice.createInjector(Guice.java:99) at com.google.inject.Guice.createInjector(Guice.java:73) at io.druid.guice.GuiceInjectors.makeStartupInjector(GuiceInjectors.java:61) at io.druid.indexer.HadoopDruidIndexerConfig.<clinit>(HadoopDruidIndexerConfig.java:106) at io.druid.indexer.DetermineHashedPartitionsJob$DetermineHashedPartitionsPartitioner.setConf(DetermineHashedPartitionsJob.java:415) at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:77) at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:137) at org.apache.hadoop.mapred.MapTask$NewOutputCollector.<init>(MapTask.java:714) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:782) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:347) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:174) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1730) ... View more