Support Questions

Find answers, ask questions, and share your expertise
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Show  only  | Search instead for 
Did you mean: 
Advanced Search

Cannot Run Druid Quickstart Wikiticker Demo on HDP-2.6.4

jmedel
Contributor

Created on ‎03-29-2018 05:46 AM - edited ‎09-16-2022 06:02 AM

I installed Druid with the Derby metadata storage via Ambari, then I follow the steps on the Druid Quickstart page from Druid's documentation to test Druid on HDP 2.6.4.

I am using the default Hadoop-Based Ingestion Spec:

{

  "type" : "index_hadoop",

  "spec" : {

    "ioConfig" : {

      "type" : "hadoop",

      "inputSpec" : {

        "type" : "static",

        "paths" : "quickstart/wikiticker-2015-09-12-sampled.json"

      }

    },

    "dataSchema" : {

      "dataSource" : "wikiticker",

      "granularitySpec" : {

        "type" : "uniform",

        "segmentGranularity" : "day",

        "queryGranularity" : "none",

        "intervals" : ["2015-09-12/2015-09-13"]

      },

      "parser" : {

        "type" : "hadoopyString",

        "parseSpec" : {

          "format" : "json",

          "dimensionsSpec" : {

            "dimensions" : [

              "channel",

              "cityName",

              "comment",

              "countryIsoCode",

              "countryName",

              "isAnonymous",

              "isMinor",

              "isNew",

              "isRobot",

              "isUnpatrolled",

              "metroCode",

              "namespace",

              "page",

              "regionIsoCode",

              "regionName",

              "user"

            ]

          },

          "timestampSpec" : {

            "format" : "auto",

            "column" : "time"

          }

        }

      },

      "metricsSpec" : [

        {

          "name" : "count",

          "type" : "count"

        },

        {

          "name" : "added",

          "type" : "longSum",

          "fieldName" : "added"

        },

        {

          "name" : "deleted",

          "type" : "longSum",

          "fieldName" : "deleted"

        },

        {

          "name" : "delta",

          "type" : "longSum",

          "fieldName" : "delta"

        },

        {

          "name" : "user_unique",

          "type" : "hyperUnique",

          "fieldName" : "user"

        }

      ]

    },

    "tuningConfig" : {

      "type" : "hadoop",

      "partitionsSpec" : {

        "type" : "hashed",

        "targetPartitionSize" : 5000000

      },

      "jobProperties" : {}

    }

  }

}

and am unable to run the Wiki Demo because of 

ERROR [task-runner-0-priority-0] io.druid.indexing.overlord.ThreadPoolTaskRunner - Exception while running task[HadoopIndexTask{id=index_hadoop_wikiticker_2018-03-29T05:17:04.464Z, type=index_hadoop, dataSource=wikiticker}]
java.lang.RuntimeException: java.lang.reflect.InvocationTargetException

RuntimeException: java.lang.reflect.InvocationTargetException while running Hadoop-based Batch Ingestion Task "wikiticker".

Input Path Doesn't exist:

Caused by: java.lang.RuntimeException: org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: hdfs://sandbox-hdp.hortonworks.com:8020/user/druid/quickstart/wikiticker-2015-09-12-sampled.json.gz

Here is the full stack trace of the error:

2018-03-29T14:55:15,326 INFO [main] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties
2018-03-29T14:55:15,327 INFO [main] io.druid.guice.PropertiesModule - Loading properties from runtime.properties
2018-03-29T14:55:15,356 INFO [main] org.hibernate.validator.internal.util.Version - HV000001: Hibernate Validator 5.1.3.Final
2018-03-29T14:55:15,820 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.segment.NullValueHandlingConfig] from props[druid.null.handling.] as [io.druid.segment.NullValueHandlingConfig@6995bf68]
2018-03-29T14:55:15,878 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, directory='/usr/hdp/current/druid-middlemanager/extensions', hadoopDependenciesDir='/usr/hdp/current/druid-middlemanager/hadoop-dependencies', hadoopContainerDruidClasspath='null', addExtensionsToHadoopContainer=false, loadList=[druid-datasketches, druid-hdfs-storage, druid-kafka-indexing-service]}]
2018-03-29T14:55:15,932 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-datasketches] for class [interface io.druid.cli.CliCommandCreator]
2018-03-29T14:55:15,942 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-datasketches/druid-datasketches-0.10.1.2.6.4.0-91.jar]
2018-03-29T14:55:15,942 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-datasketches/sketches-core-0.8.4.jar]
2018-03-29T14:55:15,943 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-datasketches/memory-0.8.4.jar]
2018-03-29T14:55:15,945 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-hdfs-storage] for class [interface io.druid.cli.CliCommandCreator]
2018-03-29T14:55:15,947 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-common-2.7.3.2.6.4.0-91.jar]
2018-03-29T14:55:15,948 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/okio-1.4.0.jar]
2018-03-29T14:55:15,948 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/curator-client-2.11.0.jar]
2018-03-29T14:55:15,948 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/commons-beanutils-1.7.0.jar]
2018-03-29T14:55:15,948 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jsp-api-2.1.jar]
2018-03-29T14:55:15,948 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/snappy-java-1.0.4.1.jar]
2018-03-29T14:55:15,949 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/stax-api-1.0-2.jar]
2018-03-29T14:55:15,949 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/servlet-api-2.5.jar]
2018-03-29T14:55:15,949 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-client-2.7.3.2.6.4.0-91.jar]
2018-03-29T14:55:15,949 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-mapreduce-client-jobclient-2.7.3.2.6.4.0-91.jar]
2018-03-29T14:55:15,949 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/okhttp-2.4.0.jar]
2018-03-29T14:55:15,949 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/commons-logging-1.1.1.jar]
2018-03-29T14:55:15,949 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/api-util-1.0.0-M20.jar]
2018-03-29T14:55:15,950 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/apacheds-i18n-2.0.0-M15.jar]
2018-03-29T14:55:15,950 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/curator-recipes-2.11.0.jar]
2018-03-29T14:55:15,950 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/netty-all-4.1.11.Final.jar]
2018-03-29T14:55:15,950 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/aws-java-sdk-kms-1.10.77.jar]
2018-03-29T14:55:15,950 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/druid-hdfs-storage-0.10.1.2.6.4.0-91.jar]
2018-03-29T14:55:15,950 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/nimbus-jose-jwt-3.9.jar]
2018-03-29T14:55:15,951 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/xmlenc-0.52.jar]
2018-03-29T14:55:15,951 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/htrace-core-3.1.0-incubating.jar]
2018-03-29T14:55:15,951 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/xz-1.0.jar]
2018-03-29T14:55:15,951 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/commons-beanutils-core-1.8.0.jar]
2018-03-29T14:55:15,951 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/gson-2.2.4.jar]
2018-03-29T14:55:15,951 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jackson-core-2.4.6.jar]
2018-03-29T14:55:15,952 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/azure-storage-5.4.0.jar]
2018-03-29T14:55:15,952 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/curator-framework-2.11.0.jar]
2018-03-29T14:55:15,952 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-mapreduce-client-core-2.7.3.2.6.4.0-91.jar]
2018-03-29T14:55:15,952 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jackson-xc-1.9.13.jar]
2018-03-29T14:55:15,952 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/commons-configuration-1.6.jar]
2018-03-29T14:55:15,952 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jackson-dataformat-cbor-2.5.3.jar]
2018-03-29T14:55:15,952 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-yarn-api-2.7.3.2.6.4.0-91.jar]
2018-03-29T14:55:15,953 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-yarn-client-2.7.3.2.6.4.0-91.jar]
2018-03-29T14:55:15,953 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/aws-java-sdk-core-1.10.77.jar]
2018-03-29T14:55:15,953 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-hdfs-2.7.3.2.6.4.0-91.jar]
2018-03-29T14:55:15,953 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-yarn-registry-2.7.3.2.6.4.0-91.jar]
2018-03-29T14:55:15,953 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/azure-keyvault-core-0.8.0.jar]
2018-03-29T14:55:15,953 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-yarn-common-2.7.3.2.6.4.0-91.jar]
2018-03-29T14:55:15,954 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/api-asn1-api-1.0.0-M20.jar]
2018-03-29T14:55:15,954 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-yarn-server-common-2.7.3.2.6.4.0-91.jar]
2018-03-29T14:55:15,954 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/commons-lang3-3.4.jar]
2018-03-29T14:55:15,954 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-auth-2.7.3.2.6.4.0-91.jar]
2018-03-29T14:55:15,954 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/commons-net-3.1.jar]
2018-03-29T14:55:15,954 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/paranamer-2.3.jar]
2018-03-29T14:55:15,954 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jersey-client-1.9.jar]
2018-03-29T14:55:15,954 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-mapreduce-client-common-2.7.3.2.6.4.0-91.jar]
2018-03-29T14:55:15,955 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/avro-1.7.4.jar]
2018-03-29T14:55:15,955 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jackson-databind-2.4.6.jar]
2018-03-29T14:55:15,955 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jaxb-api-2.2.2.jar]
2018-03-29T14:55:15,955 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jackson-annotations-2.4.6.jar]
2018-03-29T14:55:15,955 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/httpclient-4.5.1.jar]
2018-03-29T14:55:15,955 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jackson-jaxrs-1.9.13.jar]
2018-03-29T14:55:15,956 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/xml-apis-1.3.04.jar]
2018-03-29T14:55:15,956 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/commons-compress-1.4.1.jar]
2018-03-29T14:55:15,956 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/xercesImpl-2.9.1.jar]
2018-03-29T14:55:15,956 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/joda-time-2.9.9.jar]
2018-03-29T14:55:15,956 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jetty-sslengine-6.1.26.hwx.jar]
2018-03-29T14:55:15,956 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/commons-digester-1.8.jar]
2018-03-29T14:55:15,957 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-aws-2.7.3.2.6.4.0-91.jar]
2018-03-29T14:55:15,957 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/json-smart-1.1.1.jar]
2018-03-29T14:55:15,957 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/apacheds-kerberos-codec-2.0.0-M15.jar]
2018-03-29T14:55:15,957 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/netty-3.6.2.Final.jar]
2018-03-29T14:55:15,957 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/aws-java-sdk-s3-1.10.77.jar]
2018-03-29T14:55:15,957 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/httpcore-4.4.3.jar]
2018-03-29T14:55:15,958 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/guava-16.0.1.jar]
2018-03-29T14:55:15,958 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-mapreduce-client-shuffle-2.7.3.2.6.4.0-91.jar]
2018-03-29T14:55:15,958 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/commons-collections-3.2.2.jar]
2018-03-29T14:55:15,958 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-mapreduce-client-app-2.7.3.2.6.4.0-91.jar]
2018-03-29T14:55:15,958 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jcip-annotations-1.0.jar]
2018-03-29T14:55:15,958 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/commons-math3-3.6.1.jar]
2018-03-29T14:55:15,958 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/leveldbjni-all-1.8.jar]
2018-03-29T14:55:15,975 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-kafka-indexing-service] for class [interface io.druid.cli.CliCommandCreator]
2018-03-29T14:55:15,976 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-kafka-indexing-service/snappy-java-1.1.2.6.jar]
2018-03-29T14:55:15,976 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-kafka-indexing-service/slf4j-api-1.6.4.jar]
2018-03-29T14:55:15,976 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-kafka-indexing-service/druid-kafka-indexing-service-0.10.1.2.6.4.0-91.jar]
2018-03-29T14:55:15,976 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-kafka-indexing-service/lz4-1.3.0.jar]
2018-03-29T14:55:15,976 INFO [main] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-kafka-indexing-service/kafka-clients-0.10.2.0.jar]
2018-03-29T14:55:16,059 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ModulesConfig] from props[druid.modules.] as [ModulesConfig{excludeList=[]}]
2018-03-29T14:55:16,204 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-datasketches] for class [interface io.druid.initialization.DruidModule]
2018-03-29T14:55:16,208 INFO [main] io.druid.initialization.Initialization - Adding implementation [io.druid.query.aggregation.datasketches.theta.SketchModule] for class [interface io.druid.initialization.DruidModule] from local file system extension
2018-03-29T14:55:16,209 INFO [main] io.druid.initialization.Initialization - Adding implementation [io.druid.query.aggregation.datasketches.theta.oldapi.OldApiSketchModule] for class [interface io.druid.initialization.DruidModule] from local file system extension
2018-03-29T14:55:16,209 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-hdfs-storage] for class [interface io.druid.initialization.DruidModule]
2018-03-29T14:55:16,211 INFO [main] io.druid.initialization.Initialization - Adding implementation [io.druid.storage.hdfs.HdfsStorageDruidModule] for class [interface io.druid.initialization.DruidModule] from local file system extension
2018-03-29T14:55:16,211 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-kafka-indexing-service] for class [interface io.druid.initialization.DruidModule]
2018-03-29T14:55:16,212 INFO [main] io.druid.initialization.Initialization - Adding implementation [io.druid.indexing.kafka.KafkaIndexTaskModule] for class [interface io.druid.initialization.DruidModule] from local file system extension
2018-03-29T14:55:17,032 WARN [main] org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2018-03-29T14:55:18,026 WARN [main] org.apache.hadoop.hdfs.shortcircuit.DomainSocketFactory - The short-circuit local reads feature cannot be used because libhadoop cannot be loaded.
2018-03-29T14:55:18,637 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.DruidMonitorSchedulerConfig] from props[druid.monitoring.] as [io.druid.server.metrics.DruidMonitorSchedulerConfig@24eeac69]
2018-03-29T14:55:18,647 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.MonitorsConfig] from props[druid.monitoring.] as [MonitorsConfig{monitors=[class com.metamx.metrics.JvmMonitor]}]
2018-03-29T14:55:18,670 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.DruidNode] from props[druid.] as [DruidNode{serviceName='druid/middlemanager', host='sandbox-hdp.hortonworks.com', port=8100}]
2018-03-29T14:55:18,781 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.lookup.LookupConfig] from props[druid.lookup.] as [LookupConfig{snapshotWorkingDir=''}]
2018-03-29T14:55:18,845 INFO [main] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties
2018-03-29T14:55:18,846 INFO [main] io.druid.guice.PropertiesModule - Loading properties from runtime.properties
2018-03-29T14:55:18,855 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.segment.NullValueHandlingConfig] from props[druid.null.handling.] as [io.druid.segment.NullValueHandlingConfig@10b4e7f8]
2018-03-29T14:55:18,861 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, directory='/usr/hdp/current/druid-middlemanager/extensions', hadoopDependenciesDir='/usr/hdp/current/druid-middlemanager/hadoop-dependencies', hadoopContainerDruidClasspath='null', addExtensionsToHadoopContainer=false, loadList=[druid-datasketches, druid-hdfs-storage, druid-kafka-indexing-service]}]
2018-03-29T14:55:18,865 INFO [main] io.druid.server.metrics.MetricsModule - Adding monitor[com.metamx.metrics.JvmMonitor@4e224df5]
2018-03-29T14:55:18,866 INFO [main] io.druid.server.metrics.MetricsModule - Adding monitor[io.druid.query.ExecutorServiceMonitor@4dd90166]
2018-03-29T14:55:18,868 INFO [main] io.druid.server.metrics.MetricsModule - Adding monitor[io.druid.server.initialization.jetty.JettyServerModule$JettyMonitor@a146b11]
2018-03-29T14:55:18,875 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.log.StartupLoggingConfig] from props[druid.startup.logging.] as [io.druid.server.log.StartupLoggingConfig@20580d4e]
2018-03-29T14:55:18,875 INFO [main] io.druid.cli.CliPeon - Starting up with processors[4], memory[316,145,664], maxMemory[1,908,932,608].
2018-03-29T14:55:18,878 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.storage.hdfs.HdfsKerberosConfig] from props[druid.hadoop.security.kerberos.] as [io.druid.storage.hdfs.HdfsKerberosConfig@0]
2018-03-29T14:55:18,885 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.indexing.common.config.TaskConfig] from props[druid.indexer.task.] as [io.druid.indexing.common.config.TaskConfig@76536c53]
2018-03-29T14:55:18,888 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.http.DruidHttpClientConfig] from props[druid.global.http.] as [io.druid.guice.http.DruidHttpClientConfig@75fd65c]
2018-03-29T14:55:18,965 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.indexing.IndexingServiceSelectorConfig] from props[druid.selectors.indexing.] as [io.druid.client.indexing.IndexingServiceSelectorConfig@1f43cab7]
2018-03-29T14:55:18,968 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.curator.CuratorConfig] from props[druid.zk.service.] as [io.druid.curator.CuratorConfig@a6e4897]
2018-03-29T14:55:18,972 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.curator.ExhibitorConfig] from props[druid.exhibitor.service.] as [io.druid.curator.ExhibitorConfig@91da29b]
2018-03-29T14:55:18,977 WARN [main] org.apache.curator.retry.ExponentialBackoffRetry - maxRetries too large (30). Pinning to 29
2018-03-29T14:55:19,003 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.CuratorDiscoveryConfig] from props[druid.discovery.curator.] as [io.druid.server.initialization.CuratorDiscoveryConfig@4aa2877c]
2018-03-29T14:55:19,031 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.indexing.common.RetryPolicyConfig] from props[druid.peon.taskActionClient.retry.] as [io.druid.indexing.common.RetryPolicyConfig@545b5ed0]
2018-03-29T14:55:19,034 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.storage.hdfs.HdfsDataSegmentPusherConfig] from props[druid.storage.] as [io.druid.storage.hdfs.HdfsDataSegmentPusherConfig@abad89c]
2018-03-29T14:55:19,036 INFO [main] io.druid.storage.hdfs.HdfsDataSegmentPusher - Configured HDFS as deep storage
2018-03-29T14:55:19,040 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.segment.loading.LocalDataSegmentPusherConfig] from props[druid.storage.] as [io.druid.segment.loading.LocalDataSegmentPusherConfig@3c232051]
2018-03-29T14:55:19,046 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.DruidServerConfig] from props[druid.server.] as [io.druid.client.DruidServerConfig@4c3de38e]
2018-03-29T14:55:19,051 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.BatchDataSegmentAnnouncerConfig] from props[druid.announcer.] as [io.druid.server.initialization.BatchDataSegmentAnnouncerConfig@1983b48a]
2018-03-29T14:55:19,055 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.ZkPathsConfig] from props[druid.zk.paths.] as [io.druid.server.initialization.ZkPathsConfig@22e2266d]
2018-03-29T14:55:19,062 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.server.coordination.DataSegmentAnnouncerProvider] from props[druid.announcer.] as [io.druid.server.coordination.BatchDataSegmentAnnouncerProvider@5d878b25]
2018-03-29T14:55:19,065 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.coordinator.CoordinatorSelectorConfig] from props[druid.selectors.coordinator.] as [io.druid.client.coordinator.CoordinatorSelectorConfig@4e245739]
2018-03-29T14:55:19,068 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.segment.realtime.plumber.CoordinatorBasedSegmentHandoffNotifierConfig] from props[druid.segment.handoff.] as [io.druid.segment.realtime.plumber.CoordinatorBasedSegmentHandoffNotifierConfig@691124ee]
2018-03-29T14:55:19,070 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning value [50000000] for [druid.processing.buffer.sizeBytes] on [io.druid.query.DruidProcessingConfig#intermediateComputeSizeBytes()]
2018-03-29T14:55:19,073 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.computation.buffer.poolCacheMaxCount, ${base_path}.buffer.poolCacheMaxCount] on [io.druid.query.DruidProcessingConfig#poolCacheMaxCount()]
2018-03-29T14:55:19,074 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.tmpDir] on [io.druid.query.DruidProcessingConfig#getTmpDir()]
2018-03-29T14:55:19,074 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.fifo] on [io.druid.query.DruidProcessingConfig#isFifo()]
2018-03-29T14:55:19,075 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning value [2] for [druid.processing.numThreads] on [io.druid.query.DruidProcessingConfig#getNumThreadsConfigured()]
2018-03-29T14:55:19,075 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.numMergeBuffers] on [io.druid.query.DruidProcessingConfig#getNumMergeBuffersConfigured()]
2018-03-29T14:55:19,075 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.columnCache.sizeBytes] on [io.druid.query.DruidProcessingConfig#columnCacheSizeBytes()]
2018-03-29T14:55:19,075 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning default value [processing-%s] for [${base_path}.formatString] on [io.druid.java.util.common.concurrent.ExecutorServiceConfig#getFormatString()]
2018-03-29T14:55:19,156 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.client.cache.CacheProvider] from props[druid.cache.] as [io.druid.client.cache.LocalCacheProvider@5c059a68]
2018-03-29T14:55:19,167 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.cache.CacheConfig] from props[druid.realtime.cache.] as [io.druid.client.cache.CacheConfig@63a9c661]
2018-03-29T14:55:19,178 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.ServerConfig] from props[druid.server.http.] as [ServerConfig{numThreads=50, maxIdleTime=PT5M, defaultQueryTimeout=300000, maxScatterGatherBytes=9223372036854775807}]
2018-03-29T14:55:19,187 INFO [main] org.eclipse.jetty.util.log - Logging initialized @4760ms
2018-03-29T14:55:19,321 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.search.search.SearchQueryConfig] from props[druid.query.search.] as [io.druid.query.search.search.SearchQueryConfig@601eb4af]
2018-03-29T14:55:19,328 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.metadata.SegmentMetadataQueryConfig] from props[druid.query.segmentMetadata.] as [io.druid.query.metadata.SegmentMetadataQueryConfig@35cec305]
2018-03-29T14:55:19,335 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.groupby.GroupByQueryConfig] from props[druid.query.groupBy.] as [GroupByQueryConfig{defaultStrategy='v2', singleThreaded=false, maxIntermediateRows=50000, maxResults=500000, bufferGrouperMaxSize=2147483647, bufferGrouperMaxLoadFactor=0.0, bufferGrouperInitialBuckets=0, maxMergingDictionarySize=100000000, maxOnDiskStorage=0, forcePushDownLimit=false, forceHashAggregation=false}]
2018-03-29T14:55:19,381 INFO [main] io.druid.offheap.OffheapBufferGenerator - Allocating new intermediate processing buffer[0] of size[50,000,000]
2018-03-29T14:55:19,421 INFO [main] io.druid.offheap.OffheapBufferGenerator - Allocating new intermediate processing buffer[1] of size[50,000,000]
2018-03-29T14:55:19,462 INFO [main] io.druid.offheap.OffheapBufferGenerator - Allocating new result merging buffer[0] of size[50,000,000]
2018-03-29T14:55:19,503 INFO [main] io.druid.offheap.OffheapBufferGenerator - Allocating new result merging buffer[1] of size[50,000,000]
2018-03-29T14:55:19,550 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.scan.ScanQueryConfig] from props[druid.query.scan.] as [ScanQueryConfig{legacy=false}]
2018-03-29T14:55:19,552 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.select.SelectQueryConfig] from props[druid.query.select.] as [io.druid.query.select.SelectQueryConfig@380ce5a3]
2018-03-29T14:55:19,554 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.topn.TopNQueryConfig] from props[druid.query.topN.] as [io.druid.query.topn.TopNQueryConfig@7ca492d9]
2018-03-29T14:55:19,556 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.server.log.RequestLoggerProvider] from props[druid.request.logging.] as [io.druid.server.log.NoopRequestLoggerProvider@7f2c57fe]
2018-03-29T14:55:19,559 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.security.AuthConfig] from props[druid.auth.] as [AuthConfig{enabled=false}]
2018-03-29T14:55:19,572 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.lookup.LookupListeningAnnouncerConfig] from props[druid.lookup.] as [ListeningAnnouncerConfig{listenersPath='/druid/listeners'}]
2018-03-29T14:55:19,574 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner.start()] on object[io.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner@4f081b5d].
2018-03-29T14:55:19,575 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.emitter.service.ServiceEmitter.start()] on object[com.metamx.emitter.service.ServiceEmitter@5b2b8d86].
2018-03-29T14:55:19,576 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.query.lookup.LookupReferencesManager.start()] on object[io.druid.query.lookup.LookupReferencesManager@19827608].
2018-03-29T14:55:19,577 INFO [main] io.druid.query.lookup.LookupReferencesManager - LookupReferencesManager is starting.
2018-03-29T14:55:19,577 INFO [main] io.druid.query.lookup.LookupReferencesManager - LookupReferencesManager is started.
2018-03-29T14:55:19,578 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.metrics.MonitorScheduler.start()] on object[com.metamx.metrics.MonitorScheduler@450f0235].
2018-03-29T14:55:19,594 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.storage.hdfs.HdfsStorageAuthentication.authenticate()] on object[io.druid.storage.hdfs.HdfsStorageAuthentication@7aea704c].
2018-03-29T14:55:19,595 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.http.client.NettyHttpClient.start()] on object[com.metamx.http.client.NettyHttpClient@339f3a55].
2018-03-29T14:55:19,595 INFO [main] io.druid.curator.CuratorModule - Starting Curator
2018-03-29T14:55:19,595 INFO [main] org.apache.curator.framework.imps.CuratorFrameworkImpl - Starting
2018-03-29T14:55:19,617 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:zookeeper.version=3.4.6-91--1, built on 01/04/2018 09:27 GMT
2018-03-29T14:55:19,617 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:host.name=sandbox-hdp.hortonworks.com
2018-03-29T14:55:19,617 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.version=1.8.0_161
2018-03-29T14:55:19,617 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.vendor=Oracle Corporation
2018-03-29T14:55:19,617 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.161-3.b14.el6_9.x86_64/jre
2018-03-29T14:55:19,617 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.class.path=/usr/hdp/current/druid-middlemanager/conf/_common:/usr/hdp/current/druid-middlemanager/conf/middleManager:/usr/hdp/current/druid-middlemanager/lib/antlr4-runtime-4.5.1.jar:/usr/hdp/current/druid-middlemanager/lib/druid-sql-0.10.1.2.6.4.0-91.jar:/usr/hdp/current/druid-middlemanager/lib/plexus-interpolation-1.19.jar:/usr/hdp/current/druid-middlemanager/lib/guice-servlet-4.1.0.jar:/usr/hdp/current/druid-middlemanager/lib/jackson-jaxrs-smile-provider-2.4.6.jar:/usr/hdp/current/druid-middlemanager/lib/curator-client-2.11.0.jar:/usr/hdp/current/druid-middlemanager/lib/tesla-aether-0.0.5.jar:/usr/hdp/current/druid-middlemanager/lib/wagon-provider-api-2.4.jar:/usr/hdp/current/druid-middlemanager/lib/extendedset-0.10.1.2.6.4.0-91.jar:/usr/hdp/current/druid-middlemanager/lib/jackson-dataformat-smile-2.4.6.jar:/usr/hdp/current/druid-middlemanager/lib/maven-model-3.1.1.jar:/usr/hdp/current/druid-middlemanager/lib/json-path-2.1.0.jar:/usr/hdp/current/druid-middlemanager/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/druid-middlemanager/lib/commons-compiler-2.7.6.jar:/usr/hdp/current/druid-middlemanager/lib/log4j-api-2.5.jar:/usr/hdp/current/druid-middlemanager/lib/jcl-over-slf4j-1.7.12.jar:/usr/hdp/current/druid-middlemanager/lib/druid-server-0.10.1.2.6.4.0-91.jar:/usr/hdp/current/druid-middlemanager/lib/jetty-proxy-9.3.19.v20170502.jar:/usr/hdp/current/druid-middlemanager/lib/commons-pool-1.6.jar:/usr/hdp/current/druid-middlemanager/lib/jsr311-api-1.1.1.jar:/usr/hdp/current/druid-middlemanager/lib/jsr305-2.0.1.jar:/usr/hdp/current/druid-middlemanager/lib/druid-indexing-service-0.10.1.2.6.4.0-91.jar:/usr/hdp/current/druid-middlemanager/lib/commons-logging-1.1.1.jar:/usr/hdp/current/druid-middlemanager/lib/okhttp-1.0.2.jar:/usr/hdp/current/druid-middlemanager/lib/RoaringBitmap-0.5.18.jar:/usr/hdp/current/druid-middlemanager/lib/http-client-1.1.0.jar:/usr/hdp/current/druid-middlemanager/lib/curator-recipes-2.11.0.jar:/usr/hdp/current/druid-middlemanager/lib/aopalliance-1.0.jar:/usr/hdp/current/druid-middlemanager/lib/netty-all-4.1.11.Final.jar:/usr/hdp/current/druid-middlemanager/lib/derbyclient-10.11.1.1.jar:/usr/hdp/current/druid-middlemanager/lib/bytebuffer-collections-0.10.1.2.6.4.0-91.jar:/usr/hdp/current/druid-middlemanager/lib/protobuf-java-3.1.0.jar:/usr/hdp/current/druid-middlemanager/lib/aether-spi-0.9.0.M2.jar:/usr/hdp/current/druid-middlemanager/lib/derbynet-10.11.1.1.jar:/usr/hdp/current/druid-middlemanager/lib/compress-lzf-1.0.3.jar:/usr/hdp/current/druid-middlemanager/lib/disruptor-3.3.6.jar:/usr/hdp/current/druid-middlemanager/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/druid-middlemanager/lib/maven-settings-3.1.1.jar:/usr/hdp/current/druid-middlemanager/lib/bcprov-jdk15on-1.52.jar:/usr/hdp/current/druid-middlemanager/lib/classmate-1.0.0.jar:/usr/hdp/current/druid-middlemanager/lib/opencsv-2.3.jar:/usr/hdp/current/druid-middlemanager/lib/druid-aws-common-0.10.1.2.6.4.0-91.jar:/usr/hdp/current/druid-middlemanager/lib/aws-java-sdk-ec2-1.10.77.jar:/usr/hdp/current/druid-middlemanager/lib/druid-services-0.10.1.2.6.4.0-91.jar:/usr/hdp/current/druid-middlemanager/lib/javax.inject-1.jar:/usr/hdp/current/druid-middlemanager/lib/jackson-datatype-joda-2.4.6.jar:/usr/hdp/current/druid-middlemanager/lib/commons-dbcp-1.4.jar:/usr/hdp/current/druid-middlemanager/lib/jackson-datatype-guava-2.4.6.jar:/usr/hdp/current/druid-middlemanager/lib/jackson-core-2.4.6.jar:/usr/hdp/current/druid-middlemanager/lib/jline-0.9.94.jar:/usr/hdp/current/druid-middlemanager/lib/base64-2.3.8.jar:/usr/hdp/current/druid-middlemanager/lib/calcite-core-1.12.0.jar:/usr/hdp/current/druid-middlemanager/lib/mapdb-1.0.8.jar:/usr/hdp/current/druid-middlemanager/lib/curator-framework-2.11.0.jar:/usr/hdp/current/druid-middlemanager/lib/log4j-core-2.5.jar:/usr/hdp/current/druid-middlemanager/lib/jetty-servlets-9.3.19.v20170502.jar:/usr/hdp/current/druid-middlemanager/lib/druid-console-0.0.2.jar:/usr/hdp/current/druid-middlemanager/lib/maven-model-builder-3.1.1.jar:/usr/hdp/current/druid-middlemanager/lib/config-magic-0.9.jar:/usr/hdp/current/druid-middlemanager/lib/emitter-0.4.5.jar:/usr/hdp/current/druid-middlemanager/lib/slf4j-api-1.6.4.jar:/usr/hdp/current/druid-middlemanager/lib/jboss-logging-3.1.3.GA.jar:/usr/hdp/current/druid-middlemanager/lib/commons-cli-1.2.jar:/usr/hdp/current/druid-middlemanager/lib/guice-4.1.0.jar:/usr/hdp/current/druid-middlemanager/lib/druid-common-0.10.1.2.6.4.0-91.jar:/usr/hdp/current/druid-middlemanager/lib/jackson-dataformat-cbor-2.5.3.jar:/usr/hdp/current/druid-middlemanager/lib/derby-10.11.1.1.jar:/usr/hdp/current/druid-middlemanager/lib/aether-api-0.9.0.M2.jar:/usr/hdp/current/druid-middlemanager/lib/commons-io-2.5.jar:/usr/hdp/current/druid-middlemanager/lib/netty-3.10.6.Final.jar:/usr/hdp/current/druid-middlemanager/lib/javax.el-3.0.0.jar:/usr/hdp/current/druid-middlemanager/lib/janino-2.7.6.jar:/usr/hdp/current/druid-middlemanager/lib/plexus-utils-3.0.15.jar:/usr/hdp/current/druid-middlemanager/lib/jackson-jaxrs-base-2.4.6.jar:/usr/hdp/current/druid-middlemanager/lib/aws-java-sdk-core-1.10.77.jar:/usr/hdp/current/druid-middlemanager/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/druid-middlemanager/lib/log4j-1.2-api-2.5.jar:/usr/hdp/current/druid-middlemanager/lib/avatica-core-1.9.0.jar:/usr/hdp/current/druid-middlemanager/lib/aether-impl-0.9.0.M2.jar:/usr/hdp/current/druid-middlemanager/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/druid-middlemanager/lib/spymemcached-2.12.3.jar:/usr/hdp/current/druid-middlemanager/lib/maven-aether-provider-3.1.1.jar:/usr/hdp/current/druid-middlemanager/lib/aggdesigner-algorithm-6.0.jar:/usr/hdp/current/druid-middlemanager/lib/aether-connector-okhttp-0.0.9.jar:/usr/hdp/current/druid-middlemanager/lib/commons-pool2-2.2.jar:/usr/hdp/current/druid-middlemanager/lib/jackson-databind-2.4.6.jar:/usr/hdp/current/druid-middlemanager/lib/asm-tree-5.2.jar:/usr/hdp/current/druid-middlemanager/lib/jetty-continuation-9.3.19.v20170502.jar:/usr/hdp/current/druid-middlemanager/lib/java-util-0.28.2.jar:/usr/hdp/current/druid-middlemanager/lib/maven-repository-metadata-3.1.1.jar:/usr/hdp/current/druid-middlemanager/lib/jackson-annotations-2.4.6.jar:/usr/hdp/current/druid-middlemanager/lib/calcite-linq4j-1.12.0.jar:/usr/hdp/current/druid-middlemanager/lib/jersey-servlet-1.19.3.jar:/usr/hdp/current/druid-middlemanager/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/druid-middlemanager/lib/asm-5.2.jar:/usr/hdp/current/druid-middlemanager/lib/asm-commons-5.2.jar:/usr/hdp/current/druid-middlemanager/lib/httpclient-4.5.1.jar:/usr/hdp/current/druid-middlemanager/lib/lz4-1.3.0.jar:/usr/hdp/current/druid-middlemanager/lib/avatica-metrics-1.9.0.jar:/usr/hdp/current/druid-middlemanager/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/druid-middlemanager/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/druid-middlemanager/lib/log4j-slf4j-impl-2.5.jar:/usr/hdp/current/druid-middlemanager/lib/javax.el-api-3.0.0.jar:/usr/hdp/current/druid-middlemanager/lib/irc-api-1.0-0014.jar:/usr/hdp/current/druid-middlemanager/lib/java-util-0.10.1.2.6.4.0-91.jar:/usr/hdp/current/druid-middlemanager/lib/jersey-guice-1.19.3.jar:/usr/hdp/current/druid-middlemanager/lib/activation-1.1.1.jar:/usr/hdp/current/druid-middlemanager/lib/druid-indexing-hadoop-0.10.1.2.6.4.0-91.jar:/usr/hdp/current/druid-middlemanager/lib/commons-lang-2.6.jar:/usr/hdp/current/druid-middlemanager/lib/jersey-server-1.19.3.jar:/usr/hdp/current/druid-middlemanager/lib/aether-connector-file-0.9.0.M2.jar:/usr/hdp/current/druid-middlemanager/lib/geoip2-0.4.0.jar:/usr/hdp/current/druid-middlemanager/lib/joda-time-2.9.9.jar:/usr/hdp/current/druid-middlemanager/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/druid-middlemanager/lib/druid-hll-0.10.1.2.6.4.0-91.jar:/usr/hdp/current/druid-middlemanager/lib/guice-multibindings-4.1.0.jar:/usr/hdp/current/druid-middlemanager/lib/curator-x-discovery-2.11.0.jar:/usr/hdp/current/druid-middlemanager/lib/druid-api-0.10.1.2.6.4.0-91.jar:/usr/hdp/current/druid-middlemanager/lib/commons-lang3-3.2.jar:/usr/hdp/current/druid-middlemanager/lib/maxminddb-0.2.0.jar:/usr/hdp/current/druid-middlemanager/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/druid-middlemanager/lib/maven-settings-builder-3.1.1.jar:/usr/hdp/current/druid-middlemanager/lib/jdbi-2.63.1.jar:/usr/hdp/current/druid-middlemanager/lib/aether-util-0.9.0.M2.jar:/usr/hdp/current/druid-middlemanager/lib/icu4j-54.1.1.jar:/usr/hdp/current/druid-middlemanager/lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/druid-middlemanager/lib/jets3t-0.9.4.jar:/usr/hdp/current/druid-middlemanager/lib/jackson-module-jaxb-annotations-2.4.6.jar:/usr/hdp/current/druid-middlemanager/lib/server-metrics-0.2.8.jar:/usr/hdp/current/druid-middlemanager/lib/jetty-client-9.3.19.v20170502.jar:/usr/hdp/current/druid-middlemanager/lib/avatica-server-1.9.0.jar:/usr/hdp/current/druid-middlemanager/lib/httpcore-4.4.3.jar:/usr/hdp/current/druid-middlemanager/lib/airline-0.7.jar:/usr/hdp/current/druid-middlemanager/lib/jackson-jaxrs-json-provider-2.4.6.jar:/usr/hdp/current/druid-middlemanager/lib/druid-processing-0.10.1.2.6.4.0-91.jar:/usr/hdp/current/druid-middlemanager/lib/zookeeper-3.4.6.2.6.4.0-91.jar:/usr/hdp/current/druid-middlemanager/lib/guava-16.0.1.jar:/usr/hdp/current/druid-middlemanager/lib/commons-codec-1.7.jar:/usr/hdp/current/druid-middlemanager/lib/jersey-core-1.19.3.jar:/usr/hdp/current/druid-middlemanager/lib/commons-dbcp2-2.0.1.jar:/usr/hdp/current/druid-middlemanager/lib/hibernate-validator-5.1.3.Final.jar:/usr/hdp/current/druid-middlemanager/lib/java-xmlbuilder-1.1.jar:/usr/hdp/current/druid-middlemanager/lib/commons-math3-3.6.1.jar:/usr/hdp/current/druid-middlemanager/lib/rhino-1.7R5.jar:/usr/hdp/current/druid-middlemanager/lib/log4j-jul-2.5.jar:/usr/hdp/current/druid-middlemanager/lib/fastutil-7.2.0.jar:/usr/hdp/2.6.4.0-91/hadoop/conf
2018-03-29T14:55:19,617 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
2018-03-29T14:55:19,617 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.io.tmpdir=/tmp
2018-03-29T14:55:19,617 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.compiler=<NA>
2018-03-29T14:55:19,617 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.name=Linux
2018-03-29T14:55:19,617 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.arch=amd64
2018-03-29T14:55:19,617 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.version=4.4.114-1.el7.elrepo.x86_64
2018-03-29T14:55:19,618 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.name=druid
2018-03-29T14:55:19,618 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.home=/home/druid
2018-03-29T14:55:19,618 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.dir=/home/druid
2018-03-29T14:55:19,619 INFO [main] org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=sandbox-hdp.hortonworks.com:2181 sessionTimeout=30000 watcher=org.apache.curator.ConnectionState@280fafd
2018-03-29T14:55:19,638 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.curator.discovery.ServerDiscoverySelector.start() throws java.lang.Exception] on object[io.druid.curator.discovery.ServerDiscoverySelector@44bc2449].
2018-03-29T14:55:19,641 INFO [main-SendThread(sandbox-hdp.hortonworks.com:2181)] org.apache.zookeeper.ClientCnxn - Opening socket connection to server sandbox-hdp.hortonworks.com/172.17.0.2:2181. Will not attempt to authenticate using SASL (unknown error)
2018-03-29T14:55:19,649 INFO [main-SendThread(sandbox-hdp.hortonworks.com:2181)] org.apache.zookeeper.ClientCnxn - Socket connection established, initiating session, client: /172.17.0.2:46682, server: sandbox-hdp.hortonworks.com/172.17.0.2:2181
2018-03-29T14:55:19,659 INFO [main-SendThread(sandbox-hdp.hortonworks.com:2181)] org.apache.zookeeper.ClientCnxn - Session establishment complete on server sandbox-hdp.hortonworks.com/172.17.0.2:2181, sessionid = 0x16271e552860016, negotiated timeout = 30000
2018-03-29T14:55:19,663 INFO [main-EventThread] org.apache.curator.framework.state.ConnectionStateManager - State change: CONNECTED
2018-03-29T14:55:19,789 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.curator.announcement.Announcer.start()] on object[io.druid.curator.announcement.Announcer@69796bd0].
2018-03-29T14:55:19,789 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.curator.discovery.ServerDiscoverySelector.start() throws java.lang.Exception] on object[io.druid.curator.discovery.ServerDiscoverySelector@40df6090].
2018-03-29T14:55:19,806 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.indexing.worker.executor.ExecutorLifecycle.start() throws java.lang.InterruptedException] on object[io.druid.indexing.worker.executor.ExecutorLifecycle@1b37fbec].
2018-03-29T14:55:19,854 INFO [main] io.druid.indexing.worker.executor.ExecutorLifecycle - Running with task: {
  "type" : "index_hadoop",
  "id" : "index_hadoop_wikiticker_2018-03-29T14:55:14.270Z",
  "spec" : {
    "dataSchema" : {
      "dataSource" : "wikiticker",
      "parser" : {
        "type" : "hadoopyString",
        "parseSpec" : {
          "format" : "json",
          "dimensionsSpec" : {
            "dimensions" : [ "channel", "cityName", "comment", "countryIsoCode", "countryName", "isAnonymous", "isMinor", "isNew", "isRobot", "isUnpatrolled", "metroCode", "namespace", "page", "regionIsoCode", "regionName", "user" ]
          },
          "timestampSpec" : {
            "format" : "auto",
            "column" : "time"
          }
        }
      },
      "metricsSpec" : [ {
        "type" : "count",
        "name" : "count"
      }, {
        "type" : "longSum",
        "name" : "added",
        "fieldName" : "added",
        "expression" : null
      }, {
        "type" : "longSum",
        "name" : "deleted",
        "fieldName" : "deleted",
        "expression" : null
      }, {
        "type" : "longSum",
        "name" : "delta",
        "fieldName" : "delta",
        "expression" : null
      }, {
        "type" : "hyperUnique",
        "name" : "user_unique",
        "fieldName" : "user",
        "isInputHyperUnique" : false,
        "round" : false
      } ],
      "granularitySpec" : {
        "type" : "uniform",
        "segmentGranularity" : "DAY",
        "queryGranularity" : {
          "type" : "none"
        },
        "rollup" : true,
        "intervals" : [ "2015-09-12T00:00:00.000Z/2015-09-13T00:00:00.000Z" ]
      }
    },
    "ioConfig" : {
      "type" : "hadoop",
      "inputSpec" : {
        "type" : "static",
        "paths" : "quickstart/wikiticker-2015-09-12-sampled.json.gz"
      },
      "metadataUpdateSpec" : null,
      "segmentOutputPath" : null
    },
    "tuningConfig" : {
      "type" : "hadoop",
      "workingPath" : null,
      "version" : "2018-03-29T14:55:14.250Z",
      "partitionsSpec" : {
        "type" : "hashed",
        "targetPartitionSize" : 5000000,
        "maxPartitionSize" : 7500000,
        "assumeGrouped" : false,
        "numShards" : -1,
        "partitionDimensions" : [ ]
      },
      "shardSpecs" : { },
      "indexSpec" : {
        "bitmap" : {
          "type" : "concise"
        },
        "dimensionCompression" : "lz4",
        "metricCompression" : "lz4",
        "longEncoding" : "longs"
      },
      "maxRowsInMemory" : 75000,
      "leaveIntermediate" : false,
      "cleanupOnFailure" : true,
      "overwriteFiles" : false,
      "ignoreInvalidRows" : false,
      "jobProperties" : { },
      "combineText" : false,
      "useCombiner" : false,
      "buildV9Directly" : true,
      "numBackgroundPersistThreads" : 0,
      "forceExtendableShardSpecs" : false,
      "useExplicitVersion" : false,
      "allowedHadoopPrefix" : [ ]
    },
    "uniqueId" : "ce51d0826af8424f874c1ad389c14f9b"
  },
  "hadoopDependencyCoordinates" : null,
  "classpathPrefix" : null,
  "context" : null,
  "groupId" : "index_hadoop_wikiticker_2018-03-29T14:55:14.270Z",
  "dataSource" : "wikiticker",
  "resource" : {
    "availabilityGroup" : "index_hadoop_wikiticker_2018-03-29T14:55:14.270Z",
    "requiredCapacity" : 1
  }
}
2018-03-29T14:55:19,856 INFO [main] io.druid.indexing.worker.executor.ExecutorLifecycle - Attempting to lock file[/apps/druid/tasks/index_hadoop_wikiticker_2018-03-29T14:55:14.270Z/lock].
2018-03-29T14:55:19,857 INFO [main] io.druid.indexing.worker.executor.ExecutorLifecycle - Acquired lock file[/apps/druid/tasks/index_hadoop_wikiticker_2018-03-29T14:55:14.270Z/lock] in 1ms.
2018-03-29T14:55:19,869 INFO [main] io.druid.indexing.common.actions.RemoteTaskActionClient - Performing action for task[index_hadoop_wikiticker_2018-03-29T14:55:14.270Z]: LockTryAcquireAction{interval=2015-09-12T00:00:00.000Z/2015-09-13T00:00:00.000Z}
2018-03-29T14:55:19,878 INFO [main] io.druid.indexing.common.actions.RemoteTaskActionClient - Submitting action for task[index_hadoop_wikiticker_2018-03-29T14:55:14.270Z] to overlord[http://sandbox-hdp.hortonworks.com:8090/druid/indexer/v1/action]: LockTryAcquireAction{interval=2015-09-12T00:00:00.000Z/2015-09-13T00:00:00.000Z}
2018-03-29T14:55:19,886 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://sandbox-hdp.hortonworks.com:8090
2018-03-29T14:55:19,912 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://sandbox-hdp.hortonworks.com:8090
2018-03-29T14:55:19,913 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://sandbox-hdp.hortonworks.com:8090
2018-03-29T14:55:19,913 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://sandbox-hdp.hortonworks.com:8090
2018-03-29T14:55:19,913 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://sandbox-hdp.hortonworks.com:8090
2018-03-29T14:55:19,915 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://sandbox-hdp.hortonworks.com:8090
2018-03-29T14:55:19,915 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://sandbox-hdp.hortonworks.com:8090
2018-03-29T14:55:19,918 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://sandbox-hdp.hortonworks.com:8090
2018-03-29T14:55:19,918 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://sandbox-hdp.hortonworks.com:8090
2018-03-29T14:55:19,922 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://sandbox-hdp.hortonworks.com:8090
2018-03-29T14:55:19,922 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://sandbox-hdp.hortonworks.com:8090
2018-03-29T14:55:19,923 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://sandbox-hdp.hortonworks.com:8090
2018-03-29T14:55:19,923 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://sandbox-hdp.hortonworks.com:8090
2018-03-29T14:55:19,924 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://sandbox-hdp.hortonworks.com:8090
2018-03-29T14:55:19,924 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://sandbox-hdp.hortonworks.com:8090
2018-03-29T14:55:19,924 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://sandbox-hdp.hortonworks.com:8090
2018-03-29T14:55:19,924 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://sandbox-hdp.hortonworks.com:8090
2018-03-29T14:55:19,925 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://sandbox-hdp.hortonworks.com:8090
2018-03-29T14:55:19,925 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://sandbox-hdp.hortonworks.com:8090
2018-03-29T14:55:19,925 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://sandbox-hdp.hortonworks.com:8090
2018-03-29T14:55:20,024 INFO [main] org.eclipse.jetty.server.Server - jetty-9.3.19.v20170502
2018-03-29T14:55:20,025 INFO [task-runner-0-priority-0] io.druid.indexing.overlord.ThreadPoolTaskRunner - Running task: index_hadoop_wikiticker_2018-03-29T14:55:14.270Z
2018-03-29T14:55:20,031 INFO [task-runner-0-priority-0] io.druid.indexing.overlord.TaskRunnerUtils - Task [index_hadoop_wikiticker_2018-03-29T14:55:14.270Z] location changed to [TaskLocation{host='sandbox-hdp.hortonworks.com', port=8100}].
2018-03-29T14:55:20,032 INFO [task-runner-0-priority-0] io.druid.indexing.overlord.TaskRunnerUtils - Task [index_hadoop_wikiticker_2018-03-29T14:55:14.270Z] status changed to [RUNNING].
2018-03-29T14:55:20,059 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/jersey-core-1.9.jar]
2018-03-29T14:55:20,059 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/hadoop-common-2.7.3.2.6.4.0-91.jar]
2018-03-29T14:55:20,084 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/okio-1.4.0.jar]
2018-03-29T14:55:20,084 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/curator-client-2.7.1.jar]
2018-03-29T14:55:20,084 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/commons-beanutils-1.7.0.jar]
2018-03-29T14:55:20,084 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/hadoop-annotations-2.7.3.2.6.4.0-91.jar]
2018-03-29T14:55:20,084 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/jsp-api-2.1.jar]
2018-03-29T14:55:20,084 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/snappy-java-1.0.4.1.jar]
2018-03-29T14:55:20,085 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/curator-recipes-2.7.1.jar]
2018-03-29T14:55:20,085 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/stax-api-1.0-2.jar]
2018-03-29T14:55:20,085 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/servlet-api-2.5.jar]
2018-03-29T14:55:20,085 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/slf4j-api-1.7.10.jar]
2018-03-29T14:55:20,085 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/hadoop-client-2.7.3.2.6.4.0-91.jar]
2018-03-29T14:55:20,085 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/netty-all-4.0.52.Final.jar]
2018-03-29T14:55:20,085 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/hadoop-mapreduce-client-jobclient-2.7.3.2.6.4.0-91.jar]
2018-03-29T14:55:20,085 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/commons-io-2.4.jar]
2018-03-29T14:55:20,085 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/okhttp-2.4.0.jar]
2018-03-29T14:55:20,085 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/api-util-1.0.0-M20.jar]
2018-03-29T14:55:20,086 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/httpcore-4.4.4.jar]
2018-03-29T14:55:20,086 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/commons-logging-1.1.3.jar]
2018-03-29T14:55:20,086 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/jsr305-3.0.0.jar]
2018-03-29T14:55:20,086 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/apacheds-i18n-2.0.0-M15.jar]
2018-03-29T14:55:20,087 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/activation-1.1.jar]
2018-03-29T14:55:20,087 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/nimbus-jose-jwt-3.9.jar]
2018-03-29T14:55:20,087 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/xmlenc-0.52.jar]
2018-03-29T14:55:20,087 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/htrace-core-3.1.0-incubating.jar]
2018-03-29T14:55:20,087 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/xz-1.0.jar]
2018-03-29T14:55:20,087 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/commons-math3-3.1.1.jar]
2018-03-29T14:55:20,087 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/commons-beanutils-core-1.8.0.jar]
2018-03-29T14:55:20,087 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/gson-2.2.4.jar]
2018-03-29T14:55:20,087 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/azure-storage-5.4.0.jar]
2018-03-29T14:55:20,088 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/protobuf-java-2.5.0.jar]
2018-03-29T14:55:20,088 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/curator-framework-2.7.1.jar]
2018-03-29T14:55:20,088 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/hadoop-mapreduce-client-core-2.7.3.2.6.4.0-91.jar]
2018-03-29T14:55:20,088 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/slf4j-log4j12-1.7.10.jar]
2018-03-29T14:55:20,088 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/jackson-annotations-2.2.3.jar]
2018-03-29T14:55:20,088 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/jackson-xc-1.9.13.jar]
2018-03-29T14:55:20,088 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/commons-cli-1.2.jar]
2018-03-29T14:55:20,088 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/commons-configuration-1.6.jar]
2018-03-29T14:55:20,088 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/hadoop-yarn-api-2.7.3.2.6.4.0-91.jar]
2018-03-29T14:55:20,089 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/hadoop-yarn-client-2.7.3.2.6.4.0-91.jar]
2018-03-29T14:55:20,089 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/hadoop-hdfs-2.7.3.2.6.4.0-91.jar]
2018-03-29T14:55:20,089 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/log4j-1.2.17.jar]
2018-03-29T14:55:20,089 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/hadoop-yarn-registry-2.7.3.2.6.4.0-91.jar]
2018-03-29T14:55:20,089 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/azure-keyvault-core-0.8.0.jar]
2018-03-29T14:55:20,089 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/jetty-util-6.1.26.hwx.jar]
2018-03-29T14:55:20,089 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/hadoop-yarn-common-2.7.3.2.6.4.0-91.jar]
2018-03-29T14:55:20,089 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/api-asn1-api-1.0.0-M20.jar]
2018-03-29T14:55:20,089 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/hadoop-yarn-server-common-2.7.3.2.6.4.0-91.jar]
2018-03-29T14:55:20,090 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/commons-lang3-3.4.jar]
2018-03-29T14:55:20,090 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/hadoop-auth-2.7.3.2.6.4.0-91.jar]
2018-03-29T14:55:20,090 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/commons-net-3.1.jar]
2018-03-29T14:55:20,090 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/paranamer-2.3.jar]
2018-03-29T14:55:20,090 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/jersey-client-1.9.jar]
2018-03-29T14:55:20,090 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/hadoop-mapreduce-client-common-2.7.3.2.6.4.0-91.jar]
2018-03-29T14:55:20,090 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/avro-1.7.4.jar]
2018-03-29T14:55:20,090 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/httpclient-4.5.2.jar]
2018-03-29T14:55:20,090 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/jaxb-api-2.2.2.jar]
2018-03-29T14:55:20,090 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/guava-11.0.2.jar]
2018-03-29T14:55:20,091 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/jackson-core-2.2.3.jar]
2018-03-29T14:55:20,091 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/jackson-mapper-asl-1.9.13.jar]
2018-03-29T14:55:20,091 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/jackson-jaxrs-1.9.13.jar]
2018-03-29T14:55:20,091 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/jackson-core-asl-1.9.13.jar]
2018-03-29T14:55:20,091 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/xml-apis-1.3.04.jar]
2018-03-29T14:55:20,091 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/commons-lang-2.6.jar]
2018-03-29T14:55:20,092 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/commons-compress-1.4.1.jar]
2018-03-29T14:55:20,092 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/xercesImpl-2.9.1.jar]
2018-03-29T14:55:20,092 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/jetty-sslengine-6.1.26.hwx.jar]
2018-03-29T14:55:20,092 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/commons-digester-1.8.jar]
2018-03-29T14:55:20,092 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/commons-codec-1.4.jar]
2018-03-29T14:55:20,092 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/json-smart-1.1.1.jar]
2018-03-29T14:55:20,092 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/apacheds-kerberos-codec-2.0.0-M15.jar]
2018-03-29T14:55:20,092 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/netty-3.6.2.Final.jar]
2018-03-29T14:55:20,092 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/jackson-databind-2.2.3.jar]
2018-03-29T14:55:20,092 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/zookeeper-3.4.6.2.6.4.0-91.jar]
2018-03-29T14:55:20,093 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/hadoop-mapreduce-client-shuffle-2.7.3.2.6.4.0-91.jar]
2018-03-29T14:55:20,093 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/commons-collections-3.2.2.jar]
2018-03-29T14:55:20,093 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/hadoop-mapreduce-client-app-2.7.3.2.6.4.0-91.jar]
2018-03-29T14:55:20,093 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/jcip-annotations-1.0.jar]
2018-03-29T14:55:20,093 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/leveldbjni-all-1.8.jar]
2018-03-29T14:55:20,093 INFO [task-runner-0-priority-0] io.druid.indexing.common.task.HadoopTask - Hadoop Container Druid Classpath is set to [file:/etc/druid/2.6.4.0-91/0/_common/:file:/etc/druid/2.6.4.0-91/0/middleManager/:file:/usr/hdp/2.6.4.0-91/druid/lib/antlr4-runtime-4.5.1.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/druid-sql-0.10.1.2.6.4.0-91.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/plexus-interpolation-1.19.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/guice-servlet-4.1.0.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/jackson-jaxrs-smile-provider-2.4.6.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/curator-client-2.11.0.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/tesla-aether-0.0.5.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/wagon-provider-api-2.4.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/extendedset-0.10.1.2.6.4.0-91.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/jackson-dataformat-smile-2.4.6.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/maven-model-3.1.1.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/json-path-2.1.0.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/jetty-util-9.3.19.v20170502.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/commons-compiler-2.7.6.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/log4j-api-2.5.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/jcl-over-slf4j-1.7.12.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/druid-server-0.10.1.2.6.4.0-91.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/jetty-proxy-9.3.19.v20170502.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/commons-pool-1.6.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/jsr311-api-1.1.1.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/jsr305-2.0.1.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/druid-indexing-service-0.10.1.2.6.4.0-91.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/commons-logging-1.1.1.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/okhttp-1.0.2.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/RoaringBitmap-0.5.18.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/http-client-1.1.0.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/curator-recipes-2.11.0.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/aopalliance-1.0.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/netty-all-4.1.11.Final.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/derbyclient-10.11.1.1.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/bytebuffer-collections-0.10.1.2.6.4.0-91.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/protobuf-java-3.1.0.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/aether-spi-0.9.0.M2.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/derbynet-10.11.1.1.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/compress-lzf-1.0.3.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/disruptor-3.3.6.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/jetty-http-9.3.19.v20170502.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/maven-settings-3.1.1.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/bcprov-jdk15on-1.52.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/classmate-1.0.0.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/opencsv-2.3.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/druid-aws-common-0.10.1.2.6.4.0-91.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/aws-java-sdk-ec2-1.10.77.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/druid-services-0.10.1.2.6.4.0-91.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/javax.inject-1.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/jackson-datatype-joda-2.4.6.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/commons-dbcp-1.4.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/jackson-datatype-guava-2.4.6.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/jackson-core-2.4.6.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/jline-0.9.94.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/base64-2.3.8.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/calcite-core-1.12.0.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/mapdb-1.0.8.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/curator-framework-2.11.0.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/log4j-core-2.5.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/jetty-servlets-9.3.19.v20170502.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/druid-console-0.0.2.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/maven-model-builder-3.1.1.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/config-magic-0.9.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/emitter-0.4.5.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/slf4j-api-1.6.4.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/jboss-logging-3.1.3.GA.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/commons-cli-1.2.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/guice-4.1.0.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/druid-common-0.10.1.2.6.4.0-91.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/jackson-dataformat-cbor-2.5.3.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/derby-10.11.1.1.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/aether-api-0.9.0.M2.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/commons-io-2.5.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/netty-3.10.6.Final.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/javax.el-3.0.0.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/janino-2.7.6.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/plexus-utils-3.0.15.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/jackson-jaxrs-base-2.4.6.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/aws-java-sdk-core-1.10.77.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/javax.servlet-api-3.1.0.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/log4j-1.2-api-2.5.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/avatica-core-1.9.0.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/aether-impl-0.9.0.M2.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/jetty-security-9.3.19.v20170502.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/spymemcached-2.12.3.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/maven-aether-provider-3.1.1.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/aggdesigner-algorithm-6.0.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/aether-connector-okhttp-0.0.9.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/commons-pool2-2.2.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/jackson-databind-2.4.6.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/asm-tree-5.2.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/jetty-continuation-9.3.19.v20170502.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/java-util-0.28.2.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/maven-repository-metadata-3.1.1.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/jackson-annotations-2.4.6.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/calcite-linq4j-1.12.0.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/jersey-servlet-1.19.3.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/jackson-mapper-asl-1.9.13.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/asm-5.2.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/asm-commons-5.2.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/httpclient-4.5.1.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/lz4-1.3.0.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/avatica-metrics-1.9.0.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/jetty-servlet-9.3.19.v20170502.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/jackson-core-asl-1.9.13.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/log4j-slf4j-impl-2.5.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/javax.el-api-3.0.0.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/irc-api-1.0-0014.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/java-util-0.10.1.2.6.4.0-91.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/jersey-guice-1.19.3.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/activation-1.1.1.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/druid-indexing-hadoop-0.10.1.2.6.4.0-91.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/commons-lang-2.6.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/jersey-server-1.19.3.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/aether-connector-file-0.9.0.M2.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/geoip2-0.4.0.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/joda-time-2.9.9.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/jetty-server-9.3.19.v20170502.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/druid-hll-0.10.1.2.6.4.0-91.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/guice-multibindings-4.1.0.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/curator-x-discovery-2.11.0.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/druid-api-0.10.1.2.6.4.0-91.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/commons-lang3-3.2.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/maxminddb-0.2.0.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/jetty-io-9.3.19.v20170502.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/maven-settings-builder-3.1.1.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/jdbi-2.63.1.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/aether-util-0.9.0.M2.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/icu4j-54.1.1.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/validation-api-1.1.0.Final.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/jets3t-0.9.4.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/jackson-module-jaxb-annotations-2.4.6.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/server-metrics-0.2.8.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/jetty-client-9.3.19.v20170502.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/avatica-server-1.9.0.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/httpcore-4.4.3.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/airline-0.7.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/jackson-jaxrs-json-provider-2.4.6.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/druid-processing-0.10.1.2.6.4.0-91.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/zookeeper-3.4.6.2.6.4.0-91.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/guava-16.0.1.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/commons-codec-1.7.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/jersey-core-1.19.3.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/commons-dbcp2-2.0.1.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/hibernate-validator-5.1.3.Final.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/java-xmlbuilder-1.1.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/commons-math3-3.6.1.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/rhino-1.7R5.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/log4j-jul-2.5.jar:file:/usr/hdp/2.6.4.0-91/druid/lib/fastutil-7.2.0.jar:file:/etc/hadoop/2.6.4.0-91/0/:file:/usr/hdp/current/druid-middlemanager/extensions/druid-datasketches/druid-datasketches-0.10.1.2.6.4.0-91.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-datasketches/sketches-core-0.8.4.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-datasketches/memory-0.8.4.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-common-2.7.3.2.6.4.0-91.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/okio-1.4.0.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/curator-client-2.11.0.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/commons-beanutils-1.7.0.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jsp-api-2.1.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/snappy-java-1.0.4.1.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/stax-api-1.0-2.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/servlet-api-2.5.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-client-2.7.3.2.6.4.0-91.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-mapreduce-client-jobclient-2.7.3.2.6.4.0-91.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/okhttp-2.4.0.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/commons-logging-1.1.1.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/api-util-1.0.0-M20.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/apacheds-i18n-2.0.0-M15.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/curator-recipes-2.11.0.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/netty-all-4.1.11.Final.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/aws-java-sdk-kms-1.10.77.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/druid-hdfs-storage-0.10.1.2.6.4.0-91.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/nimbus-jose-jwt-3.9.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/xmlenc-0.52.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/htrace-core-3.1.0-incubating.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/xz-1.0.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/commons-beanutils-core-1.8.0.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/gson-2.2.4.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jackson-core-2.4.6.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/azure-storage-5.4.0.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/curator-framework-2.11.0.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-mapreduce-client-core-2.7.3.2.6.4.0-91.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jackson-xc-1.9.13.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/commons-configuration-1.6.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jackson-dataformat-cbor-2.5.3.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-yarn-api-2.7.3.2.6.4.0-91.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-yarn-client-2.7.3.2.6.4.0-91.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/aws-java-sdk-core-1.10.77.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-hdfs-2.7.3.2.6.4.0-91.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-yarn-registry-2.7.3.2.6.4.0-91.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/azure-keyvault-core-0.8.0.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-yarn-common-2.7.3.2.6.4.0-91.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/api-asn1-api-1.0.0-M20.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-yarn-server-common-2.7.3.2.6.4.0-91.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/commons-lang3-3.4.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-auth-2.7.3.2.6.4.0-91.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/commons-net-3.1.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/paranamer-2.3.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jersey-client-1.9.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-mapreduce-client-common-2.7.3.2.6.4.0-91.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/avro-1.7.4.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jackson-databind-2.4.6.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jaxb-api-2.2.2.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jackson-annotations-2.4.6.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/httpclient-4.5.1.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jackson-jaxrs-1.9.13.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/xml-apis-1.3.04.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/commons-compress-1.4.1.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/xercesImpl-2.9.1.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/joda-time-2.9.9.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jetty-sslengine-6.1.26.hwx.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/commons-digester-1.8.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-aws-2.7.3.2.6.4.0-91.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/json-smart-1.1.1.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/apacheds-kerberos-codec-2.0.0-M15.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/netty-3.6.2.Final.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/aws-java-sdk-s3-1.10.77.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/httpcore-4.4.3.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/guava-16.0.1.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-mapreduce-client-shuffle-2.7.3.2.6.4.0-91.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/commons-collections-3.2.2.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-mapreduce-client-app-2.7.3.2.6.4.0-91.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jcip-annotations-1.0.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/commons-math3-3.6.1.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/leveldbjni-all-1.8.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-kafka-indexing-service/snappy-java-1.1.2.6.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-kafka-indexing-service/slf4j-api-1.6.4.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-kafka-indexing-service/druid-kafka-indexing-service-0.10.1.2.6.4.0-91.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-kafka-indexing-service/lz4-1.3.0.jar:file:/usr/hdp/current/druid-middlemanager/extensions/druid-kafka-indexing-service/kafka-clients-0.10.2.0.jar]
2018-03-29T14:55:20,234 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Registering com.fasterxml.jackson.jaxrs.json.JacksonJsonProvider as a provider class
2018-03-29T14:55:20,234 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Registering com.fasterxml.jackson.jaxrs.smile.JacksonSmileProvider as a provider class
2018-03-29T14:55:20,235 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Registering io.druid.server.initialization.jetty.CustomExceptionMapper as a provider class
2018-03-29T14:55:20,235 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Registering io.druid.server.StatusResource as a root resource class
2018-03-29T14:55:20,239 INFO [main] com.sun.jersey.server.impl.application.WebApplicationImpl - Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:43 PM'
2018-03-29T14:55:20,318 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.server.initialization.jetty.CustomExceptionMapper to GuiceManagedComponentProvider with the scope "Singleton"
2018-03-29T14:55:20,321 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding com.fasterxml.jackson.jaxrs.json.JacksonJsonProvider to GuiceManagedComponentProvider with the scope "Singleton"
2018-03-29T14:55:20,329 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding com.fasterxml.jackson.jaxrs.smile.JacksonSmileProvider to GuiceManagedComponentProvider with the scope "Singleton"
2018-03-29T14:55:20,668 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.server.http.security.StateResourceFilter to GuiceInstantiatedComponentProvider
2018-03-29T14:55:20,691 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.server.http.SegmentListerResource to GuiceInstantiatedComponentProvider
2018-03-29T14:55:20,704 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.server.QueryResource to GuiceInstantiatedComponentProvider
2018-03-29T14:55:20,705 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.segment.realtime.firehose.ChatHandlerResource to GuiceInstantiatedComponentProvider
2018-03-29T14:55:20,709 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.query.lookup.LookupListeningResource to GuiceInstantiatedComponentProvider
2018-03-29T14:55:20,711 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.query.lookup.LookupIntrospectionResource to GuiceInstantiatedComponentProvider
2018-03-29T14:55:20,712 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.server.StatusResource to GuiceManagedComponentProvider with the scope "Undefined"
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/hdp/2.6.4.0-91/druid/lib/log4j-slf4j-impl-2.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/hdp/current/druid-middlemanager/hadoop-dependencies/hadoop-client/2.7.3.2.6.4.0-91/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
2018-03-29T14:55:20,726 WARN [main] com.sun.jersey.spi.inject.Errors - The following warnings have been detected with resource and/or provider classes:
  WARNING: A HTTP GET method, public void io.druid.server.http.SegmentListerResource.getSegments(long,long,long,javax.servlet.http.HttpServletRequest) throws java.io.IOException, MUST return a non-void type.
2018-03-29T14:55:20,734 INFO [main] org.eclipse.jetty.server.handler.ContextHandler - Started o.e.j.s.ServletContextHandler@3f3c8b60{/,null,AVAILABLE}
2018-03-29T14:55:20,743 INFO [main] org.eclipse.jetty.server.AbstractConnector - Started ServerConnector@4adf3582{HTTP/1.1,[http/1.1]}{0.0.0.0:8100}
2018-03-29T14:55:20,743 INFO [main] org.eclipse.jetty.server.Server - Started @6317ms
2018-03-29T14:55:20,744 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.server.listener.announcer.ListenerResourceAnnouncer.start()] on object[io.druid.query.lookup.LookupResourceListenerAnnouncer@577bfadb].
2018-03-29T14:55:20,802 INFO [main] io.druid.server.listener.announcer.ListenerResourceAnnouncer - Announcing start time on [/druid/listeners/lookups/__default/sandbox-hdp.hortonworks.com:8100]
2018-03-29 14:55:21,220 task-runner-0-priority-0 WARN JNDI lookup class is not available because this JRE does not support JNDI. JNDI string lookups will not be available, continuing configuration. java.lang.ClassCastException: Cannot cast org.apache.logging.log4j.core.lookup.JndiLookup to org.apache.logging.log4j.core.lookup.StrLookup
	at java.lang.Class.cast(Class.java:3369)
	at org.apache.logging.log4j.util.LoaderUtil.newCheckedInstanceOf(LoaderUtil.java:167)
	at org.apache.logging.log4j.core.util.Loader.newCheckedInstanceOf(Loader.java:301)
	at org.apache.logging.log4j.core.lookup.Interpolator.<init>(Interpolator.java:94)
	at org.apache.logging.log4j.core.config.AbstractConfiguration.<init>(AbstractConfiguration.java:111)
	at org.apache.logging.log4j.core.config.DefaultConfiguration.<init>(DefaultConfiguration.java:48)
	at org.apache.logging.log4j.core.LoggerContext.<init>(LoggerContext.java:75)
	at org.apache.logging.log4j.core.selector.ClassLoaderContextSelector.createContext(ClassLoaderContextSelector.java:171)
	at org.apache.logging.log4j.core.selector.ClassLoaderContextSelector.locateContext(ClassLoaderContextSelector.java:145)
	at org.apache.logging.log4j.core.selector.ClassLoaderContextSelector.getContext(ClassLoaderContextSelector.java:70)
	at org.apache.logging.log4j.core.selector.ClassLoaderContextSelector.getContext(ClassLoaderContextSelector.java:57)
	at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:140)
	at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:41)
	at org.apache.logging.log4j.LogManager.getContext(LogManager.java:182)
	at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:103)
	at org.apache.logging.log4j.jul.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:34)
	at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:42)
	at org.apache.logging.log4j.jul.LogManager.getLogger(LogManager.java:89)
	at java.util.logging.LogManager.demandLogger(LogManager.java:551)
	at java.util.logging.Logger.demandLogger(Logger.java:455)
	at java.util.logging.Logger.getLogger(Logger.java:502)
	at com.google.inject.internal.util.Stopwatch.<clinit>(Stopwatch.java:27)
	at com.google.inject.internal.InternalInjectorCreator.<init>(InternalInjectorCreator.java:61)
	at com.google.inject.Guice.createInjector(Guice.java:96)
	at com.google.inject.Guice.createInjector(Guice.java:73)
	at io.druid.guice.GuiceInjectors.makeStartupInjector(GuiceInjectors.java:61)
	at io.druid.indexer.HadoopDruidIndexerConfig.<clinit>(HadoopDruidIndexerConfig.java:104)
	at io.druid.indexing.common.task.HadoopIndexTask$HadoopDetermineConfigInnerProcessing.runTask(HadoopIndexTask.java:294)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:215)
	at io.druid.indexing.common.task.HadoopIndexTask.run(HadoopIndexTask.java:178)
	at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:436)
	at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:408)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

2018-03-29 14:55:21,222 task-runner-0-priority-0 WARN JMX runtime input lookup class is not available because this JRE does not support JMX. JMX lookups will not be available, continuing configuration. java.lang.ClassCastException: Cannot cast org.apache.logging.log4j.core.lookup.JmxRuntimeInputArgumentsLookup to org.apache.logging.log4j.core.lookup.StrLookup
	at java.lang.Class.cast(Class.java:3369)
	at org.apache.logging.log4j.util.LoaderUtil.newCheckedInstanceOf(LoaderUtil.java:167)
	at org.apache.logging.log4j.core.util.Loader.newCheckedInstanceOf(Loader.java:301)
	at org.apache.logging.log4j.core.lookup.Interpolator.<init>(Interpolator.java:105)
	at org.apache.logging.log4j.core.config.AbstractConfiguration.<init>(AbstractConfiguration.java:111)
	at org.apache.logging.log4j.core.config.DefaultConfiguration.<init>(DefaultConfiguration.java:48)
	at org.apache.logging.log4j.core.LoggerContext.<init>(LoggerContext.java:75)
	at org.apache.logging.log4j.core.selector.ClassLoaderContextSelector.createContext(ClassLoaderContextSelector.java:171)
	at org.apache.logging.log4j.core.selector.ClassLoaderContextSelector.locateContext(ClassLoaderContextSelector.java:145)
	at org.apache.logging.log4j.core.selector.ClassLoaderContextSelector.getContext(ClassLoaderContextSelector.java:70)
	at org.apache.logging.log4j.core.selector.ClassLoaderContextSelector.getContext(ClassLoaderContextSelector.java:57)
	at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:140)
	at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:41)
	at org.apache.logging.log4j.LogManager.getContext(LogManager.java:182)
	at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:103)
	at org.apache.logging.log4j.jul.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:34)
	at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:42)
	at org.apache.logging.log4j.jul.LogManager.getLogger(LogManager.java:89)
	at java.util.logging.LogManager.demandLogger(LogManager.java:551)
	at java.util.logging.Logger.demandLogger(Logger.java:455)
	at java.util.logging.Logger.getLogger(Logger.java:502)
	at com.google.inject.internal.util.Stopwatch.<clinit>(Stopwatch.java:27)
	at com.google.inject.internal.InternalInjectorCreator.<init>(InternalInjectorCreator.java:61)
	at com.google.inject.Guice.createInjector(Guice.java:96)
	at com.google.inject.Guice.createInjector(Guice.java:73)
	at io.druid.guice.GuiceInjectors.makeStartupInjector(GuiceInjectors.java:61)
	at io.druid.indexer.HadoopDruidIndexerConfig.<clinit>(HadoopDruidIndexerConfig.java:104)
	at io.druid.indexing.common.task.HadoopIndexTask$HadoopDetermineConfigInnerProcessing.runTask(HadoopIndexTask.java:294)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:215)
	at io.druid.indexing.common.task.HadoopIndexTask.run(HadoopIndexTask.java:178)
	at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:436)
	at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:408)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

2018-03-29 14:55:21,240 task-runner-0-priority-0 WARN JNDI lookup class is not available because this JRE does not support JNDI. JNDI string lookups will not be available, continuing configuration. java.lang.ClassCastException: Cannot cast org.apache.logging.log4j.core.lookup.JndiLookup to org.apache.logging.log4j.core.lookup.StrLookup
	at java.lang.Class.cast(Class.java:3369)
	at org.apache.logging.log4j.util.LoaderUtil.newCheckedInstanceOf(LoaderUtil.java:167)
	at org.apache.logging.log4j.core.util.Loader.newCheckedInstanceOf(Loader.java:301)
	at org.apache.logging.log4j.core.lookup.Interpolator.<init>(Interpolator.java:94)
	at org.apache.logging.log4j.core.config.AbstractConfiguration.<init>(AbstractConfiguration.java:111)
	at org.apache.logging.log4j.core.config.xml.XmlConfiguration.<init>(XmlConfiguration.java:81)
	at org.apache.logging.log4j.core.config.xml.XmlConfigurationFactory.getConfiguration(XmlConfigurationFactory.java:44)
	at org.apache.logging.log4j.core.config.ConfigurationFactory$Factory.getConfiguration(ConfigurationFactory.java:490)
	at org.apache.logging.log4j.core.config.ConfigurationFactory$Factory.getConfiguration(ConfigurationFactory.java:460)
	at org.apache.logging.log4j.core.config.ConfigurationFactory.getConfiguration(ConfigurationFactory.java:256)
	at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:561)
	at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:578)
	at org.apache.logging.log4j.core.LoggerContext.start(LoggerContext.java:214)
	at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:145)
	at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:41)
	at org.apache.logging.log4j.LogManager.getContext(LogManager.java:182)
	at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:103)
	at org.apache.logging.log4j.jul.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:34)
	at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:42)
	at org.apache.logging.log4j.jul.LogManager.getLogger(LogManager.java:89)
	at java.util.logging.LogManager.demandLogger(LogManager.java:551)
	at java.util.logging.Logger.demandLogger(Logger.java:455)
	at java.util.logging.Logger.getLogger(Logger.java:502)
	at com.google.inject.internal.util.Stopwatch.<clinit>(Stopwatch.java:27)
	at com.google.inject.internal.InternalInjectorCreator.<init>(InternalInjectorCreator.java:61)
	at com.google.inject.Guice.createInjector(Guice.java:96)
	at com.google.inject.Guice.createInjector(Guice.java:73)
	at io.druid.guice.GuiceInjectors.makeStartupInjector(GuiceInjectors.java:61)
	at io.druid.indexer.HadoopDruidIndexerConfig.<clinit>(HadoopDruidIndexerConfig.java:104)
	at io.druid.indexing.common.task.HadoopIndexTask$HadoopDetermineConfigInnerProcessing.runTask(HadoopIndexTask.java:294)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:215)
	at io.druid.indexing.common.task.HadoopIndexTask.run(HadoopIndexTask.java:178)
	at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:436)
	at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:408)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

2018-03-29 14:55:21,241 task-runner-0-priority-0 WARN JMX runtime input lookup class is not available because this JRE does not support JMX. JMX lookups will not be available, continuing configuration. java.lang.ClassCastException: Cannot cast org.apache.logging.log4j.core.lookup.JmxRuntimeInputArgumentsLookup to org.apache.logging.log4j.core.lookup.StrLookup
	at java.lang.Class.cast(Class.java:3369)
	at org.apache.logging.log4j.util.LoaderUtil.newCheckedInstanceOf(LoaderUtil.java:167)
	at org.apache.logging.log4j.core.util.Loader.newCheckedInstanceOf(Loader.java:301)
	at org.apache.logging.log4j.core.lookup.Interpolator.<init>(Interpolator.java:105)
	at org.apache.logging.log4j.core.config.AbstractConfiguration.<init>(AbstractConfiguration.java:111)
	at org.apache.logging.log4j.core.config.xml.XmlConfiguration.<init>(XmlConfiguration.java:81)
	at org.apache.logging.log4j.core.config.xml.XmlConfigurationFactory.getConfiguration(XmlConfigurationFactory.java:44)
	at org.apache.logging.log4j.core.config.ConfigurationFactory$Factory.getConfiguration(ConfigurationFactory.java:490)
	at org.apache.logging.log4j.core.config.ConfigurationFactory$Factory.getConfiguration(ConfigurationFactory.java:460)
	at org.apache.logging.log4j.core.config.ConfigurationFactory.getConfiguration(ConfigurationFactory.java:256)
	at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:561)
	at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:578)
	at org.apache.logging.log4j.core.LoggerContext.start(LoggerContext.java:214)
	at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:145)
	at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:41)
	at org.apache.logging.log4j.LogManager.getContext(LogManager.java:182)
	at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:103)
	at org.apache.logging.log4j.jul.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:34)
	at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:42)
	at org.apache.logging.log4j.jul.LogManager.getLogger(LogManager.java:89)
	at java.util.logging.LogManager.demandLogger(LogManager.java:551)
	at java.util.logging.Logger.demandLogger(Logger.java:455)
	at java.util.logging.Logger.getLogger(Logger.java:502)
	at com.google.inject.internal.util.Stopwatch.<clinit>(Stopwatch.java:27)
	at com.google.inject.internal.InternalInjectorCreator.<init>(InternalInjectorCreator.java:61)
	at com.google.inject.Guice.createInjector(Guice.java:96)
	at com.google.inject.Guice.createInjector(Guice.java:73)
	at io.druid.guice.GuiceInjectors.makeStartupInjector(GuiceInjectors.java:61)
	at io.druid.indexer.HadoopDruidIndexerConfig.<clinit>(HadoopDruidIndexerConfig.java:104)
	at io.druid.indexing.common.task.HadoopIndexTask$HadoopDetermineConfigInnerProcessing.runTask(HadoopIndexTask.java:294)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:215)
	at io.druid.indexing.common.task.HadoopIndexTask.run(HadoopIndexTask.java:178)
	at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:436)
	at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:408)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

2018-03-29 14:55:21,250 task-runner-0-priority-0 WARN JNDI lookup class is not available because this JRE does not support JNDI. JNDI string lookups will not be available, continuing configuration. java.lang.ClassCastException: Cannot cast org.apache.logging.log4j.core.lookup.JndiLookup to org.apache.logging.log4j.core.lookup.StrLookup
	at java.lang.Class.cast(Class.java:3369)
	at org.apache.logging.log4j.util.LoaderUtil.newCheckedInstanceOf(LoaderUtil.java:167)
	at org.apache.logging.log4j.core.util.Loader.newCheckedInstanceOf(Loader.java:301)
	at org.apache.logging.log4j.core.lookup.Interpolator.<init>(Interpolator.java:94)
	at org.apache.logging.log4j.core.config.AbstractConfiguration.<init>(AbstractConfiguration.java:111)
	at org.apache.logging.log4j.core.config.DefaultConfiguration.<init>(DefaultConfiguration.java:48)
	at org.apache.logging.log4j.core.layout.PatternLayout$Builder.build(PatternLayout.java:444)
	at org.apache.logging.log4j.core.layout.PatternLayout.createDefaultLayout(PatternLayout.java:327)
	at org.apache.logging.log4j.core.appender.ConsoleAppender$Builder.<init>(ConsoleAppender.java:157)
	at org.apache.logging.log4j.core.appender.ConsoleAppender.newBuilder(ConsoleAppender.java:149)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.logging.log4j.core.config.plugins.util.PluginBuilder.createBuilder(PluginBuilder.java:154)
	at org.apache.logging.log4j.core.config.plugins.util.PluginBuilder.build(PluginBuilder.java:119)
	at org.apache.logging.log4j.core.config.AbstractConfiguration.createPluginObject(AbstractConfiguration.java:888)
	at org.apache.logging.log4j.core.config.AbstractConfiguration.createConfiguration(AbstractConfiguration.java:828)
	at org.apache.logging.log4j.core.config.AbstractConfiguration.createConfiguration(AbstractConfiguration.java:820)
	at org.apache.logging.log4j.core.config.AbstractConfiguration.doConfigure(AbstractConfiguration.java:449)
	at org.apache.logging.log4j.core.config.AbstractConfiguration.initialize(AbstractConfiguration.java:197)
	at org.apache.logging.log4j.core.config.AbstractConfiguration.start(AbstractConfiguration.java:209)
	at org.apache.logging.log4j.core.LoggerContext.setConfiguration(LoggerContext.java:492)
	at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:562)
	at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:578)
	at org.apache.logging.log4j.core.LoggerContext.start(LoggerContext.java:214)
	at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:145)
	at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:41)
	at org.apache.logging.log4j.LogManager.getContext(LogManager.java:182)
	at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:103)
	at org.apache.logging.log4j.jul.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:34)
	at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:42)
	at org.apache.logging.log4j.jul.LogManager.getLogger(LogManager.java:89)
	at java.util.logging.LogManager.demandLogger(LogManager.java:551)
	at java.util.logging.Logger.demandLogger(Logger.java:455)
	at java.util.logging.Logger.getLogger(Logger.java:502)
	at com.google.inject.internal.util.Stopwatch.<clinit>(Stopwatch.java:27)
	at com.google.inject.internal.InternalInjectorCreator.<init>(InternalInjectorCreator.java:61)
	at com.google.inject.Guice.createInjector(Guice.java:96)
	at com.google.inject.Guice.createInjector(Guice.java:73)
	at io.druid.guice.GuiceInjectors.makeStartupInjector(GuiceInjectors.java:61)
	at io.druid.indexer.HadoopDruidIndexerConfig.<clinit>(HadoopDruidIndexerConfig.java:104)
	at io.druid.indexing.common.task.HadoopIndexTask$HadoopDetermineConfigInnerProcessing.runTask(HadoopIndexTask.java:294)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:215)
	at io.druid.indexing.common.task.HadoopIndexTask.run(HadoopIndexTask.java:178)
	at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:436)
	at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:408)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

2018-03-29 14:55:21,251 task-runner-0-priority-0 WARN JMX runtime input lookup class is not available because this JRE does not support JMX. JMX lookups will not be available, continuing configuration. java.lang.ClassCastException: Cannot cast org.apache.logging.log4j.core.lookup.JmxRuntimeInputArgumentsLookup to org.apache.logging.log4j.core.lookup.StrLookup
	at java.lang.Class.cast(Class.java:3369)
	at org.apache.logging.log4j.util.LoaderUtil.newCheckedInstanceOf(LoaderUtil.java:167)
	at org.apache.logging.log4j.core.util.Loader.newCheckedInstanceOf(Loader.java:301)
	at org.apache.logging.log4j.core.lookup.Interpolator.<init>(Interpolator.java:105)
	at org.apache.logging.log4j.core.config.AbstractConfiguration.<init>(AbstractConfiguration.java:111)
	at org.apache.logging.log4j.core.config.DefaultConfiguration.<init>(DefaultConfiguration.java:48)
	at org.apache.logging.log4j.core.layout.PatternLayout$Builder.build(PatternLayout.java:444)
	at org.apache.logging.log4j.core.layout.PatternLayout.createDefaultLayout(PatternLayout.java:327)
	at org.apache.logging.log4j.core.appender.ConsoleAppender$Builder.<init>(ConsoleAppender.java:157)
	at org.apache.logging.log4j.core.appender.ConsoleAppender.newBuilder(ConsoleAppender.java:149)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.logging.log4j.core.config.plugins.util.PluginBuilder.createBuilder(PluginBuilder.java:154)
	at org.apache.logging.log4j.core.config.plugins.util.PluginBuilder.build(PluginBuilder.java:119)
	at org.apache.logging.log4j.core.config.AbstractConfiguration.createPluginObject(AbstractConfiguration.java:888)
	at org.apache.logging.log4j.core.config.AbstractConfiguration.createConfiguration(AbstractConfiguration.java:828)
	at org.apache.logging.log4j.core.config.AbstractConfiguration.createConfiguration(AbstractConfiguration.java:820)
	at org.apache.logging.log4j.core.config.AbstractConfiguration.doConfigure(AbstractConfiguration.java:449)
	at org.apache.logging.log4j.core.config.AbstractConfiguration.initialize(AbstractConfiguration.java:197)
	at org.apache.logging.log4j.core.config.AbstractConfiguration.start(AbstractConfiguration.java:209)
	at org.apache.logging.log4j.core.LoggerContext.setConfiguration(LoggerContext.java:492)
	at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:562)
	at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:578)
	at org.apache.logging.log4j.core.LoggerContext.start(LoggerContext.java:214)
	at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:145)
	at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:41)
	at org.apache.logging.log4j.LogManager.getContext(LogManager.java:182)
	at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:103)
	at org.apache.logging.log4j.jul.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:34)
	at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:42)
	at org.apache.logging.log4j.jul.LogManager.getLogger(LogManager.java:89)
	at java.util.logging.LogManager.demandLogger(LogManager.java:551)
	at java.util.logging.Logger.demandLogger(Logger.java:455)
	at java.util.logging.Logger.getLogger(Logger.java:502)
	at com.google.inject.internal.util.Stopwatch.<clinit>(Stopwatch.java:27)
	at com.google.inject.internal.InternalInjectorCreator.<init>(InternalInjectorCreator.java:61)
	at com.google.inject.Guice.createInjector(Guice.java:96)
	at com.google.inject.Guice.createInjector(Guice.java:73)
	at io.druid.guice.GuiceInjectors.makeStartupInjector(GuiceInjectors.java:61)
	at io.druid.indexer.HadoopDruidIndexerConfig.<clinit>(HadoopDruidIndexerConfig.java:104)
	at io.druid.indexing.common.task.HadoopIndexTask$HadoopDetermineConfigInnerProcessing.runTask(HadoopIndexTask.java:294)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:215)
	at io.druid.indexing.common.task.HadoopIndexTask.run(HadoopIndexTask.java:178)
	at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:436)
	at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:408)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

2018-03-29T14:55:21,499 INFO [task-runner-0-priority-0] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties
2018-03-29T14:55:21,501 INFO [task-runner-0-priority-0] io.druid.guice.PropertiesModule - Loading properties from runtime.properties
2018-03-29T14:55:21,530 INFO [task-runner-0-priority-0] org.hibernate.validator.internal.util.Version - HV000001: Hibernate Validator 5.1.3.Final
2018-03-29T14:55:22,078 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.segment.NullValueHandlingConfig] from props[druid.null.handling.] as [io.druid.segment.NullValueHandlingConfig@45f94603]
2018-03-29T14:55:22,092 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ModulesConfig] from props[druid.modules.] as [ModulesConfig{excludeList=[]}]
2018-03-29T14:55:22,216 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, directory='/usr/hdp/current/druid-middlemanager/extensions', hadoopDependenciesDir='/usr/hdp/current/druid-middlemanager/hadoop-dependencies', hadoopContainerDruidClasspath='null', addExtensionsToHadoopContainer=false, loadList=[druid-datasketches, druid-hdfs-storage, druid-kafka-indexing-service]}]
2018-03-29T14:55:22,219 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Adding implementation [io.druid.query.aggregation.datasketches.theta.SketchModule] for class [interface io.druid.initialization.DruidModule] from classpath extension
2018-03-29T14:55:22,220 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Adding implementation [io.druid.query.aggregation.datasketches.theta.oldapi.OldApiSketchModule] for class [interface io.druid.initialization.DruidModule] from classpath extension
2018-03-29T14:55:22,221 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Adding implementation [io.druid.storage.hdfs.HdfsStorageDruidModule] for class [interface io.druid.initialization.DruidModule] from classpath extension
2018-03-29T14:55:22,222 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Adding implementation [io.druid.indexing.kafka.KafkaIndexTaskModule] for class [interface io.druid.initialization.DruidModule] from classpath extension
2018-03-29T14:55:22,223 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Loading extension [druid-datasketches] for class [interface io.druid.initialization.DruidModule]
2018-03-29T14:55:22,232 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-datasketches/druid-datasketches-0.10.1.2.6.4.0-91.jar]
2018-03-29T14:55:22,232 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-datasketches/sketches-core-0.8.4.jar]
2018-03-29T14:55:22,233 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-datasketches/memory-0.8.4.jar]
2018-03-29T14:55:22,234 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Loading extension [druid-hdfs-storage] for class [interface io.druid.initialization.DruidModule]
2018-03-29T14:55:22,236 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-common-2.7.3.2.6.4.0-91.jar]
2018-03-29T14:55:22,236 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/okio-1.4.0.jar]
2018-03-29T14:55:22,236 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/curator-client-2.11.0.jar]
2018-03-29T14:55:22,236 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/commons-beanutils-1.7.0.jar]
2018-03-29T14:55:22,236 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jsp-api-2.1.jar]
2018-03-29T14:55:22,236 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/snappy-java-1.0.4.1.jar]
2018-03-29T14:55:22,236 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/stax-api-1.0-2.jar]
2018-03-29T14:55:22,236 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/servlet-api-2.5.jar]
2018-03-29T14:55:22,237 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-client-2.7.3.2.6.4.0-91.jar]
2018-03-29T14:55:22,237 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-mapreduce-client-jobclient-2.7.3.2.6.4.0-91.jar]
2018-03-29T14:55:22,237 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/okhttp-2.4.0.jar]
2018-03-29T14:55:22,237 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/commons-logging-1.1.1.jar]
2018-03-29T14:55:22,237 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/api-util-1.0.0-M20.jar]
2018-03-29T14:55:22,237 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/apacheds-i18n-2.0.0-M15.jar]
2018-03-29T14:55:22,237 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/curator-recipes-2.11.0.jar]
2018-03-29T14:55:22,237 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/netty-all-4.1.11.Final.jar]
2018-03-29T14:55:22,237 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/aws-java-sdk-kms-1.10.77.jar]
2018-03-29T14:55:22,237 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/druid-hdfs-storage-0.10.1.2.6.4.0-91.jar]
2018-03-29T14:55:22,237 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/nimbus-jose-jwt-3.9.jar]
2018-03-29T14:55:22,237 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/xmlenc-0.52.jar]
2018-03-29T14:55:22,238 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/htrace-core-3.1.0-incubating.jar]
2018-03-29T14:55:22,238 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/xz-1.0.jar]
2018-03-29T14:55:22,238 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/commons-beanutils-core-1.8.0.jar]
2018-03-29T14:55:22,238 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/gson-2.2.4.jar]
2018-03-29T14:55:22,238 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jackson-core-2.4.6.jar]
2018-03-29T14:55:22,238 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/azure-storage-5.4.0.jar]
2018-03-29T14:55:22,238 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/curator-framework-2.11.0.jar]
2018-03-29T14:55:22,238 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-mapreduce-client-core-2.7.3.2.6.4.0-91.jar]
2018-03-29T14:55:22,238 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jackson-xc-1.9.13.jar]
2018-03-29T14:55:22,238 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/commons-configuration-1.6.jar]
2018-03-29T14:55:22,239 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jackson-dataformat-cbor-2.5.3.jar]
2018-03-29T14:55:22,239 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-yarn-api-2.7.3.2.6.4.0-91.jar]
2018-03-29T14:55:22,239 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-yarn-client-2.7.3.2.6.4.0-91.jar]
2018-03-29T14:55:22,239 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/aws-java-sdk-core-1.10.77.jar]
2018-03-29T14:55:22,239 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-hdfs-2.7.3.2.6.4.0-91.jar]
2018-03-29T14:55:22,240 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-yarn-registry-2.7.3.2.6.4.0-91.jar]
2018-03-29T14:55:22,240 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/azure-keyvault-core-0.8.0.jar]
2018-03-29T14:55:22,240 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-yarn-common-2.7.3.2.6.4.0-91.jar]
2018-03-29T14:55:22,240 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/api-asn1-api-1.0.0-M20.jar]
2018-03-29T14:55:22,240 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-yarn-server-common-2.7.3.2.6.4.0-91.jar]
2018-03-29T14:55:22,240 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/commons-lang3-3.4.jar]
2018-03-29T14:55:22,240 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-auth-2.7.3.2.6.4.0-91.jar]
2018-03-29T14:55:22,240 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/commons-net-3.1.jar]
2018-03-29T14:55:22,241 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/paranamer-2.3.jar]
2018-03-29T14:55:22,241 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jersey-client-1.9.jar]
2018-03-29T14:55:22,241 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-mapreduce-client-common-2.7.3.2.6.4.0-91.jar]
2018-03-29T14:55:22,241 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/avro-1.7.4.jar]
2018-03-29T14:55:22,241 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jackson-databind-2.4.6.jar]
2018-03-29T14:55:22,241 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jaxb-api-2.2.2.jar]
2018-03-29T14:55:22,242 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jackson-annotations-2.4.6.jar]
2018-03-29T14:55:22,242 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/httpclient-4.5.1.jar]
2018-03-29T14:55:22,242 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jackson-jaxrs-1.9.13.jar]
2018-03-29T14:55:22,242 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/xml-apis-1.3.04.jar]
2018-03-29T14:55:22,242 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/commons-compress-1.4.1.jar]
2018-03-29T14:55:22,242 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/xercesImpl-2.9.1.jar]
2018-03-29T14:55:22,242 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/joda-time-2.9.9.jar]
2018-03-29T14:55:22,242 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jetty-sslengine-6.1.26.hwx.jar]
2018-03-29T14:55:22,243 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/commons-digester-1.8.jar]
2018-03-29T14:55:22,243 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-aws-2.7.3.2.6.4.0-91.jar]
2018-03-29T14:55:22,243 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/json-smart-1.1.1.jar]
2018-03-29T14:55:22,243 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/apacheds-kerberos-codec-2.0.0-M15.jar]
2018-03-29T14:55:22,243 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/netty-3.6.2.Final.jar]
2018-03-29T14:55:22,243 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/aws-java-sdk-s3-1.10.77.jar]
2018-03-29T14:55:22,243 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/httpcore-4.4.3.jar]
2018-03-29T14:55:22,243 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/guava-16.0.1.jar]
2018-03-29T14:55:22,243 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-mapreduce-client-shuffle-2.7.3.2.6.4.0-91.jar]
2018-03-29T14:55:22,243 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/commons-collections-3.2.2.jar]
2018-03-29T14:55:22,243 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/hadoop-mapreduce-client-app-2.7.3.2.6.4.0-91.jar]
2018-03-29T14:55:22,243 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/jcip-annotations-1.0.jar]
2018-03-29T14:55:22,244 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/commons-math3-3.6.1.jar]
2018-03-29T14:55:22,244 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-hdfs-storage/leveldbjni-all-1.8.jar]
2018-03-29T14:55:22,253 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Loading extension [druid-kafka-indexing-service] for class [interface io.druid.initialization.DruidModule]
2018-03-29T14:55:22,253 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-kafka-indexing-service/snappy-java-1.1.2.6.jar]
2018-03-29T14:55:22,253 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-kafka-indexing-service/slf4j-api-1.6.4.jar]
2018-03-29T14:55:22,254 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-kafka-indexing-service/druid-kafka-indexing-service-0.10.1.2.6.4.0-91.jar]
2018-03-29T14:55:22,254 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-kafka-indexing-service/lz4-1.3.0.jar]
2018-03-29T14:55:22,254 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/usr/hdp/current/druid-middlemanager/extensions/druid-kafka-indexing-service/kafka-clients-0.10.2.0.jar]
2018-03-29T14:55:22,782 WARN [task-runner-0-priority-0] org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2018-03-29T14:55:23,636 WARN [task-runner-0-priority-0] org.apache.hadoop.hdfs.shortcircuit.DomainSocketFactory - The short-circuit local reads feature cannot be used because libhadoop cannot be loaded.
2018-03-29T14:55:23,960 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.DruidMonitorSchedulerConfig] from props[druid.monitoring.] as [io.druid.server.metrics.DruidMonitorSchedulerConfig@2363f83d]
2018-03-29T14:55:23,998 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.MonitorsConfig] from props[druid.monitoring.] as [MonitorsConfig{monitors=[class com.metamx.metrics.JvmMonitor]}]
2018-03-29T14:55:24,002 INFO [task-runner-0-priority-0] io.druid.server.metrics.MetricsModule - Adding monitor[com.metamx.metrics.JvmMonitor@76544e65]
2018-03-29T14:55:24,002 INFO [task-runner-0-priority-0] io.druid.server.metrics.MetricsModule - Adding monitor[io.druid.server.initialization.jetty.JettyServerModule$JettyMonitor@f2cbb0e]
2018-03-29T14:55:24,008 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Assigning value [50000000] for [druid.processing.buffer.sizeBytes] on [io.druid.query.DruidProcessingConfig#intermediateComputeSizeBytes()]
2018-03-29T14:55:24,010 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.computation.buffer.poolCacheMaxCount, ${base_path}.buffer.poolCacheMaxCount] on [io.druid.query.DruidProcessingConfig#poolCacheMaxCount()]
2018-03-29T14:55:24,011 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.tmpDir] on [io.druid.query.DruidProcessingConfig#getTmpDir()]
2018-03-29T14:55:24,011 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.fifo] on [io.druid.query.DruidProcessingConfig#isFifo()]
2018-03-29T14:55:24,011 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Assigning value [2] for [druid.processing.numThreads] on [io.druid.query.DruidProcessingConfig#getNumThreadsConfigured()]
2018-03-29T14:55:24,011 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.numMergeBuffers] on [io.druid.query.DruidProcessingConfig#getNumMergeBuffersConfigured()]
2018-03-29T14:55:24,012 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.columnCache.sizeBytes] on [io.druid.query.DruidProcessingConfig#columnCacheSizeBytes()]
2018-03-29T14:55:24,012 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Assigning default value [processing-%s] for [${base_path}.formatString] on [io.druid.java.util.common.concurrent.ExecutorServiceConfig#getFormatString()]
2018-03-29T14:55:24,115 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.indexer.HadoopKerberosConfig] from props[druid.hadoop.security.kerberos.] as [io.druid.indexer.HadoopKerberosConfig@0]
2018-03-29T14:55:24,122 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.storage.hdfs.HdfsDataSegmentPusherConfig] from props[druid.storage.] as [io.druid.storage.hdfs.HdfsDataSegmentPusherConfig@4c55d286]
2018-03-29T14:55:24,124 INFO [task-runner-0-priority-0] io.druid.storage.hdfs.HdfsDataSegmentPusher - Configured HDFS as deep storage
2018-03-29T14:55:24,284 INFO [task-runner-0-priority-0] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties
2018-03-29T14:55:24,284 INFO [task-runner-0-priority-0] io.druid.guice.PropertiesModule - Loading properties from runtime.properties
2018-03-29T14:55:24,293 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.segment.NullValueHandlingConfig] from props[druid.null.handling.] as [io.druid.segment.NullValueHandlingConfig@4b4d4e43]
2018-03-29T14:55:24,299 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, directory='/usr/hdp/current/druid-middlemanager/extensions', hadoopDependenciesDir='/usr/hdp/current/druid-middlemanager/hadoop-dependencies', hadoopContainerDruidClasspath='null', addExtensionsToHadoopContainer=false, loadList=[druid-datasketches, druid-hdfs-storage, druid-kafka-indexing-service]}]
2018-03-29T14:55:24,300 INFO [task-runner-0-priority-0] io.druid.indexing.common.task.HadoopIndexTask - Starting a hadoop determine configuration job...
2018-03-29T14:55:24,345 INFO [task-runner-0-priority-0] io.druid.indexer.path.StaticPathSpec - Adding paths[quickstart/wikiticker-2015-09-12-sampled.json.gz]
2018-03-29T14:55:25,184 INFO [task-runner-0-priority-0] io.druid.indexer.path.StaticPathSpec - Adding paths[quickstart/wikiticker-2015-09-12-sampled.json.gz]
2018-03-29T14:55:25,513 INFO [task-runner-0-priority-0] org.apache.hadoop.yarn.client.RMProxy - Connecting to ResourceManager at sandbox-hdp.hortonworks.com/172.17.0.2:8032
2018-03-29T14:55:25,645 INFO [task-runner-0-priority-0] org.apache.hadoop.yarn.client.AHSProxy - Connecting to Application History server at sandbox-hdp.hortonworks.com/172.17.0.2:10200
2018-03-29T14:55:25,774 WARN [task-runner-0-priority-0] org.apache.hadoop.mapreduce.JobResourceUploader - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2018-03-29T14:55:25,785 WARN [task-runner-0-priority-0] org.apache.hadoop.mapreduce.JobResourceUploader - No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
2018-03-29T14:55:26,396 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.JobSubmitter - Cleaning up the staging area /user/druid/.staging/job_1522329361898_0001
2018-03-29T14:55:26,406 ERROR [task-runner-0-priority-0] io.druid.indexing.overlord.ThreadPoolTaskRunner - Exception while running task[HadoopIndexTask{id=index_hadoop_wikiticker_2018-03-29T14:55:14.270Z, type=index_hadoop, dataSource=wikiticker}]
java.lang.RuntimeException: java.lang.reflect.InvocationTargetException
	at com.google.common.base.Throwables.propagate(Throwables.java:160) ~[guava-16.0.1.jar:?]
	at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:218) ~[druid-indexing-service-0.10.1.2.6.4.0-91.jar:0.10.1.2.6.4.0-91]
	at io.druid.indexing.common.task.HadoopIndexTask.run(HadoopIndexTask.java:178) ~[druid-indexing-service-0.10.1.2.6.4.0-91.jar:0.10.1.2.6.4.0-91]
	at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:436) [druid-indexing-service-0.10.1.2.6.4.0-91.jar:0.10.1.2.6.4.0-91]
	at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:408) [druid-indexing-service-0.10.1.2.6.4.0-91.jar:0.10.1.2.6.4.0-91]
	at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_161]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_161]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_161]
	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_161]
Caused by: java.lang.reflect.InvocationTargetException
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_161]
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_161]
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_161]
	at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_161]
	at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:215) ~[druid-indexing-service-0.10.1.2.6.4.0-91.jar:0.10.1.2.6.4.0-91]
	... 7 more
Caused by: java.lang.RuntimeException: org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: hdfs://sandbox-hdp.hortonworks.com:8020/user/druid/quickstart/wikiticker-2015-09-12-sampled.json.gz
	at com.google.common.base.Throwables.propagate(Throwables.java:160) ~[guava-16.0.1.jar:?]
	at io.druid.indexer.DetermineHashedPartitionsJob.run(DetermineHashedPartitionsJob.java:210) ~[druid-indexing-hadoop-0.10.1.2.6.4.0-91.jar:0.10.1.2.6.4.0-91]
	at io.druid.indexer.JobHelper.runJobs(JobHelper.java:369) ~[druid-indexing-hadoop-0.10.1.2.6.4.0-91.jar:0.10.1.2.6.4.0-91]
	at io.druid.indexer.HadoopDruidDetermineConfigurationJob.run(HadoopDruidDetermineConfigurationJob.java:91) ~[druid-indexing-hadoop-0.10.1.2.6.4.0-91.jar:0.10.1.2.6.4.0-91]
	at io.druid.indexing.common.task.HadoopIndexTask$HadoopDetermineConfigInnerProcessing.runTask(HadoopIndexTask.java:308) ~[druid-indexing-service-0.10.1.2.6.4.0-91.jar:0.10.1.2.6.4.0-91]
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_161]
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_161]
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_161]
	at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_161]
	at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:215) ~[druid-indexing-service-0.10.1.2.6.4.0-91.jar:0.10.1.2.6.4.0-91]
	... 7 more
Caused by: org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: hdfs://sandbox-hdp.hortonworks.com:8020/user/druid/quickstart/wikiticker-2015-09-12-sampled.json.gz
	at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.singleThreadedListStatus(FileInputFormat.java:323) ~[?:?]
	at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:265) ~[?:?]
	at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:387) ~[?:?]
	at org.apache.hadoop.mapreduce.lib.input.DelegatingInputFormat.getSplits(DelegatingInputFormat.java:115) ~[?:?]
	at org.apache.hadoop.mapreduce.JobSubmitter.writeNewSplits(JobSubmitter.java:301) ~[?:?]
	at org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:318) ~[?:?]
	at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:196) ~[?:?]
	at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290) ~[?:?]
	at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1287) ~[?:?]
	at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_161]
	at javax.security.auth.Subject.doAs(Subject.java:422) ~[?:1.8.0_161]
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1869) ~[?:?]
	at org.apache.hadoop.mapreduce.Job.submit(Job.java:1287) ~[?:?]
	at io.druid.indexer.DetermineHashedPartitionsJob.run(DetermineHashedPartitionsJob.java:118) ~[druid-indexing-hadoop-0.10.1.2.6.4.0-91.jar:0.10.1.2.6.4.0-91]
	at io.druid.indexer.JobHelper.runJobs(JobHelper.java:369) ~[druid-indexing-hadoop-0.10.1.2.6.4.0-91.jar:0.10.1.2.6.4.0-91]
	at io.druid.indexer.HadoopDruidDetermineConfigurationJob.run(HadoopDruidDetermineConfigurationJob.java:91) ~[druid-indexing-hadoop-0.10.1.2.6.4.0-91.jar:0.10.1.2.6.4.0-91]
	at io.druid.indexing.common.task.HadoopIndexTask$HadoopDetermineConfigInnerProcessing.runTask(HadoopIndexTask.java:308) ~[druid-indexing-service-0.10.1.2.6.4.0-91.jar:0.10.1.2.6.4.0-91]
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_161]
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_161]
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_161]
	at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_161]
	at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:215) ~[druid-indexing-service-0.10.1.2.6.4.0-91.jar:0.10.1.2.6.4.0-91]
	... 7 more
2018-03-29T14:55:26,421 INFO [task-runner-0-priority-0] io.druid.indexing.overlord.TaskRunnerUtils - Task [index_hadoop_wikiticker_2018-03-29T14:55:14.270Z] status changed to [FAILED].
2018-03-29T14:55:26,428 INFO [task-runner-0-priority-0] io.druid.indexing.worker.executor.ExecutorLifecycle - Task completed with status: {
  "id" : "index_hadoop_wikiticker_2018-03-29T14:55:14.270Z",
  "status" : "FAILED",
  "duration" : 6396
}
2018-03-29T14:55:26,435 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.server.listener.announcer.ListenerResourceAnnouncer.stop()] on object[io.druid.query.lookup.LookupResourceListenerAnnouncer@577bfadb].
2018-03-29T14:55:26,435 INFO [main] io.druid.curator.announcement.Announcer - unannouncing [/druid/listeners/lookups/__default/sandbox-hdp.hortonworks.com:8100]
2018-03-29T14:55:26,452 INFO [main] io.druid.server.listener.announcer.ListenerResourceAnnouncer - Unannouncing start time on [/druid/listeners/lookups/__default/sandbox-hdp.hortonworks.com:8100]
2018-03-29T14:55:26,456 INFO [main] org.eclipse.jetty.server.AbstractConnector - Stopped ServerConnector@4adf3582{HTTP/1.1,[http/1.1]}{0.0.0.0:8100}
2018-03-29T14:55:26,457 INFO [main] org.eclipse.jetty.server.handler.ContextHandler - Stopped o.e.j.s.ServletContextHandler@3f3c8b60{/,null,UNAVAILABLE}
2018-03-29T14:55:26,462 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.indexing.worker.executor.ExecutorLifecycle.stop() throws java.lang.Exception] on object[io.druid.indexing.worker.executor.ExecutorLifecycle@1b37fbec].
2018-03-29T14:55:26,463 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.indexing.overlord.ThreadPoolTaskRunner.stop()] on object[io.druid.indexing.overlord.ThreadPoolTaskRunner@7493d937].
2018-03-29T14:55:26,463 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.curator.discovery.ServerDiscoverySelector.stop() throws java.io.IOException] on object[io.druid.curator.discovery.ServerDiscoverySelector@40df6090].
2018-03-29T14:55:26,466 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.curator.announcement.Announcer.stop()] on object[io.druid.curator.announcement.Announcer@69796bd0].
2018-03-29T14:55:26,467 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.curator.discovery.ServerDiscoverySelector.stop() throws java.io.IOException] on object[io.druid.curator.discovery.ServerDiscoverySelector@44bc2449].
2018-03-29T14:55:26,467 INFO [main] io.druid.curator.CuratorModule - Stopping Curator
2018-03-29T14:55:26,468 INFO [Curator-Framework-0] org.apache.curator.framework.imps.CuratorFrameworkImpl - backgroundOperationsLoop exiting
2018-03-29T14:55:26,472 INFO [main] org.apache.zookeeper.ZooKeeper - Session: 0x16271e552860016 closed
2018-03-29T14:55:26,472 INFO [main-EventThread] org.apache.zookeeper.ClientCnxn - EventThread shut down
2018-03-29T14:55:26,472 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.http.client.NettyHttpClient.stop()] on object[com.metamx.http.client.NettyHttpClient@339f3a55].
2018-03-29T14:55:26,503 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.storage.hdfs.HdfsStorageAuthentication.stop()] on object[io.druid.storage.hdfs.HdfsStorageAuthentication@7aea704c].
2018-03-29T14:55:26,504 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.metrics.MonitorScheduler.stop()] on object[com.metamx.metrics.MonitorScheduler@450f0235].
2018-03-29T14:55:26,504 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.query.lookup.LookupReferencesManager.stop()] on object[io.druid.query.lookup.LookupReferencesManager@19827608].
2018-03-29T14:55:26,504 INFO [main] io.druid.query.lookup.LookupReferencesManager - LookupReferencesManager is stopping.
2018-03-29T14:55:26,509 INFO [LookupReferencesManager-MainThread] io.druid.query.lookup.LookupReferencesManager - Lookup Management loop exited, Lookup notices are not handled anymore.
2018-03-29T14:55:26,511 INFO [main] io.druid.query.lookup.LookupReferencesManager - LookupReferencesManager is stopped.
2018-03-29T14:55:26,511 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.emitter.service.ServiceEmitter.close() throws java.io.IOException] on object[com.metamx.emitter.service.ServiceEmitter@5b2b8d86].
2018-03-29T14:55:26,511 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner.stop()] on object[io.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner@4f081b5d].
2018-03-29 14:55:26,579 pool-1-thread-1 ERROR Unable to register shutdown hook because JVM is shutting down. java.lang.IllegalStateException: Not started
	at io.druid.common.config.Log4jShutdown.addShutdownCallback(Log4jShutdown.java:46)
	at org.apache.logging.log4j.core.impl.Log4jContextFactory.addShutdownCallback(Log4jContextFactory.java:273)
	at org.apache.logging.log4j.core.LoggerContext.setUpShutdownHook(LoggerContext.java:256)
	at org.apache.logging.log4j.core.LoggerContext.start(LoggerContext.java:216)
	at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:145)
	at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:41)
	at org.apache.logging.log4j.LogManager.getContext(LogManager.java:182)
	at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:103)
	at org.apache.logging.slf4j.Log4jLoggerFactory.getContext(Log4jLoggerFactory.java:43)
	at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:42)
	at org.apache.logging.slf4j.Log4jLoggerFactory.getLogger(Log4jLoggerFactory.java:29)
	at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:253)
	at org.apache.commons.logging.impl.SLF4JLogFactory.getInstance(SLF4JLogFactory.java:155)
	at org.apache.commons.logging.impl.SLF4JLogFactory.getInstance(SLF4JLogFactory.java:132)
	at org.apache.commons.logging.LogFactory.getLog(LogFactory.java:273)
	at org.apache.hadoop.hdfs.LeaseRenewer.<clinit>(LeaseRenewer.java:72)
	at org.apache.hadoop.hdfs.DFSClient.getLeaseRenewer(DFSClient.java:830)
	at org.apache.hadoop.hdfs.DFSClient.close(DFSClient.java:968)
	at org.apache.hadoop.hdfs.DistributedFileSystem.close(DistributedFileSystem.java:1214)
	at org.apache.hadoop.fs.FileSystem$Cache.closeAll(FileSystem.java:2886)
	at org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer.run(FileSystem.java:2903)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

I will try to find the potential solution. I noticed other users using Druid on HDP 2.6 were having issues.

1,727 Views
0 Kudos
1 REPLY 1

jmedel
Contributor

Created ‎04-01-2018 07:42 PM

I realized that the problem was the input path didn't exist and that prevented me from submitting the wikiticker data into Druid. So I created the appropriate directories on HDFS, then stored the dataset into the appropriate data source path that was being referenced in the Druid Hadoop-based Ingestion Spec:

{
    "type" : "index_hadoop",
    "spec" : {
      "dataSchema" : {
        "dataSource" : "wikiticker",
        "parser" : {
          "type" : "hadoopyString",
          "parseSpec" : {
            "format" : "json",
            "timestampSpec" : {
              "format" : "auto",
              "column" : "time"
            },            
            "dimensionsSpec" : {
              "dimensions" : [
                "channel",
                "cityName",
                "comment",
                "countryIsoCode",
                "countryName",
                "isAnonymous",
                "isMinor",
                "isNew",
                "isRobot",
                "isUnpatrolled",
                "metroCode",
                "namespace",
                "page",
                "regionIsoCode",
                "regionName",
                "user"
              ]
            }
          }
        },
        "metricsSpec" : [
          {
            "name" : "count",
            "type" : "count"
          },
          {
            "name" : "added",
            "type" : "longSum",
            "fieldName" : "added"
          },
          {
            "name" : "deleted",
            "type" : "longSum",
            "fieldName" : "deleted"
          },
          {
            "name" : "delta",
            "type" : "longSum",
            "fieldName" : "delta"
          },
          {
            "name" : "user_unique",
            "type" : "hyperUnique",
            "fieldName" : "user"
          }
        ],
        "granularitySpec" : {
          "type" : "uniform",
          "segmentGranularity" : "day",
          "queryGranularity" : "none",
          "intervals" : ["2015-09-12/2015-09-13"]
        }        
      },
      "ioConfig" : {
        "type" : "hadoop",
        "inputSpec" : {
          "type" : "static",
          "paths" : "quickstart/wikiticker-2015-09-12-sampled.json.gz"
        }
      },      
      "tuningConfig" : {
        "type" : "hadoop",
        "partitionsSpec" : {
          "type" : "hashed",
          "targetPartitionSize" : 5000000
        },
        "jobProperties" : {}
      }
    }
}

On the HDP Sandbox, go into web shell client at http://sandbox-hdf.hortonworks.com:4200/

hdfs dfs -mkdir -p /user/druid/quickstart
hdfs dfs -put /usr/hdp/2.6.4.0-91/druid/quickstart/wikiticker-2015-09-12-sampled.json.gz /user/druid/quickstart/

By adding this directory in HDFS, then submitting my Hadoop-based index spec to Druid Overlord that allowed for the task to be successfully submitted and data was ingested into Druid

Run curl command to send spec over HTTP POST request to Druid Overlord:

curl -X 'POST' -H 'Content-Type:application/json' -d @/usr/hdp/2.6.4.0-91/druid/quickstart/wikiticker-index.json localhost:8090/druid/indexer/v1/task
1,163 Views
0 Kudos
Take a Tour of the Community
Don't have an account?
Register
Your experience may be limited. Sign in to explore more.
Announcements
Community Announcements
January 2023 Community Highlights
Product Announcements
[ANNOUNCE] New Cloudera JDBC Connector 2.6.30 for Impala is Released
What's New @ Cloudera
Cloudera Operational Database (COD) provides a CLI option to enable HBase region canaries
What's New @ Cloudera
Cloudera Operational Database (COD) supports creating an operational database using a predefined Data Lake template
What's New @ Cloudera
Cloudera Operational Database (COD) supports configuring JWT authentication for your HBase clients
View More Announcements