Running: /data/jdk1.8.0_131/bin/java -server -Ddaemon.name= -Dstorm.options= -Dstorm.home=/usr/hdp/2.5.3.0-37/storm -Dstorm.log.dir=/var/log/storm -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file= -cp /usr/hdp/2.5.3.0-37/storm/lib/flux-core-1.0.1.jar:/usr/hdp/2.5.3.0-37/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/hdp/2.5.3.0-37/storm/lib/zookeeper.jar:/usr/hdp/2.5.3.0-37/storm/lib/log4j-core-2.1.jar:/usr/hdp/2.5.3.0-37/storm/lib/servlet-api-2.5.jar:/usr/hdp/2.5.3.0-37/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/hdp/2.5.3.0-37/storm/lib/asm-5.0.3.jar:/usr/hdp/2.5.3.0-37/storm/lib/ring-cors-0.1.5.jar:/usr/hdp/2.5.3.0-37/storm/lib/storm-core-1.0.1.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/storm/lib/clojure-1.7.0.jar:/usr/hdp/2.5.3.0-37/storm/lib/storm-rename-hack-1.0.1.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/storm/lib/reflectasm-1.10.1.jar:/usr/hdp/2.5.3.0-37/storm/lib/log4j-api-2.1.jar:/usr/hdp/2.5.3.0-37/storm/lib/objenesis-2.1.jar:/usr/hdp/2.5.3.0-37/storm/lib/slf4j-api-1.7.7.jar:/usr/hdp/2.5.3.0-37/storm/lib/ambari-metrics-storm-sink.jar:/usr/hdp/2.5.3.0-37/storm/lib/kryo-3.0.3.jar:/usr/hdp/2.5.3.0-37/storm/lib/disruptor-3.3.2.jar:/usr/hdp/2.5.3.0-37/storm/lib/minlog-1.3.0.jar:/usr/hdp/2.5.3.0-37/storm/extlib/atlas-plugin-classloader-0.7.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/storm/extlib/storm-bridge-shim-0.7.0.2.5.3.0-37.jar org.apache.storm.daemon.ClientJarTransformerRunner org.apache.storm.hack.StormShadeTransformer /usr/metron/0.4.1/lib/metron-elasticsearch-0.4.1-uber.jar /tmp/371c022cd0d811e7a1a60a59f16be85c.jar Running: /data/jdk1.8.0_131/bin/java -client -Ddaemon.name= -Dstorm.options= -Dstorm.home=/usr/hdp/2.5.3.0-37/storm -Dstorm.log.dir=/var/log/storm -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib:/usr/hdp/current/storm-client/lib -Dstorm.conf.file= -cp /usr/hdp/2.5.3.0-37/storm/lib/flux-core-1.0.1.jar:/usr/hdp/2.5.3.0-37/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/hdp/2.5.3.0-37/storm/lib/zookeeper.jar:/usr/hdp/2.5.3.0-37/storm/lib/log4j-core-2.1.jar:/usr/hdp/2.5.3.0-37/storm/lib/servlet-api-2.5.jar:/usr/hdp/2.5.3.0-37/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/hdp/2.5.3.0-37/storm/lib/asm-5.0.3.jar:/usr/hdp/2.5.3.0-37/storm/lib/ring-cors-0.1.5.jar:/usr/hdp/2.5.3.0-37/storm/lib/storm-core-1.0.1.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/storm/lib/clojure-1.7.0.jar:/usr/hdp/2.5.3.0-37/storm/lib/storm-rename-hack-1.0.1.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/storm/lib/reflectasm-1.10.1.jar:/usr/hdp/2.5.3.0-37/storm/lib/log4j-api-2.1.jar:/usr/hdp/2.5.3.0-37/storm/lib/objenesis-2.1.jar:/usr/hdp/2.5.3.0-37/storm/lib/slf4j-api-1.7.7.jar:/usr/hdp/2.5.3.0-37/storm/lib/ambari-metrics-storm-sink.jar:/usr/hdp/2.5.3.0-37/storm/lib/kryo-3.0.3.jar:/usr/hdp/2.5.3.0-37/storm/lib/disruptor-3.3.2.jar:/usr/hdp/2.5.3.0-37/storm/lib/minlog-1.3.0.jar:/usr/hdp/2.5.3.0-37/storm/extlib/atlas-plugin-classloader-0.7.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/storm/extlib/storm-bridge-shim-0.7.0.2.5.3.0-37.jar:/tmp/371c022cd0d811e7a1a60a59f16be85c.jar:/usr/hdp/current/storm-nimbus/conf:/usr/hdp/2.5.3.0-37/storm/bin -Dstorm.jar=/tmp/371c022cd0d811e7a1a60a59f16be85c.jar org.apache.storm.flux.Flux --remote /usr/metron/0.4.1/flux/indexing/remote.yaml --filter /usr/metron/0.4.1/config/elasticsearch.properties âââââââââââ âââ ââââââ âââ ââââââââ ââââââ âââ âââ âââ ââââââ âââ âââââââââââââââââ âââ +- Apache Storm -+ +- data FLow User eXperience -+ Version: 1.0.1 Parsing file: /usr/metron/0.4.1/flux/indexing/remote.yaml 601 [main] INFO o.a.s.f.p.FluxParser - loading YAML from input stream... 604 [main] INFO o.a.s.f.p.FluxParser - Performing property substitution. 611 [main] INFO o.a.s.f.p.FluxParser - Not performing environment variable substitution. 819 [main] INFO o.a.c.f.i.CuratorFrameworkImpl - Starting 908 [main-EventThread] INFO o.a.c.f.s.ConnectionStateManager - State change: CONNECTED 2178 [main] INFO o.a.s.f.FluxBuilder - Detected DSL topology... 2332 [main] INFO o.a.m.w.b.BulkMessageWriterBolt - Requesting topology.tick.tuple.freq.secs set to 14 2362 [main] INFO o.a.m.w.b.BulkMessageWriterBolt - Requesting topology.tick.tuple.freq.secs set to 14 2380 [main] INFO o.a.m.w.b.BulkMessageWriterBolt - Requesting topology.tick.tuple.freq.secs set to 14 ---------- TOPOLOGY DETAILS ---------- Topology Name: indexing --------------- SPOUTS --------------- kafkaSpout [1] (org.apache.metron.storm.kafka.flux.StormKafkaSpout) ---------------- BOLTS --------------- indexingBolt [1] (org.apache.metron.writer.bolt.BulkMessageWriterBolt) hdfsIndexingBolt [1] (org.apache.metron.writer.bolt.BulkMessageWriterBolt) indexingErrorBolt [1] (org.apache.metron.writer.bolt.BulkMessageWriterBolt) --------------- STREAMS --------------- kafkaSpout --SHUFFLE--> indexingBolt kafkaSpout --SHUFFLE--> hdfsIndexingBolt indexingBolt --SHUFFLE--> indexingErrorBolt hdfsIndexingBolt --SHUFFLE--> indexingErrorBolt -------------------------------------- 2470 [main] INFO o.a.s.f.Flux - Running remotely... 2470 [main] INFO o.a.s.f.Flux - Deploying topology in an ACTIVE state... 2497 [main] INFO o.a.s.StormSubmitter - Generated ZooKeeper secret payload for MD5-digest: -9047232184443224394:-8109854669876438578 Exception in thread "main" java.lang.RuntimeException: java.lang.ClassNotFoundException: at org.apache.storm.security.auth.AuthUtils.GetAutoCredentials(AuthUtils.java:211) at org.apache.storm.StormSubmitter.populateCredentials(StormSubmitter.java:92) at org.apache.storm.StormSubmitter.submitTopologyAs(StormSubmitter.java:214) at org.apache.storm.StormSubmitter.submitTopology(StormSubmitter.java:310) at org.apache.storm.flux.Flux.runCli(Flux.java:171) at org.apache.storm.flux.Flux.main(Flux.java:98) Caused by: java.lang.ClassNotFoundException: at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.storm.security.auth.AuthUtils.GetAutoCredentials(AuthUtils.java:203)