Created 10-10-2017 07:00 AM
On my HDP 3.6.1, I am trying to submit a Storm topology. It submits the topology on cluster but also gives following error.
1261 [main] INFO o.a.s.StormSubmitter - Finished submitting topology: T16 1261 [main] INFO o.a.s.StormSubmitter - Initializing the registered ISubmitterHook [org.apache.atlas.storm.hook.StormAtlasHook] 1262 [main] WARN o.a.s.StormSubmitter - Error occurred in invoking submitter hook:[org.apache.atlas.storm.hook.StormAtlasHook] java.lang.ClassNotFoundException: org.apache.atlas.storm.hook.StormAtlasHook at java.net.URLClassLoader.findClass(URLClassLoader.java:381) ~[?:1.8.0_141] at java.lang.ClassLoader.loadClass(ClassLoader.java:424) ~[?:1.8.0_141] at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335) ~[?:1.8.0_141] at java.lang.ClassLoader.loadClass(ClassLoader.java:357) ~[?:1.8.0_141] at java.lang.Class.forName0(Native Method) ~[?:1.8.0_141] at java.lang.Class.forName(Class.java:264) ~[?:1.8.0_141] at org.apache.storm.StormSubmitter.invokeSubmitterHook(StormSubmitter.java:361) [storm-core-1.1.0.2.6.1.0-129.jar:1.1.0.2.6.1.0-129] at org.apache.storm.StormSubmitter.submitTopologyAs(StormSubmitter.java:278) [storm-core-1.1.0.2.6.1.0-129.jar:1.1.0.2.6.1.0-129] at org.apache.storm.StormSubmitter.submitTopology(StormSubmitter.java:390) [storm-core-1.1.0.2.6.1.0-129.jar:1.1.0.2.6.1.0-129] at org.apache.storm.StormSubmitter.submitTopologyWithProgressBar(StormSubmitter.java:426) [storm-core-1.1.0.2.6.1.0-129.jar:1.1.0.2.6.1.0-129] at org.apache.storm.StormSubmitter.submitTopologyWithProgressBar(StormSubmitter.java:407) [storm-core-1.1.0.2.6.1.0-129.jar:1.1.0.2.6.1.0-129] at com.fis.protegent.cat.ReadFromKafka01.main(ReadFromKafka01.java:90) [71daba1cac3d11e781420242ac110002.jar:?] Exception in thread "main" org.apache.storm.hooks.SubmitterHookException: java.lang.ClassNotFoundException: org.apache.atlas.storm.hook.StormAtlasHook at org.apache.storm.StormSubmitter.invokeSubmitterHook(StormSubmitter.java:368) at org.apache.storm.StormSubmitter.submitTopologyAs(StormSubmitter.java:278) at org.apache.storm.StormSubmitter.submitTopology(StormSubmitter.java:390) at org.apache.storm.StormSubmitter.submitTopologyWithProgressBar(StormSubmitter.java:426) at org.apache.storm.StormSubmitter.submitTopologyWithProgressBar(StormSubmitter.java:407) at com.fis.protegent.cat.ReadFromKafka01.main(ReadFromKafka01.java:90) Caused by: java.lang.ClassNotFoundException: org.apache.atlas.storm.hook.StormAtlasHook at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.storm.StormSubmitter.invokeSubmitterHook(StormSubmitter.java:361) ... 5 more
Please suggest what is the underlying issue and how can it be resolved.
Created 10-10-2017 07:04 AM
Are you getting the same error while performing Service check for Storm?
Then it might be related to: https://issues.apache.org/jira/browse/AMBARI-19677
.
You mentioned that your HDP version is "3.6.1" which might be a typo (i assume you wanted to type 2.6.1).... As that version is not yet released so can you please confirm the same by running the "hdp-select" command on any of your host.
# hdp-select
.
What is your Ambari Server Version?
# ambari-server --version
.
Can you please list the output of the following dir output:
# ls -lart /usr/hdp/x.x.x.x-x/storm/extlib/ # ls -lart /usr/hdp/current/atlas-server/hook/storm/
.
Created 10-10-2017 08:15 AM
Jay - Thanks for responding to my question.
Regarding HDP Version - Yes it's 2.6.1.
Please find below rest of the information.
[root@sandbox hdp]# ambari-server --version 2.5.1.0-159 [root@sandbox hdp]# cd /usr/hdp/ [root@sandbox hdp]# ls 2.5.0.0-1245 2.6.1.0-129 current share [root@sandbox hdp]# ls -lart /usr/hdp/2.6.1.0-129/storm/extlib total 8 drwxr-xr-x 2 root root 4096 May 31 04:01 . drwxr-xr-x 1 root root 4096 Jul 28 14:31 .. [root@sandbox hdp]# ls -lart /usr/hdp/current/atlas-server/hook/storm/ total 44 -rw-r--r-- 4 root root 17402 May 31 03:50 atlas-plugin-classloader-0.8.0.2.6.1.0-129.jar -rw-r--r-- 1 root root 10043 May 31 03:50 storm-bridge-shim-0.8.0.2.6.1.0-129.jar drwxr-xr-x 6 root root 4096 Jul 28 13:55 .. drwxr-xr-x 3 root root 4096 Jul 28 14:31 . drwxr-xr-x 2 root root 4096 Jul 28 14:32 atlas-storm-plugin-impl [root@sandbox hdp]#