Support Questions
Find answers, ask questions, and share your expertise

Error submitting Storm Topology StormAtlasHook

On my HDP 3.6.1, I am trying to submit a Storm topology. It submits the topology on cluster but also gives following error.

1261 [main] INFO  o.a.s.StormSubmitter - Finished submitting topology: T16
1261 [main] INFO  o.a.s.StormSubmitter - Initializing the registered ISubmitterHook [org.apache.atlas.storm.hook.StormAtlasHook]
1262 [main] WARN  o.a.s.StormSubmitter - Error occurred in invoking submitter hook:[org.apache.atlas.storm.hook.StormAtlasHook]
java.lang.ClassNotFoundException: org.apache.atlas.storm.hook.StormAtlasHook
        at java.net.URLClassLoader.findClass(URLClassLoader.java:381) ~[?:1.8.0_141]
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424) ~[?:1.8.0_141]
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335) ~[?:1.8.0_141]
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357) ~[?:1.8.0_141]
        at java.lang.Class.forName0(Native Method) ~[?:1.8.0_141]
        at java.lang.Class.forName(Class.java:264) ~[?:1.8.0_141]
        at org.apache.storm.StormSubmitter.invokeSubmitterHook(StormSubmitter.java:361) [storm-core-1.1.0.2.6.1.0-129.jar:1.1.0.2.6.1.0-129]
        at org.apache.storm.StormSubmitter.submitTopologyAs(StormSubmitter.java:278) [storm-core-1.1.0.2.6.1.0-129.jar:1.1.0.2.6.1.0-129]
        at org.apache.storm.StormSubmitter.submitTopology(StormSubmitter.java:390) [storm-core-1.1.0.2.6.1.0-129.jar:1.1.0.2.6.1.0-129]
        at org.apache.storm.StormSubmitter.submitTopologyWithProgressBar(StormSubmitter.java:426) [storm-core-1.1.0.2.6.1.0-129.jar:1.1.0.2.6.1.0-129]
        at org.apache.storm.StormSubmitter.submitTopologyWithProgressBar(StormSubmitter.java:407) [storm-core-1.1.0.2.6.1.0-129.jar:1.1.0.2.6.1.0-129]
        at com.fis.protegent.cat.ReadFromKafka01.main(ReadFromKafka01.java:90) [71daba1cac3d11e781420242ac110002.jar:?]
Exception in thread "main" org.apache.storm.hooks.SubmitterHookException: java.lang.ClassNotFoundException: org.apache.atlas.storm.hook.StormAtlasHook
        at org.apache.storm.StormSubmitter.invokeSubmitterHook(StormSubmitter.java:368)
        at org.apache.storm.StormSubmitter.submitTopologyAs(StormSubmitter.java:278)
        at org.apache.storm.StormSubmitter.submitTopology(StormSubmitter.java:390)
        at org.apache.storm.StormSubmitter.submitTopologyWithProgressBar(StormSubmitter.java:426)
        at org.apache.storm.StormSubmitter.submitTopologyWithProgressBar(StormSubmitter.java:407)
        at com.fis.protegent.cat.ReadFromKafka01.main(ReadFromKafka01.java:90)
Caused by: java.lang.ClassNotFoundException: org.apache.atlas.storm.hook.StormAtlasHook
        at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
        at java.lang.Class.forName0(Native Method)
        at java.lang.Class.forName(Class.java:264)
        at org.apache.storm.StormSubmitter.invokeSubmitterHook(StormSubmitter.java:361)
        ... 5 more

Please suggest what is the underlying issue and how can it be resolved.

2 REPLIES 2

Re: Error submitting Storm Topology StormAtlasHook

Super Mentor

@Beejal Vibhakar

Are you getting the same error while performing Service check for Storm?

Then it might be related to: https://issues.apache.org/jira/browse/AMBARI-19677

.

You mentioned that your HDP version is "3.6.1" which might be a typo (i assume you wanted to type 2.6.1).... As that version is not yet released so can you please confirm the same by running the "hdp-select" command on any of your host.

# hdp-select

.

What is your Ambari Server Version?

# ambari-server --version

.

Can you please list the output of the following dir output:

# ls -lart /usr/hdp/x.x.x.x-x/storm/extlib/
# ls -lart /usr/hdp/current/atlas-server/hook/storm/

.

Re: Error submitting Storm Topology StormAtlasHook

Jay - Thanks for responding to my question.

Regarding HDP Version - Yes it's 2.6.1.

Please find below rest of the information.

[root@sandbox hdp]# ambari-server --version
2.5.1.0-159
[root@sandbox hdp]# cd /usr/hdp/
[root@sandbox hdp]# ls
2.5.0.0-1245  2.6.1.0-129  current  share
[root@sandbox hdp]# ls -lart /usr/hdp/2.6.1.0-129/storm/extlib
total 8
drwxr-xr-x 2 root root 4096 May 31 04:01 .
drwxr-xr-x 1 root root 4096 Jul 28 14:31 ..
[root@sandbox hdp]# ls -lart /usr/hdp/current/atlas-server/hook/storm/
total 44
-rw-r--r-- 4 root root 17402 May 31 03:50 atlas-plugin-classloader-0.8.0.2.6.1.0-129.jar
-rw-r--r-- 1 root root 10043 May 31 03:50 storm-bridge-shim-0.8.0.2.6.1.0-129.jar
drwxr-xr-x 6 root root  4096 Jul 28 13:55 ..
drwxr-xr-x 3 root root  4096 Jul 28 14:31 .
drwxr-xr-x 2 root root  4096 Jul 28 14:32 atlas-storm-plugin-impl
[root@sandbox hdp]#