Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Error submitting Storm Topology StormAtlasHook

Error submitting Storm Topology StormAtlasHook

On my HDP 3.6.1, I am trying to submit a Storm topology. It submits the topology on cluster but also gives following error.

1261 [main] INFO  o.a.s.StormSubmitter - Finished submitting topology: T16
1261 [main] INFO  o.a.s.StormSubmitter - Initializing the registered ISubmitterHook [org.apache.atlas.storm.hook.StormAtlasHook]
1262 [main] WARN  o.a.s.StormSubmitter - Error occurred in invoking submitter hook:[org.apache.atlas.storm.hook.StormAtlasHook]
java.lang.ClassNotFoundException: org.apache.atlas.storm.hook.StormAtlasHook
        at java.net.URLClassLoader.findClass(URLClassLoader.java:381) ~[?:1.8.0_141]
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424) ~[?:1.8.0_141]
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335) ~[?:1.8.0_141]
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357) ~[?:1.8.0_141]
        at java.lang.Class.forName0(Native Method) ~[?:1.8.0_141]
        at java.lang.Class.forName(Class.java:264) ~[?:1.8.0_141]
        at org.apache.storm.StormSubmitter.invokeSubmitterHook(StormSubmitter.java:361) [storm-core-1.1.0.2.6.1.0-129.jar:1.1.0.2.6.1.0-129]
        at org.apache.storm.StormSubmitter.submitTopologyAs(StormSubmitter.java:278) [storm-core-1.1.0.2.6.1.0-129.jar:1.1.0.2.6.1.0-129]
        at org.apache.storm.StormSubmitter.submitTopology(StormSubmitter.java:390) [storm-core-1.1.0.2.6.1.0-129.jar:1.1.0.2.6.1.0-129]
        at org.apache.storm.StormSubmitter.submitTopologyWithProgressBar(StormSubmitter.java:426) [storm-core-1.1.0.2.6.1.0-129.jar:1.1.0.2.6.1.0-129]
        at org.apache.storm.StormSubmitter.submitTopologyWithProgressBar(StormSubmitter.java:407) [storm-core-1.1.0.2.6.1.0-129.jar:1.1.0.2.6.1.0-129]
        at com.fis.protegent.cat.ReadFromKafka01.main(ReadFromKafka01.java:90) [71daba1cac3d11e781420242ac110002.jar:?]
Exception in thread "main" org.apache.storm.hooks.SubmitterHookException: java.lang.ClassNotFoundException: org.apache.atlas.storm.hook.StormAtlasHook
        at org.apache.storm.StormSubmitter.invokeSubmitterHook(StormSubmitter.java:368)
        at org.apache.storm.StormSubmitter.submitTopologyAs(StormSubmitter.java:278)
        at org.apache.storm.StormSubmitter.submitTopology(StormSubmitter.java:390)
        at org.apache.storm.StormSubmitter.submitTopologyWithProgressBar(StormSubmitter.java:426)
        at org.apache.storm.StormSubmitter.submitTopologyWithProgressBar(StormSubmitter.java:407)
        at com.fis.protegent.cat.ReadFromKafka01.main(ReadFromKafka01.java:90)
Caused by: java.lang.ClassNotFoundException: org.apache.atlas.storm.hook.StormAtlasHook
        at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
        at java.lang.Class.forName0(Native Method)
        at java.lang.Class.forName(Class.java:264)
        at org.apache.storm.StormSubmitter.invokeSubmitterHook(StormSubmitter.java:361)
        ... 5 more

Please suggest what is the underlying issue and how can it be resolved.

2 REPLIES 2
Highlighted

Re: Error submitting Storm Topology StormAtlasHook

Super Mentor

@Beejal Vibhakar

Are you getting the same error while performing Service check for Storm?

Then it might be related to: https://issues.apache.org/jira/browse/AMBARI-19677

.

You mentioned that your HDP version is "3.6.1" which might be a typo (i assume you wanted to type 2.6.1).... As that version is not yet released so can you please confirm the same by running the "hdp-select" command on any of your host.

# hdp-select

.

What is your Ambari Server Version?

# ambari-server --version

.

Can you please list the output of the following dir output:

# ls -lart /usr/hdp/x.x.x.x-x/storm/extlib/
# ls -lart /usr/hdp/current/atlas-server/hook/storm/

.

Highlighted

Re: Error submitting Storm Topology StormAtlasHook

Jay - Thanks for responding to my question.

Regarding HDP Version - Yes it's 2.6.1.

Please find below rest of the information.

[root@sandbox hdp]# ambari-server --version
2.5.1.0-159
[root@sandbox hdp]# cd /usr/hdp/
[root@sandbox hdp]# ls
2.5.0.0-1245  2.6.1.0-129  current  share
[root@sandbox hdp]# ls -lart /usr/hdp/2.6.1.0-129/storm/extlib
total 8
drwxr-xr-x 2 root root 4096 May 31 04:01 .
drwxr-xr-x 1 root root 4096 Jul 28 14:31 ..
[root@sandbox hdp]# ls -lart /usr/hdp/current/atlas-server/hook/storm/
total 44
-rw-r--r-- 4 root root 17402 May 31 03:50 atlas-plugin-classloader-0.8.0.2.6.1.0-129.jar
-rw-r--r-- 1 root root 10043 May 31 03:50 storm-bridge-shim-0.8.0.2.6.1.0-129.jar
drwxr-xr-x 6 root root  4096 Jul 28 13:55 ..
drwxr-xr-x 3 root root  4096 Jul 28 14:31 .
drwxr-xr-x 2 root root  4096 Jul 28 14:32 atlas-storm-plugin-impl
[root@sandbox hdp]#
Don't have an account?
Coming from Hortonworks? Activate your account here