Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Is the kafka - storm lineage demo description out of date?

Highlighted

Is the kafka - storm lineage demo description out of date?

New Contributor

I was trying to run the kafka - storm lineage demo (https://hortonworks.com/hadoop-tutorial/cross-component-lineage-apache-atlas/#kafka-storm-lineage), but I get an exception at the step 4.4:

... omitted beginning of the log ...

2250 [main] INFO o.a.s.StormSubmitter - Submitting topology storm-demo-topology-02 in distributed mode with conf {"storm.zookeeper.topology.auth.scheme":"digest","storm.zookeeper.topology.auth.payload":"-5877218167981347062:-5909085040730993198","topology.workers":3,"topology.debug":true} 2816 [main] INFO o.a.s.StormSubmitter - Finished submitting topology: storm-demo-topology-02 2816 [main] INFO o.a.s.StormSubmitter - Initializing the registered ISubmitterHook [org.apache.atlas.storm.hook.StormAtlasHook] 2816 [main] WARN o.a.s.StormSubmitter - Error occurred in invoking submitter hook:[org.apache.atlas.storm.hook.StormAtlasHook] java.lang.ClassNotFoundException: org.apache.atlas.storm.hook.StormAtlasHook at java.net.URLClassLoader.findClass(URLClassLoader.java:381) ~[?:1.8.0_141] at java.lang.ClassLoader.loadClass(ClassLoader.java:424) ~[?:1.8.0_141] at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335) ~[?:1.8.0_141] at java.lang.ClassLoader.loadClass(ClassLoader.java:357) ~[?:1.8.0_141] at java.lang.Class.forName0(Native Method) ~[?:1.8.0_141] at java.lang.Class.forName(Class.java:264) ~[?:1.8.0_141] at org.apache.storm.StormSubmitter.invokeSubmitterHook(StormSubmitter.java:361) [storm-core-1.1.0.2.6.1.0-129.jar:1.1.0.2.6.1.0-129] at org.apache.storm.StormSubmitter.submitTopologyAs(StormSubmitter.java:278) [storm-core-1.1.0.2.6.1.0-129.jar:1.1.0.2.6.1.0-129] at org.apache.storm.StormSubmitter.submitTopology(StormSubmitter.java:390) [storm-core-1.1.0.2.6.1.0-129.jar:1.1.0.2.6.1.0-129] at org.apache.storm.StormSubmitter.submitTopology(StormSubmitter.java:162) [storm-core-1.1.0.2.6.1.0-129.jar:1.1.0.2.6.1.0-129] at com.dsinpractice.storm.samples.WordCountTopology.main(WordCountTopology.java:140) [d986ce02b31911e7801c0242ac110002.jar:?] Exception in thread "main" org.apache.storm.hooks.SubmitterHookException: java.lang.ClassNotFoundException: org.apache.atlas.storm.hook.StormAtlasHook at org.apache.storm.StormSubmitter.invokeSubmitterHook(StormSubmitter.java:368) at org.apache.storm.StormSubmitter.submitTopologyAs(StormSubmitter.java:278) at org.apache.storm.StormSubmitter.submitTopology(StormSubmitter.java:390) at org.apache.storm.StormSubmitter.submitTopology(StormSubmitter.java:162) at com.dsinpractice.storm.samples.WordCountTopology.main(WordCountTopology.java:140) Caused by: java.lang.ClassNotFoundException: org.apache.atlas.storm.hook.StormAtlasHook at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.storm.StormSubmitter.invokeSubmitterHook(StormSubmitter.java:361) ... 4 more

I can see the demo was written with sandbox 2.5 in mind, but I tried to run it with 2.6. Not sure if this is the reason of the error. For example the sqoop -demo worked ok, even if one link was wrong that was easy to fix.

Is there some workaround for this or did I just make a mistake somewhere?

Don't have an account?
Coming from Hortonworks? Activate your account here