Member since
09-11-2017
8
Posts
0
Kudos Received
0
Solutions
10-17-2017
08:54 AM
You can try this tutorial https://hortonworks.com/tutorial/real-time-event-processing-in-nifi-sam-schema-registry-and-superset
... View more
10-16-2017
03:55 PM
It works at port 8080 instead of port 9080. So by changing URL to http://sandbox-hdf.hortonworks.com:8080/api/v1/clusters/Sandbox, I was able to add the Service Pool.
... View more
10-10-2017
08:15 AM
Jay - Thanks for responding to my question. Regarding HDP Version - Yes it's 2.6.1. Please find below rest of the information. [root@sandbox hdp]# ambari-server --version
2.5.1.0-159
[root@sandbox hdp]# cd /usr/hdp/
[root@sandbox hdp]# ls
2.5.0.0-1245 2.6.1.0-129 current share
[root@sandbox hdp]# ls -lart /usr/hdp/2.6.1.0-129/storm/extlib
total 8
drwxr-xr-x 2 root root 4096 May 31 04:01 .
drwxr-xr-x 1 root root 4096 Jul 28 14:31 ..
[root@sandbox hdp]# ls -lart /usr/hdp/current/atlas-server/hook/storm/
total 44
-rw-r--r-- 4 root root 17402 May 31 03:50 atlas-plugin-classloader-0.8.0.2.6.1.0-129.jar
-rw-r--r-- 1 root root 10043 May 31 03:50 storm-bridge-shim-0.8.0.2.6.1.0-129.jar
drwxr-xr-x 6 root root 4096 Jul 28 13:55 ..
drwxr-xr-x 3 root root 4096 Jul 28 14:31 .
drwxr-xr-x 2 root root 4096 Jul 28 14:32 atlas-storm-plugin-impl
[root@sandbox hdp]#
... View more
10-10-2017
07:00 AM
On my HDP 3.6.1, I am trying to submit a Storm topology. It submits the topology on cluster but also gives following error. 1261 [main] INFO o.a.s.StormSubmitter - Finished submitting topology: T16
1261 [main] INFO o.a.s.StormSubmitter - Initializing the registered ISubmitterHook [org.apache.atlas.storm.hook.StormAtlasHook]
1262 [main] WARN o.a.s.StormSubmitter - Error occurred in invoking submitter hook:[org.apache.atlas.storm.hook.StormAtlasHook]
java.lang.ClassNotFoundException: org.apache.atlas.storm.hook.StormAtlasHook
at java.net.URLClassLoader.findClass(URLClassLoader.java:381) ~[?:1.8.0_141]
at java.lang.ClassLoader.loadClass(ClassLoader.java:424) ~[?:1.8.0_141]
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335) ~[?:1.8.0_141]
at java.lang.ClassLoader.loadClass(ClassLoader.java:357) ~[?:1.8.0_141]
at java.lang.Class.forName0(Native Method) ~[?:1.8.0_141]
at java.lang.Class.forName(Class.java:264) ~[?:1.8.0_141]
at org.apache.storm.StormSubmitter.invokeSubmitterHook(StormSubmitter.java:361) [storm-core-1.1.0.2.6.1.0-129.jar:1.1.0.2.6.1.0-129]
at org.apache.storm.StormSubmitter.submitTopologyAs(StormSubmitter.java:278) [storm-core-1.1.0.2.6.1.0-129.jar:1.1.0.2.6.1.0-129]
at org.apache.storm.StormSubmitter.submitTopology(StormSubmitter.java:390) [storm-core-1.1.0.2.6.1.0-129.jar:1.1.0.2.6.1.0-129]
at org.apache.storm.StormSubmitter.submitTopologyWithProgressBar(StormSubmitter.java:426) [storm-core-1.1.0.2.6.1.0-129.jar:1.1.0.2.6.1.0-129]
at org.apache.storm.StormSubmitter.submitTopologyWithProgressBar(StormSubmitter.java:407) [storm-core-1.1.0.2.6.1.0-129.jar:1.1.0.2.6.1.0-129]
at com.fis.protegent.cat.ReadFromKafka01.main(ReadFromKafka01.java:90) [71daba1cac3d11e781420242ac110002.jar:?]
Exception in thread "main" org.apache.storm.hooks.SubmitterHookException: java.lang.ClassNotFoundException: org.apache.atlas.storm.hook.StormAtlasHook
at org.apache.storm.StormSubmitter.invokeSubmitterHook(StormSubmitter.java:368)
at org.apache.storm.StormSubmitter.submitTopologyAs(StormSubmitter.java:278)
at org.apache.storm.StormSubmitter.submitTopology(StormSubmitter.java:390)
at org.apache.storm.StormSubmitter.submitTopologyWithProgressBar(StormSubmitter.java:426)
at org.apache.storm.StormSubmitter.submitTopologyWithProgressBar(StormSubmitter.java:407)
at com.fis.protegent.cat.ReadFromKafka01.main(ReadFromKafka01.java:90)
Caused by: java.lang.ClassNotFoundException: org.apache.atlas.storm.hook.StormAtlasHook
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at org.apache.storm.StormSubmitter.invokeSubmitterHook(StormSubmitter.java:361)
... 5 more
Please suggest what is the underlying issue and how can it be resolved.
... View more
Labels:
- Labels:
-
Apache Storm
10-09-2017
11:09 AM
David - Thanks for responding. I tried 127.0.0.1 and it doesn't work. BTW, with HDF Sandbox Ambari opens at port 9080. If I directly try to access this Ambari URL in a separate browser tab, Ambari responds back with JSON data. So it doesn't look like connectivity issue. Maybe it is some internal application (SAM) issue.
... View more
10-09-2017
09:31 AM
HDF Version = 3.0 Tutorial# tutorial-830 I am following this tutorial (URL - https://hortonworks.com/tutorial/real-time-event-processing-in-nifi-sam-schema-registry-and-superset/). Step#5 of this tutorial requires to configure a Service Pool. After entering Ambari URL = http://sandbox-hdf.hortonworks.com:9080/api/v1/clusters/Sandbox and Username/Password = admin/admin, it gives me javax.ws.rs.ProcessingException on top right corner (See attached ambarierror.png) Please advise if I am missing anything.
... View more
Labels:
- Labels:
-
Cloudera DataFlow (CDF)