Member since
09-01-2016
52
Posts
12
Kudos Received
2
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
13545 | 02-26-2018 02:37 PM | |
1945 | 01-25-2017 07:41 PM |
10-23-2017
08:11 PM
Thanks. That check did the trick. (It is not explicitly indicated in the above mentioned tutorial, for Storm)
... View more
10-23-2017
07:58 PM
Thanks. I did include the referred jar as you suggested: storm jar /root/tutoriales/crosscomponent_scripts/storm-demo/lib/storm-samples-1.0-jar-with-dependencies.jar com.dsinpractice.storm.samples.WordCountTopology --cluster true --name storm-demo-topology-03 --path /user/storm/storm-hdfs-test-01 --topic my-topic-01 --jars /usr/hdp/current/atlas-client/hook/storm/atlas-storm-plugin-impl/storm-bridge-0.8.0.2.6.0.3-8.jar but now there is another missing class "AtlasHook": 4930 [main] INFO o.a.s.StormSubmitter - Initializing the registered ISubmitterHook [org.apache.atlas.storm.hook.StormAtlasHook]Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/atlas/hook/AtlasHook at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass(ClassLoader.java:763) Another jar that needs to be referred?
... View more
10-23-2017
07:31 PM
Yes, there is: [root@sandbox storm-demo]# ls -l /usr/hdp/current/atlas-client/hook/storm/atlas-storm-plugin-impl/*storm-bridge*
-rw-r--r-- 1 root root 27999 Apr 1 2017 /usr/hdp/current/atlas-client/hook/storm/atlas-storm-plugin-impl/storm-bridge-0.8.0.2.6.0.3-8.jar
... View more
10-23-2017
07:14 PM
Storm error check shows the same issue. Altough this was reported in an older version (2.5.x), it seems to be the same problem. How can it be workarounded for 2.6.x?
... View more
10-23-2017
07:04 PM
hdp-version-info.txt
When running Storm - Atlas integration for "Cross Component Lineage with Apache Atlas across Apache Sqoop, Hive, Kafka & Storm" tutorial, at step
sh 004-run-storm-job.sh we get a class not found exception: Exception in thread "main" org.apache.storm.hooks.SubmitterHookException: java.lang.ClassNotFoundException: org.apache.atlas.storm.hook.StormAtlasHook at org.apache.storm.StormSubmitter.invokeSubmitterHook(StormSubmitter.java:368) at org.apache.storm.StormSubmitter.submitTopologyAs(StormSubmitter.java:278) at org.apache.storm.StormSubmitter.submitTopology(StormSubmitter.java:390) at org.apache.storm.StormSubmitter.submitTopology(StormSubmitter.java:162) at com.dsinpractice.storm.samples.WordCountTopology.main(WordCountTopology.java:140)
Any hints here? storm-error-dump.txt Regards
... View more
Labels:
- Labels:
-
Apache Atlas
-
Apache Storm
03-08-2017
03:23 PM
For JDBC, is the Simba commercial driver the only option? Thanks!
... View more
03-08-2017
03:21 PM
Yes, we could connect to Thrift Server via ODBC: - Download and install ODBC driver for Spark from HDP downloads page. - Make sure Thrift Server is up and running (default port 10015). Double check with telnet to that port, for instance. - Configure ODBC driver like this: Driver=Hortonworks Spark ODBC Driver;Host=192.168.170.45;Port=10015;SparkServerType=3;AuthMech=2;ThriftTransport=1; On the other hand, I still need to connect via JDBC -without the Simba commercial driver. How could you do this? Regards, Fernando
... View more
03-04-2017
12:14 AM
1 Kudo
Thanks @Timothy Spann Actually we missed docker firewall (we were trying on a sandbox), after modifying iptables it worked -we tried the *free* ODBC driver (could not find a free one for JDBC).
... View more
02-22-2017
01:28 AM
Sorry for the confusion. I tried both. My example refers to JDBC.
... View more
- « Previous
-
- 1
- 2
- Next »