Member since
01-07-2016
6
Posts
4
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1576 | 01-12-2016 03:13 PM |
01-12-2016
03:15 PM
1 Kudo
Solution is to tell your build/submit tool to use the storm library from HDP repository. Here how it is described for streamparse
... View more
01-12-2016
03:13 PM
1 Kudo
Issue resolved. Solution was to direct topology sumbitting tool to the custom built Storm library as described in streamparse documentation
... View more
01-09-2016
05:28 AM
2 Kudos
I am running HDP 2.2 cluster. Trying to submit Storm topology which has been tested to run in local development environment. Topology gets deployed to the cluster but fails to initialize due to some class serializaiton issue.
I am getting the following error:
2016-01-09 00:18:51 b.s.d.worker [ERROR] Error on initialization of server mk-worker
java.lang.RuntimeException: java.io.InvalidClassException: backtype.storm.task.ShellBolt; local class incompatible: stream classdesc serialVersionUID = -141067271633232418, local class serialVersionUID = 1217679306363381476
at backtype.storm.serialization.DefaultSerializationDelegate.deserialize(DefaultSerializationDelegate.java:56) ~[storm-core-0.9.3.2.2.9.0-3393.jar:0.9.3.2.2.9.0-3393]
...
To avoid library incompatibility, I have localy copied the storm-core-0.9.3.2.2.9.0-3393.jar from the cluster running Storm instance. The library is used to build the topology and to submit it. Still no luck. Anybody experienced similar issue? How do you submit your topologies to Storm?
... View more
Labels:
- Labels:
-
Apache Storm
01-09-2016
04:32 AM
Tried everything exhausting the options. Nothing worked, neither new client, nor old. Locally rebuilt patched storm-core did not work either. Had to reinstall the whole cluster thing downgrading to HDP 2.2, moving to Ubuntu 12 from Debian 7, resolving all the failed dependency of the OS. Now I am still getting the 'incompatibility error'
... View more
01-08-2016
07:19 PM
I have used 0.11.0-SNAPSHOT storm-core to submit the task as suggested.
It acutaly passes the submission phase (no more original error). The topology get deployed to the cluster. But then it fails to start with some incompatibility exception on the server side. Is there a way to selectively upgrade servers side Storm to the snapshot version?
... View more
01-07-2016
07:43 PM
I am experiencing the same issue with freshly installed HDP 2.3 cluster. I guess, it has been fixed in Storm re: https://issues.apache.org/jira/browse/STORM-1189 but only available in ver. 0.11.0 What would be the best way get my topology submitted to storm ? I there a nice way to patch or downgrade/upgrade the system? I use steamparse to submit the topology to the Storm.
... View more