Community Articles

Find and share helpful community-sourced technical articles.
Celebrating as our community reaches 100,000 members! Thank you!
Labels (2)
Expert Contributor

SYMPTOM: Storm nimbus fails to come up after Ambari was upgraded to 2.4 version while on HDP 2.4

2016-11-22 13:29:43.066 [timer] b.s.d.nimbus [ERROR] Error when processing event
	at clojure.lang.Numbers.ops( ~[clojure-1.6.0.jar:?]
	at clojure.lang.Numbers.isZero( ~[clojure-1.6.0.jar:?]
	at backtype.storm.util$partition_fixed.invoke(util.clj:892) ~[storm-core-]
	at clojure.lang.AFn.applyToHelper( ~[clojure-1.6.0.jar:?]
	at clojure.lang.AFn.applyTo( ~[clojure-1.6.0.jar:?]
	at clojure.core$apply.invoke(core.clj:624) ~[clojure-1.6.0.jar:?]
	at clojure.lang.AFn.applyToHelper( ~[clojure-1.6.0.jar:?]
	at clojure.lang.RestFn.applyTo( ~[clojure-1.6.0.jar:?]
	at clojure.core$apply.invoke(core.clj:626) ~[clojure-1.6.0.jar:?]
	at clojure.core$partial$fn__4228.doInvoke(core.clj:2468) ~[clojure-1.6.0.jar:?]
	at clojure.lang.RestFn.invoke( ~[clojure-1.6.0.jar:?]
	at backtype.storm.util$map_val$iter__366__370$fn__371.invoke(util.clj:301) ~[storm-core-]

ROOT CAUSE: It is a known issue:

RESOLUTION: It has been fixed in HDP 2.5.3, please refer section 'Upgrade' here:

WORKAROUND: This can be resolved by following below steps as a workaround:

1. Deactivate all running topologies.
2. Stop Storm service
3. Delete all states under zookeeper: -> /usr/hdp/current/zookeeper-client/bin/ (optionally in secure environment specify -server zk.server:port) -> rmr /storm 
4. Delete all states under the storm-local directory.  Please make sure to run this on all storm hosts: rm -rf <value of stormlocal.dir> 
5. Start storm service.