Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

What all sanity tests should be performed for validating high availability in storm ?

What all sanity tests should be performed for validating high availability in storm ?

Explorer

What all validations should be performed for confirming whether storm is installed and working properly .

2 REPLIES 2
Highlighted

Re: What all sanity tests should be performed for validating high availability in storm ?

Explorer

How to create a failover scenario to check the high availability storm

Highlighted

Re: What all sanity tests should be performed for validating high availability in storm ?

Mentor

You should make sure you're running HA fr Nimbus, at least 3 zookeeper servers and multiple supervisors. for some time, Nimbus was single point of failure and once down, you'd lose ability to control job behavior but that's been fixed in recent versions of Stprm, you can now enable HA via Ambari https://hortonworks.com/blog/fault-tolerant-nimbus-in-apache-storm/

So at the minimum, run 2 Nimbus servers, 3 zookeepers and as many supervisors as you can to maintain parallelism. I cannot find reference in our docs to set this up but once you are on Storm config page, there should be an option to add a standby Nimbus. Once up, you can submit a topology and simulate a Nimbus fail over, zk and supervisor fail over, adjust as necessary and continue tests.

Don't have an account?
Coming from Hortonworks? Activate your account here