Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Storm Run time issues

Solved Go to solution
Highlighted

Storm Run time issues

Contributor

Hi

We are hitting the below Storm Run Time errors as below:

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: Storm Run time issues

Contributor

@milind pandit

This is what I am giving for worker.childopts! Please correct if you see something weird.

View solution in original post

6 REPLIES 6

Re: Storm Run time issues

Mostly it sounds like your upstream spouts/bolts are outpacing your downstream bolts. Try throttling your spouts with topology.max.spout.pending settings and try to increase the topology’s parallelism. Also based on your JVM profiling find out if you are GC’ing too much which can cause tuples failures. Try increasing JVM heal size (-xmx) that is allocated for each worker. You may have to use explicit G1 garbage collector. This may have negative impact as GC pause may take longer for larger heaps.

Highlighted

Re: Storm Run time issues

Contributor

@milind pandit

This is what I am giving for worker.childopts! Please correct if you see something weird.

View solution in original post

Highlighted

Re: Storm Run time issues

I do see lot of conflicting GC arguments. Can you please try with Xmx 2048 only and remove all the exlicit GC arguments first. Then you need to tune the topology.max.spout.pending parameter with some trial and error to find the correct value.

Highlighted

Re: Storm Run time issues

Contributor

Alright @milind pandit will try it. Thanks!

Highlighted

Re: Storm Run time issues

Are you able to try it out?

Highlighted

Re: Storm Run time issues

Contributor

@milind pandit

I see topology.max.spout.pending

Don't have an account?
Coming from Hortonworks? Activate your account here