question Re: Storm Run time issues in Support Questions

Storm Run time issues

Srikaran — Tue, 28 Jun 2016 03:02:13 GMT

We are hitting the below Storm Run Time errors as below:

Re: Storm Run time issues

mpandit — Tue, 28 Jun 2016 04:40:53 GMT

Mostly it sounds like your upstream spouts/bolts are outpacing your downstream bolts. Try throttling your spouts with topology.max.spout.pending settings and try to increase the topology’s parallelism. Also based on your JVM profiling find out if you are GC’ing too much which can cause tuples failures. Try increasing JVM heal size (-xmx) that is allocated for each worker. You may have to use explicit G1 garbage collector. This may have negative impact as GC pause may take longer for larger heaps.

Re: Storm Run time issues

Srikaran — Tue, 28 Jun 2016 05:00:59 GMT

@milind pandit

This is what I am giving for worker.childopts! Please correct if you see something weird.

Re: Storm Run time issues

Srikaran — Tue, 28 Jun 2016 05:04:06 GMT

@milind pandit

I see topology.max.spout.pending

Re: Storm Run time issues

mpandit — Tue, 28 Jun 2016 05:44:01 GMT

I do see lot of conflicting GC arguments. Can you please try with Xmx 2048 only and remove all the exlicit GC arguments first. Then you need to tune the topology.max.spout.pending parameter with some trial and error to find the correct value.

Re: Storm Run time issues

Srikaran — Tue, 28 Jun 2016 07:10:35 GMT

Alright @milind pandit will try it. Thanks!

Re: Storm Run time issues

mpandit — Thu, 30 Jun 2016 04:11:08 GMT

Are you able to try it out?