Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

OutOfMemoryError and too much latency in topology with storm

Highlighted

OutOfMemoryError and too much latency in topology with storm

New Contributor

Hi all. We currently design a topology that has custom processors, some with sufficient processing, for example, an ASN1 decoder. We only have one server with 56 cores and 252 Gb of RAM. Initially, this topology ingests data through NIFI to then perform the processing in STORM and then generate the output again using NIFI. The problem is that STORM processing has memory errors and the latency is quite high. What values can be configured to solve this problem, thanks. Here are some screenshots of how the solution is implemented. Thanks for your comments

103433-image1.jpg

103432-image2.jpg

103431-image3.jpg

103430-image4.jpg

103429-image5.jpg