Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Nifi ListenTCP Processor Error

avatar
Rising Star

Hi Guys,

I have a log simulator, which is sending 10k events per second on my port 5043.

I used the ListenTCP Processor to fetch the events but im having an error.

1.

17487-1error.png

2.

17488-2error.png

So, i tried to lowered the Socket Buffer Size. The first image error was gone, but the second error is still showing.

Am i correct that i can already listen to 5043 port and i'm still getting this error(second pic), because my nifi cannot handle the amount of events?

I'm sorry, newbie here.

Thank you.

Regie

1 ACCEPTED SOLUTION

avatar

Hi @regie canada,

The second message is probably due to the fact that the processor cannot be started. You should have more details regarding the "why" in nifi-app.log file. I suspect that the port could already be in use on the host. I see you are talking about ListenTCP although your screenshots show ListenSyslog, are you sure you don't have multiple ListenX processors listening on the same port?

10k events seconds should not be an issue at all (it depends of the size of the events obviously but I guess we are talking logs and you should be good).

Hope this helps.

View solution in original post

3 REPLIES 3

avatar

Hi @regie canada,

The second message is probably due to the fact that the processor cannot be started. You should have more details regarding the "why" in nifi-app.log file. I suspect that the port could already be in use on the host. I see you are talking about ListenTCP although your screenshots show ListenSyslog, are you sure you don't have multiple ListenX processors listening on the same port?

10k events seconds should not be an issue at all (it depends of the size of the events obviously but I guess we are talking logs and you should be good).

Hope this helps.

avatar
Rising Star

@Pierre Villard Thanks for the response sir, hmm. sorry about the screenshot cause i already tried the listensyslog but they have the same error. But trying to stop the logstash which is also listening to this port made it. Thank you so much!

avatar
Cloudera Employee

For first error,try to increase the operation system's buffer size

sysctl -w net.core.rmem_max=2097152

wmem_max

https://access.redhat.com/documentation/en-US/JBoss_Enterprise_Web_Platform/5/html/Administration_An...