The issue was not related to the size of the queue, but instead to the fact that when to destination that we are sending those logs to had connectivity issues (which was causing quite a lot of timeout errors), NiFi was using a lot of a significant number of threads to retry sending the logs to the InvokeHTTP destination. This high usage of threads was causing ListenSyslog to not function properly - it was dropping the logs that it was supposed to receive. ... View more

Hello @utehrani    We are marking the Post as Closed with the recommendation for your Team to engage Cloudera Support as the Troubleshooting of the issue would require sharing of Logs, which may be sensitive to be shared across Community along with Bundle/Config Files.    Regards, Smarak ... View more

@fengsh, Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future.  ... View more

Hello @vaishaakb ,   Sadly we did not reach the solution for the main issue yet.   Yes, I checked this blog and I also checked every documentation provided by cloudera or others to try resolving this issue but no luck.   Also I want to point out that the blog's first demo is not working properly and the cloudera team posted something that shows an error ImportError: No module named numpy  Which proves that the docker image didn't work with pyspark properly. ... View more

@MichaelPlet, Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future.   ... View more

@hanumanth, have any if the replies helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future.   ... View more

@coco, has the above issue been resolved for you? was @ChethanYM 's response helpful? If you have found a solution, can you please share it with our community?  ... View more

Hi @Ploeplse    Still, if you are facing the issue, could you share the requested information (i.e code and impala table creation script) ... View more

@urunath As this is an older post, you would have a better chance of receiving a resolution by starting a new thread. This will also be an opportunity to provide details specific to your environment that could aid others in assisting you with a more accurate answer to your question. You can link this thread as a reference in your new post. Thanks ... View more

@imule, Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. ... View more