qq1.pngqq2.pngHi All, Thanks I am having a hard time doing permutations and combinations to tune the properties of both of ListenUDP and MergeContent processors. Are they standard values for each of these properties for 10000 events per second? ... View more

Hi All, Thanks, I have a pfsense firewall, which was sending data at rate of 10000 events per second. when I switched it in PROD, I was not able to match the tuning between ListenUDP and MergeContent processor. I got this error "Caused by: java.io.IOException: All Partitions have been blacklisted due to failures when attempting to update. If the Write-Ahead Log is able to perform a checkpoint, this issue may resolve itself. Otherwise, manual intervention will be required." Thanks Dheeru ... View more

Hi All, Thanks, I am getting this following error. When a data source of high throughput, is streamed. Failed to write contents of the message to FlowFile due to IOException thrown from ListenUDP[id=23d0ed8d-fc4e-3d93-84e9-2cc601ba2f61]: java.io.FileNotFoundException: /data02/content_repository,/data04/grid03/653/1508365004240-1515149 (No space left on device) I am using ListenUDP and mergeContent processor. Another issue how do I tune the performance of ListenUDP and mergeContent? Like what should be my optimal buffer size for listenUDP to stream 10000 events per second Thanks again Dheeru ... View more

Hi All, Thanks, Configured a listenUDP processor, when starting it, gives the error message "failed to invoke @OnScheduled method due to java.lang.RuntimeException: Failed while executing one of processor's OnScheduled task.; processor will not be scheduled to run for 30 seconds: java.lang.RuntimeException: Failed while executing one of processor's OnScheduled task." Even in the nifi-app.log any help to debug this. Thanks Dhiren ... View more

Hi, Thanks My directory in HDFS is yyyy/mm/dd/hh/mm/ss is there any way I can restrict it till month. example yyyy/mm Thanks Dheeru ... View more