Hi, Im throwing multiple csv files on my hdfs every minute using logstash. I need to get the files from the past minute from the current time. Im using nifi in this process. For example right now is 11:30 AM, I need to get ONLY all the files that are saved 1 minute ago or 11:29AM. What is the best approach here using nifi? Thank you. ... View more

Hi, How can i aggregate my csv data in nifi? Can you please give me options. I have csv coming every hour. For example my csv data is: Name, Subject stud1, math stud2, english stud3, math stud4, math stud5, english stud6, science My needed output is: math, 3 english, 2 science, 1 Can i make this without using any execute scripts? Thank you. ... View more

Hi Guys, I have a log simulator, which is sending 10k events per second on my port 5043. I used the ListenTCP Processor to fetch the events but im having an error. 1. 2. So, i tried to lowered the Socket Buffer Size. The first image error was gone, but the second error is still showing. Am i correct that i can already listen to 5043 port and i'm still getting this error(second pic), because my nifi cannot handle the amount of events? I'm sorry, newbie here. Thank you. Regie ... View more