Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

NIFI Performance Improvement

Highlighted

NIFI Performance Improvement

New Contributor

@Riccardo Iacomini

Hi Riccardo, I was going through one of the response you have given as to how can we improve the performance of NIFI. I would like to know what you meant as Batch processing. Do we have any processor for that or we need to split the input into multiple chunks and feed the processor. I have a NIFI instance running in my local windows laptop. It has to read the csv file that has around 35K rows and extract the zip code from every line. Then trigger a InvokeHTTP request passing the extracted zip code.Save the received response in ADLS connected through a Python script. I see the performance is very slow. Any suggestions to improve the performance. I can give you more details if we can discuss. Thanks for all your help.

Don't have an account?
Coming from Hortonworks? Activate your account here