Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]

Support Questions

Find answers, ask questions, and share your expertise
Announcements
Share your experience with Cloudera on G2 and get a $25 Amazon Gift card.
Hi, I'm CLEO! Something exciting is coming to the Community. Stay Tuned!

NiFi DecompressContent and UnpackContent Optimization

avatar
Explorer

I'm using NiFi to process .tar.gz files, extract the csv files, and upload them into S3. NiFi is currently running on a t2.large. I tested the same workflow on a t2.2xlarge, expecting an increase in performance. Yet, it didn't happen. In particular, it seems like the CompressContent and UnpackContent processors take the same amount of time, regardless of the instance type.

Any idea of what I'm doing wrong or how to optimize performance?

For the t2.large, I have concurrent tasks set to 2, while for the t2.2xlarge I have it set to 8. Execution on all nodes for both.

Thanks

1 REPLY 1

avatar
Super Collaborator

Have you tried playing with these settings? Or perhaps an instance with faster disk since that might be the bottleneck?

joseomjr_0-1701993825645.png