Support Questions

Find answers, ask questions, and share your expertise

NiFi DecompressContent and UnpackContent Optimization

avatar
Explorer

I'm using NiFi to process .tar.gz files, extract the csv files, and upload them into S3. NiFi is currently running on a t2.large. I tested the same workflow on a t2.2xlarge, expecting an increase in performance. Yet, it didn't happen. In particular, it seems like the CompressContent and UnpackContent processors take the same amount of time, regardless of the instance type.

Any idea of what I'm doing wrong or how to optimize performance?

For the t2.large, I have concurrent tasks set to 2, while for the t2.2xlarge I have it set to 8. Execution on all nodes for both.

Thanks

1 REPLY 1

avatar
Super Collaborator

Have you tried playing with these settings? Or perhaps an instance with faster disk since that might be the bottleneck?

joseomjr_0-1701993825645.png