is it possible to load s3 files parallel into database csv.gz files with out any duplicate of any files?

[#1]

Hi Team,

is there a way i can process s3 files parallel into target database (like Mysql) can any one please advice the appraoch in case i have 800+ files load them parallel let say 200 files in one flowFile?

[#2]

@mohanm Welcome to the Cloudera Community!

To help you get the best possible solution, I have tagged our NiFi expert @steven-matison  who may be able to assist you further.

Please keep us updated on your post, and we hope you find a satisfactory solution to your query.