Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

is it possible to load s3 files parallel into database csv.gz files with out any duplicate of any files?

avatar
New Contributor

Hi Team,

 

is there a way i can process s3 files parallel into target database (like Mysql) can any one please advice the appraoch in case i have 800+ files load them parallel let say 200 files in one flowFile?

1 REPLY 1

avatar
Community Manager

@mohanm Welcome to the Cloudera Community!

To help you get the best possible solution, I have tagged our NiFi expert @steven-matison  who may be able to assist you further.

Please keep us updated on your post, and we hope you find a satisfactory solution to your query.


Regards,

Diana Torres,
Community Moderator


Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.
Learn more about the Cloudera Community: