Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How to offload files from local to Hdfs in batches using Apache NIFI?

How to offload files from local to Hdfs in batches using Apache NIFI?

Explorer

Hello,

I am getting files in batches in my local folder like

1st batch getting 4 files(a.txt, b.log, c.error, d.csv)

After getting all files then after files will transfer to hdfs.

If any files fails, the files will not transfer to hdfs and send email notification to user.

Same for 2nd batch getting two files.

Any ideas or suggestions...

Thanks!

Don't have an account?
Coming from Hortonworks? Activate your account here