Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How to stream rows of a CSV files using NIFI?

How to stream rows of a CSV files using NIFI?

New Contributor

For testing purpose, I would like to stream (generate output on a periodic time interval) of rows of a CSV file.

When the file gets to the end, it restarts from the beginning of the file.

How to do it using processors or scripting?

1 REPLY 1
Highlighted

Re: How to stream rows of a CSV files using NIFI?

Expert Contributor

You can use the SplitText processor to create multiple flow files for a large block of text.

To replay the file periodically, you can use the GetFile processor to read the file - there's an option to 'Keep Source File' so that NiFi does not delete the file once it pulls it in. The processor additionally will have a schedule when you click into the Properties - you can set this schedule to 5 seconds, 5 minutes, or anything else you'd like.

Don't have an account?
Coming from Hortonworks? Activate your account here