Support Questions

Find answers, ask questions, and share your expertise
Check out our newest addition to the community, the Cloudera Data Analytics (CDA) group hub.

How to stream rows of a CSV files using NIFI?

New Contributor

For testing purpose, I would like to stream (generate output on a periodic time interval) of rows of a CSV file.

When the file gets to the end, it restarts from the beginning of the file.

How to do it using processors or scripting?


Expert Contributor

You can use the SplitText processor to create multiple flow files for a large block of text.

To replay the file periodically, you can use the GetFile processor to read the file - there's an option to 'Keep Source File' so that NiFi does not delete the file once it pulls it in. The processor additionally will have a schedule when you click into the Properties - you can set this schedule to 5 seconds, 5 minutes, or anything else you'd like.

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.