Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created 02-27-2023 09:25 AM
Yes SplitRecord is what you should use.
Attached is a flow definition as an example.
Note that I had to rename the file with a "txt" extension once you download it rename it to a .json extension
You can then drag a processor group and it gives you an option to upload the flow definition.
That example generates a file with 102 records and on SlitRecord we use a JsontTreeReader that will split by 3 records and writes the flowfiles out, In this case per 3 per flowFile generating 34 FlowFiles.
1-2 / 3 = 34
In your case and based on your screenshot I would change split count to be 1500000 ( or another number based on your needs )