Different files with different columns to be loaded in single Nifi flow

Question

I have different input files for different sources. Can I create a common Nifi flow which processes all the different kind of files? Each files will be having different types of columns and different types of output table to be loaded. For example, File 1 will be having column A, Column B to be loaded to Table AB, File 2 will be having column C, Column D, Column E to be loaded to Table CDE. Can I achieve this in a single flow or should I create different flows for different types of files?

SagarKanani · Accepted Answer

Hi....you can create a single flow as long as you can distinguish the files for e.g using the filename. You can route on attribute and load it different table.

Hope this helps. If the comment helps you to find a solution or move forward, please accept it as a solution for other community members

Sign up

Please use your Cloudera account.

Login to the community

Please use your Cloudera account.