- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Different files with different columns to be loaded in single Nifi flow
- Labels:
-
Apache NiFi
Created ‎09-02-2020 04:54 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I have different input files for different sources. Can I create a common Nifi flow which processes all the different kind of files? Each files will be having different types of columns and different types of output table to be loaded. For example, File 1 will be having column A, Column B to be loaded to Table AB, File 2 will be having column C, Column D, Column E to be loaded to Table CDE. Can I achieve this in a single flow or should I create different flows for different types of files?
Created ‎09-04-2020 12:33 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi....you can create a single flow as long as you can distinguish the files for e.g using the filename. You can route on attribute and load it different table.
Hope this helps. If the comment helps you to find a solution or move forward, please accept it as a solution for other community members
Created ‎09-04-2020 12:33 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi....you can create a single flow as long as you can distinguish the files for e.g using the filename. You can route on attribute and load it different table.
Hope this helps. If the comment helps you to find a solution or move forward, please accept it as a solution for other community members
Created on ‎09-11-2020 10:09 AM - edited ‎09-11-2020 10:10 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@SagarKanani Thanks for your reply.
