Can I use Nifi for bulk loading (<1MB CSV file) to any database (ex: Teradata/Mysql)?
If yes what will be the flow?
I'm thinking that it will be Getfile > CSVReader > PutDatabaseRecord
Can you also provide on how it is done, screenshot will definitely help.
Kindly suggest or provide solution to my question. thank you in advance!
Yes you can use NiFi for this case and by using Record oriented processors i.e. using PutDatabaseRecord processor you can do this task efficiently.
In this flow we are getting the file from source using Getfile processor and in PutDatbaseRecord processor we are using Record Reader controller service based on this service PutDatabaseRecord processor reads the incoming flowfile and prepares the statements based on statement type property and executes the statements in your Target Database.
Refer to this link for more details regards to this flow and this link describes the traditional way of doing this task vs new way of doing(using record oriented) processors.
If the Answer helped to resolve your issue, Click on Accept button below to accept the answer, That would be great help to Community users to find solution quickly for these kind of issues.