Created 03-01-2017 11:51 AM
Created 03-07-2017 02:05 AM
There are many ways to do it, however, assuming that you would use NiFi, you could build a flow starting with GetFile processor pointing to a folder where you have all your CSV files. Follow with MergeContent and PutFile processors.
Otherwise, it could be even simpler and without NiFi. If your files have the same structure and each has a header, then a simple shell script can extract the header from one file and remove the header from the others and just merge the content. You can easily do all this using sed unix command.
Created 03-06-2017 08:27 AM
I also have the same query as want the excel data to be inserted into my database but unable to find one.
Created 03-06-2017 03:30 PM
Please provide full use case and examples. It is difficult to provide assistance without the details. The more the better.
Created 03-07-2017 02:05 AM
There are many ways to do it, however, assuming that you would use NiFi, you could build a flow starting with GetFile processor pointing to a folder where you have all your CSV files. Follow with MergeContent and PutFile processors.
Otherwise, it could be even simpler and without NiFi. If your files have the same structure and each has a header, then a simple shell script can extract the header from one file and remove the header from the others and just merge the content. You can easily do all this using sed unix command.