About crajujava

crajujava · ‎07-17-2018

@Shu The scenario is to create the CSV file. I tried with the 'MergeRecord'. But it is not merging all the records. I can see that, there are 'only 2 options (i.e., 1. Keep all unique attributes & 2. Keep only common attributes). The data may vary for the columns but column names are same for all the records. Here the problem is that 'MergeRecord' is not merging all the records irrespective of columns/data, it is merging few records and few are not. Is there any processor which can merge the JSON records and give the CSV files irrespective of the record contents?

crajujava · ‎07-03-2018

I have scenario, where I'm not able to find the processors for fulfilling the requirement. Scenario: I have an XML/CSV file of size 10 GB. I have to split the file into multiple files which each are of size maximum 50MB. My system configurations are 16GB RAM, 160GB HDD and Apache NiFi 1.5.0, Java 8, Linux in a dedicated server.

crajujava · ‎06-29-2018

I have a scenario where I'm having trouble on configuring/finding the right processors to update the CSV file. Scenario: I have a CSV file and it needs to be updated based on some conditions. Here records will be in millions. Due to this I cannot hold all the records in a processor and write at once. Example flow: GetFile -> SplitRecord -> SplitJSON -> PutMongo -> (Update CSV File)

Online	Offline
Last Visited	‎07-17-2018 09:40 AM

Date Registered	‎03-12-2018 06:37 AM
Last Visited	‎07-17-2018 09:40 AM
Total Messages Posted	3

Re: Keep updating the existing CSV file

Split 10GB size of XML/CSV file into multiple file...

Keep updating the existing CSV file