Member since
03-12-2018
3
Posts
0
Kudos Received
0
Solutions
07-17-2018
09:40 AM
@Shu The scenario is to create the CSV file. I tried with the 'MergeRecord'. But it is not merging all the records. I can see that, there are 'only 2 options (i.e., 1. Keep all unique attributes & 2. Keep only common attributes). The data may vary for the columns but column names are same for all the records. Here the problem is that 'MergeRecord' is not merging all the records irrespective of columns/data, it is merging few records and few are not. Is there any processor which can merge the JSON records and give the CSV files irrespective of the record contents?
... View more
07-03-2018
07:06 AM
I have scenario, where I'm not able to find the processors for fulfilling the requirement. Scenario: I have an XML/CSV file of size 10 GB. I have to split the file into multiple files which each are of size maximum 50MB. My system configurations are 16GB RAM, 160GB HDD and Apache NiFi 1.5.0, Java 8, Linux in a dedicated server.
... View more
Labels:
- Labels:
-
Apache NiFi
06-29-2018
06:15 AM
I have a scenario where I'm having trouble on configuring/finding the right processors to update the CSV file. Scenario: I have a CSV file and it needs to be updated based on some conditions. Here records will be in millions. Due to this I cannot hold all the records in a processor and write at once. Example flow: GetFile -> SplitRecord -> SplitJSON -> PutMongo -> (Update CSV File)
... View more
Labels:
- Labels:
-
Apache NiFi