Member since
02-17-2023
2
Posts
0
Kudos Received
0
Solutions
02-23-2023
08:37 AM
Both QueryRecord and PartitionRecord do not fit this use case, I have tried it. Can SplitRecord processor be used this purpose, is yes can you provide an example based on the above sample records?
... View more
02-17-2023
09:47 AM
We have a large json file which is more than 100GB and we want to split this json file into multiple files. We used Split Text processor to split this json file into mutliple files by specifying Line Split Count. Is there any way we can pass attribute/variable in Line Split Count and then split the records based on the attribute/variable as currently Line Split Count does not support attributes/variables. Kindly suggest if there is another approach to split these json files based on attribute/variables Sample Json File {"name": "John","lastName": "Wick","phoneNumber": "123123123"} {"name": "Paul","lastName": "Jackson","phoneNumber": "123123123"} {"name": "Paul","lastName": "Jackson","phoneNumber": "123123123"}
... View more
Labels:
- Labels:
-
Apache NiFi