Member since
06-10-2018
5
Posts
1
Kudos Received
0
Solutions
06-10-2018
12:25 PM
1 Kudo
Hi, I'm working with nifi and I need to merge orc files. I get the files from s3 bucket. The flow goes like that: List s3 -> Fetch s3 objects -> merge content(output as avro) -> convert Avro to orc -> put s3 object. (I also tried only the merge content without outputing as Avro and converting to orc but it didn't work - The merged file was not valid). I get an error at the MergeContent processor: ERROR MergeContent[id=XXXX] Failed to process bundle of 2 files due to org.apache.nifi.processor.exception.ProcessException: IO thrown from MergeContent[id=XXXX]: java.io.IOException: Not a data file.
... View more
Labels:
- Labels:
-
Apache NiFi