About baymax277

baymax277 · ‎06-23-2022

I am using Nifi 1.6.0. I am reading a JSON file from s3, de-compressing it, making some changes to this file, compressing it and re-uploading it to S3. I am trying to upload the file to S3 using PutS3, but I came across this error: The compressed file content is 5 MB in size. I am using CompressContent Processor with the following configuration: I have tried the same flow on a smaller file (in a few KBs) and that file was uploaded without any errors. How do I fix this error?

araujo · ‎06-22-2022

@baymax277 , Try this: This is the regex: (?s)(^\[|\]$) You may have to increase the buffer size to accommodate your file. Cheers, André

Online	Offline
Last Visited	‎05-03-2023 07:04 AM

Member Since	‎06-22-2022 06:07 AM
Last Visited	‎05-03-2023 07:04 AM
Posts	7

Cloudera Community

Nifi PutS3 - Broken pipe (Write failed)

Re: How to read json from S3 then edit json using ...