Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Broken pipe error when passing zipfile to executestreamcommand in Nifi

Highlighted

Broken pipe error when passing zipfile to executestreamcommand in Nifi

New Contributor

Hi,

 

My flow goes as follows.

1. Pick up 2 csv files from s3 using fetschs3object.

2. Zip files using mergecontent processor.

3. Pass the zip file from step2 to python script via stdin using executestreamcommand processor.(fails here)

4. Dump output to elasticsearch.

 

I have tested the python script with zip files and it executes fine outside nifi. But the same script throws below error when used in step 3 in Nifi(as explained above).

error1.png

 

Could someone help me understand where I am going wrong?

Don't have an account?
Coming from Hortonworks? Activate your account here