Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

NiFi ExecuteStreamCommand : How to write back multiple files to NiFI flow from Python Script

NiFi ExecuteStreamCommand : How to write back multiple files to NiFI flow from Python Script

Hi,

I have created a NiFi flow which take multiple input csv files (Each one have 5 sections) and then pass to executestreamcommand processor. Which eventually trigger a python script and python create output of 5 csv files (Which are basically merging of specific section from all the files). Now challenge is how to pass these 5 csv files back to NiFi flow which takes these files to an another executestreamcommand processor which will again trigger a python script to convert each of the 5 files to xml files. Here is the sequence

1. List File

2. Fetch File

3. ExecuteStreamCommand - Create 5 csv file from all the input files passed.

4. ExecuteStreamCommand - Convert 5 csv files to xml

5. PutFile - Put all 5 xml files to a folder

I am unable to write the 5 csv files from step 3 back to NiFi flow so that next processor can process them. Please help.

 

 

 

Don't have an account?
Coming from Hortonworks? Activate your account here