Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

NiFi : Flowfile as input/output to pyspark scripts in ExecuteStreamCommand processor

Highlighted

NiFi : Flowfile as input/output to pyspark scripts in ExecuteStreamCommand processor

I had been using ExecuteStreamCommand processor to run python scripts and successfully giving flowfile as input to python scripts using sys.stdin and flowfile output as sys.stdout. Now all of these python scripts to be converted to Pyspark. How can have flow file as input/output in ExecuteStreamCommand Processor. Sys.stdin and sys.stdout does not seems to be working with pyspark. Is there any other way?

Don't have an account?
Coming from Hortonworks? Activate your account here