Reply
Highlighted
Contributor
Posts: 58
Registered: ‎10-19-2014

Oozie Streaming action, Python and Avro

[ Edited ]

Hello,

I want to use the Streaming action in Oozie workflow to run some Python scripts. This works great for text data, however as all our data is stored as Avro, I am trying to figure out how to pass Avro data into Python without first having to convert it to text. What parameters need to be set in the Streaming action and are there any jars to be explicitly added in the workflow or in Oozie shared lib?

 

Thanks,

Martin