Welcome to the Cloudera Community

Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Who agreed with this topic

Catch Output from Spark

avatar
Explorer

Is there anyway to catch an output from spark then input it on a shell? We're currently using scala to create jar files and want our spark output to be a shell input.

My idea is to use ${wf:actionData('spark-XXX')['var']} i just dont know how to implement it in spark. So basically, my problem is how to output a key=value pair from spark in oozie.

Who agreed with this topic