Reply
Highlighted
New Contributor
Posts: 5
Registered: ‎04-20-2017

Catch Output from Spark

Is there anyway to catch an output from spark then input it on a shell? We're currently using scala to create jar files and want our spark output to be a shell input.

My idea is to use ${wf:actionData('spark-XXX')['var']} i just dont know how to implement it in spark. So basically, my problem is how to output a key=value pair from spark in oozie.

Announcements