Support Questions
Find answers, ask questions, and share your expertise
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Catch Output from Spark

Catch Output from Spark

New Contributor

Is there anyway to catch an output from spark then input it on a shell? We're currently using scala to create jar files and want our spark output to be a shell input.

My idea is to use ${wf:actionData('spark-XXX')['var']} i just dont know how to implement it in spark. So basically, my problem is how to output a key=value pair from spark in oozie.

Don't have an account?
Coming from Hortonworks? Activate your account here