New Contributor
Posts: 5
Registered: ‎05-01-2016

Ozzie job on edgenode

[ Edited ]

We have pyspark program which ingests source files into hdfs and then load them into other hive tables.

Program works fine on edgenode as source files are local in edgenode.Can we schedule this pyspark program through oozie with spark2-submit --deploy-mode client?