I have a .jar file in one of the location (local or cluster) and I want to run that file using spark-shell in Yarn mode.. Can any one help me with this??
Thanks Peter Kim,
Correct me if I my understanding is wrong,
spark-shell --jars "location" of jar files --master "yarn"
is this command correct? Do I need to write anything else along with --master "yarn" this for Yarn
If you're using hadoop cluster with ambari of hortonworks, then you don't have to use that --master yarn parameter. Cause' spark service mode of HDP cluster is installed to yarn mode basically.