Support Questions
Find answers, ask questions, and share your expertise

how to run the spark submit commad using shellsript ".sh" file?

Highlighted

how to run the spark submit commad using shellsript ".sh" file?

hi i need to execute one python program using this spark command manually spark submit command is "spark-submit --master yarn --num-executors 10 --executor-cores 1 --driver-memory 5g /home/hdpmaster/spark_code/test/python/pyspark.py" how to run this command using crontab, or using shell script