Submitting a spark job by using shell script as follows: nohup spark-submit --master yarn-client --py-files libs.zip parser.py --jobname dicomparser >> out.log & Job started to perform required processing, in between killed using yarn application -kill <application_id> and job disappeared from pending list. But could see the process still going on What am I doing wrong?
... View more
