Spark History server dependecy

[#1]

Hi!
Im using Spark2 on YARN and I have some weird question maybe.

I want to turn off Spark History server but I have Spark jobs running on YARN. Can you tell me, if I turn off Spark History server what will happen? Will my applications die or I wont be able to submit more jobs or? Thanks in advance I really appriciate any help 🙂

[#2 · Accepted solution]

@Ivan Majnaric Nothing should happen. Your spark application will continue running and you will be still be able to submit applications. You will loose access to the spark history ui of course.

HTH

*** If you found this answer addressed your question, please take a moment to login and click the "accept" link on the answer.