Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Spark History server dependecy

avatar
Expert Contributor

Hi!
Im using Spark2 on YARN and I have some weird question maybe.

I want to turn off Spark History server but I have Spark jobs running on YARN. Can you tell me, if I turn off Spark History server what will happen? Will my applications die or I wont be able to submit more jobs or? Thanks in advance I really appriciate any help 🙂

1 ACCEPTED SOLUTION

avatar

@Ivan Majnaric Nothing should happen. Your spark application will continue running and you will be still be able to submit applications. You will loose access to the spark history ui of course.

HTH

*** If you found this answer addressed your question, please take a moment to login and click the "accept" link on the answer.

View solution in original post

1 REPLY 1

avatar

@Ivan Majnaric Nothing should happen. Your spark application will continue running and you will be still be able to submit applications. You will loose access to the spark history ui of course.

HTH

*** If you found this answer addressed your question, please take a moment to login and click the "accept" link on the answer.