Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Spark History server dependecy

Solved Go to solution

Spark History server dependecy

Contributor

Hi!
Im using Spark2 on YARN and I have some weird question maybe.

I want to turn off Spark History server but I have Spark jobs running on YARN. Can you tell me, if I turn off Spark History server what will happen? Will my applications die or I wont be able to submit more jobs or? Thanks in advance I really appriciate any help :)

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: Spark History server dependecy

@Ivan Majnaric Nothing should happen. Your spark application will continue running and you will be still be able to submit applications. You will loose access to the spark history ui of course.

HTH

*** If you found this answer addressed your question, please take a moment to login and click the "accept" link on the answer.

View solution in original post

1 REPLY 1
Highlighted

Re: Spark History server dependecy

@Ivan Majnaric Nothing should happen. Your spark application will continue running and you will be still be able to submit applications. You will loose access to the spark history ui of course.

HTH

*** If you found this answer addressed your question, please take a moment to login and click the "accept" link on the answer.

View solution in original post

Don't have an account?
Coming from Hortonworks? Activate your account here