Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Stopping Spark through Ambari

avatar
Rising Star

Hi,

Just wondering what happens when Spark service is chosen on Ambari and is stopped? What service is stopped behind the scenes.To my understanding, when Spark is installed through Ambari, it installs Spark-client, thrift-server and history-server. When I stop Spark through Ambari, what action is invoked. Is it the spark-client that is stopped or all the three?

Alternatively, if I have to stop spark-client through CLI, how it need to be done?

Please correct me in case my understanding is wrong in any of the above.

Thanks

1 ACCEPTED SOLUTION

avatar
Master Mentor

@Greenhorn Techie

This is what it looks like

When you stop through ambari then it will stop the following/all components.

1804-screen-shot-2016-02-04-at-112144-am.png

If just want to start or stop particular component then you can click that particular service and take the action.

Click Spark Thrift Server and you can just start or stop that .

I clicked thrift server and I can start from there...

1805-screen-shot-2016-02-04-at-112512-am.png

View solution in original post

13 REPLIES 13

avatar
Master Mentor

@Greenhorn Techie when app is finished it will stop. If you have to kill it you can issue yarn job --kill command to force. In spark-shell you just exit and kills app.

avatar
Master Mentor

@Greenhorn Techie we only support Spark on yarn not in standalone

avatar
Rising Star

@Artem Ervits Here is my confusion. If it stops immediately after app execution from a shell, why does it appear as running on Ambari, which can be stopped through UI. Are they two different things? spark-shell and spark-client? If so, in a manual installation, what need to be done to stop the spark-client, similar to the one done through Ambari.

avatar
Super Collaborator

AFAIK there is no stop action for spark-client or any client for that matter. Client means set of libraries for using the associated service. @Artem Ervits, please correct if I am missing something.