Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How to move Spark2 components to another node?

Solved Go to solution
Highlighted

How to move Spark2 components to another node?

New Contributor

Hi All,

I have spark components installed on one host. Here are the components-

Livy for Spark2 Server

Spark2 Thrift Server

Spark2 History Server

I want to move this components to other host, as I have to stop the current running host which has these components.

Can you please let me know how I should perform this moving components and do I need to change anything on application side? Can I move this through Ambari ?

Also, any service restart is required?

Appreciate your help!

Thanks.

1 ACCEPTED SOLUTION

Accepted Solutions

Re: How to move Spark2 components to another node?

@Madhura Mhatre,

You can install all these components on some other node and then stop and delete all these components from the node.

1) Go to Ambari -> Hosts

2) Select the Host where you want to move these components to

3) Click on +ADD button and select the component you want to install (Spark2 History Server, Livy for spark2 server etc)

4) Start the components on the new host after installing them

5) Click on the old host and stop all the spark components and delete them.

.

-Aditya

4 REPLIES 4

Re: How to move Spark2 components to another node?

New Contributor

@Jay Kumar SenSharma Can you please help me with this one?

Re: How to move Spark2 components to another node?

@Madhura Mhatre,

You can install all these components on some other node and then stop and delete all these components from the node.

1) Go to Ambari -> Hosts

2) Select the Host where you want to move these components to

3) Click on +ADD button and select the component you want to install (Spark2 History Server, Livy for spark2 server etc)

4) Start the components on the new host after installing them

5) Click on the old host and stop all the spark components and delete them.

.

-Aditya

Re: How to move Spark2 components to another node?

New Contributor

Hi @Aditya Sirna

I tried to follow this steps however, Spark2 History server is not available to ADD on another node? I could add Livy for spark2 and Spark2 Thrift Server.. Can you please tell me how I should move the clients?

Can you please help ?

Thank you

Re: How to move Spark2 components to another node?

I see Spark2 history server available in my cluster. Can you check if Spark2 history server is already installed on that node.

Please refer the screenshot

92894-screen-shot-2018-10-18-at-94844-am.png

For clients, move option is not required. You can install clients on the new node in the similar way. You will see "Spark client" in the dropdown when you click +ADD

Don't have an account?
Coming from Hortonworks? Activate your account here