How to move Spark2 components to another node?

[#1]

Hi All,

I have spark components installed on one host. Here are the components-

Livy for Spark2 Server

Spark2 Thrift Server

Spark2 History Server

I want to move this components to other host, as I have to stop the current running host which has these components.

Can you please let me know how I should perform this moving components and do I need to change anything on application side? Can I move this through Ambari ?

Also, any service restart is required?

Appreciate your help!

Thanks.

[#2]

@Jay Kumar SenSharma Can you please help me with this one?

[#3 · Accepted solution]

@Madhura Mhatre,

You can install all these components on some other node and then stop and delete all these components from the node.

1) Go to Ambari -> Hosts

2) Select the Host where you want to move these components to

3) Click on +ADD button and select the component you want to install (Spark2 History Server, Livy for spark2 server etc)

4) Start the components on the new host after installing them

5) Click on the old host and stop all the spark components and delete them.

.

-Aditya

[#4]

Hi @Aditya Sirna

I tried to follow this steps however, Spark2 History server is not available to ADD on another node? I could add Livy for spark2 and Spark2 Thrift Server.. Can you please tell me how I should move the clients?

Can you please help ?

Thank you

[#5]

I see Spark2 history server available in my cluster. Can you check if Spark2 history server is already installed on that node.

Please refer the screenshot

For clients, move option is not required. You can install clients on the new node in the similar way. You will see "Spark client" in the dropdown when you click +ADD