Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

How to move Spark2 components to another node?

avatar
Explorer

Hi All,

I have spark components installed on one host. Here are the components-

Livy for Spark2 Server

Spark2 Thrift Server

Spark2 History Server

I want to move this components to other host, as I have to stop the current running host which has these components.

Can you please let me know how I should perform this moving components and do I need to change anything on application side? Can I move this through Ambari ?

Also, any service restart is required?

Appreciate your help!

Thanks.

1 ACCEPTED SOLUTION

avatar
Super Guru

@Madhura Mhatre,

You can install all these components on some other node and then stop and delete all these components from the node.

1) Go to Ambari -> Hosts

2) Select the Host where you want to move these components to

3) Click on +ADD button and select the component you want to install (Spark2 History Server, Livy for spark2 server etc)

4) Start the components on the new host after installing them

5) Click on the old host and stop all the spark components and delete them.

.

-Aditya

View solution in original post

4 REPLIES 4

avatar
Explorer

@Jay Kumar SenSharma Can you please help me with this one?

avatar
Super Guru

@Madhura Mhatre,

You can install all these components on some other node and then stop and delete all these components from the node.

1) Go to Ambari -> Hosts

2) Select the Host where you want to move these components to

3) Click on +ADD button and select the component you want to install (Spark2 History Server, Livy for spark2 server etc)

4) Start the components on the new host after installing them

5) Click on the old host and stop all the spark components and delete them.

.

-Aditya

avatar
Explorer

Hi @Aditya Sirna

I tried to follow this steps however, Spark2 History server is not available to ADD on another node? I could add Livy for spark2 and Spark2 Thrift Server.. Can you please tell me how I should move the clients?

Can you please help ?

Thank you

avatar
Super Guru

I see Spark2 history server available in my cluster. Can you check if Spark2 history server is already installed on that node.

Please refer the screenshot

92894-screen-shot-2018-10-18-at-94844-am.png

For clients, move option is not required. You can install clients on the new node in the similar way. You will see "Spark client" in the dropdown when you click +ADD