Reply
Explorer
Posts: 8
Registered: ‎05-04-2017

Re: replacement of ec2 machine

 

@kartikbha

Thanks kartik,

 

Did you tried the ec2 instance replacement of the nodes with other master services such as hive,hue spark etc ?

 

I am thinking of the below strategy,let me know your views on it.

  • Will setup snapshot of the ebs volumes for the master nodes with critical services such as hive,hue ,spark etc.
  • If the master node goes down, will recover from failure.

 

Regards,

Tauqeer Khan

@Bill Havanki

 

Highlighted
Cloudera Employee
Posts: 18
Registered: ‎07-25-2017

Re: replacement of ec2 machine

[ Edited ]

There is stateless and stateful master.

For stateless master, you should be able to switch instances. For stateful master, it is a little bit complicated, it might be good to keep EBS snapshot, but the snapshot is not online replica, that you might need to do some manual work to recover from failure.

 

But those are only from the point of the view of individual instance, the configuration of master(s) might be recorded somewhere else, eg zookeeper, that you also need to refresh configuration afterwards if needed.

Explorer
Posts: 8
Registered: ‎05-04-2017

Re: replacement of ec2 machine

@kartikbha@Bill Havanki Did you try to replace the CM node .We have a scenario where we have to replace the CM instance with another instance.

Are you aware where do we need to make the changes in Cloudera director as the CM ip will be changed.

 

Cloudera Employee
Posts: 49
Registered: ‎02-18-2014

Re: replacement of ec2 machine

Hi Tauqeer,

 

As I stated in a previous reply, replacing a Cloudera Manager instance is possible but complex, and isn't a first-class feature of Director.

 

If you find yourself in a situation where you regularly need to destroy and recreate instances, whether for Cloudera Manager or cluster services, then you should consider using transient clusters and storing your data on persistent storage services like S3 or ADLS. Then you can tear down clusters and create new ones without the complexities of in-place instance replacement.

Explorer
Posts: 8
Registered: ‎05-04-2017

Re: replacement of ec2 machine

Hello Bill ,

 

We have migrated the CM to a new instance.Using few tricks and director crash shell we were able to migrate the CM to a new instance.

 

Have anyone tried to migrate KTS instances on AWS .We cannot keep the same ip of the instances as recommended by cloudera .So can anyone share the steps where we migrate the KTS instance to a new instance with different ip as compared to previous instance ip.

 

Regards,

Tauqeer

@Bill Havanki@rufusayeni@kartikbha

 

Announcements