- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
CDSW change ip address
Created 12-26-2021 02:50 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi,
what changes we need to be made if we need to change the ip address of the master and worker servers?
Thanks
Created 12-27-2021 12:37 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@ronys From CDSW Function perspective you need to adjust some Configuration as per new IP and the most important thing is forward and reverse DNS lookups MUST work.
Apart from that you can follow fe simple steps.
- Stop CDSW Service in Cloudera Manager (CM).
- Take a backup of CDSW app dir on each host by running the following command:
tar cvzf cdsw.tar.gz /var/lib/cdsw/*
- Change the IP address of the host(s).
- Ensure that forward and reverse DNS still works (use dig or nslookup commands). If not, work with netops to fix it before proceeding.
- Ensure that /etc/hosts is not used for DNS. If yes, use a DNS server before proceeding.
- On each host, check for multiple name servers in /etc/resolv.conf. If there are multiple, work with netops to ensure that each name server recognizes the new IP address.
- Update CDSW config in CM with the new IP address of the CDSW master host:
Beneath CM > CDSW > Configuration > search for "IP" and set MASTER_IP to correct IP address for CDSW master host
- Save Changes and run a cluster wide Deploy Client Configuration.
- Complete a weave reset and run prepare node on each host.
/opt/cloudera/parcels/CDSW/cni/bin/weave reset
Beneath CM > CDSW > Instances > Select All Instances > Prepare Node
- On every host, worker, and master CDSW hosts clear all iptable restrictions set up by k8s, docker, etc.
iptables-save | awk '/^[*]/ { print $1 }
/^:[A-Z]+ [^-]/ { print $1 " ACCEPT" ; }
/COMMIT/ { print $0; }' | iptables-restore - In CM, start docker daemon on every CDSW host (do not start the other CDSW roles).
- Run the weave reset on every CDSW host.
/opt/cloudera/parcels/CDSW/cni/bin/weave reset
- In CM, stop all of the docker daemons.
- In CM, select master role > actions > Prepare Node
- in CM for every worker node, select worker role > Actions > Prepare Node.
- Start all CDSW services in CM.
Cheers!
Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.
Created 12-27-2021 12:37 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@ronys From CDSW Function perspective you need to adjust some Configuration as per new IP and the most important thing is forward and reverse DNS lookups MUST work.
Apart from that you can follow fe simple steps.
- Stop CDSW Service in Cloudera Manager (CM).
- Take a backup of CDSW app dir on each host by running the following command:
tar cvzf cdsw.tar.gz /var/lib/cdsw/*
- Change the IP address of the host(s).
- Ensure that forward and reverse DNS still works (use dig or nslookup commands). If not, work with netops to fix it before proceeding.
- Ensure that /etc/hosts is not used for DNS. If yes, use a DNS server before proceeding.
- On each host, check for multiple name servers in /etc/resolv.conf. If there are multiple, work with netops to ensure that each name server recognizes the new IP address.
- Update CDSW config in CM with the new IP address of the CDSW master host:
Beneath CM > CDSW > Configuration > search for "IP" and set MASTER_IP to correct IP address for CDSW master host
- Save Changes and run a cluster wide Deploy Client Configuration.
- Complete a weave reset and run prepare node on each host.
/opt/cloudera/parcels/CDSW/cni/bin/weave reset
Beneath CM > CDSW > Instances > Select All Instances > Prepare Node
- On every host, worker, and master CDSW hosts clear all iptable restrictions set up by k8s, docker, etc.
iptables-save | awk '/^[*]/ { print $1 }
/^:[A-Z]+ [^-]/ { print $1 " ACCEPT" ; }
/COMMIT/ { print $0; }' | iptables-restore - In CM, start docker daemon on every CDSW host (do not start the other CDSW roles).
- Run the weave reset on every CDSW host.
/opt/cloudera/parcels/CDSW/cni/bin/weave reset
- In CM, stop all of the docker daemons.
- In CM, select master role > actions > Prepare Node
- in CM for every worker node, select worker role > Actions > Prepare Node.
- Start all CDSW services in CM.
Cheers!
Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.
Created 12-27-2021 02:52 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi GangWar,
Can you send me the instructions for HDP cluster ?
Thanks
Rony
Created 12-27-2021 05:18 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@ronys There is no logical difference in CDSW on HDP. You just have to run same instructions from command line just the path for that will change to /etc/cdsw/scripts instead of /opt/cloudera/parcels/CDSW/scripts.
Cheers!
Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.
Created 12-27-2021 10:54 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
