Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Does decommission of data node requires data node to be in started state?

Highlighted

Does decommission of data node requires data node to be in started state?

New Contributor

While removing one host from a multi-node cluster, when the Hadoop services are not running (i.e. Datanode is not in the started state )

I got the following error:

Component data node on host vmforkaran.informatica.com cannot be decommissioned as it's not in STARTED state

2 REPLIES 2

Re: Does decommission of data node requires data node to be in started state?

Super Mentor

@KARAN GUPTA

Yes, the DataNode must be running when we try to enable the Decommission for that DataNode.

This is needed because when an administrator decommission a datanode, the datanode will first be transitioned into DECOMMISSION_INPROGRESS state. After all blocks belonging to that datanode have been fully replicated elsewhere based on each block’s replication factor. the datanode will be transitioned to DECOMMISSIONED state. After that, the administrator can shutdown the node.


You can check the DataNode status like Decommissioned...etc in NameNode UI in the mean time.

http://$NAMENODE_HOST:50070/dfshealth.html#tab-datanode


Details : https://docs.hortonworks.com/HDPDocuments/HDP3/HDP-3.1.0/administration/content/decommission-datanod...


Re: Does decommission of data node requires data node to be in started state?

Super Mentor

@KARAN GUPTA

Additionally please refer to the following link which explains the sequence of Removing a Node (Host) from multinode cluster.

https://docs.hortonworks.com/HDPDocuments/Ambari-2.7.3.0/managing-and-monitoring-ambari/content/amb_...

You must decommission a master or slave running on a host before removing it or its host from service. Decommissioning helps you to prevent potential loss of data or disruption of service. Decommissioning is available for the following component types:

  • DataNodes

  • NodeManagers

  • RegionServers

Decommissioning executes the following tasks:

For DataNodes
Safely replicates the HDFS data to other DataNodes in the cluster
For NodeManagers
Stops accepting new job requests from the masters and stops the component
For RegionServers
Turns on drain mode and stops the component


.