Query about data missing after disk replacement.

Shivakuk — Tue, 08 Aug 2023 07:50:37 GMT

Earlier after performing this replacement, a month back. Data wiped and it stood at 7.7 GB ever a month, data consistently increased now standing at 326 GB.
/dev/sde1 7.1T 326G 6.8T 5% /u05

We usually don't perform, decommissioning. So, before replacement data wasn't transferred to any datanode. If such case, after the activity, the data was in wiped state.
Kindly help with Cloudera review

Re: Query about data missing after disk replacement.

ChethanYM — Mon, 04 Mar 2024 10:06:50 GMT

@Shivakuk When you replace a disk in an HDFS cluster, especially if it's a DataNode disk, the Hadoop system should handle data replication and rebalancing automatically. This means that once the new disk is added and the DataNode is back online, HDFS will redistribute the data across the cluster to maintain the configured replication factor.

If data was wiped during or after the disk replacement process, it's critical to investigate why this occurred and take measures to prevent data loss in the future. Ensure that proper backup and recovery procedures are in place, and consider implementing data mirroring or replication to minimize the risk of data loss due to hardware failures.

Regards,

Chethan YM

question Query about data missing after disk replacement. in Support Questions

Query about data missing after disk replacement.

Re: Query about data missing after disk replacement.