Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Query about data missing after disk replacement.

avatar
Explorer

Earlier after performing this replacement, a month back. Data wiped and it stood at 7.7 GB ever a month, data consistently increased now standing at 326 GB.
/dev/sde1                                           7.1T  326G  6.8T   5% /u05


We usually don't perform, decommissioning. So, before replacement data wasn't transferred to any datanode. If such case, after the activity, the data was in wiped state.
Kindly help with Cloudera review

1 REPLY 1

avatar
Master Collaborator

@Shivakuk When you replace a disk in an HDFS cluster, especially if it's a DataNode disk, the Hadoop system should handle data replication and rebalancing automatically. This means that once the new disk is added and the DataNode is back online, HDFS will redistribute the data across the cluster to maintain the configured replication factor.

If data was wiped during or after the disk replacement process, it's critical to investigate why this occurred and take measures to prevent data loss in the future. Ensure that proper backup and recovery procedures are in place, and consider implementing data mirroring or replication to minimize the risk of data loss due to hardware failures.

Regards,

Chethan YM