- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Query about data missing after disk replacement.
- Labels:
-
HDFS
Created 08-08-2023 12:50 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Earlier after performing this replacement, a month back. Data wiped and it stood at 7.7 GB ever a month, data consistently increased now standing at 326 GB.
/dev/sde1 7.1T 326G 6.8T 5% /u05
We usually don't perform, decommissioning. So, before replacement data wasn't transferred to any datanode. If such case, after the activity, the data was in wiped state.
Kindly help with Cloudera review
Created 03-04-2024 02:06 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@Shivakuk When you replace a disk in an HDFS cluster, especially if it's a DataNode disk, the Hadoop system should handle data replication and rebalancing automatically. This means that once the new disk is added and the DataNode is back online, HDFS will redistribute the data across the cluster to maintain the configured replication factor.
If data was wiped during or after the disk replacement process, it's critical to investigate why this occurred and take measures to prevent data loss in the future. Ensure that proper backup and recovery procedures are in place, and consider implementing data mirroring or replication to minimize the risk of data loss due to hardware failures.
Regards,
Chethan YM