Created 12-23-2017 02:28 AM
What will happen if HDFS storage reached to 100% and which demon process gives alert to Cluster GI?
Created 12-23-2017 02:30 AM
May be following things
1) Cluster will get hang.
2) Jobs will start failing with message as space not exist.
Please add with your comments, if any other required to include!
Created 12-23-2017 06:54 PM
YARN Resource Manager has a configuration that prevents you from launching jobs when the data node is around 90-95% full. So that is the first level of error you will see. At the HDFS level, you will error since block allocations and writes would fail.
If you have Amabari, then Ambari will be firing alerts much before you reach 100%. I don't think HDFS will fire alerts, instead, you will see failures at the HDFS level.
Created 12-24-2017 09:33 AM
Yep will fail in HDFS level and Jobs as well saying space not exist, which process is responsible for doing this task and how it works ?