Support Questions
Find answers, ask questions, and share your expertise

What will happen if HDFS storage reached to 100% and which demon process gives alert to Cluster GI ?

Expert Contributor

What will happen if HDFS storage reached to 100% and which demon process gives alert to Cluster GI?

3 REPLIES 3

Expert Contributor

May be following things

1) Cluster will get hang.

2) Jobs will start failing with message as space not exist.

Please add with your comments, if any other required to include!

Rising Star

@zkfs

YARN Resource Manager has a configuration that prevents you from launching jobs when the data node is around 90-95% full. So that is the first level of error you will see. At the HDFS level, you will error since block allocations and writes would fail.

If you have Amabari, then Ambari will be firing alerts much before you reach 100%. I don't think HDFS will fire alerts, instead, you will see failures at the HDFS level.

Expert Contributor

Yep will fail in HDFS level and Jobs as well saying space not exist, which process is responsible for doing this task and how it works ?