Skip to main content
Amn_468
Amn_468
Silver ⭐️⭐️⭐️
March 23, 2020
Solved

Name Node Pause duration

Hi,

We are repeatedly getting alerts for NN Pause duration (The health test result for NAME_NODE_PAUSE_DURATION has become bad: Average time spent paused was 44.5 second(s) (74.25%) per minute over the previous 5 minute(s). Critical threshold: 60.00%.) 

CM / CDH - 5.16.2

Current NN Heap Size - 4GB

Block Used - 5TB

 

Request some assistance in fixing this.

 

Thanks 

Amn

 

 

 

venkatsambath
venkatsambathAnswer
Gold ⭐️⭐️⭐️
April 2, 2020

Hi @Amn_468 

Please configure it in

 

CM > HDFS > Configuration > 
Java Heap Size of NameNode in Bytes 
Enter a value per requirement
Save and Restart

 

View in thread

3 replies

venkatsambath
Gold ⭐️⭐️⭐️
venkatsambath
Gold ⭐️⭐️⭐️
March 23, 2020

You would need to tune your heap in accordance with the number of files. The tuning guideline is in document https://docs.cloudera.com/HDPDocuments/HDP2/HDP-2.6.5/bk_command-line-installation/content/configuring-namenode-heap-size.html

 

If you would like to get count of files, You may run hdfs dfs -count /

 

 

Translate
Amn_468
Amn_468Author
Silver ⭐️⭐️⭐️
April 2, 2020

Hi @venkatsambath 

 

Appericate your help, would like some assistance in configuring NN heap size, would like to know what would be the best way to move forward:

  1. Increase NN heap via Cloudera Manager (HDFS>Config> NN>Heap (HA Cluster)) OR
  2. Changing it via  /etc/hadoop/conf/hadoop-env.sh (HADOOP_NAMENODE_OPTS)

Kindly Advise

 

Regards

Amn

 

Translate
venkatsambath
Gold ⭐️⭐️⭐️
venkatsambathAnswer
Gold ⭐️⭐️⭐️
April 2, 2020

Hi @Amn_468 

Please configure it in

 

CM > HDFS > Configuration > 
Java Heap Size of NameNode in Bytes 
Enter a value per requirement
Save and Restart

 

Translate
Terms & ConditionsAccessibility statement