Support Questions

Find answers, ask questions, and share your expertise
Announcements
We’ve updated our product names and community labels - click here for full details

Name Node Pause duration

avatar
Rising Star

Hi,

We are repeatedly getting alerts for NN Pause duration (The health test result for NAME_NODE_PAUSE_DURATION has become bad: Average time spent paused was 44.5 second(s) (74.25%) per minute over the previous 5 minute(s). Critical threshold: 60.00%.) 

CM / CDH - 5.16.2

Current NN Heap Size - 4GB

Block Used - 5TB

 

Request some assistance in fixing this.

 

Thanks 

Amn

 

 

 

1 ACCEPTED SOLUTION

avatar

Hi @Amn_468 

Please configure it in

 

CM > HDFS > Configuration > 
Java Heap Size of NameNode in Bytes 
Enter a value per requirement
Save and Restart

 

View solution in original post

3 REPLIES 3

avatar

You would need to tune your heap in accordance with the number of files. The tuning guideline is in document https://docs.cloudera.com/HDPDocuments/HDP2/HDP-2.6.5/bk_command-line-installation/content/configuri...

 

If you would like to get count of files, You may run hdfs dfs -count /

 

 

avatar
Rising Star

Hi @venkatsambath 

 

Appericate your help, would like some assistance in configuring NN heap size, would like to know what would be the best way to move forward:

  1. Increase NN heap via Cloudera Manager (HDFS>Config> NN>Heap (HA Cluster)) OR
  2. Changing it via  /etc/hadoop/conf/hadoop-env.sh (HADOOP_NAMENODE_OPTS)

Kindly Advise

 

Regards

Amn

 

avatar

Hi @Amn_468 

Please configure it in

 

CM > HDFS > Configuration > 
Java Heap Size of NameNode in Bytes 
Enter a value per requirement
Save and Restart