Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Name Node Pause duration

avatar
Rising Star

Hi,

We are repeatedly getting alerts for NN Pause duration (The health test result for NAME_NODE_PAUSE_DURATION has become bad: Average time spent paused was 44.5 second(s) (74.25%) per minute over the previous 5 minute(s). Critical threshold: 60.00%.) 

CM / CDH - 5.16.2

Current NN Heap Size - 4GB

Block Used - 5TB

 

Request some assistance in fixing this.

 

Thanks 

Amn

 

 

 

1 ACCEPTED SOLUTION

avatar
Master Collaborator

Hi @Amn_468 

Please configure it in

 

CM > HDFS > Configuration > 
Java Heap Size of NameNode in Bytes 
Enter a value per requirement
Save and Restart

 

View solution in original post

3 REPLIES 3

avatar
Master Collaborator

You would need to tune your heap in accordance with the number of files. The tuning guideline is in document https://docs.cloudera.com/HDPDocuments/HDP2/HDP-2.6.5/bk_command-line-installation/content/configuri...

 

If you would like to get count of files, You may run hdfs dfs -count /

 

 

avatar
Rising Star

Hi @venkatsambath 

 

Appericate your help, would like some assistance in configuring NN heap size, would like to know what would be the best way to move forward:

  1. Increase NN heap via Cloudera Manager (HDFS>Config> NN>Heap (HA Cluster)) OR
  2. Changing it via  /etc/hadoop/conf/hadoop-env.sh (HADOOP_NAMENODE_OPTS)

Kindly Advise

 

Regards

Amn

 

avatar
Master Collaborator

Hi @Amn_468 

Please configure it in

 

CM > HDFS > Configuration > 
Java Heap Size of NameNode in Bytes 
Enter a value per requirement
Save and Restart