question Re: Name Node Pause duration in Support Questions

Name Node Pause duration

Amn_468 — Mon, 23 Mar 2020 02:19:00 GMT

Hi,

We are repeatedly getting alerts for NN Pause duration (The health test result for NAME_NODE_PAUSE_DURATION has become bad: Average time spent paused was 44.5 second(s) (74.25%) per minute over the previous 5 minute(s). Critical threshold: 60.00%.)

CM / CDH - 5.16.2

Current NN Heap Size - 4GB

Block Used - 5TB

Request some assistance in fixing this.

Thanks

Amn

Re: Name Node Pause duration

venkatsambath — Mon, 23 Mar 2020 03:48:06 GMT

You would need to tune your heap in accordance with the number of files. The tuning guideline is in document https://docs.cloudera.com/HDPDocuments/HDP2/HDP-2.6.5/bk_command-line-installation/content/configuring-namenode-heap-size.html

If you would like to get count of files, You may run hdfs dfs -count /

Re: Name Node Pause duration

Amn_468 — Thu, 02 Apr 2020 05:41:29 GMT

Hi @venkatsambath

Appericate your help, would like some assistance in configuring NN heap size, would like to know what would be the best way to move forward:

Increase NN heap via Cloudera Manager (HDFS>Config> NN>Heap (HA Cluster)) OR
Changing it via /etc/hadoop/conf/hadoop-env.sh (HADOOP_NAMENODE_OPTS)

Kindly Advise

Regards

Amn

Re: Name Node Pause duration

venkatsambath — Thu, 02 Apr 2020 06:19:14 GMT

Hi @Amn_468

Please configure it in

CM > HDFS > Configuration > Java Heap Size of NameNode in Bytes Enter a value per requirement Save and Restart