- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Name Node Pause duration
- Labels:
-
Apache Hadoop
-
Cloudera Manager
-
HDFS
Created 03-22-2020 07:19 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi,
We are repeatedly getting alerts for NN Pause duration (The health test result for NAME_NODE_PAUSE_DURATION has become bad: Average time spent paused was 44.5 second(s) (74.25%) per minute over the previous 5 minute(s). Critical threshold: 60.00%.)
CM / CDH - 5.16.2
Current NN Heap Size - 4GB
Block Used - 5TB
Request some assistance in fixing this.
Thanks
Amn
Created 04-01-2020 11:19 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi @Amn_468
Please configure it in
CM > HDFS > Configuration >
Java Heap Size of NameNode in Bytes
Enter a value per requirement
Save and Restart
Created 03-22-2020 08:48 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
You would need to tune your heap in accordance with the number of files. The tuning guideline is in document https://docs.cloudera.com/HDPDocuments/HDP2/HDP-2.6.5/bk_command-line-installation/content/configuri...
If you would like to get count of files, You may run hdfs dfs -count /
Created 04-01-2020 10:41 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Appericate your help, would like some assistance in configuring NN heap size, would like to know what would be the best way to move forward:
- Increase NN heap via Cloudera Manager (HDFS>Config> NN>Heap (HA Cluster)) OR
- Changing it via /etc/hadoop/conf/hadoop-env.sh (HADOOP_NAMENODE_OPTS)
Kindly Advise
Regards
Amn
Created 04-01-2020 11:19 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi @Amn_468
Please configure it in
CM > HDFS > Configuration >
Java Heap Size of NameNode in Bytes
Enter a value per requirement
Save and Restart
