Cloudera Community
yosuke
user rank
Frequent Visitor

Re: NodeManager doesn't work properly though it se...

by Frequent Visitor in Support Questions
‎05-11-2021 01:48 PM
‎05-11-2021 01:48 PM
@Shelton  Thank you for the response.   I haven't checked the settings yet, however we don't configure THP setting to disabled. I googled and found some article saying THP is not for Hadoop workload like below. https://community.cloudera.com/t5/Community-Articles/OS-Configurations-for-Better-Hadoop-Performance/ta-p/247300   I think you pointed out that our NodeManager went wrong due to the some workload happened and our node running NodeManager couldn't deal with it. Is my understanding correct?   I will configure this in our test environment first. Not knowing how this situation happened, I need some time to verify. If any progress or additional query, I will post again.   Thank you very much again.   Best regards, Yosuke ... View more

NodeManager doesn't work properly though it seems ...

by Frequent Visitor in Support Questions
‎05-08-2021 12:19 AM
‎05-08-2021 12:19 AM
Hi,   I'm running a 6-node Hadoop Cluster, which version is HDP 3.1.4, and faced a weird situation so could anyone please help me out.    Checking on Ambari WebUI, NodeManagers which is consisted of 3 nodes seem just fine. However when we push a application into yarn, all the app failed.   Investigating the situation and log files, I found one of the NodeManager node's WebUI not responding and emitting the following log.    WARN org.apache.hadoop.util.SysInfoLinux: Couldn't read /proc/meminfo: can't determine memory settings   By restarting the NodeManager Service, this situation is resolved for a moment but seems reproducible.   Does anyone faced same problem? Any comment is highly appreciated.   Thank you in advance.   Best Regards, Yosuke ... View more
Contact Me
Online
Offline
Last Visited
‎12-28-2021 05:20 AM
Community Statistics
Member Since ‎05-07-2021 07:08 PM
Last Visited ‎12-28-2021 05:20 AM
Posts 2