Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How to tune Linux machine in order to improve CPU load average and CPU utilization

Highlighted

How to tune Linux machine in order to improve CPU load average and CPU utilization

We are working with a huge Hadoop cluster. ( HDP - 2.6.4 + ambari )

We have 736 datanode machines and each node has 16 cores × 2 threads.

On some machines we saw CPU load average (98-128 for 5 min).

After deep investigation, we found:

  • no HW problem
  • no disk problem
  • no network problem
  • no infra problem

What we still have not checked is about how to tune the Linux kernel parameters.

What are the parameters or any kernel parameters that can help the machines in order to get good CPU working with most CPU LOW load average?

http://linuxrealtime.org/index.php/Improving_the_Real-Time_Properties

Michael-Bronson