some clarification about the explanation regarding 'tuned', such as its potential impact on Hadoop.

[#1]

Hi everyone, I would like some clarification. Thank you.

CDP recommends disabling the 'tuned' service for performance optimization.

Disable the tuned Service

The suggestion to disable 'tuned' stems from its capability to transition the CPU into c-state idle mode, potentially leading to decreased performance.

Disable the tuned Service on RHEL 8

We would like some clarification about the explanation regarding 'tuned', such as its potential impact on Hadoop. Thank you.

For example, THP:

Disabling Transparent Hugepages (THP) 
Most Linux platforms supported by Cloudera Runtime include a feature called transparent hugepages, which interacts poorly with Hadoop workloads and can seriously degrade performance.

For example, swappiness:

Setting the vm.swappiness Linux Kernel Parameter

On most systems, vm.swappiness is set to 60 by default. This is not suitable for Hadoop clusters because processes are sometimes swapped even when enough memory is available.

Regards

[#2 · Accepted solution]

Hello @steinsgate 

Thank you for reaching out on this

You can refer to the below RedHat link to know more about how tuned works on OS. You can check from the below document how different classes work

https://access.redhat.com/documentation/en-us/red_hat_enterprise_linux/8/html/monitoring_and_managin...

You can set the particular workloads from the available ones using tuned.

Also tuned is providing a set of guidelines. You still need to do testing for your particular workloads to validate that the performance curve is acceptable.

[#3]

Hello @upadhyayk04 

I see, thank you.