dose we need to set huge pages on all nodes in the cluster?

[#1]

we have ambari cluster with - master machines + workers machines + kafka machines

dose we need to configured MTU=9000 on all nodes?

refrence - https://community.hortonworks.com/articles/8563/typical-hdp-cluster-network-configuration-best-pra.h...

dose Disable Transparent Huge Page - means to disable the HUGE PAGES option ?

[#2 · Accepted solution]

@Michael Bronson

The Huge Pages needs to be disabled on all the cluster nodes. Thats the reason ambari shows a WARNING while registering a Host to the cluster if the Huge Pages are not setup. Ambari Host Check Fails if Transparent Huge Pages (THP) is not disabled. https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.1.3/bk_ambari-troubleshooting/content/resolving...

# echo never > /sys/kernel/mm/redhat_transparent_hugepage/defrag
# echo never > /sys/kernel/mm/redhat_transparent_hugepage/enabled

.

When we configure the MTU explicitly then we should configuring the MTU same across the cluster nodes else MTU configurations can produce serious problems with the network. Enabling Jumbo Frames across the cluster nodes can improve bandwidth through better check sums and possibly may also provide packet integrity however you will need to consult with your Network admins before making this decision. Regarding setting MTU to 9000 it is better to check the network infrastructure first and to see if all the network devices can support MTU 9000 or not. Network admins can be more helpful here as this is basically a network tuning parameter.

.

[#3]

just to be clear , according to your answer we understand that MTU=9000 recomended to be set on all machines in the cluster include master machines . workers machines and kafka machines , am I corecyt ?

[#4]

@Michael Bronson

Yes. But this value should be implemented after consulting your network admins.

[#5]

@jay how to calculate the MTU value? 8000? or 9000? or between them ? , what hortonworks recomended ?

[#6]

@Michael Bronson

The following link explains how to set the MTU value and how to deter mine it's value based on our network devices standards.

https://www.tp-link.com/us/article/?faqid=190