Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

networking for Hadoop clusters + Ethernet speed 1000Mb/s or 10G for hadoop clusters

networking for Hadoop clusters + Ethernet speed 1000Mb/s or 10G for hadoop clusters

we want to build Hadoop cluster , with HDP - 2.6.5

 

About the Ethernet speed

Dose speed: `1000Mb/s` for Ethernet , is enough when dealing with Hadoop cluster ?

 

Or Hadoop cluster must have network Ethernet speed of 10G ?


example of our setting on dell machine with linux rhel

 

ethtool ifn-33
Settings for ifn33:
Supported ports: [ TP ]
Supported link modes: 10baseT/Half 10baseT/Full
100baseT/Half 100baseT/Full
1000baseT/Full
Supported pause frame use: No
Supports auto-negotiation: Yes
Supported FEC modes: Not reported
Advertised link modes: 10baseT/Half 10baseT/Full
100baseT/Half 100baseT/Full
1000baseT/Full
Advertised pause frame use: No
Advertised auto-negotiation: Yes
Advertised FEC modes: Not reported
Speed: 1000Mb/s

 


reference - https://www.arista.com/assets/data/pdf/Whitepapers/Hadoop_WP_final.pdf

Don't have an account?
Coming from Hortonworks? Activate your account here