Member since
11-29-2016
6
Posts
0
Kudos Received
0
Solutions
11-29-2016
06:58 PM
I believe the only overall HDFS limit is determined by how much memory is available in the namenode.
... View more
11-29-2016
12:36 AM
A couple of comments: 1. The section on setting up a dual homed network is correct, but misleading. Most people who set up dual-homed networks would expect to spread at least some of the load over the interfaces, but Hadoop code is just not network aware in that sense. So it is *much* better to use bonding/link aggregation for network redundancy. 2. In this day and age, don't even think about using 1Gb ports. Use at least 2 10Gb ports. Cloud providers are *today* installing 50Gb networks to their servers - 2x25Gb or 1x50Gb. You're wasting a LOT of CPU if you don't give them enough bandwidth.
... View more