@kiyengar Whether you should upgrade your infrastructure or not will be a decision you will have to make based on the performance details of your cluster as it stands today and compared to what you expect your load to increase to in the near- to mid-term future.
While we can't provide you a one-size-fits-all answer for that, I CAN tell you that many of the clusters we see in production now do use 10GbE networking. In fact, the reference architectures from our partners Dell and Oracle go well beyond that and actually utillize dual bonded 10GbE and/or bonded Infiniband network configurations for their hadoop cluster offerings.
The answer to your question will really come down to "are you seeing, or will you soon see network saturation in your cluster?" If your cluster is handling the workloads you are throwing at it just fine, than there is no need to upgrade. If your network is becoming, or will soon become a serious bottleneck in your throughput, than definitely look to upgrade. Make sure to work closely with your hardware vendor to assure the latest 10GbE hardware/firmware you seek to use is bug free, however, as we've seen many issues with early generation firmware on some network adapters.
Regarding SSDs, make sure you fully understand all the nuances of using and configuring them correctly before you head down that path. This blog is a very helpful place to start.
... View more
