So one more question I had.   Is it purely a non-functional performance consideration based on workloads?   Is it ever a concern that any of the software components in the Cloudera stack would actually cause job failures (or even worse successful completions by creating a corrupt dataset) through mixing say bonded 1GE and 10GE racks of servers? We're running HBase, MapReduce and very light impala on our cluster of over 60 nodes, and we're thinking of moving to 10GE for nodes 60 - 100. But we're not sure if we should also upgrade the existing 60 nodes.   We'll do some investigation now to determine whether our jobs are network bound. But there doesn't seem to be an easy way of measuring other than through the Chart views and looking at total bytes received on all interfaces across time across each node. Any other suggestions?   Would anyone recommend that in order to move to 10GE networking that all potential components of the solution MUST be upgraded? Or is it purely a call to be made based on the performance attributes of jobs running? ... View more

Thanks,   I've been managing 30-40 node clusters in my team (soon >60), and we've found that the CPU and memory differences are easy to manage through configurations for mapreduce.    But newer generations of hardware are about to hit the market soon, SSDs are going to get cheaper and 10GE networking is not almost a standard in most datacentres.    So should we upgrade our existing nodes to 10GE? Or should we keep everything mixed and allow the software to handle it? ... View more