https://community.cloudera.com/t5/Support-Questions/Minimum-number-of-nodes-and-specs-for-a-real-cluster/m-p/36418#M52142 <P>Our initial test server for Hadoop cluster is:</P><P>&nbsp;</P><P>1 Namenode (64GB ram + 24 core) + 2 hdd 1 for os, 1 for hdfs storage.</P><P>3 Datanode (each 32GB ram + 16 core) + 2 hdd 1 for os, 1 for dfs storage.</P><P>&nbsp; &nbsp;- the datanode is also used for: zookeeper, kafka, spark, YARN/mapreduce, Impala and Pig/Hive gateway.</P><P>&nbsp;</P><P>As the best practice to run hadoop environment, all server should be a bare metal and not VM.</P><P>&nbsp;</P><P>IMHO, maybe you could make the namenode server smaller like 32GB of ram with less core. But for the datanode sides, I don't recommend to have less specs than that, especially the minimum memory.</P> Wed, 20 Jan 2016 11:07:09 GMT sphinxid 2016-01-20T11:07:09Z