I know that default value is 4096. As per Hortonworks recommendation, we need to set it to 16K if we are using HBase.
I think we should consider number of cores, main memory, ulimits etc. I need to understand how can we decide best value of this property?
http://blog.cloudera.com/blog/2012/03/hbase-hadoop-xceivers/ has some formulas which we can use for deciding value.
Please advice! :)
There is a longer version of that post here. http://www.larsgeorge.com/2012/03/hadoop-hbase-and-xceivers.html
You can use the formula at the end of it.
I think Hortonworks recommendation is taking the easier approach and putting a higher limit which works in most cases.