Support Questions

Find answers, ask questions, and share your expertise

Is there any recommendation for dfs.datanode.max.transfer.thread ?

Super Guru

I know that default value is 4096. As per Hortonworks recommendation, we need to set it to 16K if we are using HBase.

I think we should consider number of cores, main memory, ulimits etc. I need to understand how can we decide best value of this property? has some formulas which we can use for deciding value.

Please advice! 🙂



There is a longer version of that post here.

You can use the formula at the end of it.


I think Hortonworks recommendation is taking the easier approach and putting a higher limit which works in most cases.

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.