how many ldap servers for hadoop authentication

[#1]

Does anyone have insights into how many ldap servers would be required for 100s of jobs? the cluster is kerberized and uses ldap authentication. Right now I have 1 LDAP server setup. When do I scale to multi ldap servers? Asking this to avoid bottlenecks if ldap server is being pounded.

[#2 · Accepted solution]

@Sunile Manjee

Have you seen this article for tuning: https://community.hortonworks.com/articles/38591/hadoop-and-ldap-usage-load-patterns-and-tuning.html

This article provides good background on the performance scaling of LDAP: http://researchweb.watson.ibm.com/people/d/dverma/papers/sigmetrics2001.pdf