Community Articles
Find and share helpful community-sourced technical articles.

Hadoop relies heavily on DNS, and as such performs many DNS lookups during normal operation. To reduce the load on your DNS infrastructure, it's highly recommended to use the Name Service Caching Daemon (NSCD) on cluster nodes running Linux or any other dns caching mechanism ( i.e dnsmasq ).

This daemon will cache host, user, and group lookups and provide better resolution performance, and reduced load on DNS infrastructure.

Default cache size and TTL value are good enough to reduce the significant load. However, you might need to tweak this as per your environment.

0 Kudos
Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.
Version history
Last update:
‎06-30-2018 11:46 AM
Updated by:
Top Kudoed Authors