Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

What triggers du in datanode?

What triggers du in datanode?

New Contributor

Hi there,

 

We were doing some impala testings and we noticed that after dropping the linux system cache (echo 1 > /proc/sys/vm/drop_caches), very often datanode starts du command, which normally we are expecting for every fs.du.interval but we are seeing it much more often than the specified interval. We did the bypass using https://allthingshadoop.com/2011/05/20/faster-datanodes-with-less-wait-io-using-df-instead-of-du/ but we are wondering what's triggering it and whether there's a better config/workaround.

 

Thanks!

Don't have an account?
Coming from Hortonworks? Activate your account here