Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Audit trail for HDFS data use

Re: Audit trail for HDFS data use

New Contributor

I have the same/related question: what is the default logging level for logging user-issued 'hdfs dfs' commands?  Does the system log all those commands by default?  Where would I look to see what the logging level actually is?  Thanks.

Highlighted

Re: Audit trail for HDFS data use

Super Guru

@davids30,

 

What, exactly, are you trying to track?  Are you trying to generate audit information for HDFS access?

Re: Audit trail for HDFS data use

New Contributor
Trying to track how a user interacted with HDFS for compliance reasons. What files were accessed, what hdfs commands were issued, and when.

Thanks

Re: Audit trail for HDFS data use

Super Guru

@davids30,

 

If you are using CDH:

 

- (without Navigator Audit Server) by default, audits are stored in /var/log/hadoop-hdfs/hfds-audit.log

- (With Navigator Audit Server), audits are stored in /var/log/hadoop-hdfs/audits/

 

This page has a list of auditable events:

 

https://www.cloudera.com/documentation/enterprise/6/6.0/topics/cn_audit_event_reference.html#operati...

 

 

Re: Audit trail for HDFS data use

New Contributor
thanks!
Don't have an account?
Coming from Hortonworks? Activate your account here