Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Push audit event to kafka cluster using Navigator

Push audit event to kafka cluster using Navigator

New Contributor

Hi, 

I'm using  (non-kerberized) Cloudera Enterprise 5.8.0 (#42 built by jenkins on 20160714-1246 git: d08ac14ff050a108864fab00205c12e0d4043132)

 

, trying to publish audit events to another kafka cluster following this link:
http://www.cloudera.com/documentation/enterprise/5-8-x/topics/datamgmt_audit_publish.html.

The hdfs audit events failed to be sent to the topic I created in another kafka cluster, but  they were recorded in "/var/log/cloudera-scm-navigator/logfile". 

Here is the my configuration for "Navigator Audit Server Loggin":


log4j.logger.kafkaAuditStream=TRACE,KAFKA
log4j.appender.KAFKA=kafka.producer.KafkaLog4jAppender
log4j.additivity.com.cloudera.navigator.kafkaAuditStream=false
log4j.appender.KAFKA.layout=org.apache.log4j.PatternLayout
log4j.appender.KAFKA.layout.ConversionPattern=%m%n
log4j.appender.KAFKA.SyncSend=false
log4j.appender.KAFKA.BrokerList=sandbox.com:9092
log4j.appender.KAFKA.Topic=TEST

 

I've verified that the kafka cluster is working fine, and they can ping to each other, so I think the problem might be related to my configuration on CDH. 
PS: I did this before on a CDH 5.5.3 before and it succeeded, now I did the same configuration to 5.8.x but failed.

 

Can any one tell me where to check the root cause for it?

 

Thanks and regards,

Da

1 REPLY 1
Highlighted

Re: Push audit event to kafka cluster using Navigator

New Contributor

Were you able to solve this? We are facing a similar issue and wanted to see if it has been resolved before we open a ticket with Cloudera.

 

Thank You,

N.