Glad that the issue has been resolved @dansteu. Can you please accept my answer as a solution: https://community.cloudera.com/t5/Support-Questions/Data-Lineage-not-shown-after-importing-Hive-entities/m-p/324554/highlight/true#M229402 This will help the community find answers in future. Thanks! ... View more

@dansteuCan you share the output of these commands? Please run them from the Kafka broker host and request the Kafka principal prior: /usr/hdp/current/kafka-broker/bin/kafka-topics.sh --list --zookeeper `hostname -f`:2181 And the second command: https://gitlab.com/saurabhlambe/Atlas-stuff/-/blob/master/Atlas%20API.md#c-describe-atlas-consumer-group-to-check-current-consumer-lag ... View more

@dansteuyou are correct. Only if Atlas fetches Hive metadata automatically (with no manual intervention), only then the lineage is created. Please refer to this Apache Atlas document to set up the Atlas Hive hook: https://atlas.apache.org/1.2.0/Hook-Hive.html BTW, when you install Atlas in an HDP cluster, these properties are automatically set and no intervention is needed. So you might just need to confirm if those properties are set.   Regards, Saurabh ... View more

@KamalakannanI think curl works differently than it does on Linux. I found something that could help: https://stackoverflow.com/questions/62912236/webhdfs-curl-negotiate-on-windows ... View more

Hi Megh, Looking at the error, it seems that a NN failover happened at the remote cluster when the distcp didn't yet finish. Also, did you mention namespaces instead of hostnames in the distcp command? I would recommend you review this document on performing distcp between clusters that have Namenode HA enabled. Thanks, Saurabh ... View more

Hi Madhuri,   Streaming Ranger audits to third-party services (other than HDFS, Solr) is still not officially supported. I found this article though, can you check if that helps: https://my.cloudera.com/knowledge/How-to-send-Ranger-audit-logs-to-log4j-appenders?id=276802 Also, there's a Github page to enable streaming Ranger audits to Kafka topics: https://github.com/Raghav-Guru/kafka-ranger-audit Here's an Apache document on steps to enable Audits to a component that has log4j appender: https://cwiki.apache.org/confluence/display/RANGER/Ranger+0.5+Audit+Configuration#Ranger0.5AuditConfiguration-AudittoLog4j ... View more

Hi @woodcock_mike, thanks for this interesting question. I could reproduce this issue locally in my Ambari 2.7.4 cluster as well. Allow me some time to research and figure out how we could get rid of the additional absent Kafka server in Ranger audits. I'll be right back. ... View more

Hi J, is NetIQ a SAML authentication mechanism? If yes, then the below link could be useful to you: https://knox.apache.org/books/knox-1-4-0/user-guide.html#Pac4j+Provider+-+CAS+/+OAuth+/+SAML+/+OpenID+Connect   Generally, Knox supports two types of identity providers: Authentication providers Federation providers Does NetIQ fall under federation provider category? Please correct me if I'm wrong. Read more here: https://knox.apache.org/books/knox-1-4-0/user-guide.html#Authentication   Thanks, Saurabh ... View more