question Re: Metadata not being captured by ATLAS_HOOK HDP 2.6 in Archives of Support Questions (Read Only)

Metadata not being captured by ATLAS_HOOK HDP 2.6

sriramdboss — Fri, 08 Sep 2017 18:30:38 GMT

Env: HDP 2.6

Kerberos enabled

Atlas added as a service post upgrade.

Metadata is not visible from Atlas UI. Tried consuming the messages from beginning for the topic ATLAS_HOOK and this doesn't have any messages.

However, I can see the list of entities and when queried for the entities, I can see them in kafka-logs (grep with entity name and result shows the recent .log files matches).

Ranger plugin for kafka is not eabled and shen searched for ACL's, all users have write access from all hosts for the topic.

Re: Metadata not being captured by ATLAS_HOOK HDP 2.6

Shelton — Fri, 08 Sep 2017 20:14:41 GMT

@Sundara Palanki

You should enable the Ranger Kafka hook,restart all stale configs and retry

Re: Metadata not being captured by ATLAS_HOOK HDP 2.6

sriramdboss — Fri, 08 Sep 2017 20:27:22 GMT

@Geoffrey Shelton Okot The authorizer class is set to simpleAuthorizer* and why should I have the ranger plugin for kafka enabled ?

Re: Metadata not being captured by ATLAS_HOOK HDP 2.6

nixonrodrigues — Sat, 09 Sep 2017 21:50:09 GMT

@sundara Palanki

which entities types of entities you are referring to, if hive did you try import-hive.sh script or create table in hive db.

check the hive and atlas application logs for error during table creation time.

Re: Metadata not being captured by ATLAS_HOOK HDP 2.6

sriramdboss — Mon, 11 Sep 2017 20:56:26 GMT

@Nixon Rodrigues The problem was with the initial import where atlas user doesn't have read/execute on /apps/hive/warehouse. Once I added the policy for atlas user and ran the script, I was able to get everything in place.