Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Atlas not refreshing with hive metdata

avatar
Master Guru

HDP 2.5. I have run hive-import.sh. Then i made some changes like added new table and created view on that table.

  1. The new table and view don't come up while searching under DSL hive_table
  2. The new table shows up in general search but is missing schema

I re-ran import-hive.sh and the columns still do not show up

8066-atlas.jpg

1 ACCEPTED SOLUTION

avatar
Master Guru

I found the issue. This is a bug. Engineering working on issue.

View solution in original post

3 REPLIES 3

avatar
Guru

I would imagine this is because the external table and view are not hive_tables. Try using CREATE TABLE instead if you want it to register as a "hive_table" otherwise it will show up in the lineage like you see in the screenshot you posted.

If you want to associate them all under the same key words you can leverage "TAGS" to tag the tables with a common tag (ex. "AIRLINE_DATA").

The DSL search will only return the exact data type you select.

Hope this helps.

avatar
Master Guru

@Vasilis Vagias Hive external tables should show up in atlas. This functionality worked recently. Not sure what happened. @Anderw Ahn Please confirm my understanding.

avatar
Master Guru

I found the issue. This is a bug. Engineering working on issue.