question Re: Atlas not refreshing with hive metdata in Archives of Support Questions (Read Only)

Atlas not refreshing with hive metdata

sunile_manjee — Sun, 18 Aug 2019 10:28:20 GMT

HDP 2.5. I have run hive-import.sh. Then i made some changes like added new table and created view on that table.

The new table and view don't come up while searching under DSL hive_table
The new table shows up in general search but is missing schema

I re-ran import-hive.sh and the columns still do not show up

Re: Atlas not refreshing with hive metdata

vnv — Thu, 29 Sep 2016 01:48:58 GMT

I would imagine this is because the external table and view are not hive_tables. Try using CREATE TABLE instead if you want it to register as a "hive_table" otherwise it will show up in the lineage like you see in the screenshot you posted.

If you want to associate them all under the same key words you can leverage "TAGS" to tag the tables with a common tag (ex. "AIRLINE_DATA").

The DSL search will only return the exact data type you select.

Hope this helps.

Re: Atlas not refreshing with hive metdata

sunile_manjee — Thu, 29 Sep 2016 10:09:20 GMT

@Vasilis Vagias Hive external tables should show up in atlas. This functionality worked recently. Not sure what happened. @Anderw Ahn Please confirm my understanding.

Re: Atlas not refreshing with hive metdata

sunile_manjee — Thu, 29 Sep 2016 11:35:58 GMT

I found the issue. This is a bug. Engineering working on issue.