- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Atlas not refreshing with hive metdata
- Labels:
-
Apache Atlas
Created on ‎09-28-2016 06:30 PM - edited ‎08-18-2019 03:28 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
HDP 2.5. I have run hive-import.sh. Then i made some changes like added new table and created view on that table.
- The new table and view don't come up while searching under DSL hive_table
- The new table shows up in general search but is missing schema
I re-ran import-hive.sh and the columns still do not show up
Created ‎09-29-2016 04:35 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I found the issue. This is a bug. Engineering working on issue.
Created ‎09-28-2016 06:48 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I would imagine this is because the external table and view are not hive_tables. Try using CREATE TABLE instead if you want it to register as a "hive_table" otherwise it will show up in the lineage like you see in the screenshot you posted.
If you want to associate them all under the same key words you can leverage "TAGS" to tag the tables with a common tag (ex. "AIRLINE_DATA").
The DSL search will only return the exact data type you select.
Hope this helps.
Created ‎09-29-2016 03:09 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@Vasilis Vagias Hive external tables should show up in atlas. This functionality worked recently. Not sure what happened. @Anderw Ahn Please confirm my understanding.
Created ‎09-29-2016 04:35 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I found the issue. This is a bug. Engineering working on issue.
