Support Questions

Find answers, ask questions, and share your expertise

How to make dropped hive table status as inactive/deleted in apache atlas

avatar
Contributor

Hi ,

I have apache atlas setup in place and hive hooks are up and running. All the hive create/update , lineages etc sowing in atlas.

Now I have dropped one hive table from Hive and  this same hive table entity is still showing up in apache atlas as ACTIVE. can someone suggest is this something expected or do we need to explicitly delete this entity from Atlas? 

6 REPLIES 6

avatar
Master Collaborator

Hi @bigdatacm 

Thanks for bringing up the issue.

To explicitly remove the entity from Atlas after dropping the Hive table, you can use the Atlas REST API or the Atlas UI to delete the entity.

UI - you can manually delete the entity from the Atlas UI by searching for the table and removing it.

Thanks,

Shehbaz.

 

avatar
Contributor

thanks for getting back to me @shehbazk 

okay. Entities in Atlas remain in an ACTIVE state, even if they have been deleted from Hive ?

The only option is to delete via UI or Rest api calls ? 

avatar
Expert Contributor

@bigdatacm This is the one of  option is to delete the entity via the UI or REST API.

avatar
Expert Contributor

when a table is dropped from Hive, the corresponding entity in Atlas should ideally be marked as deleted. However, there are a few potential reasons why the entity might still be shown as active

1.Delayed Synchronization

2.Configuration Issue

avatar
Contributor

ok. Thanks for your reply @vats 

I am getting all my entities updates in real time like create/update/alter of hive tables. so it might be configuration issue? By any chance do yo know where to look for delete hive operation configuration in atlas/hive? 

avatar
Expert Contributor

@bigdatacm  May be  the configuration for the Hive hook in Atlas is not properly set up. Ensure that the Atlas hook is correctly configured in the Hive configuration file (hive-site.xml). Check for any errors or warnings related to the hook configuration in the Atlas and Hive logs.