History of ATLAS lineage

[#1]

Does ATLAS show lineage only from the time it is implemented or from the time an object was created even when ATLAS was not there i.e. if there was a hive table A created on 12/31/2014 and another hive table B created from A on 03/31/2015 and then ATLAS was implemented in the cluster on 07/31/2016, will the lineage of B show that it was created from A?

[#2 · Accepted solution]

@Subhankar Dasgupta

Atlas can track lineage of entities(like hive table) only after it is implemented/plugged in to cluster. Any lineage information before adding atlas to the system cannot be tracked.

There is a provision to import metadata (not lineage) of already existing hive tables by using an import tool, which comes as part of Atlas installation. For more information on this, please refer here.