@Amit Jain Atlas has ton of exciting features in the roadmap and definitely plans for two way metadata exchange with other metadata management tools. As of right now (& this may change), the plan is to exchange the lineage information with other tools too, to be able to provide an end-to-end lineage of data from source system, all the way to the final destination. With that said, it seems very unlikely that in a large enterprise setting you would replace all other metadata tools with one magical tool. Typically speaking the governance tools are expected to tap into the data processes automatically and non-intrusively to gather lineage information and this require native hooks into those data processes. Atlas has and will continue to expand, when it comes to native hooks for processing that takes place in a Hadoop cluster but I doubt there is any interest in tapping natively into the processes going on into other systems like data warehousing system, transactional, operational and reporting systems. For those pieces (metadata and lineage) from external systems, Atlas will continue to rely on and integrate with other metadata tools. Just like Hadoop, other components in overall data architecture have their roles and place so they will continue to exist and so will the governance tools for those components. Vendors need to and (most likely) will work together to provide a seamless experience to the customers. If you havent watched this presentation from Andrew Ahn, PM for Governance Tools at HWX, I would highly recommend it to understand better where Atlas is going - https://www.youtube.com/watch?time_continue=3&v=LZ... Hope this helps. Let me know if you have any follow up question.
... View more
