Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Does Atlas track Sqoop Exports?

Solved Go to solution

Does Atlas track Sqoop Exports?

New Contributor

Was able to follow the sandbox tutorial and got sqoop import to be tracked in atlas. I then made a new hive table by joining two tables I sqooped in and then tried to sqoop export the new hive table back to MySQL. This worked fine in terms of transferring the new hive table into a new MySQL table.... but Atlas did not track the export!?! (I can see the import lineage and the hiveQL lineage...but no export lineage.)

So, does Altas support sqoop exports? or is their something else I have to configure. (using Atlas 0.7 and Hortonworks Sandbox 2.5)

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: Does Atlas track Sqoop Exports?

@George Cancro

Currently, atlas does not track the sqoop export, it supports only sqoop import. Please refer to the below documentation.

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_command-line-installation/content/config...

5 REPLIES 5

Re: Does Atlas track Sqoop Exports?

Re: Does Atlas track Sqoop Exports?

New Contributor

Namit, looked at article you submitted. Are you saying that sqoop exports are not automatic like sqoop imports and therefore I should use the API or kafka topic to "work-around" this?

Re: Does Atlas track Sqoop Exports?

Yes, as Ayub mentioned below as of now Sqoop exports are not automatic.

Re: Does Atlas track Sqoop Exports?

New Contributor

Thanks for quick reply, got it.

Highlighted

Re: Does Atlas track Sqoop Exports?

@George Cancro

Currently, atlas does not track the sqoop export, it supports only sqoop import. Please refer to the below documentation.

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_command-line-installation/content/config...