- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Does Atlas track Sqoop Exports?
- Labels:
-
Apache Atlas
-
Apache Sqoop
Created 03-09-2017 08:01 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Was able to follow the sandbox tutorial and got sqoop import to be tracked in atlas. I then made a new hive table by joining two tables I sqooped in and then tried to sqoop export the new hive table back to MySQL. This worked fine in terms of transferring the new hive table into a new MySQL table.... but Atlas did not track the export!?! (I can see the import lineage and the hiveQL lineage...but no export lineage.)
So, does Altas support sqoop exports? or is their something else I have to configure. (using Atlas 0.7 and Hortonworks Sandbox 2.5)
Created 03-14-2017 03:36 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Currently, atlas does not track the sqoop export, it supports only sqoop import. Please refer to the below documentation.
Created 03-10-2017 01:45 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Created 03-14-2017 02:34 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Namit, looked at article you submitted. Are you saying that sqoop exports are not automatic like sqoop imports and therefore I should use the API or kafka topic to "work-around" this?
Created 03-14-2017 04:17 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Yes, as Ayub mentioned below as of now Sqoop exports are not automatic.
Created 03-14-2017 04:33 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Thanks for quick reply, got it.
Created 03-14-2017 03:36 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Currently, atlas does not track the sqoop export, it supports only sqoop import. Please refer to the below documentation.
