- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
How to capture full HQL statements running real time in Hive
- Labels:
-
Apache Atlas
-
Apache Hive
-
Apache YARN
Created ‎10-12-2017 05:24 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi,
I am trying to build a script to capture lineage (Atlas) when Data moves out of Hive. In order to capture the HQL statements executed in Hive( MR / Tez) by other applications, I am looking for some API endpoint to capture real time events occurring in hive.
Thank you,
Subash
Created ‎10-13-2017 04:28 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@subash sharma Have taken a look at the Hive Hook code? This should give you a good idea of the approach used. I don't know if that will be sufficient for all your needs, but it should give you a good idea on how to approach the problem.
Hope this helps.
Created ‎10-13-2017 04:28 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@subash sharma Have taken a look at the Hive Hook code? This should give you a good idea of the approach used. I don't know if that will be sufficient for all your needs, but it should give you a good idea on how to approach the problem.
Hope this helps.
Created ‎10-14-2017 02:14 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Thank you @Ashutosh Mestry.
