question How to capture full HQL statements running real time in Hive in Archives of Support Questions (Read Only)

How to capture full HQL statements running real time in Hive

subash_sharma — Fri, 13 Oct 2017 00:24:58 GMT

Hi,

I am trying to build a script to capture lineage (Atlas) when Data moves out of Hive. In order to capture the HQL statements executed in Hive( MR / Tez) by other applications, I am looking for some API endpoint to capture real time events occurring in hive.

Thank you,

Subash

Re: How to capture full HQL statements running real time in Hive

amestry — Fri, 13 Oct 2017 23:28:12 GMT

@subash sharma Have taken a look at the Hive Hook code? This should give you a good idea of the approach used. I don't know if that will be sufficient for all your needs, but it should give you a good idea on how to approach the problem.

Hope this helps.

Re: How to capture full HQL statements running real time in Hive

subash_sharma — Sat, 14 Oct 2017 21:14:15 GMT

Thank you @Ashutosh Mestry.