question Re: I heard like oozie work flow job definitions will be stored in a Data Base, if so I would like to pull all oozie schduling information ? is there a direct API? Intention is to bring those details on to Qlikview Dashboard. in Archives of Support Questions (Read Only)

I heard like oozie work flow job definitions will be stored in a Data Base, if so I would like to pull all oozie schduling information ? is there a direct API? Intention is to bring those details on to Qlikview Dashboard.

t_sankar85 — Thu, 05 Jan 2017 23:01:50 GMT

Re: I heard like oozie work flow job definitions will be stored in a Data Base, if so I would like to pull all oozie schduling information ? is there a direct API? Intention is to bring those details on to Qlikview Dashboard.

KuldeepK — Fri, 06 Jan 2017 01:32:11 GMT

Oozie stores workflow definitions in a backend DB as blobs, it would be complex to fetch it from DB directly. Best way is to use Oozie command line.

Please refer below link for more details about Oozie CLI

https://oozie.apache.org/docs/3.1.3-incubating/DG_CommandLineTool.html

OR if you are interested in Oozie REST API then here is the doc

https://oozie.apache.org/docs/4.0.0/WebServicesAPI.html

Hope this information helps! Please revert if you need any other details about Oozie! 🙂

Re: I heard like oozie work flow job definitions will be stored in a Data Base, if so I would like to pull all oozie schduling information ? is there a direct API? Intention is to bring those details on to Qlikview Dashboard.

t_sankar85 — Fri, 06 Jan 2017 23:58:07 GMT

@Kuldeep Kulkarni - Thanks for your reply. Can you please help me with Oozie CLI to get the list of the jobs whose schdule is between 8AM-5pm EST.

Re: I heard like oozie work flow job definitions will be stored in a Data Base, if so I would like to pull all oozie schduling information ? is there a direct API? Intention is to bring those details on to Qlikview Dashboard.

KuldeepK — Sun, 08 Jan 2017 22:07:28 GMT

@Sankar T

Below is one example of oozie command line to get status of all the SUCCEEDED jobs

Note - You can redirect this output to some file and get the time conversion done --> get the resulted job IDs and put it in Hive/Hbase as per your requirement.

Hope this helps!

[root@prodnode1 ~]# oozie jobs -oozie http://prodnode2:11000/oozie -len 1000000 -filter status=SUCCEEDED
Job ID                                   App Name     Status    User      Group     Started                 Ended
------------------------------------------------------------------------------------------------------------------------------------
0000007-161206152234228-oozie-oozi-W     FALCON_FEED_RETENTION_hdfsreplication1SUCCEEDED    falcon    -         2016-12-14 07:28 GMT    2016-12-14 07:28 GMT
------------------------------------------------------------------------------------------------------------------------------------
0000006-161206152234228-oozie-oozi-W     FALCON_FEED_RETENTION_hdfsreplication1SUCCEEDED    falcon    -         2016-12-13 07:28 GMT    2016-12-13 07:28 GMT
------------------------------------------------------------------------------------------------------------------------------------
0000005-161206152234228-oozie-oozi-W     FALCON_FEED_RETENTION_hdfsreplication1SUCCEEDED    falcon    -         2016-12-12 07:28 GMT    2016-12-12 07:28 GMT
------------------------------------------------------------------------------------------------------------------------------------
0000004-161206152234228-oozie-oozi-W     FALCON_FEED_RETENTION_hdfsreplication1SUCCEEDED    falcon    -         2016-12-11 07:28 GMT    2016-12-11 07:28 GMT
------------------------------------------------------------------------------------------------------------------------------------
0000003-161206152234228-oozie-oozi-W     FALCON_FEED_RETENTION_hdfsreplication1SUCCEEDED    falcon    -         2016-12-10 07:28 GMT    2016-12-10 07:28 GMT
-----------------------------------------------------------------------------------------

...

[Output truncated]
0000003-160926083516131-oozie-oozi-W     FALCON_FEED_RETENTION_hdfsreplicationSUCCEEDED    falcon    -         2016-10-08 05:55 GMT    2016-10-08 07:27 GMT
------------------------------------------------------------------------------------------------------------------------------------
[root@prodnode1 ~]#

Re: I heard like oozie work flow job definitions will be stored in a Data Base, if so I would like to pull all oozie schduling information ? is there a direct API? Intention is to bring those details on to Qlikview Dashboard.

KuldeepK — Sun, 08 Jan 2017 22:08:06 GMT

@Sankar T - Please mark my answer as accepted if this has helped you 🙂

Re: I heard like oozie work flow job definitions will be stored in a Data Base, if so I would like to pull all oozie schduling information ? is there a direct API? Intention is to bring those details on to Qlikview Dashboard.

t_sankar85 — Tue, 10 Jan 2017 00:18:17 GMT

Thank you @Kuldeep Kulkarni

Re: I heard like oozie work flow job definitions will be stored in a Data Base, if so I would like to pull all oozie schduling information ? is there a direct API? Intention is to bring those details on to Qlikview Dashboard.

KuldeepK — Tue, 10 Jan 2017 00:54:39 GMT

@Sankar T - Can you please accept my answer if it helped!