I heard like oozie work flow job definitions will be stored in a Data Base, if so I would like to pull all oozie schduling information ? is there a direct API? Intention is to bring those details on to Qlikview Dashboard.

[#1 · Accepted solution]

@Sankar T

Oozie stores workflow definitions in a backend DB as blobs, it would be complex to fetch it from DB directly. Best way is to use Oozie command line.

Please refer below link for more details about Oozie CLI

https://oozie.apache.org/docs/3.1.3-incubating/DG_CommandLineTool.html

OR if you are interested in Oozie REST API then here is the doc

https://oozie.apache.org/docs/4.0.0/WebServicesAPI.html

Hope this information helps! Please revert if you need any other details about Oozie! 🙂

[#2]

@Kuldeep Kulkarni - Thanks for your reply. Can you please help me with Oozie CLI to get the list of ...

[#3]

@Sankar T

Below is one example of oozie command line to get status of all the SUCCEEDED jobs

Note - You can redirect this output to some file and get the time conversion done --> get the resulted job IDs and put it in Hive/Hbase as per your requirement.

Hope this helps!

[root@prodnode1 ~]# oozie jobs -oozie http://prodnode2:11000/oozie -len 1000000 -filter status=SUCCEEDED
Job ID                                   App Name     Status    User      Group     Started                 Ended
------------------------------------------------------------------------------------------------------------------------------------
0000007-161206152234228-oozie-oozi-W     FALCON_FEED_RETENTION_hdfsreplication1SUCCEEDED    falcon    -         2016-12-14 07:28 GMT    2016-12-14 07:28 GMT
------------------------------------------------------------------------------------------------------------------------------------
0000006-161206152234228-oozie-oozi-W     FALCON_FEED_RETENTION_hdfsreplication1SUCCEEDED    falcon    -         2016-12-13 07:28 GMT    2016-12-13 07:28 GMT
------------------------------------------------------------------------------------------------------------------------------------
0000005-161206152234228-oozie-oozi-W     FALCON_FEED_RETENTION_hdfsreplication1SUCCEEDED    falcon    -         2016-12-12 07:28 GMT    2016-12-12 07:28 GMT
------------------------------------------------------------------------------------------------------------------------------------
0000004-161206152234228-oozie-oozi-W     FALCON_FEED_RETENTION_hdfsreplication1SUCCEEDED    falcon    -         2016-12-11 07:28 GMT    2016-12-11 07:28 GMT
------------------------------------------------------------------------------------------------------------------------------------
0000003-161206152234228-oozie-oozi-W     FALCON_FEED_RETENTION_hdfsreplication1SUCCEEDED    falcon    -         2016-12-10 07:28 GMT    2016-12-10 07:28 GMT
-----------------------------------------------------------------------------------------

...

[Output truncated]
0000003-160926083516131-oozie-oozi-W     FALCON_FEED_RETENTION_hdfsreplicationSUCCEEDED    falcon    -         2016-10-08 05:55 GMT    2016-10-08 07:27 GMT
------------------------------------------------------------------------------------------------------------------------------------
[root@prodnode1 ~]#

[#4]

Thank you @Kuldeep Kulkarni

[#5]

@Sankar T - Can you please accept my answer if it helped!

[#6]

@Sankar T - Please mark my answer as accepted if this has helped you 🙂