Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

I heard like oozie work flow job definitions will be stored in a Data Base, if so I would like to pull all oozie schduling information ? is there a direct API? Intention is to bring those details on to Qlikview Dashboard.

Solved Go to solution
Highlighted

I heard like oozie work flow job definitions will be stored in a Data Base, if so I would like to pull all oozie schduling information ? is there a direct API? Intention is to bring those details on to Qlikview Dashboard.

Contributor
 
1 ACCEPTED SOLUTION

Accepted Solutions

Re: I heard like oozie work flow job definitions will be stored in a Data Base, if so I would like to pull all oozie schduling information ? is there a direct API? Intention is to bring those details on to Qlikview Dashboard.

Super Guru
@Sankar T

Oozie stores workflow definitions in a backend DB as blobs, it would be complex to fetch it from DB directly. Best way is to use Oozie command line.

Please refer below link for more details about Oozie CLI

https://oozie.apache.org/docs/3.1.3-incubating/DG_CommandLineTool.html

OR if you are interested in Oozie REST API then here is the doc

https://oozie.apache.org/docs/4.0.0/WebServicesAPI.html

Hope this information helps! Please revert if you need any other details about Oozie! :)

6 REPLIES 6

Re: I heard like oozie work flow job definitions will be stored in a Data Base, if so I would like to pull all oozie schduling information ? is there a direct API? Intention is to bring those details on to Qlikview Dashboard.

Super Guru
@Sankar T

Oozie stores workflow definitions in a backend DB as blobs, it would be complex to fetch it from DB directly. Best way is to use Oozie command line.

Please refer below link for more details about Oozie CLI

https://oozie.apache.org/docs/3.1.3-incubating/DG_CommandLineTool.html

OR if you are interested in Oozie REST API then here is the doc

https://oozie.apache.org/docs/4.0.0/WebServicesAPI.html

Hope this information helps! Please revert if you need any other details about Oozie! :)

Re: I heard like oozie work flow job definitions will be stored in a Data Base, if so I would like to pull all oozie schduling information ? is there a direct API? Intention is to bring those details on to Qlikview Dashboard.

Contributor

Re: I heard like oozie work flow job definitions will be stored in a Data Base, if so I would like to pull all oozie schduling information ? is there a direct API? Intention is to bring those details on to Qlikview Dashboard.

Super Guru

@Sankar T

Below is one example of oozie command line to get status of all the SUCCEEDED jobs

Note - You can redirect this output to some file and get the time conversion done --> get the resulted job IDs and put it in Hive/Hbase as per your requirement.

Hope this helps!

[root@prodnode1 ~]# oozie jobs -oozie http://prodnode2:11000/oozie -len 1000000 -filter status=SUCCEEDED
Job ID                                   App Name     Status    User      Group     Started                 Ended
------------------------------------------------------------------------------------------------------------------------------------
0000007-161206152234228-oozie-oozi-W     FALCON_FEED_RETENTION_hdfsreplication1SUCCEEDED    falcon    -         2016-12-14 07:28 GMT    2016-12-14 07:28 GMT
------------------------------------------------------------------------------------------------------------------------------------
0000006-161206152234228-oozie-oozi-W     FALCON_FEED_RETENTION_hdfsreplication1SUCCEEDED    falcon    -         2016-12-13 07:28 GMT    2016-12-13 07:28 GMT
------------------------------------------------------------------------------------------------------------------------------------
0000005-161206152234228-oozie-oozi-W     FALCON_FEED_RETENTION_hdfsreplication1SUCCEEDED    falcon    -         2016-12-12 07:28 GMT    2016-12-12 07:28 GMT
------------------------------------------------------------------------------------------------------------------------------------
0000004-161206152234228-oozie-oozi-W     FALCON_FEED_RETENTION_hdfsreplication1SUCCEEDED    falcon    -         2016-12-11 07:28 GMT    2016-12-11 07:28 GMT
------------------------------------------------------------------------------------------------------------------------------------
0000003-161206152234228-oozie-oozi-W     FALCON_FEED_RETENTION_hdfsreplication1SUCCEEDED    falcon    -         2016-12-10 07:28 GMT    2016-12-10 07:28 GMT
-----------------------------------------------------------------------------------------

...

[Output truncated]
0000003-160926083516131-oozie-oozi-W     FALCON_FEED_RETENTION_hdfsreplicationSUCCEEDED    falcon    -         2016-10-08 05:55 GMT    2016-10-08 07:27 GMT
------------------------------------------------------------------------------------------------------------------------------------
[root@prodnode1 ~]#

Re: I heard like oozie work flow job definitions will be stored in a Data Base, if so I would like to pull all oozie schduling information ? is there a direct API? Intention is to bring those details on to Qlikview Dashboard.

Contributor

Thank you @Kuldeep Kulkarni

Re: I heard like oozie work flow job definitions will be stored in a Data Base, if so I would like to pull all oozie schduling information ? is there a direct API? Intention is to bring those details on to Qlikview Dashboard.

Super Guru

@Sankar T - Can you please accept my answer if it helped!

Re: I heard like oozie work flow job definitions will be stored in a Data Base, if so I would like to pull all oozie schduling information ? is there a direct API? Intention is to bring those details on to Qlikview Dashboard.

Super Guru

@Sankar T - Please mark my answer as accepted if this has helped you :)

Don't have an account?
Coming from Hortonworks? Activate your account here