09-15-2017 01:55 AM
we are developing dozens of different workflows in Oozie. We use 3 environments, DEV, PRE and PRO.
What I'd like to do is to keep same workflow.xml files in all 3 environments and only read properties for db connections, urls, authentications etc from the Cloudera environment. In this way, it would be possible to version control the files and deploy them easily. Is it possible?
Googling, I saw maybe config-default.xml would be a place for default property values, but I cannot find any in our Cloudera 5.10. We use Hue to design the workflows, algthough we can use other way to define WFs.
09-17-2017 11:35 PM
09-18-2017 12:08 AM
thanks for the reply. I think I saw the cmd line example you refer to, is it this? https://oozie.apache.org/docs/4.0.0/DG_Examples.html
The thing is that our client wants to have some graphical interface like Hue, so they could control (including launching) any job in the datalake.
Maybe we could edit externally job.properties in the WF's workspace? Actually I've tried to edit the contents of the file, but Hue ignores the new values - when submitting, a popup opens with all the properties with values unchanged. Maybe I'm doing something wrong?
09-18-2017 04:06 AM
09-18-2017 04:13 AM - edited 09-18-2017 07:09 AM
Actually I edited the job.properties with Hue's file browser. But those original properties has to be stored somewhere else (in Hue's memory?) because they remain unchanged. I even restarted Oozie and Hue and reopened the WF, but the Hue still did not took into account new values of the job.properties.
05-15-2018 11:45 PM
I finally solved this issue by using config-default.xml located in the workspace of every workflow, I put all variables in there.
If I want to update all values, I have a script that updates all directories.