question Re: Force coordinator to pick up updated workflow definition in Archives of Support Questions (Read Only)

Force coordinator to pick up updated workflow definition

MartinEK — Fri, 16 Sep 2022 09:25:31 GMT

Hello,

Is there any way to force a submitted coordinator to pick up updated definition of the workflow?

E.g. in a simple workflow with one action which runs a Hive script, if that script is updated, currently I see the only option is to kill the submitted coordinator and submit it again. Is there any other way in which it could pick up the modified Hive script?

Thanks,

Martin

Re: Force coordinator to pick up updated workflow definition

Harsh J — Mon, 30 Mar 2015 12:22:26 GMT

If you update the workflow.xml at the same location the coordinator is
configured to look for it, it will automatically pick up the newer XML
contents for the future workflow instances.

Re: Force coordinator to pick up updated workflow definition

MartinEK — Mon, 30 Mar 2015 12:46:16 GMT

Hi thanks for the quick reply, I thought I saw different behaviour but it might have been my mistake. Will double check and raise support call if the expected behaviour is as you decribed and I am seeing something different.

Thanks,

Martin

Re: Force coordinator to pick up updated workflow definition

MartinEK — Mon, 30 Mar 2015 12:49:32 GMT

Also just to confirm - given the behaviour described in the following thread to which I just replied, workflow.xml is not updated in the workspace directory immediately when saved in Hue (as per the response it is only updated when first submitted). So whilst I have made changes to workflow definition (added extra step), the workflow.xml file is not updated in the folder. Is it then expected that the submitted coordinator will pick up those changes?

Thanks,

Martin

Re: Force coordinator to pick up updated workflow definition

MartinEK — Mon, 30 Mar 2015 15:54:54 GMT

To follow up: the behaviour I observed is that after the scheduled execution through coordinator, the new actions were shown in the Workflows dashboard Graph tab, however they were skipped during the execution run. See attached screenshot. The new actions introduced were the fork "RunThingsInParallel" and the two actions (both Hive) in the right hand side branch. They are all greyed out rather than the green OK status during and after the execution, which was successful. I will be raising a support call for this.

Re: Force coordinator to pick up updated workflow definition

MartinEK — Sun, 26 Apr 2015 03:52:28 GMT

For the benefit of community members: Cloudera support team confirmed that an updated workflow definition is NOT picked up by an existing submitted coordinator schedule. The workarounds are either to kill the coordinator schedule and resubmit, or to submit the workflow manually which will force the workflow.xml to be updated.

Martin

Re: Force coordinator to pick up updated workflow definition

Shobana — Mon, 27 Apr 2015 18:13:22 GMT

This is JIRA HUE-2551 The two options currently available are - kill the coordinator and create a new one - run the workflow manually after the change.