question Falcon Passing parameters to existing Oozie Workflow with Hive Action in Archives of Support Questions (Read Only)

Falcon Passing parameters to existing Oozie Workflow with Hive Action

grajagopal — Wed, 30 Sep 2015 00:04:16 GMT

Got an existing oozie workflow that has Hive Action. When called through Falcon, its not dynamically substituting the job.properties values. the oozie job fails with the Variable name not found. anyone encountered the scenario ?

Re: Falcon Passing parameters to existing Oozie Workflow with Hive Action

grajagopal — Wed, 30 Sep 2015 03:27:30 GMT

Figured it out. We need to add the properties to the process XML. But the issue is it cannot be done via UI . I has to be done via CLI.

Re: Falcon Passing parameters to existing Oozie Workflow with Hive Action

bsaini — Thu, 01 Oct 2015 04:01:29 GMT

Ganesh - You are right that the process xml has to be changed but are you not able to edit the xml directly via UI ?

Re: Falcon Passing parameters to existing Oozie Workflow with Hive Action

sball — Fri, 02 Oct 2015 23:06:37 GMT

If you do this, the UI bindings seem to automatically revert the xml as soon as there is any interaction with the form side (e.g. save)

Re: Falcon Passing parameters to existing Oozie Workflow with Hive Action

grajagopal — Sat, 03 Oct 2015 03:43:21 GMT

No. If you edit the UI, the properties disappear automatically. Only CLI works. Looks like a bug on the UI.

Re: Falcon Passing parameters to existing Oozie Workflow with Hive Action

vranganathan — Thu, 15 Oct 2015 00:17:10 GMT

Thanks - Can you create a bug on Falcon UI for this - which version of the UI are you using

Re: Falcon Passing parameters to existing Oozie Workflow with Hive Action

landon_t_robins — Thu, 10 Dec 2015 02:11:40 GMT

Yeah, you should be able to pass any properties to the workflow.xml from Falcon's process.xml. Like this:

This would go before the <workflow> tag and after the <output> tags. They're used in the workflow.xml as ${workflowName}, ${hiveDB}, ${queueName}, and so on.

<properties>
    <property name="workflowName" value="1234-my-workflow" />
    <property name="rawDataDirectoryHDFS" value="/path/to/hdfs/files/" />
    <property name="hiveDB" value="my_db" />
    <property name="jobTracker" value="hdpcluster003.company.com:8050"/>
    <property name="nameNode" value="hdfs://MYHA:8020"/>
    <property name="queueName" value="dev"/>
</properties>