question Re: Could not submit Oozie workflow with distcp-action in Archives of Support Questions (Read Only)

Could not submit Oozie workflow with distcp-action

venkata_gangava — Sat, 19 Dec 2015 00:47:14 GMT

Hi,

I am trying to submit Oozie workflow with distcp-action but getting below error when I validate the workflow

oozie validate pdr-distcp-wf.xml Error: Invalid app definition, org.xml.sax.SAXParseException; lineNumber: 9; columnNumber: 20; cvc-complex-type.2.4.a: Invalid content was found starting with element 'configuration'. One of '{"uri:oozie:distcp-action:0.2":arg}' is expected.

Please find the workflow that I am using below....

<workflow-app xmlns="uri:oozie:workflow:0.2" name="pdr-distcp-wf">
 <start to="distcp-node"/>
  <action name="distcp-node">
   <distcp xmlns="uri:oozie:distcp-action:0.2">
            <job-tracker>${jobTracker}</job-tracker>
            <name-node>${nameNode1}</name-node>
            <arg>${SourceDir}</arg>
            <arg>${TargetDir}</arg>
    <configuration>
     <property>
       <name>oozie.launcher.mapreduce.job.hdfs-servers</name>
       <value>${nameNode1},${nameNode2}</value>
     </property>
   </configuration>
  </distcp>
   <ok to="end"/>
   <error to="kill"/>
 </action>
  <kill name="kill">
      <message>Action failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message>
  </kill>
  <end name="end"/>
</workflow-app>

Please help me out

Re: Could not submit Oozie workflow with distcp-action

aervits — Thu, 24 Dec 2015 09:58:22 GMT

you forgot to close the discp action with </distcp>

  <distcp xmlns="uri:oozie:distcp-action:0.2">
            <job-tracker>${jobTracker}</job-tracker>
            <name-node>${nameNode1}</name-node>
            <arg>${nameNode1}/path/to/input.txt</arg>
            <arg>${nameNode2}/path/to/output.txt</arg>
  </distcp>

Re: Could not submit Oozie workflow with distcp-action

venkata_gangava — Fri, 25 Dec 2015 02:14:28 GMT

I closed it.

You can see it below to </configuration>

Re: Could not submit Oozie workflow with distcp-action

aervits — Fri, 25 Dec 2015 02:19:56 GMT

@Venkata Sridhar Gangavarapu I did not say close configuration block, you did not close distcp block

<distcpxmlns="uri:oozie:distcp-action:0.2">

</distcp>

Re: Could not submit Oozie workflow with distcp-action

venkata_gangava — Tue, 29 Dec 2015 23:54:06 GMT

Okay...Below is my workflow where I have the distcp block closed as well

<job-tracker>${jobTracker}</job-tracker>

<name-node>${nameNode1}</name-node>

<arg>${SourceDir}</arg>

<arg>${TargetDir}</arg>

<name>oozie.launcher.mapreduce.job.hdfs-servers</name>

<value>${nameNode1},${nameNode2}</value>

</property>

</configuration>

</distcp>

I still get the same error

Error: Invalid app definition, org.xml.sax.SAXParseException; lineNumber: 9; columnNumber: 19; cvc-complex-type.2.4.a: Invalid content was found starting with element 'configuration'. One of '{"uri:oozie:distcp-action:0.2":arg}' is expected.

Re: Could not submit Oozie workflow with distcp-action

aervits — Wed, 30 Dec 2015 00:21:49 GMT

try to replace your workflow with this and then plugin your values

https://github.com/apache/oozie/blob/master/examples/src/main/apps/distcp/workflow.xml

Re: Could not submit Oozie workflow with distcp-action

venkata_gangava — Wed, 30 Dec 2015 03:10:37 GMT

I changed the workflow as you suggested

<workflow-app xmlns="uri:oozie:workflow:0.3" name="pdr-distcp-wf"> <start to="distcp-node"/> <action name="distcp-node"> <distcp xmlns="uri:oozie:distcp-action:0.1"> <job-tracker>${jobTracker}</job-tracker> <name-node>${nameNode1}</name-node> <arg>${SourceDir}</arg> <arg>${TargetDir}</arg> <configuration> <property> <name>oozie.launcher.mapreduce.job.hdfs-servers</name> <value>${nameNode1},${nameNode2}</value> </property> </configuration> <arg>${SourceDir}</arg> <arg>${TargetDir}</arg> </distcp> <ok to="end"/> <error to="kill"/> </action> <kill name="kill"> <message>Action failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message> </kill> <end name="end"/> </workflow-app>

But still the same error

Re: Could not submit Oozie workflow with distcp-action

venkata_gangava — Tue, 05 Jan 2016 23:36:19 GMT

I did as you said. Below is the changed workflow.

I still see the below error

Please advice

Thanks,

Venkat

Re: Could not submit Oozie workflow with distcp-action

emaxwell — Fri, 15 Jan 2016 22:08:04 GMT

@Venkata Sridhar Gangavarapu

In the example from the oozie github, all of the <arg> parameters are after the <configuration> section. In your latest example, you have <arg> statements on both sides of the <configuration> block. Try moving all of your <arg>s to after the <configuration> block. It seems to be expecting the <configuration> block before any <arg> statements.

Re: Could not submit Oozie workflow with distcp-action

venkata_gangava — Sat, 16 Jan 2016 00:31:05 GMT

Hey Emaxwell,

You are correct. The args should be after the configuration block is closed. The workflow is valid now

Artem Ervits: Thank you so much for your help on this.

The issue is resolved..!!

Re: Could not submit Oozie workflow with distcp-action

aervits — Sat, 16 Jan 2016 00:32:24 GMT

@Venkata Sridhar Gangavarapu you're welcome, please choose the answer that was most relevant and mark as accepted.

Re: Could not submit Oozie workflow with distcp-action

viswa_come — Fri, 29 Jan 2016 15:26:14 GMT

Hi Venkat,

The problem is here you declared args parameter before the configuration you should declare the args after the configuration it won't give you an error. I tested it it's working fine.

<workflow-app xmlns="uri:oozie:workflow:0.2" name="pdr-distcp-wf">

<job-tracker>${jobTracker}</job-tracker>

<name-node>${nameNode1}</name-node>

<name>oozie.launcher.mapreduce.job.hdfs-servers</name>

<value>${nameNode1},${nameNode2}</value>

</property>

</configuration>

<arg>${SourceDir}</arg>

<arg>${TargetDir}</arg>

</distcp>

</action>

<message>Action failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message>

</kill>

</workflow-app>