Reply
New Contributor
Posts: 1
Registered: ‎11-24-2015

Could not find Yarn tags property (mapreduce.job.tags) when sunning oozie workflows.

 

We have CDH5.5 installed on 5 clusters. We use oozie to submit workflows that do M/R.

 

We have been unable to run workflows. Our workflows are failing with the following error:

 

 

2015-11-24 09:01:48,651  WARN JavaActionExecutor:523 - SERVER[wfc-t00-had-001.uni.zillow.local] USER[etl] GROUP[-] TOKEN[] APP[assessor-transform-wf] JOB[0000181-151123173413039-oozie-oozi-W] ACTION[000018
1-151123173413039-oozie-oozi-W@transformation] Launcher ERROR, reason: Main class [org.apache.oozie.action.hadoop.JavaMain], main() threw exception, Could not find Yarn tags property (mapreduce.job.tags)
2015-11-24 09:01:48,651  WARN JavaActionExecutor:523 - SERVER[wfc-t00-had-001.uni.zillow.local] USER[etl] GROUP[-] TOKEN[] APP[assessor-transform-wf] JOB[0000181-151123173413039-oozie-oozi-W] ACTION[000018
1-151123173413039-oozie-oozi-W@transformation] Launcher exception: Could not find Yarn tags property (mapreduce.job.tags)
java.lang.RuntimeException: Could not find Yarn tags property (mapreduce.job.tags)
        at org.apache.oozie.action.hadoop.LauncherMainHadoopUtils.getChildYarnJobs(LauncherMainHadoopUtils.java:53)
        at org.apache.oozie.action.hadoop.LauncherMainHadoopUtils.killChildYarnJobs(LauncherMainHadoopUtils.java:88)
        at org.apache.oozie.action.hadoop.JavaMain.run(JavaMain.java:46)
        at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:46)
        at org.apache.oozie.action.hadoop.JavaMain.main(JavaMain.java:38)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:228)
        at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
        at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
        at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runSubtask(LocalContainerLauncher.java:378)
        at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runTask(LocalContainerLauncher.java:296)
        at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.access$200(LocalContainerLauncher.java:181)
        at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler$1.run(LocalContainerLauncher.java:224)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
        at java.util.concurrent.FutureTask.run(FutureTask.java:262)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

 

 No upgrade or any other action was done on teh server. The only thing that happened was that oozie daemon stopped for some reason over the weekend, causing oozie client to fail with "connection refused" error. So we restarted the oozie daemon, and since then no workflows run successfully.

 

Any help appreciated.

 

 

Posts: 1,892
Kudos: 432
Solutions: 302
Registered: ‎07-31-2013

Re: Could not find Yarn tags property (mapreduce.job.tags) when sunning oozie workflows.

Are you bundling any oozie libraries into your application jars or placing them into your application lib/ directory?

The message you see is not what the current 5.5.x code is [1], so its coming from an older version. Since this is a fresh installation, the only suspect is either a bad sharelib directory on HDFS that needs redeploying, or that some WFs of yours are including an older oozie library that's taking precedence over the server's variant.

[1] - https://github.com/cloudera/oozie/blob/cdh5.5.1-release/hadooplibs/hadoop-utils-cdh5mr2/src/main/jav...
Announcements