Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here. Want to know more about what has changed? Check out the Community News blog.

Could not find Yarn tags property (mapreduce.job.tags) when sunning oozie workflows.

Could not find Yarn tags property (mapreduce.job.tags) when sunning oozie workflows.

New Contributor

 

We have CDH5.5 installed on 5 clusters. We use oozie to submit workflows that do M/R.

 

We have been unable to run workflows. Our workflows are failing with the following error:

 

 

2015-11-24 09:01:48,651  WARN JavaActionExecutor:523 - SERVER[wfc-t00-had-001.uni.zillow.local] USER[etl] GROUP[-] TOKEN[] APP[assessor-transform-wf] JOB[0000181-151123173413039-oozie-oozi-W] ACTION[000018
1-151123173413039-oozie-oozi-W@transformation] Launcher ERROR, reason: Main class [org.apache.oozie.action.hadoop.JavaMain], main() threw exception, Could not find Yarn tags property (mapreduce.job.tags)
2015-11-24 09:01:48,651  WARN JavaActionExecutor:523 - SERVER[wfc-t00-had-001.uni.zillow.local] USER[etl] GROUP[-] TOKEN[] APP[assessor-transform-wf] JOB[0000181-151123173413039-oozie-oozi-W] ACTION[000018
1-151123173413039-oozie-oozi-W@transformation] Launcher exception: Could not find Yarn tags property (mapreduce.job.tags)
java.lang.RuntimeException: Could not find Yarn tags property (mapreduce.job.tags)
        at org.apache.oozie.action.hadoop.LauncherMainHadoopUtils.getChildYarnJobs(LauncherMainHadoopUtils.java:53)
        at org.apache.oozie.action.hadoop.LauncherMainHadoopUtils.killChildYarnJobs(LauncherMainHadoopUtils.java:88)
        at org.apache.oozie.action.hadoop.JavaMain.run(JavaMain.java:46)
        at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:46)
        at org.apache.oozie.action.hadoop.JavaMain.main(JavaMain.java:38)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:228)
        at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
        at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
        at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runSubtask(LocalContainerLauncher.java:378)
        at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runTask(LocalContainerLauncher.java:296)
        at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.access$200(LocalContainerLauncher.java:181)
        at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler$1.run(LocalContainerLauncher.java:224)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
        at java.util.concurrent.FutureTask.run(FutureTask.java:262)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

 

 No upgrade or any other action was done on teh server. The only thing that happened was that oozie daemon stopped for some reason over the weekend, causing oozie client to fail with "connection refused" error. So we restarted the oozie daemon, and since then no workflows run successfully.

 

Any help appreciated.

 

 

1 REPLY 1
Highlighted

Re: Could not find Yarn tags property (mapreduce.job.tags) when sunning oozie workflows.

Master Guru
Are you bundling any oozie libraries into your application jars or placing them into your application lib/ directory?

The message you see is not what the current 5.5.x code is [1], so its coming from an older version. Since this is a fresh installation, the only suspect is either a bad sharelib directory on HDFS that needs redeploying, or that some WFs of yours are including an older oozie library that's taking precedence over the server's variant.

[1] - https://github.com/cloudera/oozie/blob/cdh5.5.1-release/hadooplibs/hadoop-utils-cdh5mr2/src/main/jav...