Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Oozie error

Oozie error

Explorer
Launcher exception: mapreduce.job.map.class is incompatible with map compatability mode.

I'm getting below error

 

Launcher exception: mapreduce.job.map.class is incompatible with map compatability mode.
java.io.IOException: mapreduce.job.map.class is incompatible with map compatability mode.
	at org.apache.hadoop.mapreduce.Job.ensureNotSet(Job.java:1211)
	at org.apache.hadoop.mapreduce.Job.setUseNewAPI(Job.java:1247)
	at org.apache.hadoop.mapreduce.Job.submit(Job.java:1300)
	at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:564)
	at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:559)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1671)
	at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:559)
	at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:550)
	at org.apache.oozie.action.hadoop.MapReduceMain.submitJob(MapReduceMain.java:102)
	at org.apache.oozie.action.hadoop.MapReduceMain.run(MapReduceMain.java:64)
	at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:49)
	at org.apache.oozie.action.hadoop.MapReduceMain.main(MapReduceMain.java:38)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:236)
	at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
	at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runSubtask(LocalContainerLauncher.java:378)
	at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runTask(LocalContainerLauncher.java:296)
	at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.access$200(LocalContainerLauncher.java:181)
	at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler$1.run(LocalContainerLauncher.java:224)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)

 Im trying schedule MR job with MRv2. Can anyone help me in sorting out this?

2 REPLIES 2

Re: Oozie error

Master Guru
Could you share your action XML? Per the error you may be setting a few
properties that are illegal in the context of others (such as using the new
API properties, while passing older API classes, or without toggling new
API on explicitly via 'mapred.mapper.new-api' and 'mapred.reducer.new-api'
toggles per
https://cwiki.apache.org/confluence/display/OOZIE/Map+Reduce+Cookbook).

Re: Oozie error

Explorer

thanks. 

 

<workflow-app name="simpletest" xmlns="uri:oozie:workflow:0.5">
<start to="mapreduce-e6ba"/>
<kill name="Kill">
<message>Action failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message>
</kill>
<action name="mapreduce-e6ba">
<map-reduce>
<job-tracker>${jobTracker}</job-tracker>
<name-node>${nameNode}</name-node>
<prepare>
<delete path="${nameNode}/test/out5"/>
</prepare>
<configuration>
<property>
<name>mapreduce.map.class</name>
<value>testYarn1.WordCount$MyMapper</value>
</property>
<property>
<name>mapreduce.reduce.class</name>
<value>testYarn1.WordCount$MyReducer</value>
</property>
<property>
<name>mapred.input.dir</name>
<value>/test/wordcount.txt</value>
</property>
<property>
<name>mapred.output.dir</name>
<value>/test/out5/</value>
</property>
<property>
<name>mapred.reducer.new-api</name>
<value>true</value>
</property>
<property>
<name>mapred.mapper.new-ap</name>
<value>true</value>
</property>
</configuration>
<archive>/user/hue/oozie/workspaces/sample/WordCount.jar#WordCount.jar</archive>
</map-reduce>
<ok to="End"/>
<error to="Kill"/>
</action>
<end name="End"/>
</workflow-app>

 

Please have a look at my property file.