Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: The Cloudera Community will undergo maintenance on Saturday, August 17 at 12:00am PDT. See more info here.

Oozie error

Oozie error

Explorer
Launcher exception: mapreduce.job.map.class is incompatible with map compatability mode.

I'm getting below error

 

Launcher exception: mapreduce.job.map.class is incompatible with map compatability mode.
java.io.IOException: mapreduce.job.map.class is incompatible with map compatability mode.
	at org.apache.hadoop.mapreduce.Job.ensureNotSet(Job.java:1211)
	at org.apache.hadoop.mapreduce.Job.setUseNewAPI(Job.java:1247)
	at org.apache.hadoop.mapreduce.Job.submit(Job.java:1300)
	at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:564)
	at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:559)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1671)
	at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:559)
	at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:550)
	at org.apache.oozie.action.hadoop.MapReduceMain.submitJob(MapReduceMain.java:102)
	at org.apache.oozie.action.hadoop.MapReduceMain.run(MapReduceMain.java:64)
	at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:49)
	at org.apache.oozie.action.hadoop.MapReduceMain.main(MapReduceMain.java:38)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:236)
	at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
	at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runSubtask(LocalContainerLauncher.java:378)
	at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runTask(LocalContainerLauncher.java:296)
	at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.access$200(LocalContainerLauncher.java:181)
	at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler$1.run(LocalContainerLauncher.java:224)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)

 Im trying schedule MR job with MRv2. Can anyone help me in sorting out this?

2 REPLIES 2

Re: Oozie error

Cloudera Employee
Could you share your action XML? Per the error you may be setting a few
properties that are illegal in the context of others (such as using the new
API properties, while passing older API classes, or without toggling new
API on explicitly via 'mapred.mapper.new-api' and 'mapred.reducer.new-api'
toggles per
https://cwiki.apache.org/confluence/display/OOZIE/Map+Reduce+Cookbook).
Highlighted

Re: Oozie error

Explorer

thanks. 

 

<workflow-app name="simpletest" xmlns="uri:oozie:workflow:0.5">
<start to="mapreduce-e6ba"/>
<kill name="Kill">
<message>Action failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message>
</kill>
<action name="mapreduce-e6ba">
<map-reduce>
<job-tracker>${jobTracker}</job-tracker>
<name-node>${nameNode}</name-node>
<prepare>
<delete path="${nameNode}/test/out5"/>
</prepare>
<configuration>
<property>
<name>mapreduce.map.class</name>
<value>testYarn1.WordCount$MyMapper</value>
</property>
<property>
<name>mapreduce.reduce.class</name>
<value>testYarn1.WordCount$MyReducer</value>
</property>
<property>
<name>mapred.input.dir</name>
<value>/test/wordcount.txt</value>
</property>
<property>
<name>mapred.output.dir</name>
<value>/test/out5/</value>
</property>
<property>
<name>mapred.reducer.new-api</name>
<value>true</value>
</property>
<property>
<name>mapred.mapper.new-ap</name>
<value>true</value>
</property>
</configuration>
<archive>/user/hue/oozie/workspaces/sample/WordCount.jar#WordCount.jar</archive>
</map-reduce>
<ok to="End"/>
<error to="Kill"/>
</action>
<end name="End"/>
</workflow-app>

 

Please have a look at my property file.