07-17-2014 05:53 AM - edited 07-17-2014 07:05 AM
I have a cluster managed using CM5.0 and has both mapreduce and Yarn installed and running. I want to make oozie to submit jobs to yarn rather than mapreduce. So in Oozie configuration through Cloudera Manager, changed the mapreduce properties to yarn so that oozie can submit all jobs to Resorce manager. But when I submit the workflow defined in oozie (through hue) it is still submiting the jobs to jobTracker and showing the below error,
HadoopAccessorException: E0900: Jobtracker [hostname:8021] not allowed, not in Oozie
How I can make Oozie to automatically pick yarn configurations (hostname:8032) so that it is submitted to Resource manager? Someone's help will be greatly appreciated!! Thanks in advance.
07-19-2014 11:16 PM
07-21-2014 11:26 AM
I checked it out earlier for safety valve, but it is empty. This is a newly installed cluster, defaulty the mapred property in oozie is set to mapreduce and I changed it to Yarn. In mapreduce mode jobs are executing but in Yarn mode it is throwing this error.
07-21-2014 12:13 PM
08-14-2014 11:53 AM
IIRC, for Hue to switch between MR1 and MR2, you have to ensure that a few of the other services are also switched. For example, in CM's Hive configuration page, I believe it has a similar config property to Oozie's that lets you switch between MR1 and MR2. Make sure they are both set to MR2. You should also check if any other services have a similar property. Then restart Hue, of course.
10-15-2015 08:21 AM
Thanks for valuable information . I have fixed the above issue by changing the MapReduce Service property value in hive configuration file to Yarn.