Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Running Oozie

Running Oozie

Rising Star

Hi,

 

I am trying to run the example of oozie that comes with Cloudera Sandbox (cloudera-quickstart-vm-4.4.0-1-vmware).

 

I extracted oozie-examples.tar.gz that was in /usr/share/doc/oozie-3.3.2+92

 

As shown in Apache Oozie link, I tried to run the Oozie but no success

https://oozie.apache.org/docs/4.0.1/DG_Examples.html

 

[cloudera@localhost oozie-3.3.2+92]$ oozie job -oozie http://localhost:11000/oozie -config examples/apps/map-reduce/job.properties -run

 

Error: E0901 : E0901: Namenode [localhost:8020] not allowed, not in Oozies whitelist

 

oozie-site.xml looks like:

 

less /etc/oozie/conf.dist/oozie-site.xml

 

<property>
<name>oozie.service.HadoopAccessorService.jobTracker.whitelist</name>
<value> </value>
<description>
Whitelisted job tracker for Oozie service.
</description>
</property>

<property>
<name>oozie.service.HadoopAccessorService.nameNode.whitelist</name>
<value> </value>
<description>
Whitelisted job tracker for Oozie service.
</description>
</property>

 

job.properties looks like:

 

nameNode=hdfs://localhost:8020
jobTracker=localhost:8021
queueName=default
examplesRoot=examples

oozie.wf.application.path=${nameNode}/user/${user.name}/${examplesRoot}/apps/map-reduce
outputDir=map-reduce

 

I am very frustated of unsuccessful attempts that I am thinking of giving up. Your help will be highly appreciated. 

 

Thanks,
Rio

 

PS 

I am new to Oozie 

1 REPLY 1

Re: Running Oozie

Cloudera Employee

Hello Rio --

 

Apologies for your frustration -- it appears that the default settings for Oozie on the QuickStart VM have two properties

that need to be changed:  The whitelist for the NameNode and the whitelist for the JobTracker.  I recommend to just "remove" these properties, and I'll walk you through doing this.

 

Since this is the QuickStart VM, Hadoop is managed best by using Cloudera Manager. 

 

1) Open Firefox in your Virtual Machine and go to:  http://localhost:7180
    The username and password are "admin" and "admin" without quotes.

 

2) Click on the "Services" link, and click on the "oozie1" service

 

3) Click on "configuration", and click "View and Edit".  On the left hand side, there's an "Oozie Server (Default)" Category (See the attached screenshot below)

 

OozieConfig.png

 

4) (Almost there!) Paste the XML below into the "Oozie Server Configuration Safety Valve for oozie-site.xml"

 

<property>
    <name>oozie.service.HadoopAccessorService.nameNode.whitelist</name>
    <value/>
    <description/>
</property>

<property>
        <name>oozie.service.HadoopAccessorService.jobTracker.whitelist</name>
        <value/>
        <description>
            Whitelisted job tracker for Oozie service.
        </description>
    </property>

 

5) Click "Save Changes", then restart the Oozie service from Cloudera Manager.

 

Now, you should be able to go to the command line and run these commands to submit the sample MapReduce Oozie workflow:

 

$ tar -xzvf oozie-example.tgz  # You've already done this, I think

$ hadoop fs -put examples  # This will put the examples jar and friends into HDFS, with example data

$ oozie job -oozie http://localhost:11000/oozie -config examples/apps/map-reduce/job.properties -run

 

Now you can go into Hue at http://localhost:8888/home and click the "Oozie Editor" -- it's a yellow-circle at the top of Hue and see your workflow running.  Of course, you can use the oozie command to get the status as well.

 

I hope this helps, and I intend to test this with the new Quickstart VM for Cloudera 5, to make this effort unnecessary in future versions of the Quickstart VM.

 

Thanks

--Nate