Reply
Highlighted
rio
Explorer
Posts: 48
Registered: ‎04-18-2014

Running Oozie

Hi,

 

I am trying to run the example of oozie that comes with Cloudera Sandbox (cloudera-quickstart-vm-4.4.0-1-vmware).

 

I extracted oozie-examples.tar.gz that was in /usr/share/doc/oozie-3.3.2+92

 

As shown in Apache Oozie link, I tried to run the Oozie but no success

https://oozie.apache.org/docs/4.0.1/DG_Examples.html

 

[cloudera@localhost oozie-3.3.2+92]$ oozie job -oozie http://localhost:11000/oozie -config examples/apps/map-reduce/job.properties -run

 

Error: E0901 : E0901: Namenode [localhost:8020] not allowed, not in Oozies whitelist

 

oozie-site.xml looks like:

 

less /etc/oozie/conf.dist/oozie-site.xml

 

<property>
<name>oozie.service.HadoopAccessorService.jobTracker.whitelist</name>
<value> </value>
<description>
Whitelisted job tracker for Oozie service.
</description>
</property>

<property>
<name>oozie.service.HadoopAccessorService.nameNode.whitelist</name>
<value> </value>
<description>
Whitelisted job tracker for Oozie service.
</description>
</property>

 

job.properties looks like:

 

nameNode=hdfs://localhost:8020
jobTracker=localhost:8021
queueName=default
examplesRoot=examples

oozie.wf.application.path=${nameNode}/user/${user.name}/${examplesRoot}/apps/map-reduce
outputDir=map-reduce

 

I am very frustated of unsuccessful attempts that I am thinking of giving up. Your help will be highly appreciated. 

 

Thanks,
Rio

 

PS 

I am new to Oozie 

Cloudera Employee
Posts: 1
Registered: ‎10-12-2013

Re: Running Oozie

Hello Rio --

 

Apologies for your frustration -- it appears that the default settings for Oozie on the QuickStart VM have two properties

that need to be changed:  The whitelist for the NameNode and the whitelist for the JobTracker.  I recommend to just "remove" these properties, and I'll walk you through doing this.

 

Since this is the QuickStart VM, Hadoop is managed best by using Cloudera Manager. 

 

1) Open Firefox in your Virtual Machine and go to:  http://localhost:7180
    The username and password are "admin" and "admin" without quotes.

 

2) Click on the "Services" link, and click on the "oozie1" service

 

3) Click on "configuration", and click "View and Edit".  On the left hand side, there's an "Oozie Server (Default)" Category (See the attached screenshot below)

 

OozieConfig.png

 

4) (Almost there!) Paste the XML below into the "Oozie Server Configuration Safety Valve for oozie-site.xml"

 

<property>
    <name>oozie.service.HadoopAccessorService.nameNode.whitelist</name>
    <value/>
    <description/>
</property>

<property>
        <name>oozie.service.HadoopAccessorService.jobTracker.whitelist</name>
        <value/>
        <description>
            Whitelisted job tracker for Oozie service.
        </description>
    </property>

 

5) Click "Save Changes", then restart the Oozie service from Cloudera Manager.

 

Now, you should be able to go to the command line and run these commands to submit the sample MapReduce Oozie workflow:

 

$ tar -xzvf oozie-example.tgz  # You've already done this, I think

$ hadoop fs -put examples  # This will put the examples jar and friends into HDFS, with example data

$ oozie job -oozie http://localhost:11000/oozie -config examples/apps/map-reduce/job.properties -run

 

Now you can go into Hue at http://localhost:8888/home and click the "Oozie Editor" -- it's a yellow-circle at the top of Hue and see your workflow running.  Of course, you can use the oozie command to get the status as well.

 

I hope this helps, and I intend to test this with the new Quickstart VM for Cloudera 5, to make this effort unnecessary in future versions of the Quickstart VM.

 

Thanks

--Nate

 

 

 

 

Announcements