Hey,    Couple of things:   1.  This section is not necessary, it doesn't hurt anything, but you don't need it:   <configuration> <property> <name>oozie.hive.defaults</name> <value>/user/someuser/hive-default.xml</value> </property> </configuration>   2.  What version of CDH are you using?   3.  Are you using CM?   It really looks like you still don't have the credentials configured in the oozie-site.xml.  If you are using CM, that might be why, can you chec, the instructions below and configure the oozie-site.xml for credentials?         For the Oozie configuration: 1.  If using CM, add an Oozie proxy to the core-site.xml for the Hive metastore server: - Go to, "HDFS Service->Configuration->Service-Wide->Advanced-> Cluster-wide Configuration Safety Valve for core-site.xml" 2. Add:  <property> <name>hadoop.proxyuser.oozie.hosts</name> <value>*</value> </property> <property> <name>hadoop.proxyuser.oozie.groups</name> <value>*</value> </property> 3. Restart the Hive metastore server. 4. Add the HCat credentials class to oozie-site.xml. Edit the file and add: <property> <name>oozie.credentials.credentialclasses</name> <value>hcat=org.apache.oozie.action.hadoop.HCatCredentials</value> </property> 5. In addition, If using CM, go to "Oozie service->Configuration->Oozie Server(default)->Advanced-> Oozie Server Configuration Safety Valve for oozie-site.xml" 6. Add:   <property> <name>oozie.credentials.credentialclasses</name> <value>hcat=org.apache.oozie.action.hadoop.HCatCredentials</value> </property> 7.  Restart Oozie.    ... View more

Hello,   Here is an example if you are using a Driver class:   Steps: Pull the Source code for the new PiEstimator and compile with Maven. Requires Git, Maven and Java: git clone https://github.com/cmconner156/oozie_pi_load_test.git cd oozie_pi_load_test/PiEstimatorKrbSrc vi pom.xml set hadoop-core and hadoop-client to match your version. mvm clean install Copy oozie_pi_load_test/PiEstimatorKrbSrc/target/PiEstimatorKrb-1.0.jar to some location in HDFS. Make sure it's readable by whichever Hue user will run the workflow. Go to Hue browser and go to the Oozie app Go to the Workflows tab Click "Create" Enter a name and description Click Save Drag "Java" from the actions above to the slot between "Start" and "end" Give it a name and description For the Jar name, click the browse button Find the PiEstimatorKrb-1.0.jar file you put in HDFS For "Main Class" enter "com.test.PiEstimatorKrb" For "Arguments" enter "<tempdir> <nMaps> <nSamples>" by replacing those with correct values. For example "/user/cconner/pi_temp 4 1000", base the nMaps and nSamples on what you would normally use for the Pi example. Click "add path" next to "Files" and search for PiEstimatorKrb-1.0.jar in HDFS. Click Done. Click Save. Click Submit on the left.     Here is an example not using a driver class:   Steps: Put /usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar in HDFS somewhere, I put it in /user/oozie and make it readable by everyone.  Create a directory in HDFS for the job. I did "hadoop fs -mkdir teragen_oozie"  Create an empty input directory in HDFS for the job. I did "hadoop fs -mkdir teragen_oozie/input"  Go into Hue->Oozie and click Create workflow.  Enter Name, Description, "HDFS deployment directory" and set it to the location above  Click Save  Click + button for Mapreduce  Enter a name for the MR task  For Jar name, browse to the location where you put hadoop-mapreduce-examples.jar above  Click "Add Property" for Job Properties and add the following:  mapred.input.dir = hdfs://cdh412-1.test.com:8020/user/admin/teragen_oozie/input  mapred.output.dir = hdfs://cdh412-1.test.com:8020/user/admin/teragen_oozie/output  mapred.mapper.class = org.apache.hadoop.examples.terasort.TeraGen$SortGenMapper  terasort.num-rows = 500  Click "Add delete" for Prepare and specify "hdfs://cdh412-1.test.com:8020/user/admin/teragen_oozie/output" as the location.  Click Save.  Now run the Workflow and it should succeed  NOTE: change cdh412-1.test.com:8020 to be the correct NN for your environment.   Hope this helps! ... View more

No problem!   The workflow and coordinator definitions are in the Hue DB and the xml for them are in HDFS, just none of the status history, that Hue pulls from Oozie.  Everything you need to resubmit the coordinators and workflows is in the Hue DB and HDFS and clearing the Oozie DB won't cause any problems there.   Thanks Chris ... View more

Hey, The /user/ directory is owned by "hdfs" with 755 permissions. As a result only hdfs can write to that directory. Unlike unix/linux, hdfs is the superuser and not root. So you would need to do this: sudo -u hdfs hadoop fs -mkdir /user/,,myfile,, sudo -u hdfs hadoop fs -put myfile.txt /user/,,/,, If you want to create a home directory for root so you can store files in his directory, do: sudo -u hdfs hadoop fs -mkdir /user/root sudo -u hdfs hadoop fs -chown root /user/root Then as root you can do "hadoop fs -put file /user/root/". Hope this helps. Chris ... View more

When you added the hadoop.proxyuser.oozie.* values, did you restart MapReduce and HBase?  They have to be restarted to notice that change.  Also, are you using CM?  It doesn't look like it, but I wanted to confirm because that would change things.   Thanks Chris ... View more