Reply
DBG
New Contributor
Posts: 4
Registered: ‎07-24-2014

Trying to submit pig job with oozie and yarn

Just got the CDH5 build of Oozie setup and am trying to get it to connect to Hadoop. When I try to submit the following

 

oozie pig -file test.pig -oozie http://localhost:11000/oozie -config job.properties

I get

java.lang.RuntimeException: jobtracker is not specified in conf
        at org.apache.oozie.client.XOozieClient.validateHttpSubmitConf(XOozieClient.java:117)
        at org.apache.oozie.client.XOozieClient.submitScriptLanguage(XOozieClient.java:199)
        at org.apache.oozie.cli.OozieCLI.scriptLanguageCommand(OozieCLI.java:1693)
        at org.apache.oozie.cli.OozieCLI.processCommand(OozieCLI.java:551)
        at org.apache.oozie.cli.OozieCLI.run(OozieCLI.java:506)
        at org.apache.oozie.cli.OozieCLI.main(OozieCLI.java:192)
jobtracker is not specified in conf

 

I'm sure I am doing something dumb or missed a config but I can't figure out what.

 

I tried a jobTracker= directive in my properties but that didn't seem to work, and removing it didn't cause a different error, so I assume its not getting that far.

DBG
New Contributor
Posts: 4
Registered: ‎07-24-2014

Re: Trying to submit pig job with oozie and yarn

So I went reading the code. I discovered that using

 

fs.defaultFS and mapreduce.jobtracker.address in my job.properties file seems to have solved the problem.

 

Perhaps it was earlier versions of Ooozie which used jobTracker and nameNode

New Contributor
Posts: 1
Registered: ‎10-05-2014

Re: Trying to submit pig job with oozie and yarn

I just discovered this and it seems like I am having the same issue as you had. You said you started using fs.defaultFS and mapreduce.jobtracker.address in job.properties. Does this also mean that you switched out the variables in your workflow? Or was there somewhere else you did this?

 

I know you resolved this a while ago but Oozie has been giving me so many compatibility issues and this would really hel.

Announcements

Our community is getting a little larger. And a lot better.


Learn More about the Cloudera and Hortonworks community merger planned for late July and early August.