Support Questions
Find answers, ask questions, and share your expertise
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Yarn RM REST api to submit map-reduce job


Yarn RM REST api to submit map-reduce job


Hi - I am looking for some information about can we submit mapreduce job using Yarn RM REST Apis. I have a mapreduce jar which works well with hadoop jar commond unix shell. I want to submit the same job remotly via my web application. I am thinking to use Yarn RM REST Apis. Specially Cluster Applications API(Submit Application)


My Questions

1. Is this possible ? Is this the right approch.

2. Is there any sample code avaliable where I can see how to submit the MR job via REST Api. The documentation shows example for ShellCommond only which is not very clear to me.


Thanks in advance.




Re: Yarn RM REST api to submit map-reduce job

Master Guru
While it is possible to submit an application via the REST API of RM's
WebServices, its not a trivial thing to setup the same for a complex
application such as MapReduce2 (which will make use of every available API

You may find it easier instead to store your job on HDFS, and use an Oozie
workflow over it. Oozie supports a REST API that is far easier to use to
fire and control jobs:

Re: Yarn RM REST api to submit map-reduce job

Thanks for the reply. We are moving on oozie wf webservice. I agree that is very easy as compare to yarn REST apis. Thanks.
Don't have an account?
Coming from Hortonworks? Activate your account here