Reply
Highlighted
Explorer
Posts: 6
Registered: ‎06-13-2015

What are the different ways of submitting Hadoop jobs?

I just know the below two ways of submitting Hadoop jobs

 

1) CLI(Command line interface)

2) OOzie

 

Are there any other ways to do it ? and which is the most widely used method of submitting the Hadoop jobs?

 

Thanks

Posts: 1,827
Kudos: 406
Solutions: 292
Registered: ‎07-31-2013

Re: What are the different ways of submitting Hadoop jobs?

There's no one 'widely used method'. It depends on what you are doing. For instance, ETL jobs are fairly regular ones, and Oozie is preferred in submitting them, but there are also ad-hoc jobs on the cluster from analysts/etc. users that go via CLI and don't need a scheduler as they are mostly one-off, or on-need.

You can also submit programmatically from running code, or from scripting libraries that provide such support, but otherwise those two you've mentioned are pretty much the only options.
Announcements