Reply
New Contributor
Posts: 2
Registered: ‎09-03-2014

Sqoop2 automation

[ Edited ]

Hi,

 

I need to extract data from an Oracle DB table that's partition by hour. I have setup Sqoop2 connection and can run the  job manually. WHat is the best way to automate the extarct to run at certain intervals? 

 

Thanks in advance,

Willem

Explorer
Posts: 17
Registered: ‎06-23-2014

Re: Sqoop2 automation

I suggest looking at Oozie. Oozie is the defacto workflow manager/scheduler and is supported on CDH. You can schedule jobs to be run at certain time intervals, at certain dates/times, etc.

Oozie supports Sqoop jobs. Here is some documentation, although I have no idea how up-to-date it is :)

 

Hope that helps!

New Contributor
Posts: 2
Registered: ‎09-03-2014

Re: Sqoop2 automation

Thanks Daan, but I don't see any refernce to Sqoop2. Does Oozie support Soop2? 

Announcements
New solutions