Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

How to do Sqoop Incremental Import through Oozie Coordinator

avatar
Explorer

I want to continuously import data from Postgres to Hive through Sqoop Oozie Coordinator Jobs. In incremental import we need to give the last value to start the import from last value.But in this case we don't know the last value as the data is growing continuously ..Is there any way to automate this process?

Could anyone please help me in resolving the issue

 

20 REPLIES 20

avatar
Expert Contributor

Hi,

 

I would request you to configure Sqoop gateways on that hosts and install metastore.

 

KB:- https://my.cloudera.com/knowledge/Creating-and-Executing-Sqoop-Jobs-Remotely-|-Sqoop1-Shared-Metasto...

 

Regards

Nitish