How to automate sqoop incremental import using sqoop job?

[#1]

Hi there, How to automate sqoop incremental import using sqoop job? As for as I know, sqoop job remembers the last value. If we create a sqoop job like sqoop job --create myjob -- import --connect blah blah.. sqoop exec myjob and automate the job, It will create the job each time it executes. So, we will get job already exists error. So, Is it possible to automate sqoop incremental import using sqoop job? Please let me know your knowledge on this. Thanks in advance.

[#2 · Accepted solution]

Execute does not create a sqoop job. sqoop job creates the job and you will get an error if you try creating multiple sqoop job with the same job name.

You need to pass --incremental and --check-col on the job to trigger incremental updates.

[#3]

Hi Ravi,

Thank you very much for your prompt reply and it helped me a lot. I understand the operation now. Once again thanks