question Re: Sqoop job name in Archives of Support Questions (Read Only)

Sqoop job name

pvillard — Fri, 26 Aug 2016 22:43:24 GMT

Hi,

I am looking for a way to specify the name of my Sqoop job (export to Teradata). Here is the command I execute:

/usr/bin/sqoop export \
        -Dteradata.db.output.method=internal.fastload \
        --connect <connection> \
        --connection-manager org.apache.sqoop.teradata.TeradataConnManager \
        --username myuser \
        --password mypassword \
        --table <table> \
        --export-dir <sourceDir> \
        --num-mappers <mappers> \
        --verbose \
        --input-null-non-string ''

I tried the following options in the command:

        -Dmapreduce.job.id="myJob"
        -Dmapreduce.job.name="myJob" \

But it seems to be ignored and my job is always named "TeradataSqoopExportJob".

Is there a way to rename the job?

Thanks!

Re: Sqoop job name

sunile_manjee — Fri, 26 Aug 2016 22:43:25 GMT

@Pierre Villard

can you please try the --create myjobname

sqoop job --create myjob -- import --connect jdbc:mysql://example.com/db \
    --table mytable

Re: Sqoop job name

pvillard — Sat, 27 Aug 2016 01:27:21 GMT

I'd prefer a solution without using the Sqoop metastore, but I'll try that anyway and let you know. I believe that in this case, that this is overridden by the connector code and not sure if we can do much.

Re: Sqoop job name

ledel — Sun, 23 Oct 2016 17:39:12 GMT

@Pierre Villard I got it working with -D mapred.job.name=mySqoopTest