Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Sqoop import from teradata using fast export method

Highlighted

Sqoop import from teradata using fast export method

New Contributor

Hello all,

 

Having an issue with sqooping from a Teradata database when using the Teradata method "--fast-export", example sqoop query is below

 

``` import

-Dhadoop.security.credential.provider.path=jceks:/PATH/TO/password/password.jcecks

-Dteradata.db.job.data.dictionary.usexviews=false

--connect

jdbc:teradata://DATABASE

--password-alias

password.alias

--username

USER

--connection-manager

org.apache.sqoop.teradata.TeradataConnManager

--fields-terminated-by

'\t'

--lines-terminated-by

'\n'

--null-non-string

''

--null-string

''

--num-mappers

8

--split-by

column3

--target-dir

/THE/TARGET/DIR

--query

SELECT column1,column2,column3 WHERE column3 > '2020-01-01 00:00:00' and column3 <= '2020-01-12 10:41:20' AND $CONDITIONS

--

--method

internal.fastexport ```

 

The error I am getting is

**Caused by: com.teradata.connector.common.exception.ConnectorException: java.sql.SQLException: [Teradata Database] [TeraJDBC ] [Error 3524] [SQLState 42000] The user does not have CREATE VIEW access to database DATABASE.**

 

I suspect fast export will implement a staging table/view to be temporarily created, and the job under the hood will be ingesting from the temp table. Is this a sqoop mechanism and is it possible to turn it off? 

Alternatively is there a better way to do the same import.

I should note that sensitive information(server details) has been removed from the question and that the sqoop query runs fine when I do not use faster export

 

Thanks

 

Dan

3 REPLIES 3
Highlighted

Re: Sqoop import from teradata using fast export method

Guru

@DPez,

 

I know that split.by.partition does require CREATE VIEW privilege, see table below:

Screen Shot 2020-01-16 at 10.42.32 am.png

I believe that fastexport is new, and it might have the same requirement. However, I can't find official documentation to support it.

Maybe other community members can validate.

 

Cheers

Eric

Highlighted

Re: Sqoop import from teradata using fast export method

New Contributor

Hi Eric

 

Thanks for the response, did some digging off the back of your answer and I believe you are correct it is the split by that is causing the problem. Will test it and post the results here

Re: Sqoop import from teradata using fast export method

Guru
@DPez,

Yeah, please share the result with your research.

Cheers
Eric
Don't have an account?
Coming from Hortonworks? Activate your account here