Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

AWS S3 error while sqoop import from oracle table blob data type column

Highlighted

AWS S3 error while sqoop import from oracle table blob data type column

New Contributor

We are importing data form below oracle table having BLOB column UPLOAD_FILE

 

sqoop import --connect jdbc:oracle:thin:@//dev-1c-db-3.dev.spratingsvpc.com:1521/CGSODSDV.WORLD --username IDF_SQOOP_USER --password <> --table ARROWG.EXTERNAL_UPLOAD --m 10  --fields-terminated-by ',' --fetch-size 100000 --split-by EXT_UPLOAD_ID --target-dir s3://spr-idf-dev1-landing/EXTERNAL_UPLOAD

 

Getting below error:

19/11/22 07:14:56 INFO mapreduce.Job: Task Id : attempt_1563293960212_15441_m_000007_0, Status : FAILED
Error: java.lang.IllegalArgumentException: Wrong FS: s3://spr-idf-dev1-landing/EXTERNAL_UPLOAD/_lob, expected: hdfs://idf-namenode-emr-dev1.dev.spratingsvpc.com:8020

 

Please help us on this

 

2 REPLIES 2

Re: AWS S3 error while sqoop import from oracle table blob data type column

Community Manager

@Pabba While we welcome your question, you would be much more likely to obtain a useful answer if you posted this to the the appropriate AWS forum for EMR.

 

 

Bill Brooks, Community Manager
Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

Re: AWS S3 error while sqoop import from oracle table blob data type column

Mentor

@Pabba 

 

Have you tried using the access key+ secret key and instead of s3 use s3a//

 

sqoop import -Dfs.s3a.access.key=$ACCES_KEY -Dfs.s3a.secret.key=$SECRET_KEY
--connect jdbc:oracle:thin:@//dev-1c-db-3.dev.spratingsvpc.com:1521/CGSODSDV.WORLD --username IDF_SQOOP_USER --password <> D --table $TABLENAME --target-dir s3a://spr-idf-dev1-landing/EXTERNAL_UPLOAD

 

Confirm and Check the HDFS format in AWS 

 

Validate hdfs format

$ hadoop fs -ls s3://spr-idf-dev1-landing

 

Validate hdfs format

$ hadoop fs -ls s3a://spr-idf-dev1-landing

 

Please revert 

 

 

Don't have an account?
Coming from Hortonworks? Activate your account here