Reply
Explorer
Posts: 12
Registered: ‎10-25-2016

Sqoop import from oracle error database manager

Hello I have a 6 nodes cluster with cloudera CDH 5.7.1 and Sqoop version: 1.4.6

 

I've installed the connector in the proper location

 

/var/lib/sqoop
bash-4.1$ ls -lrt
total 13928
-rwxr-xr-x 1 root root 10489904 Oct 12 10:10 sqoop-connector-teradata-1.2c5.jar
-rwxr-xr-x 1 root root     2455 Oct 12 10:10 tdgssconfig.jar
-rwxr-xr-x 1 root root   991265 Oct 12 10:10 terajdbc4.jar
-rwxrwxrwx 1 root root  2739670 Feb  8 17:57 ojdbc6.jar
-rw-r--r-- 1 root root    11166 Feb  8 18:13 QueryResult.java

 

 

when I try any to ingest data... for example sqoop import --connect jdbc:oracle:thin:@dbquad0:3999:QUAD0 --username user--password pwd--query "select cod_ateco,id_datc from qzt_dim_ateco" --hive-import --target-dir '/tmp/sqoopimport' --hive-table dece_sqoop_quad --split-by object_type

 

 

 I allways the following error

Warning: /opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/bin/../lib/sqoop/../accumulo does not exist! Accumulo imports will fail.
Please set $ACCUMULO_HOME to the root of your Accumulo installation.
17/02/09 10:55:43 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6-cdh5.7.1
17/02/09 10:55:43 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
17/02/09 10:55:43 INFO tool.BaseSqoopTool: Using Hive-specific delimiters for output. You can override
17/02/09 10:55:43 INFO tool.BaseSqoopTool: delimiters with --fields-terminated-by, etc.
17/02/09 10:55:43 ERROR sqoop.ConnFactory: Could not load ManagerFactory com.cloudera.sqoop.manager.TeradataManagerFactory (not found)
17/02/09 10:55:43 ERROR tool.BaseSqoopTool: Got error creating database manager: java.io.IOException: No manager for connect string: jdbc:oracle:thin:@dbquad0:3999:QUAD0
        at org.apache.sqoop.ConnFactory.getManager(ConnFactory.java:191)
        at org.apache.sqoop.tool.BaseSqoopTool.init(BaseSqoopTool.java:258)
        at org.apache.sqoop.tool.ImportTool.init(ImportTool.java:89)
        at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:603)
        at org.apache.sqoop.Sqoop.run(Sqoop.java:143)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
        at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179)
        at org.apache.sqoop.Sqoop.runTool(Sqoop.java:218)
        at org.apache.sqoop.Sqoop.runTool(Sqoop.java:227)
        at org.apache.sqoop.Sqoop.main(Sqoop.java:236)

if i use option --driver oracle.jdbc.driver.OracleDriver for listtable work fine

 

can yuo help me?

Champion
Posts: 776
Registered: ‎05-16-2016

Re: Sqoop import from oracle error database manager

[ Edited ]

Found this error statement in your error stack trace. 

 

ERROR sqoop.ConnFactory: Could not load ManagerFactory com.cloudera.sqoop.manager.TeradataManagerFactory (not found)

 

Please test this below configuration in Testing enviroment before you implement in production. 

 

1 . create a drectory
managers.d
 
2 .  sudo create a file under /etc/sqoop/conf/managers.d/ cloudera_td_connector.txt
 
3 Type the below line in the file .cldra_td_connector.txt
 
com.cloudera.connector.teradata.TeradataManagerFactory = /var/lib/sqoop/sqoop-connector-teradata-1.2c5.jar

 

And this should help you to overcome the errors.

 

Thanks

Highlighted
Explorer
Posts: 12
Registered: ‎10-25-2016

Re: Sqoop import from oracle error database manager

thanks for your feedback cdguna.

 

The file already exists:

 

[root@bda1node03 managers.d]# pwd
/etc/sqoop/conf/managers.d
[root@bda1node03 managers.d]# ls -lrt
total 4
-rwxrwxrwx 1 root root 105 Feb  8 17:24 cldra_td_connector.txt
[root@bda1node03 managers.d]# cat cldra_td_connector.txt
com.cloudera.connector.teradata.TeradataManagerFactory=/var/lib/sqoop/sqoop-connector-teradata-1.2c5.jar
[root@bda1node03 managers.d]#

 but the errors (Teradata and Oracle) persists.

 

The cldra_td_connector.txt should also solve the oracle error?

 

Thanks

Announcements
New solutions