question Re: Sqoop connector for Microsoft SQL Server in Archives of Support Questions (Read Only)

Sqoop connector for Microsoft SQL Server

mriggs1 — Fri, 23 Oct 2015 05:46:16 GMT

Microsoft says that the Sqoop connector for Hadoop is now included in Sqoop 1.4 and no longer provides a direct download, but I can't seem to find it. Which jar should I be using, and do I need to manually specify a JDBC driver class?

Running "sqoop list-databases --connect jdbc:sqlserver://<IP Address>:<Port Number> --username <Username> --password <Password>" results in "RuntimeException: Could not load db driver class: com.microsoft.sqlserver.jdbc.SQLServerDriver". This is with Sqoop 1.4.6.

Re: Sqoop connector for Microsoft SQL Server

deepesh1 — Fri, 23 Oct 2015 06:41:35 GMT

You can use the sqljdbc4.jar that ships under the windows install of HDP at <OOZIE_HOME>/extra_libs.

Re: Sqoop connector for Microsoft SQL Server

aervits — Fri, 23 Oct 2015 08:30:12 GMT

download it here http://www.microsoft.com/en-us/download/details.aspx?displaylang=en&id=11774, you need the tar.gz file, extract and place in sqoop lib folder.

Re: Sqoop connector for Microsoft SQL Server

cstanca — Sun, 12 Jun 2016 05:46:37 GMT

@Artem Ervits, @Deepesh, @Mike Riggs

I'm trying this in HDP 2.4 sandbox with SQL Server Express 2014. Connectivity is ok.

Even you add it to /var/lib/sqoop/lib/ or /usr/lib/sqoop/lib folder, how do you get past that a connection-manager needs to be set to use a factory class in order to use the Microsoft driver? The error (even is shown as a WARN) is:

WARN sqoop.ConnFactory: Parameter --driver is set to an explicit driver however appropriate connection manager is not being set (via --connection-manager). Sqoop is going to fall back to org.apache.sqoop.manager.GenericJdbcManager. Please specify explicitly which connection manager should be used next time.

Due to this, the command does not work.

This error is thrown after executing a command like this:

sqoop list-databases --driver com.microsoft.sqlserver.jdbc.SQLServerDriver --connect jdbc:sqlserver://10.226.170.191\poc:1433 --username WHATEVERUSER --password WHATEVERPASSWORD

--connection-manager directive seems to be needed. What needs to be added?

Re: Sqoop connector for Microsoft SQL Server

aervits — Sun, 12 Jun 2016 06:47:06 GMT

Why is there a forward slash in jdbc string?

Re: Sqoop connector for Microsoft SQL Server

kkunjan — Sat, 09 Jul 2016 05:48:03 GMT

I am using HDP sandbox and not sure where is the sqoop lib folder. I see this file path /hdp/apps/2.4.0.0-169/sqoop and I placed the sqljdbc.jar file here:, but still get the same error. Is there some other place the file needs to be placed? Also, the sqoop.tar.gz file is also present in the same file path [it came with the package]. Does that also have to be extracted and placed elsewhere? Thank you for your help.

Re: Sqoop connector for Microsoft SQL Server

rkandula — Sat, 07 Jan 2017 02:32:03 GMT

Copy sqljdbc42.jar to following location /usr/hdp/current/sqoop-client/lib/ and try

Don't even need to use --driver option