Sqoop - missing driver or something else?

NicHopper — Fri, 27 Jan 2017 23:02:58 GMT

Hi,

my ultimate goal is to get some data from SQL Server and import it to HDFS, after discussions with others they have said I am best extracting the data with Sqoop to AVRO files and then creating a HIVE table based on them.

So to do this I'm starting at the beginnning.

Step 1 getting Sqoop to connect to the table, at this point it doesn't have to do anything with it.

In Step 2 I'll worry about extract it AVRO files

So I put together the following command

sqoop import --connect "jdbc:sqlserver://<SQLSERVER>:1433;database=sandbox;user=hdfsuser;password=hdfspassword" --table policy

And Scoop goes off to try and do it but then I get the following back

Could not load db driver class: com.microsoft.sqlserver.jdbc.SQLServerDriver java.lang.RuntimeException: Could not load db driver class: com.microsoft.sqlserver.jdbc.SQLServerDriver

Does this mean that I need to install it as detailed here;

http://stackoverflow.com/questions/23096655/sqoop-connecting-to-sql-server

Or am I barking up the wrong tree.

I'm having to do a Hadoop POC all on my own so having you all to bounce my ideas off and get help from is a real plus so thanks for taking the time to read all this and any help would be massively appreciated by me.

Thanks, Nic

Re: Sqoop - missing driver or something else?

orenault — Sat, 28 Jan 2017 00:03:21 GMT

You are correct, you need to first install the SQL server connector.

https://community.hortonworks.com/questions/1941/sqoop-connector-for-microsoft-sql-server.html

You will need to copy it into /usr/hdp/current/sqoop-client/lib/

Re: Sqoop - missing driver or something else?

NicHopper — Sat, 28 Jan 2017 00:21:54 GMT

Thanks for confirming that, I'll give it a try on Monday, have a great weekend.

Nic

Re: Sqoop - missing driver or something else?

NicHopper — Mon, 30 Jan 2017 17:53:55 GMT

That did the job for me. Thanks again.

question Re: Sqoop - missing driver or something else? in Support Questions

Sqoop - missing driver or something else?

Re: Sqoop - missing driver or something else?

Re: Sqoop - missing driver or something else?

Re: Sqoop - missing driver or something else?