question Re: Sqooping data from LOCAL MSSQL Server to HDInsight over Azure? in Archives of Support Questions (Read Only)

Sqooping data from LOCAL MSSQL Server to HDInsight over Azure?

rmian — Wed, 16 Dec 2015 05:36:05 GMT

I am trying to Sqoop data from a local on-site Microsoft SQL server to Hive in HDinsights in Azure.

Inside Secure Shell in HDInsight, I CAN sqoop data in from Azure SQL Server but UNABLE to sqoop data from SQL Server locally.

I can also setup Azure SQL Server, setup firewall setting and synchronize with local SQL Server. I cannot connect/ping the external SQL Server's ip.

- why can't my sqoop connect to the local SQL Server?

- are there any firewalls setup in HDInsight that prevents connection?

nsabharwal — Wed, 16 Dec 2015 05:57:45 GMT

If endpoints are set for the ports then connectivity should not be an issue.

pardeep_kumar — Wed, 16 Dec 2015 06:29:42 GMT

It looks like network issue rather than Sqoop issue as you are mentioning you are not able to ping external SQL Server machine.

rmian — Thu, 17 Dec 2015 00:04:22 GMT

@Pardeep

Strange...able to setup Azure SQL Server, setup firewall setting and synchronize with local SQL Server. Possibly something specific to HDInsight....

rmian — Fri, 08 Jan 2016 03:33:51 GMT

@pardeep

answer from microsoft: "I believe this will not work unless your HDInsight cluster and your on premise SQL server are connected thorugh a VPN.

I would recommend trying alternatuves like Azure Data Factory for such a hybrid data movement scenario."

cgross — Thu, 28 Jan 2016 06:57:39 GMT

Give Azure Data Factory (ADF) a try.