Support Questions
Find answers, ask questions, and share your expertise

Sqooping data from LOCAL MSSQL Server to HDInsight over Azure?

Explorer

I am trying to Sqoop data from a local on-site Microsoft SQL server to Hive in HDinsights in Azure.

Inside Secure Shell in HDInsight, I CAN sqoop data in from Azure SQL Server but UNABLE to sqoop data from SQL Server locally.

I can also setup Azure SQL Server, setup firewall setting and synchronize with local SQL Server. I cannot connect/ping the external SQL Server's ip.

- why can't my sqoop connect to the local SQL Server?

- are there any firewalls setup in HDInsight that prevents connection?

1 ACCEPTED SOLUTION

Accepted Solutions

Explorer

@pardeep

answer from microsoft: "I believe this will not work unless your HDInsight cluster and your on premise SQL server are connected thorugh a VPN.

I would recommend trying alternatuves like Azure Data Factory for such a hybrid data movement scenario."

https://social.msdn.microsoft.com/Forums/azure/en-US/36646ef9-221e-4e8e-b80e-c91316857958/sqooping-d...

View solution in original post

5 REPLIES 5

@rmian

If endpoints are set for the ports then connectivity should not be an issue.

It looks like network issue rather than Sqoop issue as you are mentioning you are not able to ping external SQL Server machine.

Explorer

@Pardeep

Strange...able to setup Azure SQL Server, setup firewall setting and synchronize with local SQL Server. Possibly something specific to HDInsight....

New Contributor

Give Azure Data Factory (ADF) a try.

Explorer

@pardeep

answer from microsoft: "I believe this will not work unless your HDInsight cluster and your on premise SQL server are connected thorugh a VPN.

I would recommend trying alternatuves like Azure Data Factory for such a hybrid data movement scenario."

https://social.msdn.microsoft.com/Forums/azure/en-US/36646ef9-221e-4e8e-b80e-c91316857958/sqooping-d...

View solution in original post