Created 01-07-2016 07:32 PM
Need to pull data from MSSQL over WAN into Hive. Storing them as files on HDFS would be a bonus.
Curios to know if Sqoop is able to provide a robust import over WAN? Would Sqoop meet requirements of a production environment?
Thanking in advance
Created 01-09-2016 01:11 AM
Sqoop is able to provide a robust import over WAN ? Yes but exact answer based on the setup
- Connection speed/bandwidth
- Security "Very Important"
Would Sqoop meet requirements of a production environment? Yes http://hortonworks.com/hadoop/sqoop/
Created 01-27-2016 11:05 PM
If you have other data processing occuring inside Azure take a look at Azure Data Factory for your data movement. It can orchestrate reads and writes across SQL Server, Hive, Pig, and much more.