Created 06-13-2018 06:29 PM
Team,
I build a new cluster and we have jobs to pull data out of MS SQL Server.
MS SQL Server listens on port 1433 and our Network Security team has denied to open firewall between our Hadoop Cluster and MS SQL Server saying that port 1433 is a non secure port.
MS SQL DBAs said that they cannot enable SSL on the DB side because other applications(legacy) would not be able to connect to MS SQL Server.
Now from hadoop side we need to ensure our connections are secure.
Has anybody faced this situation ?
thanks
Kumar
Created 06-14-2018 08:05 AM
it's quite usual, that the DB servers are protected from access from the internet, and if your hadoop cluster is not in the company network, it is considered as being internet, so you security team will not allow access.
You can discuss with your networks security team, if a VPN tunnel from your hadoop cluster to the sql server is possible, but in most cases, network security will require in that cases to apply all internal security standards on your hadoop cluster as well, as otherwise they are not considered as trustworthy.
Another option is, if a SSH connection is allowed from the ms SQL server to your hadoop cluster, in that case you could tunnel the port 1433 as well to use it from hadoop.
A common solution to this situation is also to migrate the hadoop cluster from a cloud location to a on premise installation.
Created 06-14-2018 08:05 AM
it's quite usual, that the DB servers are protected from access from the internet, and if your hadoop cluster is not in the company network, it is considered as being internet, so you security team will not allow access.
You can discuss with your networks security team, if a VPN tunnel from your hadoop cluster to the sql server is possible, but in most cases, network security will require in that cases to apply all internal security standards on your hadoop cluster as well, as otherwise they are not considered as trustworthy.
Another option is, if a SSH connection is allowed from the ms SQL server to your hadoop cluster, in that case you could tunnel the port 1433 as well to use it from hadoop.
A common solution to this situation is also to migrate the hadoop cluster from a cloud location to a on premise installation.