- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Spark ports to connect to rdbms source using jdbc
- Labels:
-
Apache Spark
-
Apache YARN
Created 08-21-2021 09:16 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hello
I have a spark cluster on CHD 6.3.3
1 master node and 3 worker nodes
I will read huge data from external RDBMS”mssql” using jdbc driver
And I need to open the port in the firewall
My external RDBMS port is 99766
But my problem is what port should I open from the spark side for each node so I can read and write data using the master and all workers in my spark application.
Thank you
Created 08-31-2021 01:58 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi
Apache spark will initiate connection to your db on that port only via jdbc , so you can open a firewall where sources are your nodes ips and destination is your db server ip on the port you specified.
Best Regards
