Member since
01-23-2020
1
Post
0
Kudos Received
0
Solutions
11-30-2020
08:52 AM
check your timeouts turn off or fix any firewalls test any network calls from other machines. could also be the sFTP server you are reading from Connection timed out (Connection timed out); routing to comms.failure: java.io.IOException: Failed to obtain connection to remote host due to com.jcraft.jsch.JSchException: java.net.ConnectException: Connection timed out (Connection timed out) java.io.IOException: Failed to obtain connection to remote host due to com.jcraft.jsch.JSchException: java.net.Connect Up the timeouts for the network calls. How many NIC cards do you have are they 10Gb+? What is the RAM? I recommend 32GB RAM with most to JVM, 30-32 cores. The best practice is to use Cloudera Flow Management with a Cloudera Manager's managed cluster it will make sure everything is running properly. You can also restart them to get a different leading node. Usually when you do sFTP you have only one node making the calls, so that's why that one will get timeout errors calling that SFTP server. Make the timeout greater, your SFTP may be slow or offline or blocked by firewall/gateway/proxy/linux network
... View more