question Re: Datanode IPC port TIME_WAIT in Support Questions

Datanode IPC port TIME_WAIT

isoardi — Tue, 13 Sep 2022 07:42:37 GMT

hello to all,
I have many connections in time_wait on the ipc port 1019 of the datanode:
More than 600 time_wait and about 250 established.
Is that normal?

I’m afraid that’s why index write closed on solr errors (the index is on hdfs).
The servers are downloaded and the datanode does not saturate the jvm heap.

I couldn’t find any max connection configuration for port 1019
Any ideas?

Environment:

HDP 3.1.5.0-152 with HDFS 3.1.1

Thanks in advance

Re: Datanode IPC port TIME_WAIT

rki_ — Thu, 15 Sep 2022 07:22:32 GMT

Hi @isoardi ,

Seeing sockets in TIME_WAIT state is normal and is by design when the socket is getting closed. Unless we see tens of thousands of sockets in TIME_WAIT state which would consume the ephemeral ports on the host , these are fine. It would be the CLOSE_WAIT sockets we need check which indicates the application has not called the close() call on the socket.

You can refer the below RedHat documentation for more info on this and ways to close the TW sockets by reusing them.

https://access.redhat.com/solutions/24154

Re: Datanode IPC port TIME_WAIT

isoardi — Thu, 15 Sep 2022 07:57:39 GMT

Hi @rki_ ,

Thanks for the explanation.

I had hoped to have found a reason for the index writer closed error of SolR.

Thanks you anyway