question Re: creating UNIX domain socket with SOCK_STREAM in Archives of Support Questions (Read Only)

creating UNIX domain socket with SOCK_STREAM

vinayk — Fri, 08 Jun 2018 16:51:38 GMT

Hi All,

I was running command hadoop fs -get /user/centos/dist/a.txt

I got error during command java.net.SocketException: error creating UNIX domain socket with SOCK_STREAM: Too many open files

Open file limit is default limit. I didn't change.

Can some one suggest should i have to increase open file limit in sysctl and limit.conf?

Thanks

vinay

Re: creating UNIX domain socket with SOCK_STREAM

tsokorai — Fri, 08 Jun 2018 19:13:30 GMT

Hi @Vinay K

It depends, you might have some underlying issue, first check who is holding up too many open files, by using the os command "lsof"

If everything seems OK but and you just have this issue due to the workload, increase the number of open files in limit.conf, but beware that if you are using Ambari and using of of the hadoop users, its limit will be overridden by the value from the Ambari configuration.

Re: creating UNIX domain socket with SOCK_STREAM

vinayk — Fri, 08 Jun 2018 19:21:18 GMT

@tsokorai

I have increased the hard and soft value in limits.conf.

Thanks