Member since
02-11-2016
5
Posts
0
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
11090 | 02-12-2016 10:04 AM |
02-12-2016
10:04 AM
The problem was solved by changing the system user to root, usergroup to root and shared usergroup to hadoop in the HDFS configuration. I also removed the original folders named "dfs-socket" in /var/run/ in all DataNodes and let the script create new folders.
... View more
02-12-2016
09:36 AM
I am begining to see where the problem lies. In the Cloudera Manager HDFS config setting, I am using hduser:hadoop as the system user and system group. After re-starting the HDFS, I saw that /var/run/dfs-socket was created and assigned to hduser:hadoop. But, I am still getting the error: java.io.IOException: the path component: '/var/run/dfs-socket' is owned by a user who is not root and not you. What I am not clear is when hdfs.sh is run to start the HDFS service, which user is running the script? Note that root user was used to install the Cloudera Manager and setup all the NameNodes and DataNodes.
... View more
02-11-2016
07:57 PM
I was able to complete the installation of CDH-5.5.1. But, all datanodes have problem starting HDFS service due to the following problem: 2016-02-11 18:18:51,394 FATAL org.apache.hadoop.hdfs.server.datanode.DataNode: Exception in secureMain
java.net.BindException: bind(2) error: Permission denied when trying to bind to '/ssd1/tmp/dfs/socket/dn'
at org.apache.hadoop.net.unix.DomainSocket.bind0(Native Method)
at org.apache.hadoop.net.unix.DomainSocket.bindAndListen(DomainSocket.java:191)
at org.apache.hadoop.hdfs.net.DomainPeerServer.<init>(DomainPeerServer.java:40)
at org.apache.hadoop.hdfs.server.datanode.DataNode.getDomainPeerServer(DataNode.java:970)
at org.apache.hadoop.hdfs.server.datanode.DataNode.initDataXceiver(DataNode.java:936)
at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:1144)
at org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:453)
at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:2402)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:2289)
at org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:2336)
at org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:2513)
at org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:2537) The original location was /var/run/hdfs-sockets/dn. I had the same problem with original location. So, I changed it to a new location, and I still have the "permission denied" problem. I installed the Cloudera Manager using the user root.
... View more
Labels: