Member since
12-23-2018
5
Posts
0
Kudos Received
0
Solutions
12-27-2018
02:15 PM
@Jay Kumar SenSharma I was getting the directory is in an inconsistent state error. I made the necessary changes in hdfs-site.xml and everything is working fine now. Thanks for the help! 🙂
... View more
12-24-2018
11:49 AM
Thanks for the response @Jay Kumar SenSharma. The port 8020 is not listening, I'll look into this issue
... View more
12-23-2018
06:05 PM
Hi folks,
I have installed a single node hadoop cluster on my local machine. I'm using it for 1-2 months now and I have execute few MR codes without any problem.
But recently while studying Pig, I found out that I was unable to start the job history server.
To solve this problem, I added below lines in the mapred-site.xml: <property>
<name>mapreduce.jobhistory.address</name>
<value>localhost:10020</value> <!-- hostname of machine where jobhistory service is started -->
</property>
<property>
<name>mapreduce.jobhistory.webapp.address</name>
<value>localhost:19888</value>
</property>
But after making the above changes, I'm getting the below error while executing basic HDFS commands SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/share/java/slf4j/slf4j-log4j12.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/share/java/slf4j/slf4j-jdk14.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
18/12/23 22:22:23 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
ls: Call From localhost/127.0.0.1 to localhost:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
Even a basic hadoop fs throws the above error. I have removed the above configuration from mapred-site.xml, tried formatting namenode but still the same issue. Can someone please help me as I'm stuck with this for very long
... View more
Labels:
- Labels:
-
Apache Hadoop