Member since
04-09-2016
18
Posts
2
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
4520 | 06-05-2016 10:24 AM |
06-05-2016
10:24 AM
1 Kudo
Ambari 2.2.1.0 and HDP 2.3.4.0 and this issue got resolved with below steps 1) stopped ambari agent and ambari server 2) did NN format using --> hdfs namenode -format 3) provided 777 rights and changed the user to hadoop, for namenode folder resided in the below path /bigdata/hadoop/hdfs/namenode 4) restarted the agent and server.
... View more
06-05-2016
12:04 AM
Latest NN logs: 2016-06-05 01:03:14,805 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:stop(217)) - NameNode metrics system stopped.
2016-06-05 01:03:14,806 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:shutdown(607)) - NameNode metrics system shutdo$
2016-06-05 01:03:14,806 ERROR namenode.NameNode (NameNode.java:main(1712)) - Failed to start namenode.
java.net.BindException: Port in use: server1.ddns.net:50070
at org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:919)
at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:856)
at org.apache.hadoop.hdfs.server.namenode.NameNodeHttpServer.start(NameNodeHttpServer.java:142)
at org.apache.hadoop.hdfs.server.namenode.NameNode.startHttpServer(NameNode.java:892)
at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:716)
at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:951)
at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:935)
at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1641)
at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1707)
Caused by: java.net.BindException: Address already in use
at sun.nio.ch.Net.bind0(Native Method)
at sun.nio.ch.Net.bind(Net.java:444)
at sun.nio.ch.Net.bind(Net.java:436)
at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:214)
at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
at org.mortbay.jetty.nio.SelectChannelConnector.open(SelectChannelConnector.java:216)
at org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:914)
... 8 more
2016-06-05 01:03:14,809 INFO util.ExitUtil (ExitUtil.java:terminate(124)) - Exiting with status 1
2016-06-05 01:03:14,812 INFO namenode.NameNode (LogAdapter.java:info(47)) - SHUTDOWN_MSG:
/************************************************************
... View more
06-03-2016
11:23 PM
Any help would be appreciated... Thanks in advance.
... View more
06-03-2016
07:15 PM
Even after re run the NN, nothing is getting displayed [root@server1 conf]# lsof -i:50070
[root@server1 conf]#
... View more
06-03-2016
06:58 PM
Thanks for the reply. Below are the results of each one you asked to execute. 1) [root@server1 hdfs]# ps aux | grep -i namenode
root 27093 0.0 0.0 103308 900 pts/0 S+ 19:40 0:00 grep -i namenode
2) [root@server1 hdfs]# nano hadoop-hdfs-namenode-server1.ddns.net.log 2016-06-03 14:03:11,218 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:stop(211)) - Stopping NameNode metrics system...
2016-06-03 14:03:11,219 INFO impl.MetricsSinkAdapter (MetricsSinkAdapter.java:publishMetricsFromQueue(141)) - timeline thre$
2016-06-03 14:03:11,219 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:stop(217)) - NameNode metrics system stopped.
2016-06-03 14:03:11,219 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:shutdown(607)) - NameNode metrics system shutdo$
2016-06-03 14:03:11,220 ERROR namenode.NameNode (NameNode.java:main(1712)) - Failed to start namenode.
java.net.BindException: Port in use: server1.ddns.net:50070
at org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:919)
at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:856)
at org.apache.hadoop.hdfs.server.namenode.NameNodeHttpServer.start(NameNodeHttpServer.java:142)
at org.apache.hadoop.hdfs.server.namenode.NameNode.startHttpServer(NameNode.java:892)
at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:716)
at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:951)
at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:935)
at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1641)
at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1707)
Caused by: java.net.BindException: Address already in use
at sun.nio.ch.Net.bind0(Native Method)
at sun.nio.ch.Net.bind(Net.java:444)
at sun.nio.ch.Net.bind(Net.java:436)
at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:214)
at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
at org.mortbay.jetty.nio.SelectChannelConnector.open(SelectChannelConnector.java:216)
at org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:914)
... 8 more
2016-06-03 14:03:11,223 INFO util.ExitUtil (ExitUtil.java:terminate(124)) - Exiting with status 1
2016-06-03 14:03:11,260 INFO namenode.NameNode (LogAdapter.java:info(47)) - SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode at server1.ddns.net/141.178.0.16 In my core-site.xml, below is the entry <property>
<name>fs.defaultFS</name>
<value>hdfs://server1.ddns.net:8020</value>
</property>
In my hdfs-site.xml, below are the entry <property>
<name>dfs.https.port</name>
<value>50470</value>
</property>
<property>
<name>dfs.namenode.http-address</name>
<value>server1.ddns.net:50070</value>
</property>
<property>
<name>dfs.namenode.https-address</name>
<value>server1.ddns.net:50470</value>
</property>
<property>
<name>dfs.namenode.rpc-address</name>
<value>server1.ddns.net:8020</value>
</property>
<property>
<name>dfs.namenode.safemode.threshold-pct</name>
<value>1</value>
</property>
... View more
06-03-2016
12:03 PM
I'm using Ambari 2.2.1.0 and HDP 2.3.4.0 Using Ambari UI, I tried to start my NN. But, its showing below error. safemode: Call From server1.ddns.net/141.178.0.16 to server1.ddns.net:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused 2016-06-03 12:40:06,640 - Retrying after 10 seconds. Reason: Execution of '/usr/hdp/current/hadoop-hdfs-namenode/bin/hdfs dfsadmin -fs hdfs://server1.ddns.net:8020 -safemode get | grep 'Safe mode is OFF'' returned 1. safemode: Call From server1.ddns.net/141.178.0.16 to server1.ddns.net:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused After that, I tried below commands and the outputs are: [root@server1 ~]# sudo -u hdfs hdfs dfsadmin -report
report: Call From server1.ddns.net/141.178.0.16 to server1.ddns.net:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
[root@server1 ~]# sudo -u hdfs hdfs dfsadmin -safemode enter
safemode: Call From server1.ddns.net/141.178.0.16 to server1.ddns.net:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
[root@server1 ~]# sudo -u hdfs hdfs dfsadmin -safemode leave
safemode: Call From server1.ddns.net/141.178.0.16 to server1.ddns.net:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
[root@server1 ~]#
1) Why is it not leaving from safemode? 2) What could be the solution to resolve my problem and make the NN up? Please help me in this regard....
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Hadoop
05-25-2016
07:17 AM
Hi, Can anyone suggest which version of HDF/NiFi I can use for HDP2.2.8.0? Is HDF 1.1 compatible for HDP2.2.x when I wanted to interact with HDP component stacks? Thanks in advance.
... View more
Labels:
05-16-2016
07:02 PM
Thanks a lot!! It worked!
... View more
05-16-2016
04:10 PM
[root@server1 Desktop]# ls -l /usr/hdp/current/ | grep zookeeper
lrwxrwxrwx 1 root root 31 May 12 23:15 zookeeper-client -> /usr/hdp/2.2.9.0-3393/zookeeper
drwxr-xr-x 3 root root 4096 May 12 23:30 zookeeper-server
[root@server1 Desktop]# ls -l /usr/hdp/current/zookeeper-server/bin
ls: cannot access /usr/hdp/current/zookeeper-server/bin: No such file or directory
[root@server1 Desktop]#
... View more
05-16-2016
03:43 PM
Hi, It's a multi-node cluster and while starting zookeeper in ambari UI on a server (server1), it's getting failed with below error. Zookeeper server is running on remaing servers. Can any one please help me to resolve this issue?
... View more
Labels:
- Labels:
-
Apache Ambari
05-12-2016
08:10 PM
Thanks. Now I'm able to configure see the page with new cluster.
... View more
05-09-2016
04:31 AM
Thank you for the suggestion. Actually, I'm using MySQL. When I've run the below command, It's outputting as [root@mainserver yum.repos.d]# ambari-server reset
**** WARNING **** You are about to reset and clear the Ambari Server database. This will remove all cluster host and configuration information from the database. You will be required to re-configure the Ambari server and re-run the cluster wizard.
Are you SURE you want to perform the reset [yes/no] (no)? yes
ERROR: Exiting with exit code 1.
REASON: Ambari doesn't support resetting exernal DB automatically. To reset Ambari Server schema you must first drop and then create it using DDL scripts from
"/var/lib/ambari-server/resources/"
So, 1) I've dropped the databases of ambari, hive, oozie 2) and then dropped the users from all hosts from the root 3) Then I created users , databases and ran the SOURCE
/var/lib/ambari-server/resources/Ambari-DDL-MySQL-CREATE.sql; query. Please suggest me, is this the right approach for the above error?
... View more
05-08-2016
08:34 PM
1) How to get agent, metrics etc packages on hosts (host1 & host2)? I've copied ambari.repo from server to my hosts. [root@mainserver yum.repos.d]# scp ambari.repo host1.ddns.net:/etc/yum.repos.d/
[root@mainserver yum.repos.d]# scp ambari.repo host2.ddns.net:/etc/yum.repos.d/
Now, I'm able to see agent, metrics etc packages on hosts (host1 & host2). 2) How to re-install ambari-agents on all hosts? Will go with Manual installation. 3) But, How to re-install HDP from ambari UI freshly using wizard? As I'm seeing my old cluster details on the screen?
... View more
05-08-2016
08:22 PM
As I'm re-installing the HDP, I'm unable to view the wizard page on Ambari UI screen. I'm with my old cluster details only. How can I view the wizard page?
... View more
05-08-2016
05:21 PM
1 Kudo
Hi Team, I've followed the below link to uninstall the ambari and hdp (ambari - 2.1.2.1 and hdp - 2.2.8.0) https://pulsatingtaurus.wordpress.com/2015/02/15/clean-uninstall-hortonworks-hdp-2-2/ After that, I followed below link and completed the steps till 2.3 - Start the Ambari Server section. http://docs.hortonworks.com/HDPDocuments/Ambari-2.1.0.0/bk_Installing_HDP_AMB/content/_start_the_ambari_server.html
I'm able to start the ambari-server successfully on the Server1. But, When I execute the below command on any of my hosts (host1, host2), I'm unable to see the packages related to agents. [root@host1 ~]# yum search ambari
Loaded plugins: product-id, security, subscription-manager
Setting up Upgrade Process
No Match for argument: ambari-agent
No package ambari-agent available.
No Packages marked for Update
Before un-installation of ambari and hdp... I used to get below output for the same command on all of my hosts (host1, host2). [root@host1 ~]# yum search ambari
Loaded plugins: product-id, security, subscription-manager
============================= N/S Matched: ambari =============================
ambari-agent.x86_64 : Ambari Agent
ambari-metrics-collector.x86_64 : Ambari Metrics Assembly
ambari-metrics-common.noarch : Ambari Metrics Common
ambari-metrics-hadoop-sink.x86_64 : Ambari Metrics Assembly
ambari-metrics-monitor.x86_64 : Ambari Metrics Assembly
ambari-server.x86_64 : Ambari Server
Please let me know and help me in this regards, 1) How to get agent, metrics etc packages on hosts (host1 & host2)? 2) How to re-install ambari-agents on all hosts? 3) How to re-install HDP using ambari UI freshly (I stopped all the services and then followed the link https://pulsatingtaurus.wordpress.com/2015/02/15/clean-uninstall-hortonworks-hdp-2-2/ to uninstall)? Regards, CPAT
... View more
Labels:
04-10-2016
02:47 PM
After remove, clean, update and reinstallation of repo... it worked for me. Thanks!!
... View more
04-09-2016
05:07 PM
Yes, this is on my ambari server node. yum repolist is showing below, on NameNode server. HDP-2.2.8.0 HDP Version - HDP-2.2.8.0 167+24 HDP-UTILS-1.1.0.20 HDP Utils Version - HDP-UTILS-1.1.0.20 43 Updates-ambari-2.1.2.1 ambari-2.1.2.1 - Updates 6 let me re-execute the steps, what you have mentioned.
... View more
04-09-2016
03:42 PM
Dear Team,
Hardware/Software Information:
I'm trying to install HDP2.2.8.0 using ambari2.1.2.1. RHEL6.5 and 64Bit is the OS.
I have configured password less ssh between nodes. So, not going with manual installation of ambari agent.
yum repolist is showing below, on NameNode server.
HDP-2.2.8.0 HDP Version - HDP-2.2.8.0 167+24
HDP-UTILS-1.1.0.20
HDP Utils Version - HDP-UTILS-1.1.0.20 43
Updates-ambari-2.1.2.1 ambari-2.1.2.1 - Updates 6
yum repolist is showing below, on my DataNode server.
Updates-ambari-2.1.2.1 ambari-2.1.2.1 - Updates
yum search ambari
is showing below, on my DataNode server.
ambari-agent.x86_64 : Ambari Agent This agent version is 2.1.2.1
PROBLEM:
During
Confirming the Hosts step using ambari, able to see the below error message
========================== Running setup agent script... ==========================
Command start time 2016-04-08 20:18:16
Desired version (2.2.0.0) of ambari-agent package is not available. Repository has following versions of ambari-agent:2.1.2.1,
Connection to datanode1.ddns.net closed.
SSH command execution finished
host=datanode1.ddns.net, exitcode=1
Command end time 2016-04-08 20:18:26
ERROR: Bootstrap of host datanode1.ddns.net fails because previous action finished with non-zero exit code (1)
ERROR MESSAGE: tcgetattr: Invalid argument
Connection to datanode1.ddns.net closed.
STDOUT: Desired version (2.2.0.0) of ambari-agent package is not available. Repository has following versions of ambari-agent:2.1.2.1,
Please help me in this regard and let me know where I went wrong and what is the solution for this issue.
Regards, PAT K2BigTech
... View more
Labels: