Member since
08-08-2017
1652
Posts
30
Kudos Received
11
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 1916 | 06-15-2020 05:23 AM | |
| 15456 | 01-30-2020 08:04 PM | |
| 2069 | 07-07-2019 09:06 PM | |
| 8100 | 01-27-2018 10:17 PM | |
| 4569 | 12-31-2017 10:12 PM |
10-25-2017
04:45 AM
how to delete worker or kafka node from cluster by manual way because some times we cant delete the node from the ambari ( not clear why ) , and in this case we want to do the deletion by manual approach ( for example delete folder / users / rpm manual from the Linux machine )
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Hadoop
-
Apache Kafka
10-24-2017
09:20 AM
hi jay
just to clarify your instructions ( and regarding that standby name node on master01 and active node on master02
can you approve this steps
su - hdfs hdfs dfsadmin -safemode leave ( on master02 ) cp -rp /hadoop/hdfs/journal/hdfsha/current /hadoop/hdfs/journal/hdfsha/current.orig ( on master02 ) rm -f /hadoop/hdfs/journal/hdfsha/current/* ( on master02 )
hdfs namenode -bootstrapStandby ( on master01 )
... View more
10-24-2017
08:27 AM
we found this workaround - hadoop namenode -recover , is it other soultion for our problem ?
... View more
10-24-2017
06:08 AM
hi Jay still waiting to your answer , do you mean to do hdfs dfsadmin -safemode leave on the namenode that is runing ( master02 ) ? ( standby namenode is on master01 ) , second - Then take a backup of the directory "/hadoop/hdfs/namenode/current" should be on the active name node ? , I ask this because it is more logic to do this on standby ( master01 machine )
... View more
10-23-2017
06:50 PM
my active node is on master02 so I need to do the steps on master02 machine? ( include backup )
... View more
10-23-2017
06:22 PM
can you please show me how to bring safe mode out with forceExit on Active NN , bootstrapStandby.
... View more
10-23-2017
05:21 PM
we installed new HDP cluster version 2.6 meanwhile HDFS and yarn are down and when we start the HDFS we get: 2017-10-23 16:39:35,510 ERROR datanode.DataNode (DataNode.java:secureMain(2691)) - Exception in secureMain
org.apache.hadoop.util.DiskChecker$DiskErrorException: Too many failed volumes - current valid volumes: 0, volumes configured: 5, volumes failed: 5, volume fail
ures tolerated: 0
at org.apache.hadoop.hdfs.server.datanode.checker.StorageLocationChecker.check(StorageLocationChecker.java:216)
at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:2583)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:2492)
at org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:2539)
at org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:2684)
at org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:2708)
2017-10-23 16:39:35,512 INFO util.ExitUtil (ExitUtil.java:terminate(124)) - Exiting with status 1
2017-10-23 16:39:35,515 INFO datanode.DataNode (LogAdapter.java:info(47)) - SHUTDOWN_MSG: what we need to check in this case ?
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Hadoop
10-23-2017
05:15 PM
Is this a kerberized cluster? - what you mean we have 3 masters machine + 2 workers machines
... View more
10-23-2017
05:14 PM
Do you have the correct "etc/hosts" - yes
... View more
10-23-2017
05:12 PM
Was this Node working fine earlier - yes
... View more