Cloudera Community
mike_bronson7
user rank
Guru

Re: is it safe to remove the /tmp/hive/hive folder...

by Guru in Support Questions
‎06-16-2019 03:49 PM
‎06-16-2019 03:49 PM
we try the following to remove files that older then 10 days , but because there are so many files then files not deleted at all hdfs dfs -ls /tmp/hive/hive   |   tr -s " "    |    cut -d' ' -f6-8    |     grep "^[0-9]"    |    awk 'BEGIN{ MIN=14400; LAST=60*MIN; "date +%s" | getline NOW } { cmd="date -d'\''"$1" "$2"'\'' +%s"; cmd | getline WHEN; DIFF=NOW-WHEN; if(DIFF > LAST){ print "Deleting: "$3; system("hdfs dfs -rm -r "$3) }}' ... View more

is it safe to remove the /tmp/hive/hive folder?

by Guru in Support Questions
‎06-16-2019 03:47 PM
‎06-16-2019 03:47 PM
is it safe to remove the /tmp/hive/hive folder? ( from hdfs ) as hdfs dfs -rm -r /tmp/hive/hive the reason for that because under /tmp/hive/hive we have thousand of files and we cant delete therm hdfs dfs -ls /tmp/hive/ Found 7 items drwx------   - admin     hdfs          0 2019-03-05 12:00 /tmp/hive/admin drwx------   - drt   hdfs          0 2019-06-16 14:02 /tmp/hive/drt drwx------   - ambari-qa hdfs          0 2019-06-16 15:11 /tmp/hive/ambari-qa drwx------   - anonymous hdfs          0 2019-06-16 08:57 /tmp/hive/anonymous drwx------   - hdfs      hdfs          0 2019-06-13 08:42 /tmp/hive/hdfs drwx------   - hive      hdfs          0 2019-06-13 10:58 /tmp/hive/hive drwx------   - root      hdfs          0 2018-07-17 23:37 /tmp/hive/root You have mail in /var/spool/mail/root ... View more

Re: how to recover the edits_inprogress_xxxxxx fil...

by Guru in Support Questions
‎06-16-2019 05:32 AM
‎06-16-2019 05:32 AM
also I cant start the journal node ( on the bade namenode ) 2019-06-16 05:29:39,734 WARN  namenode.FSImage (EditLogFileInputStream.java:scanEditLog(359)) - Caught exception after scanning through 0 ops from /hadoop/hdfs/journal/hdfsha/current/edits_inprogress_0000000000018783114 while determining its valid length. Position was 1032192 java.io.IOException: Can't scan a pre-transactional edit log.         at org.apache.hadoop.hdfs.server.namenode.FSEditLogOp$LegacyReader.scanOp(FSEditLogOp.java:4974)         at org.apache.hadoop.hdfs.server.namenode.EditLogFileInputStream.scanNextOp(EditLogFileInputStream.java:245)         at org.apache.hadoop.hdfs.server.namenode.EditLogFileInputStream.scanEditLog(EditLogFileInputStream.java:355)         at org.apache.hadoop.hdfs.server.namenode.FileJournalManager$EditLogFile.scanLog(FileJournalManager.java:551)         at org.apache.hadoop.hdfs.qjournal.server.Journal.scanStorageForLatestEdits(Journal.java:192)         at org.apache.hadoop.hdfs.qjournal.server.Journal.<init>(Journal.java:152)         at org.apache.hadoop.hdfs.qjournal.server.JournalNode.getOrCreateJournal(JournalNode.java:90)         at org.apache.hadoop.hdfs.qjournal.server.JournalNode.getOrCreateJournal(JournalNode.java:99)         at org.apache.hadoop.hdfs.qjournal.server.JournalNodeRpcServer.getJournalState(JournalNodeRpcServer.java:127)         at org.apache.hadoop.hdfs.qjournal.protocolPB.QJournalProtocolServerSideTranslatorPB.getJournalState(QJournalProtocolServerSideTranslatorPB.java:118)         at org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocolProtos$QJournalProtocolService$2.callBlockingMethod(QJournalProtocolProtos.java:25415)         at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:640)         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:982)         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2351)         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2347)         at java.security.AccessController.doPrivileged(Native Method)         at javax.security.auth.Subject.doAs(Subject.java:422)         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1869)         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2347) 2019-06-16 05:29:39,734 WARN  namenode.FSImage (EditLogFileInputStream.java:scanEditLog(364)) - After resync, position is 1032192 ... View more

Re: how to recover the edits_inprogress_xxxxxx fil...

by Guru in Support Questions
‎06-16-2019 04:02 AM
‎06-16-2019 04:02 AM
@Geoffrey Shelton Okot no both namenode started as standby and then the namenode stooped ... View more

Re: how to recover the edits_inprogress_xxxxxx fil...

by Guru in Support Questions
‎06-14-2019 06:44 AM
‎06-14-2019 06:44 AM
so according to this info do you recommended to set the value as is ( 31 ) or other ? ... View more

Re: how to recover the edits_inprogress_xxxxxx fil...

by Guru in Support Questions
‎06-14-2019 06:43 AM
‎06-14-2019 06:43 AM
on the good name node we have the number 31 on the bad name node we have also the number 31 on the other journal node we have the number 28 ... View more

Re: how to recover the edits_inprogress_xxxxxx fil...

by Guru in Support Questions
‎06-14-2019 06:06 AM
‎06-14-2019 06:06 AM
@Geoffrey Shelton Okot - about cat last-promised-epoch , I have the number 31 in non working node , do you mean that I need to decrease it to 30? ... View more

Re: how to recover the edits_inprogress_xxxxxx fil...

by Guru in Support Questions
‎06-13-2019 10:05 PM
‎06-13-2019 10:05 PM
@Geoffrey Shelton Okot thank you so much for your effort and for your time , tomorrow I will do your steps , in spite I still not do the tests , I will choose your answer as accept , and if I have comments then I will share them , again many many thanks ... View more

how to recover the edits_inprogress_xxxxxx file ?

by Guru in Support Questions
‎06-13-2019 06:42 PM
‎06-13-2019 06:42 PM
hi all we have ambari cluster - HDP version - 2.6.4 on one of the master machine we cant start the name node and we notice that ls  /hadoop/hdfs/journal/hdfsha/current/ | grep edits_inprogress  edits_inprogress_0000000000018783114.empty we not have the edits_inprogress_xxxxxx file what we have is only the file - edits_inprogress_0000000000018783114.empty any idea how to recover the - edits_inprogress_xxxxxx file 2019-06-13 19:45:42,473 FATAL namenode.FSEditLog (JournalSet.java:mapJournalsAndReportErrors(398)) - Error: recoverUnfinalizedSegments failed for required journal (JournalAndStream(mgr=QJM to  java.io.IOException: Timed out waiting 120000ms for a quorum of nodes to respond.         at org.apache.hadoop.hdfs.qjournal.client.AsyncLoggerSet.waitForWriteQuorum(AsyncLoggerSet.java:137)         at org.apache.hadoop.hdfs.qjournal.client.QuorumJournalManager.createNewUniqueEpoch(QuorumJournalManager.java:183)         at org.apache.hadoop.hdfs.qjournal.client.QuorumJournalManager.recoverUnfinalizedSegments(QuorumJournalManager.java:436)         at org.apache.hadoop.hdfs.server.namenode.JournalSet$8.apply(JournalSet.java:624)         at org.apache.hadoop.hdfs.server.namenode.JournalSet.mapJournalsAndReportErrors(JournalSet.java:393)         at org.apache.hadoop.hdfs.server.namenode.JournalSet.recoverUnfinalizedSegments(JournalSet.java:621)         at org.apache.hadoop.hdfs.server.namenode.FSEditLog.recoverUnclosedStreams(FSEditLog.java:1521)         at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startActiveServices(FSNamesystem.java:1196)         at org.apache.hadoop.hdfs.server.namenode.NameNode$NameNodeHAContext.startActiveServices(NameNode.java:1951)         at org.apache.hadoop.hdfs.server.namenode.ha.ActiveState.enterState(ActiveState.java:61)         at org.apache.hadoop.hdfs.server.namenode.ha.HAState.setStateInternal(HAState.java:64)         at org.apache.hadoop.hdfs.server.namenode.ha.StandbyState.setState(StandbyState.java:49)         at org.apache.hadoop.hdfs.server.namenode.NameNode.transitionToActive(NameNode.java:1807)         at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.transitionToActive(NameNodeRpcServer.java:1656)         at org.apache.hadoop.ha.protocolPB.HAServiceProtocolServerSideTranslatorPB.transitionToActive(HAServiceProtocolServerSideTranslatorPB.java:107)         at org.apache.hadoop.ha.proto.HAServiceProtocolProtos$HAServiceProtocolService$2.callBlockingMethod(HAServiceProtocolProtos.java:4460)         at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:640)         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:982)         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2351)         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2347)         at java.security.AccessController.doPrivileged(Native Method)         at javax.security.auth.Subject.doAs(Subject.java:422)         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1869)         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2347) 2019-06-13 19:45:42,476 INFO  util.ExitUtil (ExitUtil.java:terminate(124)) - Exiting with status 1 ... View more

Re: How to purge old ambari metrics records

by Guru in Support Questions
‎05-13-2019 06:34 AM
‎05-13-2019 06:34 AM
I guess we need to stop the metrics collector service before we deleted the files - am I correct ? second - is it safe to do this approach ( deleting the files ? ) ... View more
Contact Me
Online
Offline
Last Visited
‎08-27-2024 09:17 AM
Community Statistics
Member Since ‎08-08-2017 09:40 AM
Last Visited ‎08-27-2024 09:17 AM
Posts 1,652
Kudos received 29