Member since
05-22-2016
29
Posts
2
Kudos Received
2
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 2315 | 10-16-2017 08:40 PM | |
| 7904 | 02-24-2017 01:23 AM |
08-28-2019
04:19 AM
Deal all.
CM has below query to draw "Total slow get operations across RegionServers"
SELECT integral(total_slow_get_rate_across_regionservers) WHERE entityName = "hbase" AND category = SERVICE
What are the criteria for slow? 1sec ? or hbase.ipc.warn.response.time?
Thanks in advance
... View more
Labels:
- Labels:
-
Apache HBase
-
Cloudera Manager
05-29-2019
12:46 AM
dear all. I'm trying to initiate replication. My situation is same as below. https://www.cloudera.com/documentation/enterprise/5-13-x/topics/cdh_bdr_hbase_replication.html#topic_20_11_7 Start replication. Add the destination cluster as a peer and immediately disable it using disable_peer. On the source cluster, take a snapshot of the table and export it. The snapshot command flushes the table from memory for you. On the destination cluster, import and restore the snapshot. Run enable_peer to re-enable the destination cluster. Source cluster has 40TB of table and to export snapshot to target cluster it will take 15 hours. Is the changes (wal or replication queue) for this 15 hours will not be deleted? Thanks.
... View more
- Tags:
- HBase
- replication
- wal
Labels:
- Labels:
-
Apache HBase
09-19-2018
12:32 AM
@bgooley Thank you for your feedback. It was mistake inputting password. Now solved the problem. Sorry and Thank you again.
... View more
09-11-2018
02:28 AM
Hello. I have configured hue to integrate ldap login. And suceeded 'Test LDAP Configuration' from Hue's Action Menu. But When I try to login with ldap user on hue webui login I failed with 'incorrect username or password'. What should I have to check ? And the login page does not display LDAP select box. Just only displayed username and password box. Thanks.
... View more
Labels:
- Labels:
-
Cloudera Hue
07-03-2018
08:23 PM
Got it! Thank you for the explanation.
... View more
07-03-2018
07:43 PM
Dear Harsh J Thank you very much. Very helpful. One more questions about changing hfile format. After change hfile format version, is it rewrite all of hfile to new version format? Or Just be applied only newly created hfile? Thanks.
... View more
07-03-2018
02:54 AM
1 Kudo
Hello ~ I'm looking for the solution of below symtoms. Anyone who knows the solution ? Thanks . Environment : CDH 5.14 (HBase 1.2) -- create test table
create 'jkkim','f'
-- put an sample data
put 'jkkim','row2','f:name','jonggyun Kim2'
-- put another sample data with TTL
put 'jkkim','row4','f:name','jonggyun Kim',{TTL => 10000}
-- scan after 15 seconds
scan 'jkkim'
-- row4 does not shown result (expected)
ROW COLUMN+CELL
row2 column=f:name, timestamp=1530609778641, value=jonggyun Kim2
1 row(s) in 0.0120 seconds
--put sample data again with TTL
put 'jkkim','row4','f:name','jonggyun Kim',{TTL => 10000}
-- Run manually flush command
flush 'jkkim'
--scan after 15 seconds
scan 'jkkim'
-- row4 is shown result (not expected)
ROW COLUMN+CELL
row2 column=f:name, timestamp=1530609778641, value=jonggyun Kim2
row4 column=f:name, timestamp=1530609975940, value=jonggyun Kim
... View more
- Tags:
- TTL
Labels:
- Labels:
-
Apache HBase
02-08-2018
10:37 PM
Hello ~
I can't solve the below issue, plz help me.
hadoop jar /opt/cloudera/parcels/CDH/lib/hadoop-0.20-mapreduce/hadoop-examples.jar pi 10 10000
Number of Maps = 10
Samples per Map = 10000
Wrote input for Map #0
Wrote input for Map #1
Wrote input for Map #2
Wrote input for Map #3
Wrote input for Map #4
Wrote input for Map #5
Wrote input for Map #6
Wrote input for Map #7
Wrote input for Map #8
Wrote input for Map #9
Starting Job
18/02/09 15:23:14 INFO client.RMProxy: Connecting to ResourceManager at kerberos001-hbase-db.testinfra-dev.com/10.127.86.45:8032
18/02/09 15:23:14 INFO hdfs.DFSClient: Created token for vincent: HDFS_DELEGATION_TOKEN owner=vincent@TEST.COM, renewer=yarn, realUser=, issueDate=1518157394188, maxDate=1518762194188, sequenceNumber=9, masterKeyId=117 on 10.127.86.45:8020
18/02/09 15:23:14 INFO security.TokenCache: Got dt for hdfs://kerberos001-hbase-db.testinfra-dev.com:8020; Kind: HDFS_DELEGATION_TOKEN, Service: 10.127.86.45:8020, Ident: (token for vincent: HDFS_DELEGATION_TOKEN owner=vincent@TEST.COM, renewer=yarn, realUser=, issueDate=1518157394188, maxDate=1518762194188, sequenceNumber=9, masterKeyId=117)
18/02/09 15:23:14 INFO input.FileInputFormat: Total input paths to process : 10
18/02/09 15:23:14 INFO mapreduce.JobSubmitter: number of splits:10
18/02/09 15:23:14 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1518080546056_0001
18/02/09 15:23:14 INFO mapreduce.JobSubmitter: Kind: HDFS_DELEGATION_TOKEN, Service: 10.127.86.45:8020, Ident: (token for vincent: HDFS_DELEGATION_TOKEN owner=vincent@TEST.COM, renewer=yarn, realUser=, issueDate=1518157394188, maxDate=1518762194188, sequenceNumber=9, masterKeyId=117)
18/02/09 15:23:15 INFO impl.YarnClientImpl: Submitted application application_1518080546056_0001
18/02/09 15:23:15 INFO mapreduce.Job: The url to track the job: http://kerberos001-hbase-db.testinfra-dev.com:8088/proxy/application_1518080546056_0001/
18/02/09 15:23:15 INFO mapreduce.Job: Running job: job_1518080546056_0001
18/02/09 15:23:27 INFO mapreduce.Job: Job job_1518080546056_0001 running in uber mode : false
18/02/09 15:23:27 INFO mapreduce.Job: map 0% reduce 0%
18/02/09 15:23:27 INFO mapreduce.Job: Job job_1518080546056_0001 failed with state FAILED due to: Application application_1518080546056_0001 failed 2 times due to AM Container for appattempt_1518080546056_0001_000002 exited with exitCode: 1
For more detailed output, check application tracking page:http://kerberos001-hbase-db.testinfra-dev.com:8088/proxy/application_1518080546056_0001/Then, click on links to logs of each attempt.
Diagnostics: Exception from container-launch.
Container id: container_1518080546056_0001_02_000001
Exit code: 1
Stack trace: ExitCodeException exitCode=1:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:601)
at org.apache.hadoop.util.Shell.run(Shell.java:504)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:786)
at org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor.launchContainer(LinuxContainerExecutor.java:373)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Shell output: main : command provided 1
main : run as user is vincent
main : requested yarn user is vincent
Writing to tmp file /dfs/yarn/nm/nmPrivate/application_1518080546056_0001/container_1518080546056_0001_02_000001/container_1518080546056_0001_02_000001.pid.tmp
Container exited with a non-zero exit code 1
Failing this attempt. Failing the application.
18/02/09 15:23:27 INFO mapreduce.Job: Counters: 0
Job Finished in 13.602 seconds
java.io.FileNotFoundException: File does not exist: hdfs://kerberos001-hbase-db.testinfra-dev.com:8020/user/vincent/QuasiMonteCarlo_1518157392185_124408720/out/reduce-out
at org.apache.hadoop.hdfs.DistributedFileSystem$20.doCall(DistributedFileSystem.java:1266)
at org.apache.hadoop.hdfs.DistributedFileSystem$20.doCall(DistributedFileSystem.java:1258)
at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1258)
at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1820)
at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1844)
at org.apache.hadoop.examples.QuasiMonteCarlo.estimatePi(QuasiMonteCarlo.java:314)
at org.apache.hadoop.examples.QuasiMonteCarlo.run(QuasiMonteCarlo.java:354)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.examples.QuasiMonteCarlo.main(QuasiMonteCarlo.java:363)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:71)
at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)
at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:74)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
user : vincent
-- os account
cat /etc/passwd |grep vincent vincent:x:11002:11102::/home/vincent:/bin/bash
-- hdfs user directory
hdfs dfs -ls /user |grep vincent drwxr-xr-x - vincent supergroup 0 2018-02-09 15:23 /user/vincent
klist Ticket cache: FILE:/tmp/krb5cc_p29242 Default principal: vincent@TEST.COM
Valid starting Expires Service principal 02/09/18 15:22:57 02/10/18 15:22:57 krbtgt/TEST.COM@TEST.COM renew until 02/16/18 15:22:57
Kerberos 4 ticket cache: /tmp/tkt0 klist: You have no tickets cached
... View more
Labels:
- Labels:
-
Apache YARN
-
HDFS
-
Kerberos
-
MapReduce
-
Security
10-16-2017
07:52 PM
Dear all. I'm trying to enable kerberos for cluster but I have got some errors below. Anyone who know what is wrong ? /usr/share/cmf/bin/import_credentials.sh failed with exit code 127 and output of <<
+ export PATH=/usr/kerberos/bin:/usr/kerberos/sbin:/usr/lib/mit/sbin:/usr/sbin:/usr/lib/mit/bin:/usr/bin:/sbin:/usr/sbin:/bin:/usr/bin
+ PATH=/usr/kerberos/bin:/usr/kerberos/sbin:/usr/lib/mit/sbin:/usr/sbin:/usr/lib/mit/bin:/usr/bin:/sbin:/usr/sbin:/bin:/usr/bin
+ KEYTAB_OUT=/var/run/cloudera-scm-server/cmf3579156749802764271.keytab
+ USER=cloudera-scm/admin@HBASE.ITSC.COM
+ PASSWD='REDACTED'
+ KVNO=1
+ SLEEP=0
+ RHEL_FILE=/etc/redhat-release
+ '[' -f /etc/redhat-release ']'
+ set +e
+ grep Tikanga /etc/redhat-release
+ '[' 1 -eq 0 ']'
+ '[' 0 -eq 0 ']'
+ grep 'CentOS release 5' /etc/redhat-release
+ '[' 1 -eq 0 ']'
+ '[' 0 -eq 0 ']'
+ grep 'Scientific Linux release 5' /etc/redhat-release
+ '[' 1 -eq 0 ']'
+ set -e
+ '[' -z /etc/krb5.conf ']'
+ echo 'Using custom config path '\''/etc/krb5.conf'\'', contents below:'
+ cat /etc/krb5.conf
+ IFS=' '
+ read -a ENC_ARR
+ for ENC in '"${ENC_ARR[@]}"'
+ ktutil
+ echo 'addent -password -p cloudera-scm/admin@HBASE.ITSC.COM -k 1 -e aes256-cts:normal'
+ '[' 0 -eq 1 ']'
+ echo 'REDACTED'
+ echo 'wkt /var/run/cloudera-scm-server/cmf3579156749802764271.keytab'
ktutil: relocation error: ktutil: symbol krb5_enctype_to_name, version k5crypto_3_MIT not defined in file libk5crypto.so.3 with link time reference
... View more
Labels:
- Labels:
-
Kerberos
02-24-2017
01:23 AM
1 Kudo
I tested this again. "Restarting JN which is in the same machine of NN occurs NN fail" was my misunderstanding. The cause of problem is below I thnik. When the JN is restarted, the editlog file known to NN's QJM is no longer available (invalid) You can not record changes to this JN until the edit log is rolled and a new log file is created. After the JN restart, it takes about 3 minutes for the editlog to roll and transition to a usable state. When restarting JN, restart one of them and immediately restart the other. If two JNs can not write, they will stop NN. So, If I restarted JN with interval (about 5 minutes), this can not happen.
... View more
02-20-2017
01:30 AM
dear all. My cluster is configured as below 2 NN 3 JN 2 Failovercontroller 20 DN For maintainence reason, I had to restart all component of our hadoop cluster. When I restarted a JN (this JN is in the same machine of NN), NN failovered. below is the NN's log This log says it failed because it failed writing to majority. I'd like to know why can't write to JN. Thanks. 2017-02-17 11:18:04,266 INFO BlockStateChange: BLOCK* BlockManager: ask xxx.xxx.xx.192:50010 to delete [blk_1073833801_92991]
2017-02-17 11:18:04,267 INFO BlockStateChange: BLOCK* BlockManager: ask xxx.xxx.xx.191:50010 to delete [blk_1073833801_92991]
2017-02-17 11:18:07,267 INFO BlockStateChange: BLOCK* BlockManager: ask xxx.xxx.xx.189:50010 to delete [blk_1073833801_92991]
2017-02-17 11:18:30,896 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Rescanning after 30001 milliseconds
2017-02-17 11:18:30,898 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Scanned 0 directive(s) and 0 block(s) in 1 millisecond( s).
2017-02-17 11:19:00,897 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Rescanning after 30000 milliseconds
2017-02-17 11:19:00,898 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Scanned 0 directive(s) and 0 block(s) in 2 millisecond( s).
2017-02-17 11:19:01,314 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: Number of transactions: 8 Total time for transactions(ms): 4 Number of transactions batched in Syncs: 2 Number of syncs: 5 SyncTimes(ms): 23 6
2017-02-17 11:19:01,354 WARN org.apache.hadoop.hdfs.qjournal.client.QuorumJournalManager: Remote journal xxx.xxx.xx.188:8485 failed to write txns 679604-679604. Will try to write to this JN again after the next log roll.
org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.qjournal.protocol.JournalOutOfSyncException): Can't write, no segment open
at org.apache.hadoop.hdfs.qjournal.server.Journal.checkSync(Journal.java:485)
at org.apache.hadoop.hdfs.qjournal.server.Journal.journal(Journal.java:354)
at org.apache.hadoop.hdfs.qjournal.server.JournalNodeRpcServer.journal(JournalNodeRpcServer.java:149)
at org.apache.hadoop.hdfs.qjournal.protocolPB.QJournalProtocolServerSideTranslatorPB.journal(QJournalProtocolServerSideTranslatorPB.java:158)
at org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocolProtos$QJournalProtocolService$2.callBlockingMethod(QJournalProtocolProtos.java:25421)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:617)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1073)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2216)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2212)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1796)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2210)
at org.apache.hadoop.ipc.Client.call(Client.java:1472)
at org.apache.hadoop.ipc.Client.call(Client.java:1409)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:230)
at com.sun.proxy.$Proxy18.journal(Unknown Source)
at org.apache.hadoop.hdfs.qjournal.protocolPB.QJournalProtocolTranslatorPB.journal(QJournalProtocolTranslatorPB.java:167)
at org.apache.hadoop.hdfs.qjournal.client.IPCLoggerChannel$7.call(IPCLoggerChannel.java:385)
at org.apache.hadoop.hdfs.qjournal.client.IPCLoggerChannel$7.call(IPCLoggerChannel.java:378)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2017-02-17 11:19:01,776 WARN org.apache.hadoop.hdfs.qjournal.client.QuorumJournalManager: Remote journal xxx.xxx.xx.190:8485 failed to write txns 679604-679604. Will try to write to this JN again after the next log roll.
org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.qjournal.protocol.JournalOutOfSyncException): Can't write, no segment open
at org.apache.hadoop.hdfs.qjournal.server.Journal.checkSync(Journal.java:485)
at org.apache.hadoop.hdfs.qjournal.server.Journal.journal(Journal.java:354)
at org.apache.hadoop.hdfs.qjournal.server.JournalNodeRpcServer.journal(JournalNodeRpcServer.java:149)
at org.apache.hadoop.hdfs.qjournal.protocolPB.QJournalProtocolServerSideTranslatorPB.journal(QJournalProtocolServerSideTranslatorPB.java:158)
at org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocolProtos$QJournalProtocolService$2.callBlockingMethod(QJournalProtocolProtos.java:25421)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:617)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1073)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2216)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2212)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1796)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2210)
at org.apache.hadoop.ipc.Client.call(Client.java:1472)
at org.apache.hadoop.ipc.Client.call(Client.java:1409)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:230)
at com.sun.proxy.$Proxy18.journal(Unknown Source)
at org.apache.hadoop.hdfs.qjournal.protocolPB.QJournalProtocolTranslatorPB.journal(QJournalProtocolTranslatorPB.java:167)
at org.apache.hadoop.hdfs.qjournal.client.IPCLoggerChannel$7.call(IPCLoggerChannel.java:385)
at org.apache.hadoop.hdfs.qjournal.client.IPCLoggerChannel$7.call(IPCLoggerChannel.java:378)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2017-02-17 11:19:01,779 FATAL org.apache.hadoop.hdfs.server.namenode.FSEditLog: Error: flush failed for required journal (JournalAndStream(mgr=QJM to [xxx.xxx.xx.188:8485, xxx.xxx.xx.190:8485, xxx.xxx.xx.193:8485], stream=QuorumOutputStream starting at txid 679597))
org.apache.hadoop.hdfs.qjournal.client.QuorumException: Got too many exceptions to achieve quorum size 2/3. 1 successful responses:
xxx.xxx.xx.193:8485: null [success]
2 exceptions thrown:
xxx.xxx.xx.190:8485: Can't write, no segment open
at org.apache.hadoop.hdfs.qjournal.server.Journal.checkSync(Journal.java:485)
at org.apache.hadoop.hdfs.qjournal.server.Journal.journal(Journal.java:354)
at org.apache.hadoop.hdfs.qjournal.server.JournalNodeRpcServer.journal(JournalNodeRpcServer.java:149)
at org.apache.hadoop.hdfs.qjournal.protocolPB.QJournalProtocolServerSideTranslatorPB.journal(QJournalProtocolServerSideTranslatorPB.java:158)
at org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocolProtos$QJournalProtocolService$2.callBlockingMethod(QJournalProtocolProtos.java:25421)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:617)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1073)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2216)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2212)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1796)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2210)
xxx.xxx.xx.188:8485: Can't write, no segment open
at org.apache.hadoop.hdfs.qjournal.server.Journal.checkSync(Journal.java:485)
at org.apache.hadoop.hdfs.qjournal.server.Journal.journal(Journal.java:354)
at org.apache.hadoop.hdfs.qjournal.server.JournalNodeRpcServer.journal(JournalNodeRpcServer.java:149)
at org.apache.hadoop.hdfs.qjournal.protocolPB.QJournalProtocolServerSideTranslatorPB.journal(QJournalProtocolServerSideTranslatorPB.java:158)
at org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocolProtos$QJournalProtocolService$2.callBlockingMethod(QJournalProtocolProtos.java:25421)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:617)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1073)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2216)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2212)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1796)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2210)
at org.apache.hadoop.hdfs.qjournal.client.QuorumException.create(QuorumException.java:81)
at org.apache.hadoop.hdfs.qjournal.client.QuorumCall.rethrowException(QuorumCall.java:223)
at org.apache.hadoop.hdfs.qjournal.client.AsyncLoggerSet.waitForWriteQuorum(AsyncLoggerSet.java:142)
at org.apache.hadoop.hdfs.qjournal.client.QuorumOutputStream.flushAndSync(QuorumOutputStream.java:107)
at org.apache.hadoop.hdfs.server.namenode.EditLogOutputStream.flush(EditLogOutputStream.java:113)
at org.apache.hadoop.hdfs.server.namenode.EditLogOutputStream.flush(EditLogOutputStream.java:107)
at org.apache.hadoop.hdfs.server.namenode.JournalSet$JournalSetOutputStream$8.apply(JournalSet.java:533)
at org.apache.hadoop.hdfs.server.namenode.JournalSet.mapJournalsAndReportErrors(JournalSet.java:393)
at org.apache.hadoop.hdfs.server.namenode.JournalSet.access$100(JournalSet.java:57)
at org.apache.hadoop.hdfs.server.namenode.JournalSet$JournalSetOutputStream.flush(JournalSet.java:529)
at org.apache.hadoop.hdfs.server.namenode.FSEditLog.logSync(FSEditLog.java:651)
at org.apache.hadoop.hdfs.server.namenode.FSEditLog.logSync(FSEditLog.java:585)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startFileInt(FSNamesystem.java:2752)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startFile(FSNamesystem.java:2624)
at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.create(NameNodeRpcServer.java:599)
at org.apache.hadoop.hdfs.server.namenode.AuthorizationProviderProxyClientProtocol.create(AuthorizationProviderProxyClientProtocol.java:112)
at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.create(ClientNamenodeProtocolServerSideTranslatorPB.java:401)
at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java )
at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:617)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1073)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2216)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2212)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1796)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2210)
2017-02-17 11:19:01,781 WARN org.apache.hadoop.hdfs.qjournal.client.QuorumJournalManager: Aborting QuorumOutputStream starting at txid 679597
2017-02-17 11:19:01,788 INFO org.apache.hadoop.util.ExitUtil: Exiting with status 1
2017-02-17 11:19:01,795 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode at abc.db.co/xxx.xxx.xx.190
... View more
Labels:
- Labels:
-
HDFS
02-13-2017
01:17 AM
Dear all. Now I'm using CDH5.9.1 and I hope to upgrade the new version (5.10). How can I upgrade CDH 5.10 from 5.9.1 ? I tried by "cluster upgrade" pull down menu of Cluster but didn't appeared cdh 5.10 in the list of candidate. Thanks
... View more
- Tags:
- Upgrade 5.10
Labels:
- Labels:
-
Cloudera Manager
01-17-2017
05:21 PM
Dear surajacharya. Thanks , very helpful!!! Have a good day!
... View more
01-17-2017
12:30 AM
Dear all. I want to know about whether if cdh 5.9 applied the patches for HBASE-16132 bug . https://issues.apache.org/jira/browse/HBASE-16132 And Can I check what the list of patches for some CDH versions somewhere ? Thanks.
... View more
- Tags:
- HBASE-16132
- Scan
Labels:
- Labels:
-
Apache HBase
