Member since
07-17-2019
738
Posts
433
Kudos Received
111
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2543 | 08-06-2019 07:09 PM | |
2797 | 07-19-2019 01:57 PM | |
3917 | 02-25-2019 04:47 PM | |
3967 | 10-11-2018 02:47 PM | |
1298 | 09-26-2018 02:49 PM |
08-07-2019
04:29 PM
I would start by assuming that no service which relies on HDFS can simply use S3 directly. S3Guard can likely bridge the gap for most systems (HBase is an exception), but I cannot tell you the requirements for every service in existence.
... View more
08-06-2019
07:09 PM
Blob stores do not have the same semantics as file systems. HBase relies on very specific semantics with respect to concurrency and atomic operations which most blob stores (including S3) do not provide. One example: a move of some "directory" in an S3 bucket is not atomic whereas this is atomic in HDFS. HBase will 100% not work correctly if you try to configure hbase.rootdir to use S3 via the S3A adapter in Hadoop. EMR has proprietary code in their S3 filesystem access layer, unique from S3A, which does not suffer from this issue somehow.
... View more
07-23-2019
01:42 PM
1 Kudo
You are running against a version of Hadoop which does not have the expected classes that HBase wants to check. I find it very unlikely that you are using Hadoop 3.1.2 on the HBase classpath. HBase relies on very specific semantics from the underlying filesystem to guarantee no data loss. This warning is telling you that HBase failed to make this automatic check and that you should investigate this to make sure that you don't experience data loss going forward.
... View more
07-19-2019
01:57 PM
HBase 0.94 and 0.95 are extremely old versions. You should not be using them any longer. In general, you should use the same exact version of client jars which match the HBase cluster version you are trying to interact with.
... View more
06-26-2019
02:51 PM
As my previous comment says, this is a benign warning message. It does not indicate any problem with the system. If you have RegionServers crashing, your problem lies elsewhere. Would suggest you contact support to help you identify this problem if you are having problems doing so.
... View more
06-06-2019
06:54 PM
Please share the code you are using to run this benchmark. If it is using some sensitive data, please reproduce it using non-sensitive data. Without seeing how you are executing the timings, it's near impossible to give any meaningful advice.
... View more
04-25-2019
02:41 PM
It's just a bug in HDP that the correct version is not being reported. There is no HBase issue to be concerned about.
... View more
02-25-2019
05:01 PM
Use a Scanner. You can't use Gets, as a Get requires you to know a rowKey.
... View more
02-25-2019
04:47 PM
1 Kudo
hbase(main):001:0> help 'scan'
Scan a table; pass table name and optionally a dictionary of scanner
specifications. Scanner specifications may include one or more of:
TIMERANGE, FILTER, LIMIT, STARTROW, STOPROW, ROWPREFIXFILTER, TIMESTAMP,
MAXLENGTH or COLUMNS, CACHE or RAW, VERSIONS, ALL_METRICS or METRICS
...
Some examples:
...
hbase> scan 't1', {COLUMNS => 'c1', TIMERANGE => [1303668804000, 1303668904000]}
... View more
01-29-2019
02:39 PM
You should look at the HBase Master log to understand why it has not yet become initialized on its own. Additionally, you may have to look at a JStack of the HBase Master process to help understand why it's stuck, if that's now obvious from the log itself.
... View more