Member since
09-29-2015
94
Posts
117
Kudos Received
35
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2469 | 08-04-2017 06:13 PM | |
5432 | 03-21-2017 08:00 PM | |
2497 | 11-30-2016 07:38 PM | |
1279 | 11-03-2016 05:56 PM | |
2639 | 10-11-2016 06:44 PM |
09-09-2016
07:03 PM
What Artem says. Plus please DO NOT use any HBase version lower than 0.98 or better HBase-1.1. HBase-0.90 is at least 6 years old if not more.
... View more
09-06-2016
09:50 PM
2 Kudos
A region will not split, if there is already a set of "reference files". A reference file is a soft link to "half of" some other hfile. When a region splits, there would be two daughter regions, which have these reference files, referring to the parent. This scheme ensures that region splits are quick, and never re-writes the entire region data during the split. A region will NEVER split if there are reference files lying around still referring to its parents. Reference files normally get cleaned out by compaction. Once the compaction re-writes the file, the reference files will be deleted and the region can split again. If you use case bulk loads every 10 seconds or so, then there is probably A LOT Of small files being written and immense compaction pressure resulting in compactions not going through, and hence blocking further splits in the region. I recommend reducing the frequency of bulk loads, optimizing compaction file limits to be higher and in general keeping the compaction queue not full.
... View more
08-24-2016
12:44 PM
5 Kudos
You do not have to worry about TTL by default unless you are explicitly setting the value. By default TTL will be 'FOREVER' which will never delete data as expected.
... View more
08-23-2016
01:33 PM
2 Kudos
You can take a look at the Apache Nutch project: https://nutch.apache.org/
... View more
08-05-2016
05:34 PM
1 Kudo
@randy is right. TableSnapshotInputFormat is the IF to use to be able to read from an HBase snapshot. You can pass a Scan object which you can configure with your Filters, or timestamp predicates to do the filtering for you.
... View more
07-29-2016
06:22 PM
1 Kudo
If you have a live cluster, you can take a look at the catalog from Phoenix. You can either query the SYSTEM.CATALOG table, or use !tables, etc kind of commands to check the catalog.
... View more
07-29-2016
06:15 PM
The best summary of the backup status and what is coming in HDP-2.5 is here: https://hortonworks.com/blog/coming-hdp-2-5-incremental-backup-restore-apache-hbase-apache-phoenix/
... View more
07-15-2016
05:18 PM
What Rajesh said above is right. You can use hbase hbck -repair to automatically fix the issue. In recent versions of HDP-2.4, you should not have experienced the bug that might cause this, but there maybe something else wrong. Did you check whether HDFS is healthy?
... View more
07-14-2016
11:47 PM
Maybe a typo: "our_apps_user" is given permission, versus you are kinit'ing with "our_app_user".
... View more
06-17-2016
05:45 PM
2 Kudos
In newer versions of the HBase, you can use status 'detailed'
which will print the active master, backup masters as well as regionservers.
... View more