Hello @krishpuvi    Thanks for using Cloudera Community. Based on the Post, You wish to run HBase Major Compaction on a particular queue to ensure the Compaction activity doesn't impact other resources in the Cluster.    Please note that HBase Major Compaction isn't using any YARN managed resources & as such, We can't map Major Compaction to be run on any YARN Queue. You can restict MajorCompaction to use lesser bandwidth via [1] & [2], which explains the "PressureAwareCompactionThroughputController" with Min & Max Speed along with the Parameter to disable any Speed Limit via "NoLimitThroughputController". Additionally, You can disable Compaction & run Compaction manually during Off-Business-Hours at Table/ColumnFamiliy Level as well.    - Smarak   [1] https://docs.cloudera.com/cdp-private-cloud-base/7.1.6/configuring-hbase/topics/hbase-limit-the-speed-of-compactions.html [2] https://hbase.apache.org/devapidocs/org/apache/hadoop/hbase/regionserver/throttle/PressureAwareCompactionThroughputController.html   ... View more

Hello @proble    As we haven't received any response from your side, We shall be marking the Post as Resolved. Having said that, Please do share your experience with handling the concerned issue & whether the details shared by us assisted you.    In short, the HBase Table Creation is failing as Master hasn't completed Initialisation. You have to use HBCK2 Tool to assign the HBase:Meta & HBase:Namespace (Whichever isn't assigned as per Master Logs). Link [1] covers our response to the Post on 2021/05/31 with the Log trace to be verified in Master Logs & the Steps to be followed. We hope the Post was helpful to you & assisted in resolving the issue.    - Smarak   [1] https://community.cloudera.com/t5/Support-Questions/Error-while-creating-table-in-hbase/m-p/317429/highlight/true#M227161   ... View more

Hello @Aman_Patel_CV    Thanks for using Cloudera Community. Based on the Post, You would like to take HBase Table Backup in incremental fashion to S3.    Kindly use [1] for using Incremental Backup to S3, which list the Usage with S3 as Backup Path as well. Additionally, Customer may use Snapshot yet the Snapshot needs to be exported to S3 as covered via [2]. Link [3] also offers more details into S3 Backup Scenario available with S3 & HBase.    Let us know if the shared references assist you. Please report if you have any issues as well & we shall get back to you with the required details.   - Smarak   [1] https://hbase.apache.org/book.html#br.terminology [2] https://hbase.apache.org/book.html#snapshots_s3 [3] https://hbase.apache.org/book.html#br.s3.backup.scenario ... View more

Hello @JB0000000000001    Thanks for using Cloudera Community. This is an Old Post, as such I am unsure whether you have found the details being shared below.   Having said that, [1] by Cloudera HBase Team offers a few details of S3 Performance in the final paragrapgh. As mentioned in the concerned Paragraph, BucketCache is Critical for Performance & AWS suggest the same in [2] under "Operational considerations" Section.    In short, there are definitely areas for Performance Degradation yet there are few Links is LinkedIn Slideshare around Microsoft, Airbnb, Huawei HBase Usage on Cloud & they offer a lot of details into the Observation made & Optimisation performed. The Optimisation aren't always centered on HBase & pivot towards Cloud Infrastructure as well. Such Slideshare should offer additional insight to your Team.    Being an Old Post, We wish to check if your Team have come across findings, which can be shared with us. This would allow the Post to be used by fellow community Users, who may be considering the Cloud Storage Latency aspect as well.    - Smarak   [1] https://blog.cloudera.com/how-hbase-in-cdp-can-leverage-amazons-s3/ [2] https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-hbase-s3.html ... View more