Member since
01-16-2018
607
Posts
48
Kudos Received
106
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
529 | 05-06-2024 06:09 AM | |
747 | 05-06-2024 06:00 AM | |
781 | 05-06-2024 05:51 AM | |
793 | 05-01-2024 07:38 AM | |
855 | 05-01-2024 06:42 AM |
12-08-2020
06:20 AM
Hello @TGH Sharing the Steps for building the HBCK2 Jar using Git reference & additionally, refer the Post via [1] for the details on building HBCK2 Tool as well. - Smarak [1] https://community.cloudera.com/t5/Support-Questions/How-to-get-hbck2-tool-for-CDH-6-3-2/m-p/295867/highlight/true#M218004
... View more
12-08-2020
06:15 AM
Hello @ma_lie1 This is an Old Post, yet sharing the details to close the Post & for future reference. You can build the HBCK2 Tool from the HBCK2 Git Page. Sharing the Steps below (Expect git & maven to be installed). The Command Usage is documented via Link [1]: - Smarak [1] https://github.com/apache/hbase-operator-tools/tree/master/hbase-hbck2
... View more
12-08-2020
06:05 AM
Hello @TGH Thanks for using Cloudera Community. You had Region-In-Transition (RIT) & the HDFS Directory has been removed for the Regions along with the ZNode being removed, yet HBase reports RIT. You wish to fix the RIT issue by removing the Meta Table entries as RIT avoids Balancer run. In HBase v2 (CDH v6.3.x), the MasterProcWALs is critical for any Procedure, which are stuck or blocked. You mentioned a lot of procedures (Disable|Delete) being observed. The graceful manner for your Team to manage the requirement is to use the HBCK2 Tool. You can build the HBCK2 using the Link [1]. Next, You can use the HBCK2 Tool to bypass the Procedure (PIDs) associated with the Table, for which the Region Directories have been removed. Once any PID is bypassed, the HMaster UI Page (Locks & Procedures ) Section would show the PID as "Bypass". After ensuring the required PIDs are bypassed, Restart the HMaster Service & use the HBCK2 Tool to remove the Region entries in Meta, for which the HDFS Region Directories are removed. Use "bypass" & "extraRegionsInMeta" HBCK2 Command as documented in Link [1]. Alternatively, You can Stop HMaster > Remove MasterProcWALs (After confirming no RUNNABLE Procedures excluding the PID associated with the Table for which Region Directory have been removed) > Start HMaster. However, this isn't an ideal approach & you can encounter "Master Is Initialising" issue, for which HBCK2 Tool is required. The "Master Is Initialising" context is captured in Link [1] as well. - Smarak [1] https://github.com/apache/hbase-operator-tools/tree/master/hbase-hbck2
... View more
12-08-2020
05:48 AM
Hello @kvinod Thanks for the Update. The Replication ZNode being created is expected after restart. The Checkbox concerning HBase Replication being left unchecked indicates Replication being disabled yet I have observed couple of cases wherein a CM Config wasn't passed to Service Level, causing certain unexpected behaviour. The explicit addition of the Parameter was to ensure the Service (HBase in this case) is aware of the Configuration. Or, Master Restart (Performed via HBase Restart) may have resolved the issue, by spawning a new CleanerChoreThread. As such, the issue is likely with the HBase Service being unaware of Replication being disabled or HMaster CleanerChore Thread. By explicitly adding the HBase Replication as False & restarting the HBase Service, We covered the 2 possibilities. - Smarak Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
... View more
12-08-2020
03:29 AM
Hello @Manoj690 Thanks for using Cloudera Community. Your concern is Phoenix Table created on top of a Restored Table isn't showing the Non-PrimaryKey Columns correctly. Can you share the Steps used by your Team to backup the Table & subsequent restore. Additionally, Whether the Backup & Restore are being performed within the same Cluster along with the Distribution being used (For Versioning Check). - Smarak
... View more
12-08-2020
03:23 AM
Hello @kvinod Thanks for using Cloudera Community. Your concern is HBase OldWALs on HDFS Path "/hbase/oldWALs" are occupying a lot of space. HBase Replication isn't being used & TTL is set to 1 Minute. The HMaster Trace Logs capture the CleanerChore with verbose logging, yet I wish to check if you have tried the following 2 options: 1. Restart the HMaster Service to confirm if any issues with CleanerChore, 2. The Parameter "hbase.replication" is set correctly to False via the Steps shared under Section [1]. 3. If the "/hbase/replication" has any entries. If no Replication is utilised (HBase Replication or Lily Indexer), Try removing the "/hbase/replication" ZNode & restart the HMaster Service. - Smarak [1] CM=> HBase=> Configuration=> Advanced=> HBase Service Advanced Configuration Snippet (Safety Valve) for hbase-site.xml
... View more
12-02-2020
09:46 PM
1 Kudo
Hello @nanda_bigdata
Sharing the Solution to ensure the Post is marked Completed. From WAL Reader, We confirmed the Writes to the RegionServer WAL pertains to 1 ColumnFamily only, indicating the Writes are arriving to 1 ColumnFamily only. It was confirmed that the wrong Hbase Configuration was being used by the Application. After ensuring the correct Hbase Configuration was used by Application, the issue was Fixed.
- Smarak
... View more
11-28-2020
06:52 AM
Hello @ibr If you are referring to the Supported Database for CDP Private Cloud Base (Which is the SDX for Private Cloud Experience), the list of Supported Databases for CDP Private Cloud Base, wherein the Databases for Metadata, Authorisation is maintained is shared in the Link [1]. [1] https://docs.cloudera.com/cdp-private-cloud/latest/release-guide/topics/cdpdc-database-requirements.html
... View more
11-22-2020
09:28 PM
Hello @Manoj690 RegionServer is a Service & your team can add the RegionServer Service interactively using via Ambari (HDP) or Cloudera Manager (CDH or CDP). - Smarak
... View more
11-12-2020
10:51 AM
Hello @lenu If you have Replication enabled, WALs are likely to be persisted until the WALs are replicated. If you aren't using HBase Replication, Ensure there are no Peers (via "list_peers") & "hbase.replication" Property is false. If the oldWALs aren't removed, Enable TRACE Logging for the HBase Master Service, which would print the CleanerChore Thread removing or skipping any entries. - Smarak
... View more