About smdas

smdas · ‎12-08-2020

Hello @Manoj690 Thanks for using Cloudera Community. Your concern is Phoenix Table created on top of a Restored Table isn't showing the Non-PrimaryKey Columns correctly. Can you share the Steps used by your Team to backup the Table & subsequent restore. Additionally, Whether the Backup & Restore are being performed within the same Cluster along with the Distribution being used (For Versioning Check). - Smarak

smdas · ‎12-08-2020

Hello @kvinod Thanks for using Cloudera Community. Your concern is HBase OldWALs on HDFS Path "/hbase/oldWALs" are occupying a lot of space. HBase Replication isn't being used & TTL is set to 1 Minute. The HMaster Trace Logs capture the CleanerChore with verbose logging, yet I wish to check if you have tried the following 2 options: 1. Restart the HMaster Service to confirm if any issues with CleanerChore, 2. The Parameter "hbase.replication" is set correctly to False via the Steps shared under Section [1]. 3. If the "/hbase/replication" has any entries. If no Replication is utilised (HBase Replication or Lily Indexer), Try removing the "/hbase/replication" ZNode & restart the HMaster Service. - Smarak [1] CM=> HBase=> Configuration=> Advanced=> HBase Service Advanced Configuration Snippet (Safety Valve) for hbase-site.xml

smdas · ‎12-02-2020

Hello @nanda_bigdata Sharing the Solution to ensure the Post is marked Completed. From WAL Reader, We confirmed the Writes to the RegionServer WAL pertains to 1 ColumnFamily only, indicating the Writes are arriving to 1 ColumnFamily only. It was confirmed that the wrong Hbase Configuration was being used by the Application. After ensuring the correct Hbase Configuration was used by Application, the issue was Fixed. - Smarak

smdas · ‎11-28-2020

Hello @ibr If you are referring to the Supported Database for CDP Private Cloud Base (Which is the SDX for Private Cloud Experience), the list of Supported Databases for CDP Private Cloud Base, wherein the Databases for Metadata, Authorisation is maintained is shared in the Link [1]. [1] https://docs.cloudera.com/cdp-private-cloud/latest/release-guide/topics/cdpdc-database-requirements.html

smdas · ‎11-22-2020

Hello @Manoj690 RegionServer is a Service & your team can add the RegionServer Service interactively using via Ambari (HDP) or Cloudera Manager (CDH or CDP). - Smarak

smdas · ‎11-12-2020

Hello @lenu If you have Replication enabled, WALs are likely to be persisted until the WALs are replicated. If you aren't using HBase Replication, Ensure there are no Peers (via "list_peers") & "hbase.replication" Property is false. If the oldWALs aren't removed, Enable TRACE Logging for the HBase Master Service, which would print the CleanerChore Thread removing or skipping any entries. - Smarak

smdas · ‎11-12-2020

Hello @ebythomaspanick It appears you are hitting HBASE-20616. If you have verified that no other Procedures are in RUNNABLE State (Except for Truncate & Enable for the concerned Table), Sidelining the MasterProcWALs & Clearing the Temp Directory "/apps/hbase/data/.tmp" would ensure the TruncateTableProcedure aren't retried. Stop the Masters (Active & Standby) during the concerned Step to avoid any issues. - Smarak

smdas · ‎11-12-2020

Hello @singhvNt It's an Old Post, yet answering the Query for posterity. MajorCompaction doesn't perform any Merging of Regions. Either Region Normalizer or MergeRegion Command merges the Regions. - Smarak

smdas · ‎11-12-2020

Hello @shubs If you have fixed the issue, Kindly update the Post with the Solution. The Exception is coming from DFSInputStream with EOFException. Worth checking if the RegionServer having issues has any Zero Length WAL File under the WAL Directory. Or, Enable TRACE Logging on the concerned RegionServer to capture additional details on the concerned Exception. Or, Checking which WAL is being replicated & any FS issues with the blocks associated with the WAL File. - Smarak

smdas · ‎11-12-2020

Hello @SimL YARN Timeline Server v2 Reader uses HBase for Storage. The Log & HBCK Report shows the Table "prod.timelineservice.entity" has Regions in OPENING State, which would naturally cause any Client accessing the Table report RetriesExhaustedWithDetailsException. A Region is typically stuck in OPENING State, if there is any issues with WALEditReplay or any other reason, which would be clear from the RegionServer Logs where the Region is being opened. Unless the RegionServer Logs are available, any Comment is unlikely to be an accurate assessment of the issue your team is facing. Would recommend checking the RegionServer Logs wherein the Regions are in OPENING State & based on the cause, plan accordingly. - Smarak

Online	Offline
Last Visited	‎04-15-2025 02:52 AM

Member Since	‎01-16-2018 09:55 AM
Last Visited	‎04-15-2025 02:52 AM
Posts	613
Kudos received	48

Cloudera Community

Re: Timeout: PBJ session not going idle

Re: Impact of Upgrading EKS from 1.29 to 1.31 on C...

Re: Capture airflow run duration

Re: How to enable IAM for apache airflow

Re: Apache Airflow can not connect to mssql 2008

Re: Phoenix table creation on top of restored hbas...

Re: OldWALs are not deleting

Re: Hbase Flush/writes not working for one of the ...

Re: Can we use as Greenplum database in CDP priva...

Re: Hbase regions in Transition count not decreasi...

Re: HBASE OldWals not deleting

Re: Hbase hung command

Re: Hbase region minimization

Re: Hbase Replication Issue

Re: ATSv2 HBase Application - The HBase applicatio...