Skip to main content
Kapkiai
Kapkiai
Bronze III
January 9, 2024
Solved

HBase Writes Fails With .FailedSanityCheckException

Hello Community,

I am getting below error on my HBase table. The table has been fine for close to a year until 2 days ago. What's the cause?

org.apache.nifi.hbase.PutHBaseRecord PutHBaseRecord[id=ee1b356c-aa58-13f5-ac63-84a796230216] Failed to put records to HBase.
org.apache.hadoop.hbase.client.RetriesExhaustedWithDetailsException: Failed 1 action: org.apache.hadoop.hbase.exceptions.FailedSanityCheckException: Requested row out of range for batchMutate on HRegion USAGE:DATA_TRANSPARENCY,a11ced068cb301a6c6c502932d686a05_20200621142500_189290_366,1676533563461.bbbebf59c6e4e9750e9f5825850d6f4f., startKey='a11ced068cb301a6c6c502932d686a05_20200621142500_189290_366', getEndKey()='a11f2100d30ecc142b4c0466c01797ad_20230202125000_129718_339', row='a1200e570c1a24fee95b1004dbff50eb_20240108193317_2079_8316'
at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:1041)
at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicBatchOp(RSRpcServices.java:959)

Anandh_S
Anandh_SAnswer
Gold ⭐️
January 9, 2024

This may be caused by holes in the region chain, that can be caused by regions not being assigned to any region server or they stuck in transition. Do you see any inconsistencies from hbck report for table USAGE:DATA_TRANSPARENCY?

View in thread

3 replies

VidyaSargur
Community Manager
VidyaSargur
Community Manager
January 9, 2024

Hi @Kapkiai Welcome to our community! To help you get the best possible answer, I have tagged in our HBase experts @smdas @PrathapKumar @rki_  who may be able to assist you further.

Please feel free to provide any additional information or details about your query, and we hope that you will find a satisfactory solution to your question.

Translate
Regards, Vidya Sargur, Community Manager Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
Anandh_S
Gold ⭐️
Anandh_SAnswer
Gold ⭐️
January 9, 2024

This may be caused by holes in the region chain, that can be caused by regions not being assigned to any region server or they stuck in transition. Do you see any inconsistencies from hbck report for table USAGE:DATA_TRANSPARENCY?

Translate
VidyaSargur
Community Manager
VidyaSargur
Community Manager
January 18, 2024

@Kapkiai Did the response assist in resolving your query? If it did, kindly mark the relevant reply as the solution, as it will aid others in locating the answer more easily in the future. 

Translate
Regards, Vidya Sargur, Community Manager Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
Terms & ConditionsAccessibility statement