Thanks for the info.  Just playing around with it a little, but looks like this will get what I need for the Data Visualization on CDP Public Cloud I am using. Thanks ... View more

Thank you for this very valuable input! (I had somehow missed the response). I see indeed increased latencies, but see that should be neglectable for hot data. I have observed this, but think there is a limit to how much data you can keep 'hot'. This depends on a combination of settings at the level of the hbase catalog properties and the hbcase cluster. We have discussed this also in following thread: https://community.cloudera.com/t5/Support-Questions/simplest-method-to-read-a-full-hbase-table-so-it-is-stored/m-p/317194#M227055 It would be very interesting if a more in depth study would ever be conducted and reported, as this is very relevant for applications with hbase as back-end that require some more advanced querying of the data (like in my case aggregations to compute a heatmap using a high volume of data points).     ... View more

Hi @BabaHer    CDP onward to support Spark and HBase, cloudera is recommended to use hbase-spark jar. https://mvnrepository.com/artifact/org.apache.hbase.connectors.spark/hbase-spark?repo=cloudera-repos   The latest hbase-spark jar version is 1.0.0.7.2.10.0-148.   To integrate Spark3 with Hbase you can find sample example below:   https://kontext.tech/column/spark/628/spark-connect-to-hbase ... View more

@michalm_ Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future.   ... View more

Follow-Update to tag @KR_IQ @sppandita85BLR as the Original Post is Old.  ... View more

Hello @mahfooz-iiitian    Please note that CDH Releases are End-Of-Support & CDP Releases aren't supporting Spark-HBase-Connector in favor of HBase-Spark-Connector as documented below. In short, Hortonworks Spark-HBase Connector isn't Supported yet in favor of HBase Connector for Spark.    -  Smarak   [1] https://issues.apache.org/jira/browse/HBASE-25326 [2] https://github.com/LucaCanali/Miscellaneous/blob/master/Spark_Notes/Spark_HBase_Connector.md [3] https://docs.cloudera.com/cdp-private-cloud/latest/data-migration/topics/cdp-data-migration-hbase-prepare-data-migration.html   ... View more

Hello @Chandresh    Hope you are doing well. We wish to confirm if you have identified the Cause of the issue. If Yes, Kindly share the same to benefit our fellow Community Users as well. If no further assistance required, Please mark the Post as Solved.    - Smarak ... View more

Hello @ryu    As mentioned by @arunek95, we assume Phoenix is enabled for the Cluster. If not, Kindly enable Phoenix & try the Command again.    The Logging indicates HDP v2.6.1.0 with Phoenix v4.7. The Directory "/usr/lib/phoenix/" has the Phoenix Client & you mentioned the same Directory has Phoenix Server Jar as well. Kindly verify if the Permission on the JAR is Correct & confirm via "jar -tvf" on the Phoenix Server Jar that the Class "MetaDataEndpointImpl" is included in the same.    The Error indicates the Phoenix creating the SYSTEM Tables (Upon 1st Connection to Phoenix) is encountering the Error. In our Internal Setup, We see the Phoenix-Server Jar is present in HBase Lib Path as well, pointing to the Phoenix-Server Jar in Phoenix Lib Path as SymLink: /usr/hdp/<Version>/hbase/lib/phoenix-server.jar -> /usr/hdp/<Version>/phoenix/phoenix-server.jar   Kindly ensure the Phoenix Server JAR is present in HBase Lib Directory as well. Additionally, Review the Master Logs to check for the Error Message at HBase Level as well.    - Smarak ... View more

Hello @gurucgi    This is an Old Post yet we wish to check if the issue has been addressed by you. If Yes, Please share the Steps to ensure fellow Community Users can benefit from your experience.    Based on the Post, SystemCatalogRegionObserver is being reported for Class not being loaded. The concerned Error is being received for Phoenix v5.1.1. In Cloudera, We are shipping with Phoenix v5.1.0 at the time of writing. I am not sure if you are being impacted via [1]. In short, the JAR seems to be requiring the Phoenix-Server Jar to be placed rightfully.    - Smarak   [1] https://issues.apache.org/jira/browse/PHOENIX-6330   ... View more

Hello @Satya_Singh    Do let us know if your issue has been resolved. If Yes, Please share the Mitigation Steps followed by you to ensure other Community Users can benefit from your experience & mark the Post as Resolved as well.    - Smarak ... View more