question Spark Hbase Connector for Spark 3.x and Scala 2.12.x in Support Questions

Spark Hbase Connector for Spark 3.x and Scala 2.12.x

BabaHer — Wed, 21 Jul 2021 13:30:04 GMT

There is no SHC available for Spark 3.x and Scala 2.12.x.

Why did Community stops support for the updated spark&scala version?

Is there any alternative opetion for Spark Hbase Connector for Spark 3.x?

Thanks in advance.!

Re: Spark Hbase Connector for Spark 3.x and Scala 2.12.x

smdas — Fri, 23 Jul 2021 09:05:53 GMT

Hello @BabaHer

Thanks for using Cloudera Community. It appears HBASE-25326 via [1] allows HBase Connector to be used for Spark v3.0 & the Git Page via [2] by the HBASE-25326 Owner offers Example as well.

- Smarak

[1] https://issues.apache.org/jira/browse/HBASE-25326

[2] https://github.com/LucaCanali/Miscellaneous/blob/master/Spark_Notes/Spark_HBase_Connector.md

Re: Spark Hbase Connector for Spark 3.x and Scala 2.12.x

RangaReddy — Fri, 30 Jul 2021 15:47:55 GMT

Hi @BabaHer

CDP onward to support Spark and HBase, cloudera is recommended to use hbase-spark jar.

https://mvnrepository.com/artifact/org.apache.hbase.connectors.spark/hbase-spark?repo=cloudera-repos

The latest hbase-spark jar version is 1.0.0.7.2.10.0-148.

To integrate Spark3 with Hbase you can find sample example below:

https://kontext.tech/column/spark/628/spark-connect-to-hbase