Skip to main content
BabaHer
BabaHer
Bronze ⭐️⭐️⭐️
July 21, 2021
Question

Spark Hbase Connector for Spark 3.x and Scala 2.12.x

There is no SHC available for Spark 3.x and Scala 2.12.x.

Why did Community stops support for the updated spark&scala version?

Is there any alternative opetion for Spark Hbase Connector for Spark 3.x?

 

Thanks in advance.!

2 replies

smdas
Gold ⭐️⭐️
smdas
Gold ⭐️⭐️
July 23, 2021

Hello @BabaHer 

 

Thanks for using Cloudera Community. It appears HBASE-25326 via [1] allows HBase Connector to be used for Spark v3.0 & the Git Page via [2] by the HBASE-25326 Owner offers Example as well. 

 

- Smarak

 

[1] https://issues.apache.org/jira/browse/HBASE-25326

[2] https://github.com/LucaCanali/Miscellaneous/blob/master/Spark_Notes/Spark_HBase_Connector.md

 

Translate
RangaReddy
Gold ⭐️
RangaReddy
Gold ⭐️
July 30, 2021

Hi @BabaHer 

 

CDP onward to support Spark and HBase, cloudera is recommended to use hbase-spark jar.

https://mvnrepository.com/artifact/org.apache.hbase.connectors.spark/hbase-spark?repo=cloudera-repos

 

The latest hbase-spark jar version is 1.0.0.7.2.10.0-148.

 

To integrate Spark3 with Hbase you can find sample example below:

 

https://kontext.tech/column/spark/628/spark-connect-to-hbase

Translate
Terms & ConditionsAccessibility statement