Support Questions
Find answers, ask questions, and share your expertise

Spark Hbase connector latest version for Spark 1.6.1 version

Explorer

Is there any maven repository for Spark Hbase connector [https://github.com/hortonworks-spark/shc], which is compatible with Spark 1.6.1 and Hbase 1.1.2?

Or i have to build the jar from Git Hub? https://github.com/hortonworks-spark/shc/blob/master/pom.xml.

If i have to build the jar from Git, is the above Git link is the correct one?

Since we are using HDP 2.4.2 is it available in the HDP Distribution some where? or should i use the spark-packages.

I cannot use 0.0.11-1.6.1-s_2.10 this version, because the hbase connection leak is fixed after this version as per this pull request https://github.com/hortonworks-spark/shc/issues/19

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Spark Hbase connector latest version for Spark 1.6.1 version

Expert Contributor

This is not available in any distribution since its a package and can be used independently. The latest 1.6 release is https://github.com/hortonworks-spark/shc/tree/v1.0.1-1.6

You can build that with the hbase version that matches your env.

View solution in original post

1 REPLY 1

Re: Spark Hbase connector latest version for Spark 1.6.1 version

Expert Contributor

This is not available in any distribution since its a package and can be used independently. The latest 1.6 release is https://github.com/hortonworks-spark/shc/tree/v1.0.1-1.6

You can build that with the hbase version that matches your env.

View solution in original post