Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Spark Hbase connector latest version for Spark 1.6.1 version

Solved Go to solution
Highlighted

Spark Hbase connector latest version for Spark 1.6.1 version

New Contributor

Is there any maven repository for Spark Hbase connector [https://github.com/hortonworks-spark/shc], which is compatible with Spark 1.6.1 and Hbase 1.1.2?

Or i have to build the jar from Git Hub? https://github.com/hortonworks-spark/shc/blob/master/pom.xml.

If i have to build the jar from Git, is the above Git link is the correct one?

Since we are using HDP 2.4.2 is it available in the HDP Distribution some where? or should i use the spark-packages.

I cannot use 0.0.11-1.6.1-s_2.10 this version, because the hbase connection leak is fixed after this version as per this pull request https://github.com/hortonworks-spark/shc/issues/19

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Spark Hbase connector latest version for Spark 1.6.1 version

Expert Contributor

This is not available in any distribution since its a package and can be used independently. The latest 1.6 release is https://github.com/hortonworks-spark/shc/tree/v1.0.1-1.6

You can build that with the hbase version that matches your env.

1 REPLY 1

Re: Spark Hbase connector latest version for Spark 1.6.1 version

Expert Contributor

This is not available in any distribution since its a package and can be used independently. The latest 1.6 release is https://github.com/hortonworks-spark/shc/tree/v1.0.1-1.6

You can build that with the hbase version that matches your env.

Don't have an account?
Coming from Hortonworks? Activate your account here