Spark Hbase connector latest version for Spark 1.6.1 version

sancar_sn — Thu, 26 Jan 2017 20:58:18 GMT

Is there any maven repository for Spark Hbase connector [https://github.com/hortonworks-spark/shc], which is compatible with Spark 1.6.1 and Hbase 1.1.2?

Or i have to build the jar from Git Hub? https://github.com/hortonworks-spark/shc/blob/master/pom.xml.

If i have to build the jar from Git, is the above Git link is the correct one?

Since we are using HDP 2.4.2 is it available in the HDP Distribution some where? or should i use the spark-packages.

I cannot use 0.0.11-1.6.1-s_2.10 this version, because the hbase connection leak is fixed after this version as per this pull request https://github.com/hortonworks-spark/shc/issues/19

Re: Spark Hbase connector latest version for Spark 1.6.1 version

bikas — Fri, 27 Jan 2017 02:32:46 GMT

This is not available in any distribution since its a package and can be used independently. The latest 1.6 release is https://github.com/hortonworks-spark/shc/tree/v1.0.1-1.6

You can build that with the hbase version that matches your env.

question Spark Hbase connector latest version for Spark 1.6.1 version in Archives of Support Questions (Read Only)

Spark Hbase connector latest version for Spark 1.6.1 version

Re: Spark Hbase connector latest version for Spark 1.6.1 version