Is there any maven repository for Spark Hbase connector [https://github.com/hortonworks-spark/shc], which is compatible with Spark 1.6.1 and Hbase 1.1.2?
Or i have to build the jar from Git Hub? https://github.com/hortonworks-spark/shc/blob/master/pom.xml.
If i have to build the jar from Git, is the above Git link is the correct one?
Since we are using HDP 2.4.2 is it available in the HDP Distribution some where? or should i use the spark-packages.
I cannot use 0.0.11-1.6.1-s_2.10 this version, because the hbase connection leak is fixed after this version as per this pull request https://github.com/hortonworks-spark/shc/issues/19
This is not available in any distribution since its a package and can be used independently. The latest 1.6 release is https://github.com/hortonworks-spark/shc/tree/v1.0.1-1.6
You can build that with the hbase version that matches your env.
View solution in original post