Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

HDP Spark HBase Connector

avatar
Master Guru

Is there any documentation available on HDP Spark HBase connector?

1 ACCEPTED SOLUTION

avatar
Master Guru

I found the documentation (not on HDP at this time)

https://github.com/hortonworks/shc

View solution in original post

15 REPLIES 15

avatar
Expert Contributor

Is the spark hbase connector GA in HDP 2.5.3 ?

avatar
Super Collaborator

Yes. For Spark 1.6 it is GA in HDP 2.5.3. The documentation is available from the Github site for a given SHC release tag. That is the source of truth.

avatar

I try to use in HDP 2.4.0 and cannot run the samples files. I have a Cluster HDP 2.4

mvn clean package test

Cause: java.net.BindException: Address already in use

at sun.nio.ch.Net.bind0(Native Method) at sun.nio.ch.Net.bind(Net.java:433)

....

[INFO] HBase Spark Connector Project Parent POM ........... SUCCESS [ 1.542 s] [INFO] HBase Spark Connector Project Core ................. FAILURE [01:04 min] [INFO] HBase Spark Connector Project Examples ............. SKIPPED

avatar
Explorer

hi

is there a way to use the connector offline? is the connector included in HDP 2.6?

that is without using --repositories http://repo.hortonworks.com/content/groups/public/

i am developing in a closed offline environment and cannot download from the internet the connector...

if not, can anyone provide another way of pyspark-hbase connection?

,

hi i'm using python pyspark,

is there a way to run spark-submit offline?

that is without using --repositories http://repo.hortonworks.com/content/groups/public/

is the connector included in HDP 2.6?

avatar
Expert Contributor

I am in the exact same configuration (no way to reach internet from our cluster...), did you find any other option to make it run ?

avatar
Master Collaborator