Support Questions

Find answers, ask questions, and share your expertise
Announcements
Check out our newest addition to the community, the Cloudera Data Analytics (CDA) group hub.

Set HBase Properties in SHC

Expert Contributor

I'm using the Spark HBase Connector (SHC, which is included in my HDP 2.6.5 installation) for moving data into HBase using Spark SQL.

Since my dataframe (the cell values) is very huge, I sometimes get an "KeyValue size too large" exception. Therefore I found this article, that sais, that I have to increase the value of the HBase property "hbase.client.keyvalue.maxsize": https://community.hortonworks.com/content/supportkb/154006/errorjavalangillegalargumentexception-key...

I changed this property in my HBase configuration via Ambari, this seems not to help.

Now I tried to change this property in my application (Zeppelin notebook), therefore I need to give my SHC this property, but I don't know how to do this (setting the property in my Zeppelin HBase interpreter settings also didn't help).

Can someone show how to change the property for the SHC? Is there a way to do this? Thank you!

1 REPLY 1

@Daniel Müller

You must be adding the hbase-site.xml to your interpreter in Zeppelin. Add this property in that hbase-site.xml and see if that helps.

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.