Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

HOW TO READ AND WRITE HBASE TABLE USING SPARK?

HOW TO READ AND WRITE HBASE TABLE USING SPARK?

Explorer

I am trying to writing a pyspark code to read and write to hbase table. 

CDH version : 5.12

Spark Version : 2.2

hbase : 1.2.

scala: 2.11.8

 

I have followed the below link. 

http://community.cloudera.com/t5/Storage-Random-Access-HDFS/Include-latest-hbase-spark-in-CDH/m-p/43...

 

I could able to read the data. but getting exception while write df to hbase. as org.apache.hadoop.hbase.spark.DefaultSource does not allow create table as select

 

looking for sample snippet. 

 

Regards,

Sankar.

 

Don't have an account?
Coming from Hortonworks? Activate your account here