Support Questions
Find answers, ask questions, and share your expertise

HOW TO READ AND WRITE HBASE TABLE USING SPARK?

Highlighted

HOW TO READ AND WRITE HBASE TABLE USING SPARK?

Explorer

I am trying to writing a pyspark code to read and write to hbase table. 

CDH version : 5.12

Spark Version : 2.2

hbase : 1.2.

scala: 2.11.8

 

I have followed the below link. 

http://community.cloudera.com/t5/Storage-Random-Access-HDFS/Include-latest-hbase-spark-in-CDH/m-p/43...

 

I could able to read the data. but getting exception while write df to hbase. as org.apache.hadoop.hbase.spark.DefaultSource does not allow create table as select

 

looking for sample snippet. 

 

Regards,

Sankar.