Support Questions
Find answers, ask questions, and share your expertise

Using spark to join between hbase and oracle tables

Using spark to join between hbase and oracle tables

New Contributor

Hi,

Has anyone used spark  to join between hbase and Oracle tables?

We were able to do so on one artition using hivecontext but failed once trying to use hbasecontexts to support multi partitions

 

Thanks,

Rotem

1 REPLY 1

Re: Using spark to join between hbase and oracle tables

Explorer

Not the fastest way to do it, but you can create a hive table on top of the hbase table and use Spark JDBC to create your hbase Dataframe. you can then join that dataframe with your Oracle dataframe.