Member since
10-17-2017
5
Posts
0
Kudos Received
0
Solutions
01-02-2018
05:26 AM
@Edgar Orendain I have already done what the above tutorials are meant for Apache spark, python, hive ORC from spark etc.). I have a specific need for HBase-Spark integration only - even that I have been able to achieve read, I need to up able to write or update HBase from spark.
... View more
12-28-2017
10:20 AM
I am trying to write a dataframe back into an HBase table. I have been able to read data from an HBase table using the hortonworks spark-hbase connector from https://github.com/hortonworks-spark/shc I have seen this article https://hortonworks.com/blog/spark-hbase-dataframe-based-hbase-connector/ which gives some code for saving data back into hbase. However, I need something similar on pyspark. Cannot find any working code, even for syntax and packages to import. The only other way I think I can try is using phoenix jars. But trying to go purely with hortonworks libraries and see if this is possible. Can anyone help?
... View more
Labels:
12-28-2017
05:29 AM
@Artem Ervits, Is there any progress on the Spark on HBase by Hortonworks. We are using the HDP platform but I am not able to easily conclude from the internet that confirms there is progress beyond the above discussion in 2016.
... View more