Created 07-18-2016 02:20 PM
I am using HDP 2.3.2 with spark 1.4.1. As per below link Spark hbase connector works with HDP 2.4.2 onwards. Can someone help with me how can i read hbase in spark using HDP 2.3.2
Created 07-18-2016 02:30 PM
Want to get a detailed solution you have to login/registered on the community
Register/LoginCreated 07-18-2016 02:30 PM
Want to get a detailed solution you have to login/registered on the community
Register/LoginCreated 07-18-2016 02:30 PM
I understand that. I am asking is there any other way I can read hbase inside spark?
Created 07-18-2016 02:35 PM
The only recommended way is to upgrade the cluster to HDP2.4.2. You can also install spark 1.6.1 manually on HDP 2.3.2 but we don't recommend that.
Thanks.
Created 07-21-2016 09:51 AM
I'm reading from Hbase in a spark Hdp 2.3.4.0-3485 (and I've done reading with lower Hdp releases).
Read hbase through a RDD:
Configuration hbaseConfiguration = HBaseConfiguration.create(); hbaseConfiguration.set(TableInputFormat.INPUT_TABLE, "sometable"); JavaPairRDD<ImmutableBytesWritable, Result> hbaseRdd = sc.newAPIHadoopRDD(hbaseConfiguration, TableInputFormat.class, ImmutableBytesWritable.class, Result.class);
Or am I missing something?