Member since
06-29-2017
2
Posts
0
Kudos Received
0
Solutions
02-27-2018
10:03 AM
val sc=new Scan() add two filters in filterlist (keyonlyfilter,firstkeyonlyfilter) add that filterlist to scan val conf =HBaseConfiguration.create() conf.addResource(newPath("/usr/hdp/current/hbase-client/conf/hbase-site.xml")) conf.set("hbase.zookeeper.quorum","xxx") conf.set(TableInputFormat.INPUT_TABLE,"TEST_TABLE") conf.set(TableInputFormat.SCAN,convertscantoString(sc)) val hBaseRDD = sc.newAPIHadoopRDD(conf, classOf[org.apache.hadoop.hbase.mapreduce.TableInputFormat], classOf[org.apache.hadoop.hbase.io.ImmutableBytesWritable], classOf[org.apache.hadoop.hbase.client.Result]) hBaseRDD.count()
... View more