Hbase through YARN

[#1]

Hello Friends,

Is there a way to interact with Hbase using YARN ( I mean from YARN application) . I want to create a Hbase table insert some rows and delete it.

Best Regards,

Rohit Sureka

[#2]

@Rohit Sureka

Did you review this ?

https://github.com/OpenSOC/opensoc-streaming/blob/master/OpenSOC-EnrichmentAdapters/src/main/java/co...

https://github.com/OpenSOC/opensoc-streaming/blob/master/OpenSOC-EnrichmentAdapters/src/main/java/co...

[#3]

Hi @Rohit Sureka, and welcome to HCC! Yes, you can access HBase from almost any Yarn-running component like MapReduce, Hive, Pig, or Spark. Here are some links: Hive HBase integration, Spark on HBase, and HBase and MapReduce.

[#4 · Accepted solution]

You need to use hbase client api, it has changed a bit in HBase 1.x but the jist of it is the same https://www.slideshare.net/mobile/martyhall/hadoop-tutorial-hbase-part-3-java-client-api

It is only good for small number of mutations, when you want to use asynchronous and batch mutations go with MapReduce as Predrag noted or use BufferedMutator as an example https://hbase.apache.org/apidocs/org/apache/hadoop/hbase/client/BufferedMutator.html

It is available in the examples of the HBase source code