Created 03-29-2016 04:42 AM
Hello Friends,
Is there a way to interact with Hbase using YARN ( I mean from YARN application) . I want to create a Hbase table insert some rows and delete it.
Best Regards,
Rohit Sureka
Created 03-29-2016 09:16 AM
You need to use hbase client api, it has changed a bit in HBase 1.x but the jist of it is the same https://www.slideshare.net/mobile/martyhall/hadoop-tutorial-hbase-part-3-java-client-api
It is only good for small number of mutations, when you want to use asynchronous and batch mutations go with MapReduce as Predrag noted or use BufferedMutator as an example https://hbase.apache.org/apidocs/org/apache/hadoop/hbase/client/BufferedMutator.html
It is available in the examples of the HBase source code
Created 03-29-2016 04:55 AM
Created 03-29-2016 06:01 AM
Hi @Rohit Sureka, and welcome to HCC! Yes, you can access HBase from almost any Yarn-running component like MapReduce, Hive, Pig, or Spark. Here are some links: Hive HBase integration, Spark on HBase, and HBase and MapReduce.
Created 03-29-2016 09:16 AM
You need to use hbase client api, it has changed a bit in HBase 1.x but the jist of it is the same https://www.slideshare.net/mobile/martyhall/hadoop-tutorial-hbase-part-3-java-client-api
It is only good for small number of mutations, when you want to use asynchronous and batch mutations go with MapReduce as Predrag noted or use BufferedMutator as an example https://hbase.apache.org/apidocs/org/apache/hadoop/hbase/client/BufferedMutator.html
It is available in the examples of the HBase source code