- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
what's the relationship between yarn and hbase?
- Labels:
-
Apache HBase
-
Apache YARN
Created ‎12-15-2016 02:48 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Does yarn take responsibility of hbase's resource manage?
Created ‎12-15-2016 03:56 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
HBase can run on YARN or without YARN. MapReduce jobs always run on YARN, so whenever there is an HBase operation that performs a MapReduce, that will be run on YARN.
Created ‎12-15-2016 03:07 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
YARN works very well for hosting HBase clusters. Some more details you can find in: http://hortonworks.com/blog/introducing-hoya-hbase-on-yarn/
Although HBase & YARN are not dependent on each other and HBase needs only HDFS for columnar store , it doesn't need mapreduce/yarn.
Created ‎12-15-2016 03:16 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
thanks:-)...But when I run a bulk load import in hbase, I can see a MR job showing in YARN Resource manager UI, that makes me confused.
Created ‎12-15-2016 03:56 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
HBase can run on YARN or without YARN. MapReduce jobs always run on YARN, so whenever there is an HBase operation that performs a MapReduce, that will be run on YARN.
Created ‎12-16-2016 01:25 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@billie That's helpful...but when HBase run on YRAN, how to control the resource HBase takes?
Created ‎12-16-2016 02:50 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
With YARN applications, you specify the resources you want the containers to use when the app is launched. With HBase on YARN using Slider, you specify this in the resources.json file passed to the slider create command.
Created ‎12-19-2016 02:04 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@billie Got it...thanks, Billie:-)
