- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
HBase using WASB as rootDir
- Labels:
-
Apache HBase
Created ‎10-26-2015 01:35 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Has this been tested? I cannot see region info, pre-splitting a table occurs but I do not see whether it actually took effect. Deleting/disabling/pre-splitting a table takes a long time.
Created ‎10-26-2015 06:47 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Using WASB as a filesystem backend for HBase has been tested and certified by Hortonworks and MS jointly. However, you should not use it with plain HDP on WASB since some configuration for WAL directories are needed (storing WALs on page store versus storing data files in blob store). I would recommend using HDI.
Created ‎10-26-2015 01:38 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Are you using HDI? What version of HDP?
Created ‎10-26-2015 01:45 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
HDP 2.3.2, not HDI
Created ‎10-26-2015 02:04 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I see a lot of Jira activity on WASB and HBase, I guess I'm out of luck here https://issues.apache.org/jira/browse/HADOOP-12089
Created ‎10-26-2015 06:47 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Using WASB as a filesystem backend for HBase has been tested and certified by Hortonworks and MS jointly. However, you should not use it with plain HDP on WASB since some configuration for WAL directories are needed (storing WALs on page store versus storing data files in blob store). I would recommend using HDI.
Created ‎10-27-2015 03:19 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
http://community.hortonworks.com/articles/2143/use-wasb-as-hdp-232-filesystem.html I used page blob as per the hadoop-azure doc
