- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Does phoenix update global index during bulk load?
- Labels:
-
Apache Phoenix
Created 09-02-2016 04:41 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Does phoenix update global index during bulk load? curious if this is supported and how it works.
Created 09-02-2016 06:10 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Yes, it updates indexes. If we are talking about MR job, than bulk load generates HFiles for user table and index tables at the same time and load it using HBase bulk load. In case of PSQL the data is loading using regular upserts and indexes are updated in regular way.
Created 09-02-2016 05:38 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Yes, it does. If it didn't, your queries would return incorrect results.
The code suggests to me that the PhoenixRecordWriter handles the responsibility of updating both the data tables and index tables during the MR job output, but I'm not sure the link is to exactly the right class.
Created 09-02-2016 06:10 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Yes, it updates indexes. If we are talking about MR job, than bulk load generates HFiles for user table and index tables at the same time and load it using HBase bulk load. In case of PSQL the data is loading using regular upserts and indexes are updated in regular way.
Created 09-02-2016 07:57 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@Randy Gelhausen and @ssoldatov thank you for your responses.
Created 12-30-2016 05:24 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Update the column and the column was on the index witn MR bulkload,It didn't update . And then I can get the old result if the condition on the index.https://issues.apache.org/jira/browse/PHOENIX-2521
