question Re: Does phoenix update global index during bulk load? in Archives of Support Questions (Read Only)

Does phoenix update global index during bulk load?

sunile_manjee — Fri, 02 Sep 2016 23:41:52 GMT

Does phoenix update global index during bulk load? curious if this is supported and how it works.

Re: Does phoenix update global index during bulk load?

rgelhausen — Sat, 03 Sep 2016 00:38:59 GMT

Yes, it does. If it didn't, your queries would return incorrect results.

The code suggests to me that the PhoenixRecordWriter handles the responsibility of updating both the data tables and index tables during the MR job output, but I'm not sure the link is to exactly the right class.

Re: Does phoenix update global index during bulk load?

ssoldatov — Sat, 03 Sep 2016 01:10:41 GMT

Yes, it updates indexes. If we are talking about MR job, than bulk load generates HFiles for user table and index tables at the same time and load it using HBase bulk load. In case of PSQL the data is loading using regular upserts and indexes are updated in regular way.

Re: Does phoenix update global index during bulk load?

sunile_manjee — Sat, 03 Sep 2016 02:57:46 GMT

@Randy Gelhausen and @ssoldatov thank you for your responses.

Re: Does phoenix update global index during bulk load?

1792313430 — Fri, 30 Dec 2016 13:24:47 GMT

Update the column and the column was on the index witn MR bulkload,It didn't update . And then I can get the old result if the condition on the index.https://issues.apache.org/jira/browse/PHOENIX-2521