question how to define "Table Name Pattern" for more than 1 table in ChangeCaptureMySql processor configuration file in Support Questions

how to define "Table Name Pattern" for more than 1 table in ChangeCaptureMySql processor configuration file

AbhishekSingh — Thu, 07 Jul 2022 16:33:25 GMT

Hi,

how to define "Table Name Pattern" for more than 1 table in ChangeCaptureMySql processor configuration file. I tried below patterns where "product_types" and "user_subscription" table names. I want to read data only from these tables.

[product_types|user_subscription]_ or [product_types|user_subscription]%

Re: how to define "Table Name Pattern" for more than 1 table in ChangeCaptureMySql processor configuration file

araujo — Thu, 07 Jul 2022 22:37:49 GMT

@AbhishekSingh ,

The pattern expression must be a regular expression (regex).

The regex equivalent to your LIKE pattern is:

(product_types|user_subscription).*

Cheers,

André

Re: how to define "Table Name Pattern" for more than 1 table in ChangeCaptureMySql processor configuration file

grigpapdone — Tue, 06 Jun 2023 08:00:47 GMT

Hello @araujo

This does not work, i tried to use the above expression and the changeMySql does not use it.

So far i can do the following

- whitelist individual tables

- include all tables (by setting the table name pattern to empty)

This is a problem for us, we need to whitelist tables, since the dB user we use does not have access to all tables and the processor complains without the filtering.

Manually filtering one table at a time, is not a scalable approach since we need to extract data from multiple tables and this processor does not support incoming connections.

Did anyone find a solution where one instance of "CaptureChangeMySQL" can extract data for multiple tables ?

Re: how to define "Table Name Pattern" for more than 1 table in ChangeCaptureMySql processor configuration file

grigpapdone — Tue, 20 Jun 2023 08:57:50 GMT

Anyone else experienced this issue ? is there a solution that does not involve creating one CaptureChangeMySQL processor instance per source table ?

Re: how to define "Table Name Pattern" for more than 1 table in ChangeCaptureMySql processor configuration file

grigpapdone — Wed, 30 Aug 2023 08:08:34 GMT

Anyone else experienced this issue ? is there a solution that does not involve creating one CaptureChangeMySQL processor instance per source table ?