- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
how to define "Table Name Pattern" for more than 1 table in ChangeCaptureMySql processor configuration file
- Labels:
-
Apache NiFi
Created on ‎07-07-2022 09:30 AM - edited ‎07-07-2022 09:33 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi,
how to define "Table Name Pattern" for more than 1 table in ChangeCaptureMySql processor configuration file. I tried below patterns where "product_types" and "user_subscription" table names. I want to read data only from these tables.
[product_types|user_subscription]_ or [product_types|user_subscription]%
Created ‎07-07-2022 03:37 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
The pattern expression must be a regular expression (regex).
The regex equivalent to your LIKE pattern is:
(product_types|user_subscription).*
Cheers,
André
Was your question answered? Please take some time to click on "Accept as Solution" below this post.
If you find a reply useful, say thanks by clicking on the thumbs up button.
Created ‎07-07-2022 03:37 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
The pattern expression must be a regular expression (regex).
The regex equivalent to your LIKE pattern is:
(product_types|user_subscription).*
Cheers,
André
Was your question answered? Please take some time to click on "Accept as Solution" below this post.
If you find a reply useful, say thanks by clicking on the thumbs up button.
Created ‎06-06-2023 01:00 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hello @araujo
This does not work, i tried to use the above expression and the changeMySql does not use it.
So far i can do the following
- whitelist individual tables
- include all tables (by setting the table name pattern to empty)
This is a problem for us, we need to whitelist tables, since the dB user we use does not have access to all tables and the processor complains without the filtering.
Manually filtering one table at a time, is not a scalable approach since we need to extract data from multiple tables and this processor does not support incoming connections.
Did anyone find a solution where one instance of "CaptureChangeMySQL" can extract data for multiple tables ?
Created ‎06-20-2023 01:57 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Anyone else experienced this issue ? is there a solution that does not involve creating one CaptureChangeMySQL processor instance per source table ?
Created ‎08-30-2023 01:08 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Anyone else experienced this issue ? is there a solution that does not involve creating one CaptureChangeMySQL processor instance per source table ?
