Hello everyone,
We are currently facing an issue with the NiFi ExecuteSQLRecord processor and JsonRecordSetWriter controller service while fetching data from a MySQL database. The problem arises when dealing with a large dataset, where accent characters are being converted to something different. However, when working with a smaller dataset (e.g., 10 records per file), the accents appear as expected.
Here are some key details about our setup:
- NiFi Version: 1.23.2
- Database: MySQL
- JDBC URL: jdbc:mysql://{host}:3306/{database_name}?useCursorFetch=true&allowPublicKeyRetrieval=true&serverTimezone=UTC&characterEncoding=UTF8&useUnicode=yes
We suspect that the issue is related to character encoding. The specific problem is exemplified by the transformation of a word like "Montréal" into "Montréal" when dealing with larger datasets.
@SAMSAL, @joseomjr, @cotopaul, @mat
We would greatly appreciate any insights, suggestions, or solutions from the community. If anyone has encountered a similar problem or has expertise in dealing with character encoding issues.
Thank you!