Support Questions

Find answers, ask questions, and share your expertise

Character encoding for accent character in NiFi

avatar
New Contributor

Hello everyone,

We are currently facing an issue with the NiFi ExecuteSQLRecord processor and JsonRecordSetWriter controller service while fetching data from a MySQL database. The problem arises when dealing with a large dataset, where accent characters are being converted to something different. However, when working with a smaller dataset (e.g., 10 records per file), the accents appear as expected.

Here are some key details about our setup:

  • NiFi Version: 1.23.2
  • Database: MySQL
  • JDBC URL: jdbc:mysql://{host}:3306/{database_name}?useCursorFetch=true&allowPublicKeyRetrieval=true&serverTimezone=UTC&characterEncoding=UTF8&useUnicode=yes

We suspect that the issue is related to character encoding. The specific problem is exemplified by the transformation of a word like "Montréal" into "Montréal" when dealing with larger datasets.

@SAMSAL@joseomjr@cotopaul@mat   
We would greatly appreciate any insights, suggestions, or solutions from the community. If anyone has encountered a similar problem or has expertise in dealing with character encoding issues.

Thank you!

0 REPLIES 0