Member since
12-27-2023
3
Posts
0
Kudos Received
0
Solutions
01-22-2024
09:12 PM
Hello everyone, We are currently facing an issue with the NiFi ExecuteSQLRecord processor and JsonRecordSetWriter controller service while fetching data from a MySQL database. The problem arises when dealing with a large dataset, where accent characters are being converted to something different. However, when working with a smaller dataset (e.g., 10 records per file), the accents appear as expected. Here are some key details about our setup: NiFi Version: 1.23.2 Database: MySQL JDBC URL: jdbc:mysql://{host}:3306/{database_name}?useCursorFetch=true&allowPublicKeyRetrieval=true&serverTimezone=UTC&characterEncoding=UTF8&useUnicode=yes We suspect that the issue is related to character encoding. The specific problem is exemplified by the transformation of a word like "Montréal" into "Montréal" when dealing with larger datasets. @SAMSAL, @joseomjr, @cotopaul, @mat We would greatly appreciate any insights, suggestions, or solutions from the community. If anyone has encountered a similar problem or has expertise in dealing with character encoding issues. Thank you!
... View more
Labels:
- Labels:
-
Apache NiFi
01-01-2024
09:29 PM
Your input means a lot, and I appreciate your assistance @DianaTorres, @SAMSAL and @joseomjr. Thank you all for sharing your knowledge and insights!
... View more
12-27-2023
10:13 PM
Hey there, I'm trying to create a nested JSON using SQL in NiFi, but the output I'm getting has the nested part as a string. Here's the query I'm using: SELECT
order_id,
JSON_ARRAYAGG(
JSON_OBJECT(
'order_Item_Seq_Id', order_Item_Seq_Id,
'product_Id', product_Id
)
) as order_item
FROM order_item
GROUP BY order_id; The output looks like this: [{
"order_id": "10000",
"order_item": "[{\"product_Id\": \"10007\", \"order_Item_Seq_Id\": \"00101\"}]"
}] But I want it to be a valid nested JSON like this: [
{
"order_id": "10000",
"order_item": [
{
"product_Id": "10007",
"order_Item_Seq_Id": "00101"
}
]
}
] I'm hoping for a solution using Apache NiFi or Jolt. Any help would be appreciated. Thank you!
... View more
Labels:
- Labels:
-
Apache NiFi