Member since
05-30-2025
4
Posts
0
Kudos Received
0
Solutions
02-04-2026
06:58 AM
1 Kudo
Hello @NadirHamburg Thanks for being part of our Community. I'm not an expert on Clickhouse, but was reading that it could be something on the DB causing the batches to repeat and causing that amount of duplicated records. From NiFi side, you can try to set the batch size at the same amount of records, this should work for you. But I know that for big databases it could be a problem. From Clickhouse, I found this documentation: https://clickhouse.com/docs/engines/table-engines/mergetree-family There talks about ReplicatedMergeTree, which should be a good option to avoid duplicates. Do you have your table with those settings? Do you see any errors on PutDatabaseRecord log? If so, can you share them?
... View more
06-04-2025
11:01 AM
@NadirHamburg Can you elaborate on what you are looking for from Cloudera Support? zit seems you are asking a question related to xml storage files which is not related to any of our Cloudera Products. Did you mean to submit this questions to Microsoft? Thank you
... View more
05-31-2025
03:04 AM
This indeed fixed the issue. Thanks a lot !
... View more