About DGaboleiro

DGaboleiro · ‎12-19-2022

Update: Created a custom processor by duplicating PutDatabaseRecord and added the if statement that was done in the commit https://github.com/apache/nifi/pull/4772/commits/0d6bca493842286ddae6a0577dfed55cd1808f7c. It solved the issue but I had to create a NAR with all of the bundled dependencies in nifi-standard-processors because I was having an error while starting NiFi (https://community.cloudera.com/t5/Support-Questions/Nifi-throwing-error-on-startup/m-p/240893) I've checked the code base and the if statement is not present in Nifi > 1.12 Hey @MattWho, since you were the only one helping and @mburgess is not replying to the ticket, do you think it is possible/doable to create an hot-fix or something like that to have this commit? - I've seen more people complaining regarding this issue and it would be useful to not duplicate the source code just to add an if statement Thanks

DGaboleiro · ‎12-13-2022

Hey @mburgess could you give a little help in this ticket? I am still facing this issue and I'm not sure how to implement a workaroud

DGaboleiro · ‎10-20-2022

Hi, I'm using a PutDatabaseRecord with UPSERT statement for a PostgreSQL database, but the ON CONFLICT keys are not being quoted event with the setting "Quote Column Identifiers" set to true. ERROR: Batch entry 0 INSERT INTO "eventstorage"."2062d999b1f26bcb32c3f39d22bd34"(..., "FDZ_UUID", ...) VALUES (...) ON CONFLICT (FDZUUID) DO UPDATE SET (...) = (..., EXCLUDED."FDZ_UUID", ...) was aborted: ERROR: column "fdzuuid" does not exist I've seen an JIRA issue regarding this behavior and it is as Resolved: https://issues.apache.org/jira/browse/NIFI-8043. I'm using nifi 1.17.0 @MattWhosorry for pinging you directly, but you were the assignee of the jira ticket and I've seen you commenting other similar posts. Thanks

DGaboleiro · ‎10-20-2022

Hi, I want to execute a flow in two NiFi nodes and I'm fetching data from Cassandra running in the primary node only, but then I have a DistributeLoad with "round robin" strategy to distribute the data for the two nodes. The rest of the processors are with Execution on "All Nodes", is the DistributeLoad redundant? Meaning, if I don't use the DistributeLoad but still use the Execution on "All Nodes" for the rest of the processors, I can still have parallel processing jobs across the nodes? Or are the FlowFiles only processed in the current node? Thanks

Online	Offline
Last Visited	‎05-16-2023 08:50 AM

Member Since	‎10-20-2022 03:07 AM
Last Visited	‎05-16-2023 08:50 AM
Posts	6

Cloudera Community

Re: Upsert on conflict not quoting keys

Re: Upsert on conflict not quoting keys

Upsert on conflict not quoting keys

Distribute Loading with Execution on "All Nodes"