Member since
10-20-2022
6
Posts
0
Kudos Received
0
Solutions
12-19-2022
11:25 AM
Update: Created a custom processor by duplicating PutDatabaseRecord and added the if statement that was done in the commit https://github.com/apache/nifi/pull/4772/commits/0d6bca493842286ddae6a0577dfed55cd1808f7c. It solved the issue but I had to create a NAR with all of the bundled dependencies in nifi-standard-processors because I was having an error while starting NiFi (https://community.cloudera.com/t5/Support-Questions/Nifi-throwing-error-on-startup/m-p/240893) I've checked the code base and the if statement is not present in Nifi > 1.12 Hey @MattWho, since you were the only one helping and @mburgess is not replying to the ticket, do you think it is possible/doable to create an hot-fix or something like that to have this commit? - I've seen more people complaining regarding this issue and it would be useful to not duplicate the source code just to add an if statement Thanks
... View more
12-13-2022
08:43 AM
Hey @mburgess could you give a little help in this ticket? I am still facing this issue and I'm not sure how to implement a workaroud
... View more
10-20-2022
11:44 PM
Hi, I'm using a PutDatabaseRecord with UPSERT statement for a PostgreSQL database, but the ON CONFLICT keys are not being quoted event with the setting "Quote Column Identifiers" set to true. ERROR:
Batch entry 0 INSERT INTO "eventstorage"."2062d999b1f26bcb32c3f39d22bd34"(..., "FDZ_UUID", ...) VALUES (...) ON CONFLICT (FDZUUID) DO UPDATE SET (...) = (..., EXCLUDED."FDZ_UUID", ...) was aborted: ERROR: column "fdzuuid" does not exist I've seen an JIRA issue regarding this behavior and it is as Resolved: https://issues.apache.org/jira/browse/NIFI-8043. I'm using nifi 1.17.0 @MattWhosorry for pinging you directly, but you were the assignee of the jira ticket and I've seen you commenting other similar posts. Thanks
... View more
Labels:
- Labels:
-
Apache NiFi
10-20-2022
09:44 AM
Hey, I can be missing something, but what are you trying to accomplish with this? Having more than one NiFi node? Having more than one ZK node? Also, what are you using for the setup? Docker?
... View more
10-20-2022
08:56 AM
Hey, Generally JOLT tries to maintain the input order. The only way that I can think about is an hard-coded approach. Add this after the default spec: {
"operation": "shift",
"spec": {
"Order": {
"*": {
"top-level": {
"ProcessType": "[&2].ProcessType",
"FreightTerm": "[&2].FreightTerm",
"OrderNumber2": "[&2].OrderNumber2",
"TransmissionCommand": "[&2].TransmissionCommand",
"SequenceNumber": "[&2].SequenceNumber",
"SenderAbbreviation": "[&2].SenderAbbreviation"
},
"CustomerAddress": "[&1].CustomerAddress",
"ShipmentAddress": "[&1].ShipmentAdress",
"Volume": "[&1].Volume",
"Weight": "[&1].Weight"
}
}
}
} Also, are you trying to "duplicate" the value of "OrderNumber2"? The other solution I can remember to "replace" JOLT is by using FasterXML/Jackson
... View more
10-20-2022
03:20 AM
Hi, I want to execute a flow in two NiFi nodes and I'm fetching data from Cassandra running in the primary node only, but then I have a DistributeLoad with "round robin" strategy to distribute the data for the two nodes. The rest of the processors are with Execution on "All Nodes", is the DistributeLoad redundant? Meaning, if I don't use the DistributeLoad but still use the Execution on "All Nodes" for the rest of the processors, I can still have parallel processing jobs across the nodes? Or are the FlowFiles only processed in the current node? Thanks
... View more
Labels:
- Labels:
-
Apache NiFi