Member since
08-02-2022
7
Posts
0
Kudos Received
0
Solutions
09-07-2022
12:34 AM
@JimHalfpenny and @araujo thanks both of you for your help! The solution of creating a view with some kind of placeholders worked for me!
... View more
09-06-2022
02:30 AM
Hi, I need to compare several csv columns with values from my db. To do so I use the LookupRecord with concat various csv columns and the corresponding concat of sql columns in the DatabaseRecordLookupService. This works fine as long as I do not have any NULL values in my db. If there is a NULL value the Lookup Processor always routes those datasets to unmatched, as an empty string in the csv does not match the NULL values from the db. What needs to be written in the corresponding csv column so that it matches the db NULL value? I already tried to insert 'null', 'NULL' and 0 in the csv but it never matched the db value. Thanks for your help!
... View more
Labels:
- Labels:
-
Apache NiFi
08-09-2022
12:58 AM
Hello again 🙂 I'm currently struggling with telling the LookupRecord to use multiple columns as key (same in DatabaseRecordLookupService). It would be awesome if you could help me with this! Many thanks!
... View more
08-09-2022
12:21 AM
Thanks! That sounds like a good solution. Is it possible that you send me the configuration of your LookupRecord Processor? 🙂
... View more
08-08-2022
01:15 AM
Hey, thanks for your answer! I use UpdateRecordProcessor so the format can be whatever it needs to be 🙂 JSON, CSV, Avro... I don't care. There is a product id in both flowfiles. But most of the time the id is already in the database but just with another stock. So just checking whether the id already exists or not is not enough. Thank you!
... View more
08-05-2022
04:16 AM
Hi, I have one flowfile with data I get from an external source (stock of a supplier). The products are already in a database. So now I have to check whether the stock has changed. If the stock of my flowfile is equal to the one in the database, I don't want to write the entry into the database (avoid duplicates). Maybe someone of you has an idea how to implement this best. Many thanks for your help!
... View more
Labels:
- Labels:
-
Apache NiFi
08-04-2022
04:25 AM
Hi, is there a way to find and remove duplicate entries in two flowfiles? I have one flowfile generated with SQL Processor with entries from my database. The other one contains new and "old" entries. So in order to only write the new entries in the database, I have to detect and remove the entries that already exist in the other flowfile. I already tried the HashContentProcessor but it hashes the content of the whole file. I would need a processor that hashes line for line (and then compares all hashes with each other). Thanks for your help!
... View more
Labels:
- Labels:
-
Apache NiFi