Member since
01-10-2024
28
Posts
11
Kudos Received
1
Solution
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 1378 | 01-18-2024 11:10 PM |
01-25-2024
06:26 PM
1 Kudo
Dear @VidyaSargur, does anyone can help this issue? Thank you so much, much appreciated!!
... View more
01-24-2024
10:46 PM
Dear all, A bit background about this: I receive fresh data from a data vendor on a weekly basis and aim to either insert or update my existing database. If the lookup identifies matching values (such as company ID, fiscal year, etc.) in a record, we perform an update on specific fields (e.g., announcement date); otherwise, we insert a new record. My chain of lookups: My lookup processor setup: My data: Before lookup: After first lookup (Company ID) (It return me fs_ID): After second lookup (Fiscal_Year) (It return me another fs_ID): Note: fs_ID is retrived value from lookup tables However, I check my lookup table: It does not match the "Company_ID", it only match the "Fiscal_year", It seems like those lookup processor worked independently. I expected this output: myincomingdata.Company_ID = ent_fundamentals.Company_ID AND myincomingdata.Fiscal_year = ent_fundamentals.Fiscal_year..etc., (I can update this record base on those columns if they all match) Can anyone please help me this issue or is there any other way in doing lookup inNIFI?
... View more
Labels:
- Labels:
-
Apache NiFi
01-24-2024
10:33 PM
Thanks Samsal
... View more
01-21-2024
06:46 PM
Hi @SAMSAL Input from data provenance: Output:
... View more
01-18-2024
11:10 PM
1 Kudo
Problem solve after reading: https://community.cloudera.com/t5/Support-Questions/NiFi-Trigger-a-Processor-once-after-the-Queue-gets-empty-for/td-p/381801
... View more
01-18-2024
08:20 PM
Anyone can help about this issue?
... View more
01-18-2024
08:17 PM
Hi @SAMSAL , Please refer to the attachment: For the "Queryrecord" Processor, I tried to select updated ID from flowfile. How can I do that to obtain those new ids?
... View more
01-18-2024
12:20 AM
Hi @SAMSAL, Thanks for your reply! However, I obtained this sql statement as output of the flowfile. Please check below attachment (from data provenance) Here is my setup for Putsql: Am I done something wrong?
... View more
01-17-2024
12:31 AM
Dear all, I have a query regarding the insertion of a flowfile into a MySQL Database. Specifically, I would like to know how to retrieve the auto-incremented ID from the database and store it as a flowfile attribute. Consider the following example flowfile (representing one record, with many more records in reality): My goal is to insert this data into 'table1,' which has an auto-incremented ID field (let's assume that after insertion, the ID will be 3001). Could you please guide me on how to retrieve this auto-incremented ID and assign it to a flowfile attribute?
... View more
Labels:
- Labels:
-
Apache NiFi
01-16-2024
07:32 PM
My previous processor group is for update and insert a table. After that, I want to use ExecuteSQL processor. My question is: How to clear all flowfiles and proceed to the ExecuteSQL processor, so the ExecuteSQL processor only run once. For example, my pic above, there are 3 flowfiles queued, it means that the ExecuteSQL processor will run 3 times? (I think). how to clear them and only run once
... View more
Labels:
- Labels:
-
Apache NiFi
- « Previous
-
- 1
- 2
- Next »