Member since
01-10-2024
28
Posts
11
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
507 | 01-18-2024 11:10 PM |
04-08-2024
08:04 PM
1 Kudo
@SAMSAL Hi Samsal, Problem solved by using regex to extract maprecord{[xxxxx]}, Thanks for your details explaination about the lookup service
... View more
02-25-2024
07:13 PM
1 Kudo
Dear @SAMSAL , Thank you so much for helping, we tried different ways, and we decided to use the solution that you mention above by concatenating those columns.
... View more
01-26-2024
09:34 AM
1 Kudo
Hi @jarviszzzz , In your DB Lookup Service , I noticed you are aliasing ID as fs_ID in the Lookup Value Columns! I dont think you do an aliasing there , this property is used to list columns that exist in the target table: "A comma-delimited list of columns in the table that will be returned when the lookup key matches. Note that this may be case-sensitive depending on the database." Can you try to set it to just the ID and see if it works.
... View more
01-24-2024
10:33 PM
Thanks Samsal
... View more
01-24-2024
10:29 PM
Dear all, A bit background about this: I have newly incoming data from data vendor every week, and I would like to do either insert or update to my current database. If lookup matched some value (such as companyid, fiscal_year, ...etc,. )in a record then we update some value(annoucement date), otherwise insert. My lookup service setup: (Company ID) (Fiscal Year): My data is like this: Before lookup: After lookup company ID (it return fs_ID): After lookup fiscal year (it return fs_ID): And I go to Mysql database to check fs_ID = 351225894: IT DOES NOT MATCH THE COMPANY_ID (but it matched Fiscal_year)!!!!! It seems like each lookup processor working independently. My expected output it should does this: ent_fundamental.Company_ID = myincomingdata.company_ID AND ent_fundamental.Fiscal_year = myincomingdata.Fiscal_year etc., (then it will return me a fs_ID so that I can update this record) Or Does anyone have any good idea to do a multiple columns lookup in NIFI?
... View more
Labels:
- Labels:
-
Apache NiFi
01-22-2024
07:57 PM
1 Kudo
This is the exactly problem I was facing, still no idea how it can be done.
... View more
01-18-2024
11:10 PM
1 Kudo
Problem solve after reading: https://community.cloudera.com/t5/Support-Questions/NiFi-Trigger-a-Processor-once-after-the-Queue-gets-empty-for/td-p/381801
... View more
01-16-2024
06:26 PM
Hi Timothy, Thank you so much for helping. I also made some changes (adding index, change data types etc.,) for mysql database. Now, it ran much faster than before
... View more