Member since
01-05-2021
6
Posts
0
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
970 | 12-15-2021 09:59 PM |
12-15-2021
09:59 PM
Here is the answer if anyone is interested: https://issues.apache.org/jira/browse/NIFI-9477?filter=-4&jql=project%20%3D%20NIFI%20order%20by%20created%20DESC
... View more
12-12-2021
06:45 AM
hello all, We are using Nifi to do an incremental load from SQL Server using QueryDatabaseTableRecord where max-value column is updated_at column with a Datetime2 data type. The source tables get updated in milliseconds. We noticed that we are losing few events doing with each QueryDatabaseTableRecord run. As a work-around we created a custom processor that subtracts few seconds from the max-value in the state fetching overlapping events and then we handle any duplicates later on in the pipeline and it seems to solve the issue. However, this is not optimal. We'd like to know what's causing the skips. Our assumption so far is that timestamp datatype accuracy is causing the skips in the incremental load however we're not sure.
... View more
Labels:
- Labels:
-
Apache NiFi
05-07-2021
05:52 PM
facing the same issue on Windows
... View more
02-02-2021
12:53 AM
Hi, I'm trying to follow your solution, however step 3 only shows a masked key, as follows: <name>random.nifi.sensitive.props.key</name> <value>********</value> is there anyway that i can work around that?
... View more
01-06-2021
03:50 AM
Thanks for the answer @TimothySpann The thing is, we don't can't have source create custom views for us. Is there any other way to achieve this?
... View more
01-05-2021
02:49 AM
Hi, i'm using QueryDatabaseTable processor to incrementally load data from a database table using two columns to perform the incremental load. However, I noticed that the query that fetches the fresh rows is as follows: Select * from myTable where (mycolumn1 > someValue AND myclumn2 > somevalue) However, this does not meet my business need and I would like to perform the following to fetch new records: Select * from myTable where (mycolumn1 > someValue OR mycolumn2 > somevalue) How can this be achieved? Appreciate your help. Thanks
... View more
Labels:
- Labels:
-
Apache NiFi