Member since
08-16-2018
9
Posts
0
Kudos Received
0
Solutions
09-07-2018
01:13 PM
Hi @Shu, thanks very much the solution is working. But in case of a failure,we are missing the records. Eg : Run 1:when executing the query between "2018-09-06 12:00:00.00" and "2018-09-06 12:15:00.00" it is processed successfully Run 2:In next run the query failed for some reason, "2018-09-06 12:15:00.00" and "2018-09-06 12:30:00.00. run 3:In subsequent run, Db fetch is successful, "2018-09-06 12:30:00.00" and "2018-09-06 12:45:00.00" In the above case we are missing the records for Run 2 is there a way to maintain transaction of fully commit or rollback, or combine two processor as a single unit of work?
... View more
09-07-2018
06:23 AM
Hi @Shu, when we try to import the hcc-215124.xml file we are getting an error as GenerateFlowFile is not known to this Nifi instance. Could you please try to import once to your nifi intance and then share the file again.
... View more
08-30-2018
03:07 PM
Fetch records from a database incrementally based on time interval
We have this requirement to pull records from a database which has millions of records, the only column we can use is a date column. Is there an option to keep incremental based on a time value.
Eg:
If the initial state is 2018-08-30 12:00:00.00, in the first run it has to fetch the records between 2018-08-30 12:00:00.00 and 2018-08-30 12:15:00.00. Basically it has to keep adding 15 mins after each run. In the next run it has to fetch records between 2018-08-30 12:15:00.00 and 2018-08-30 12:30:00.00.Is this possible to acheive through QueryDatabaseTable processor.
... View more
Labels:
- Labels:
-
Apache NiFi
08-18-2018
11:40 PM
Thanks very much @Shu for your solution . I managed to find a way which is almost similar to yours.
... View more
08-16-2018
08:48 PM
I'm to Jolt transformation. I have a simple requirement to transform a json message, were I have to move the contents of the message to a subset without mapping the filed one by one. Input message: { "primary": { "value": 4 }, "quality": { "value": 3 } } Expected Output: { Data:{ "primary": { "value": 4 }, "quality": { "value": 3 } } }.,HI, I am looking to convert a json message using Jolt. it is a simple transformation, were i have to move the entire json message to a subset without mapping field by field @Matt Burgess
... View more