Member since
12-05-2022
6
Posts
1
Kudos Received
0
Solutions
01-14-2024
03:08 AM
We are trying to fetch teh date field with timestamp using mongodblookup service in nifi to compare the other date field. when we are giving the field in lookup service fields... The ISO date giving only date ... the millsecond are missing Example: ISODate("2021-02-25T10:03:46.000Z") its giving 2021-02-25 value along with timestamp as 00:00:000 ... we need that 10:03:46:000 can you please help us to get the date along with timestamp?
... View more
Labels:
- Labels:
-
Apache NiFi
01-14-2024
02:52 AM
1 Kudo
HI @steven-matison , I have added monitor activity processor for this scenario and working fine. The first table load success queue connected to monitor activity processor, once load completed, the inactive message connected to second table... then second table execution starts after the getting the inactive message from monitor activity processor Thanks.
... View more
06-21-2023
02:08 PM
Thanks for your reply. please find the details what i am trying to achieve in the flow. First of all, i am loading the source data into table1 on daily scheduled basis. Then what am trying to do, whatever the data is loaded in Table 1.(using put data database record processor). i am doing few manipulation and loading into table 2 through store procedure. High level flow: Generate flow file--> Executegroovy(Get teh current time)-->executesqlrecord(using the store procedure-->executesqlrecord(fetch the latest records) Coming back to Generate flow file. there is no incoming connection to this. Just trying generate one flow file. Whatever its been loaded on the Table 1 on daily basis(~ 1m records) to have it single flow file. Then i am using one of groovy script to get the current date once this is done, we are calling store procedure with below condition CALL PROC1 (${CURR_TIME}) In this store procedure, we are tracking Start time of execution and end time of execution and keep maintain in audit tables. Then we are again executing below query to fetch the success records from table 2 and continue to further. Select * from Table 2 where CREATED_DTTM >= (select max(START_TIME) from AUDIT WHERE PROC_NAME like 'PROC1 ' AND RUN_STATUS = 'SUCCESS') Why we used max start time: Its happening on daily basis, so we are picking the records from max. Currently there is connectivity between table 1 load (put database record processor) and the table 2 loads. additionally wants to check, how can be add the dependency( Have to wait until the data has been loaded into table 1 then start the store procedure for table 2 loads) And more than welcome, if any alternative approach can be done for this requirement.
... View more
06-20-2023
07:54 AM
Thanks for reached out me. This is how my flow and i am using nifi 11.4.2 and loading the data in MYSQL one of the table... Once this table is loaded(Put database records processor) then our generate flow file should be activated. We are trying make it as one flow file, with what ever we loaded on the per/daily load. then we are having executing groovy script to make date field definition. then we are calling Store procedure using execute SQL record processor. our condition is in store procedure, whatever loaded with current time, those records which we are pulling in next execute sql records.
... View more
05-08-2023
01:46 AM
Hi All, I am loading the data into one table, once data loaded, the store procedure processor should be executed automatically. which processor can be used for this scenarios. do we have any options in WAIT/Notify processor's?
... View more
Labels:
- Labels:
-
Apache NiFi
12-05-2022
08:20 AM
Hi , I am new to the groovy... I want to know, how json array can be formed for dynamic variables from json flow file thorough groovy script.. please let me know, if you have an idea
... View more
Labels:
- Labels:
-
Apache NiFi