Member since
11-03-2023
32
Posts
1
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
3917 | 11-08-2023 09:29 AM |
12-21-2023
11:53 AM
I want to retry my flow file if it has some error for 24 hours , retry should will happen every hours . if the file is there in the flow for more then 24 hours it should be removed .
iam trying achieve same by using update attribute processors , routeOnAttribute processor and taking help of expression language . Still iam not able to achieve it.
these are the expression I am using to check elapsed time and received Time of flow file in routeOnAttribute processor but its going to unmatched relation every time -
these values are for testing pursose -
elapsed_time = ${now():toNumber():minus(${queuedtimestamp:toNumber()}):divide(60000):gt(10)}
receivedTime= ${now():toNumber():minus(${receivedTime:toDate("yyyy-MM-dd HH:mm:ss"):toNumber()}):gt(180000)}
NOTE: retryFlowFile processor in not available as my nifi version is old
Please suggest better approach to do so .
... View more
Labels:
- Labels:
-
Apache NiFi
12-20-2023
01:32 AM
control rate processor is nor working
... View more
12-19-2023
12:54 PM
Hi , iam retrying a flow file 3 times before moving moving it to failure relationship , with each retry i want to have 10 seconds gap in between them , so 2nd retry will happen after 10 seconds . iam not able to understand how to use wait processor for this . What should be the configurations of that processor . iam using older version of nifi so i can not use retryFlowFile processor .
... View more
Labels:
- Labels:
-
Apache NiFi
12-14-2023
10:14 PM
Hi , is there any idle connection timeout for ConsumeKafka and PublishKafka processors in NIFI. Do these processors go to idle state if no data in incoming ?? if yes then what is the time in which they will go to idle state in case of no data is coming ??? and is there any way to set this time ourself ???
... View more
Labels:
- Labels:
-
Apache NiFi
12-12-2023
11:06 PM
disconnect and reconnect again this functionality i want to achieve with Publish kafka processor . ConsumerKafka will consumer continuously .
... View more
12-12-2023
11:04 PM
consuming from nifi is fine that i want to be continuous , i want to terminate connection for publish kafka processor , when there is no new message consumed by consumeKafka processor for more then 5 minutes , i want to terminate connection with publish kafka as my consumer kafka and producer kafka are different . as soon as my consumer kafka consumer some message , i want connection to be established again with producer kafka
... View more
11-28-2023
07:28 PM
Thanks @SAMSAL its working , but iam not bale to understand the settings . My requirement is , my max queue size will be 250 requests and i wanted them to get retried till 24 hours , every hour (every 1 hours till 24 hours) . once a flow file has completed 24 hours in queue i want it to get expired and i will drop it , by connecting it to a log message processor . can you please help on these settings ????
... View more
11-28-2023
05:45 AM
kafka\.topic , i tried adding this , but it did not work . I checked kafka headers too there also nothing being printed in haeder.
... View more
11-28-2023
04:33 AM
Hi , I have a publish kafka processor where iam having a self loop and flowfile expiration time for that loop is 1 hours , if some file is there for more then 1 hour it will get removed. i want to print log message (e.g. dropping the flow file) after every flow file is removed from queue after getting expired. This is the flow -
... View more
Labels:
- Labels:
-
Apache NiFi
11-26-2023
08:39 AM
kafka.topic is a key , it will have value of a kafka topic name e.g abc_xyz . this value will keep on depending from where iam consuming the meassge , from which topic . my requirement is to send the topic from where i consumed as header to the topic where iam publishing it . how can i do that ??
... View more