About Rohit1997jio

Rohit1997jio · ‎12-12-2023

consuming from nifi is fine that i want to be continuous , i want to terminate connection for publish kafka processor , when there is no new message consumed by consumeKafka processor for more then 5 minutes , i want to terminate connection with publish kafka as my consumer kafka and producer kafka are different . as soon as my consumer kafka consumer some message , i want connection to be established again with producer kafka

Rohit1997jio · ‎11-28-2023

Thanks @SAMSAL its working , but iam not bale to understand the settings . My requirement is , my max queue size will be 250 requests and i wanted them to get retried till 24 hours , every hour (every 1 hours till 24 hours) . once a flow file has completed 24 hours in queue i want it to get expired and i will drop it , by connecting it to a log message processor . can you please help on these settings ????

Rohit1997jio · ‎11-28-2023

kafka\.topic , i tried adding this , but it did not work . I checked kafka headers too there also nothing being printed in haeder.

Rohit1997jio · ‎11-28-2023

Hi , I have a publish kafka processor where iam having a self loop and flowfile expiration time for that loop is 1 hours , if some file is there for more then 1 hour it will get removed. i want to print log message (e.g. dropping the flow file) after every flow file is removed from queue after getting expired. This is the flow -

Rohit1997jio · ‎11-26-2023

kafka.topic is a key , it will have value of a kafka topic name e.g abc_xyz . this value will keep on depending from where iam consuming the meassge , from which topic . my requirement is to send the topic from where i consumed as header to the topic where iam publishing it . how can i do that ??

Rohit1997jio · ‎11-24-2023

i want to send value of kafka.topic as header i.e (the topic from where i consumed message) to publish topic (another topic) by using publish processor. But iam getting below error in publish processor-

Rohit1997jio · ‎11-20-2023

Hi , In Apache NIFI I am consuming data from one Kafka topic and publishing that data to customers Kafka topic . For this i am using ConsumeKafka and PublishKafka processor respectively. If outgoing dataflow is idle for more than 5 minutes, the Kafka connection with customer should be terminated and reconnected when there is any new messages consumed . how to do this with publish kafka processor ?? how to terminate and start the connection??

Rohit1997jio · ‎11-16-2023

Hi , In Apache NIFI I am consuming data from one Kafka topic and publishing that data to customer Kafka topic . For this iam using ConsumeKafka and PublishKafka processor respectively. If outgoing dataflow is idle for more than 5 minutes, the Kafka connection with customer should be terminated and reconnected when there is any new messages consumed . how to do this with publish kafka processor ??

Rohit1997jio · ‎11-15-2023

iam trying to publish data into multiple kafka topics with some conditions but instead of returning value of the expression , whole value passed for the property is coming. customerTopic should return me the value of the expression but its returning the expression itself attaching the images of the flow.

Rohit1997jio · ‎11-14-2023

You would need a method outside of the consume/produce that handles logic for which consume topic maps to which produce topic. can you please elaborate it more , what method and what logic need to be there

Online	Offline
Last Visited	‎09-23-2024 08:48 AM

Member Since	‎11-03-2023 12:14 AM
Last Visited	‎09-23-2024 08:48 AM
Posts	27
Kudos received	1

Cloudera Community

Re: In Apache NIFI requests are queued and showin...

Re: terminate kafka connection if publish kafka pr...

Re: how to print log message after a flow file is ...

Re: send kafka topic as header when publishing dat...

how to print log message after a flow file is expi...

Re: send kafka topic as header when publishing dat...

send kafka topic as header when publishing data to...

terminate kafka connection if publish kafka proces...

terminating kafka connection if publish kafka proc...

expression language not working in nifi update att...

Re: use only one consumer and producer processor i...