Member since
11-03-2023
32
Posts
1
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
3910 | 11-08-2023 09:29 AM |
11-24-2023
01:04 AM
i want to send value of kafka.topic as header i.e (the topic from where i consumed message) to publish topic (another topic) by using publish processor. But iam getting below error in publish processor-
... View more
Labels:
- Labels:
-
Apache NiFi
11-20-2023
12:10 AM
Hi , In Apache NIFI I am consuming data from one Kafka topic and publishing that data to customers Kafka topic . For this i am using ConsumeKafka and PublishKafka processor respectively. If outgoing dataflow is idle for more than 5 minutes, the Kafka connection with customer should be terminated and reconnected when there is any new messages consumed . how to do this with publish kafka processor ?? how to terminate and start the connection??
... View more
Labels:
- Labels:
-
Apache Kafka
-
Apache NiFi
11-16-2023
12:33 AM
Hi , In Apache NIFI I am consuming data from one Kafka topic and publishing that data to customer Kafka topic . For this iam using ConsumeKafka and PublishKafka processor respectively. If outgoing dataflow is idle for more than 5 minutes, the Kafka connection with customer should be terminated and reconnected when there is any new messages consumed . how to do this with publish kafka processor ??
... View more
Labels:
- Labels:
-
Apache NiFi
11-15-2023
02:08 AM
iam trying to publish data into multiple kafka topics with some conditions but instead of returning value of the expression , whole value passed for the property is coming. customerTopic should return me the value of the expression but its returning the expression itself attaching the images of the flow.
... View more
Labels:
- Labels:
-
Apache NiFi
11-14-2023
10:57 PM
You would need a method outside of the consume/produce that handles logic for which consume topic maps to which produce topic. can you please elaborate it more , what method and what logic need to be there
... View more
11-14-2023
10:56 PM
I want to create a flow In NIFI where i want to consumer data from 3 Kafka topics and produce that data into 3 different Kafka topics . each topic should produce data into unique topic . for example - kafka topics 1 --> produce to topic A kafka topics 2 --> produce to topic B kafka topics 3 --> produce to topic C i want to use only one Consumer processor and one producer processor . Right now i am using 3 produce Kafka processor . Can anyone suggest better approach to do so and in more optimized way. Help me to reduce three publish processors to 1 , but it should be still able to consume from multiple topics and produce to multiple topics but dynamically , like topic1 produces data to topic A only and topic 2 to topic B and so on . i tried using expression language . kafka.topic is the attribute which contains consumer topics. so i added if else condition for different consumer topic but the output was not the producer topic but whole string mentioned below in update attribute added a property customerKafkaTopic=${kafka.topic:contains('alerts'):ifElse('${kafkaTopic1}',${kafka.topic:contains('events'):ifElse('${kafkaTopic2}',${kafka.topic:contains('ack'):ifElse('${kafkatopic3}','Not_found')}))}} and passed this property customerKafkaTopic in publish kafka but it is not working . Please help with a working approach.
... View more
Labels:
- Labels:
-
Apache NiFi
11-08-2023
09:29 AM
i created a new flow with same end points , some requests are getting successful , but still few requests are still getting stuck in invoke http processor giving socket timeout exception
... View more
11-08-2023
09:26 AM
You would need a method outside of the consume/produce that handles logic for which consume topic maps to which produce topic. can you please elaborate it more , what method and what logic need to be there
... View more
11-08-2023
09:22 AM
i tried using expression language . kafka.topic is the attribute which contains consumer topics. so i added if else condition for different consumer topic but the output was not the producer topic but whole string mentioned below in update attribute added a property customerKafkaTopic=${kafka.topic:contains('alerts'):ifElse('${kafkaTopic1}',${kafka.topic:contains('events'):ifElse('${kafkaTopic2}',${kafka.topic:contains('ack'):ifElse('${kafkatopic3}','Not_found')}))}} and passed this property customerKafkaTopic in publish kafka but it is not working ,
... View more
11-08-2023
01:50 AM
I want to create a flow In NIFI where i want to consumer data from 3 Kafka topics and produce that data into 3 different Kafka topics . each topic should produce data into unique topic . for example - kafka topics 1 --> produce to topic A kafka topics 2 --> produce to topic B kafka topics 3 --> produce to topic C i want to use only one Consumer processor and one producer processor . Right now i am using 3 produce Kafka processor . Can anyone suggest better approach to do so and in more optimized way.
... View more
Labels:
- Labels:
-
Apache Kafka
- « Previous
- Next »