Cloudera Community
mango
user rank
Explorer

Kafka Consumer not receiving if Run Schedule is ab...

by Explorer in Support Questions
‎11-29-2023 03:03 AM
‎11-29-2023 03:03 AM
Hi everyone, We've been using the standard Kafka Consumer processor in our flows (ConsumeKafkaRecord_2_6 1.18.0.2.1.5.0-215 - org.apache.nifi - nifi-kafka-2-6-nar), and if we change the "Run Schedule" value from the the default "0 sec" to 5, 10, 30 seconds, we get weird results. Using values below or equal to "10 sec", we always receive messages; but if the value is above 10 sec, the consumer just keeps running without producing any output (flowfiles). Are we missing any specific configuration? Is this a restriction on the scheduling value we can use for Kafka consumers?   Any help will be appreciated.    Is this    Thanks  ... View more
Labels:

Re: NIFI ListenUDP with TLS support?

by Explorer in Support Questions
‎11-29-2023 02:51 AM
‎11-29-2023 02:51 AM
@steven-matison can you provide more details on that suggestion regarding DTLS? (python native capabilities in Nifi 2.0).  ... View more

Re: NIFI ListenUDP with TLS support?

by Explorer in Support Questions
‎11-29-2023 02:48 AM
‎11-29-2023 02:48 AM
Thanks @joseomjr and @steven-matison  for confirming it. That was our initial conclusion. We checked the ListenUDP Processor source code, and it looks like we could adapt it, and create a new implementation for the org.apache.nifi.processor.util.listen.dispatcher.ChannelDispatcher interface; replacing the existing implementation (org.apache.nifi.processor.util.listen.dispatcher.DatagramChannelDispatcher). On the other hand, we are also looking at the possibility to use CoAP instead, and completely rewrite that Processor, but it also depends on our clients that will interact with it. Many thanks again.  ... View more

NIFI ListenUDP with TLS support?

by Explorer in Support Questions
‎11-03-2023 08:58 AM
‎11-03-2023 08:58 AM
Hi there, We've been using Nifi for awhile in our projects, mostly using Kafka and AMQP Client processors for receiving data; but recently a request came up for UDP, specifically DTLS (Datagram transport Layer Security). Looking at the existing UDP Client Processors, it appears that DTLS is not supported; or at least it's not clear for us how to do it. Is that correct? Are there any alternatives then? Maybe creating a custom ListenDTLS processor based on the existing ListenUDP? Could that work? Best regards ... View more
Labels:
Contact Me
Online
Offline
Last Visited
‎12-21-2023 06:31 AM
Community Statistics
Member Since ‎11-03-2023 06:17 AM
Last Visited ‎12-21-2023 06:31 AM
Posts 4