question Re: NiFi PublishKafka_0_10 processor in Archives of Support Questions (Read Only)

NiFi PublishKafka_0_10 processor

dsandoval — Sun, 18 Aug 2019 07:26:43 GMT

I'm doing the following tutorial

https://es.hortonworks.com/tutorial/deploying-machine-learning-models-using-spark-structured-streaming/#deploying-the-model

, and at the moment of configuring Nifi to transmit tweets to Kafka. I get the following errror in the execution of the data flow:

If anyone can help me thank you very much

Re: NiFi PublishKafka_0_10 processor

Wynner — Tue, 15 May 2018 20:18:08 GMT

@David Sandoval

Will you provide a snapshot of the processor configuration? What version of HDF are you using?

Re: NiFi PublishKafka_0_10 processor

dsandoval — Sun, 18 Aug 2019 07:26:34 GMT

Hi, @Wynner

I am using the version HDP-2.5.0.0-1245.

The processor configuration: the problem is in the configuration of this parameter ack.wait.time

Re: NiFi PublishKafka_0_10 processor

Wynner — Tue, 15 May 2018 21:38:38 GMT

@David Sandoval

It looks like a version compatibility issue. Delete that property from the processor. Does that cause another issue?

What version of NiFi are you using?

Re: NiFi PublishKafka_0_10 processor

dsandoval — Sun, 18 Aug 2019 07:26:26 GMT

@Wynner

If I delete that property from the processor, I have no problem in the PublishKafka but in the processors ConsumeKafka and PutSolrContentStream I do not receive the messages.

The version I use of NIFI: 1.0.0-DEMO

Re: NiFi PublishKafka_0_10 processor

Wynner — Tue, 15 May 2018 22:32:41 GMT

@David Sandoval

Would you post a snapshot of the ConsumeKafka processor?

Re: NiFi PublishKafka_0_10 processor

dsandoval — Sun, 18 Aug 2019 07:26:18 GMT

@Wynner

The processor configuration: ConsumeKafka

Re: NiFi PublishKafka_0_10 processor

Wynner — Tue, 15 May 2018 23:41:01 GMT

@David Sandoval

The property Topic Name must match what you used in the PublishKafka processor, in this case "tweets". So, change the Topic Name(s) to tweets in the ConsumeKafka processor.

FYI, when responding to a comment or an answer posted, it is best to post the response in the same answer or comment.

Re: NiFi PublishKafka_0_10 processor

dsandoval — Tue, 15 May 2018 23:54:19 GMT

@Wynner,

it helped me thank you very much.

Re: NiFi PublishKafka_0_10 processor

Wynner — Wed, 16 May 2018 00:06:27 GMT

@David Sandoval

That is great to hear. Would you do me a favor and accept my answer?