Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Consume Kafka error Nifi

Consume Kafka error Nifi

New Contributor

Does anyone know about this error from Kafka? I am using Nifi 1.5.0 with ConsumerKafka processor.

ConsumeKafka[id=34753ed3-9dd6-15ed-9c91-147026236eee] Failed to retain connection due to No current assignment for partition TEST_KAFKA_TOPIC:

This is the first time we are testing Nifi to consume from over 200 topics and its failing terribly so far. When this error goes the other one comes up which is as below

Was interrupted while trying to communicate with Kafka with lease org.apache.nifi.processors.kafka.pubsub.ConsumerPool$SimpleConsumerLease@6cb8afba. Will roll back session and discard any partially received data.

2 REPLIES 2

Re: Consume Kafka error Nifi

Contributor

Could you please try to "describe" the affected topic using command below:

kafka-topics.sh --describe --zookeeper <zkHost:zkPort> --topic TEST_KAFKA_TOPIC

Please share the output.

Are you able to consume from this topic? you can test by using kafka APIs below:

kafka-console-consumer.sh --bootstrap-server <brokerHost:brokerPort> --topic TEST_KAFKA_TOPIC --new-consumer  --from-beginning

Note: If you're using kerberos, make sure to have a valid ticket and include --security-protocol SASL_PLAINTEXT

Thanks.

Re: Consume Kafka error Nifi

New Contributor

@mrodriguez

Thanks for your reply.

Please find below the output.

[]$ bin/kafka-topics.sh --describe --zookeeper localhost:2181 --topic TEST_KAFKA_TOPIC Topic:TEST_KAFKA_TOPIC PartitionCount:1 ReplicationFactor:1 Configs: Topic: TEST_KAFKA_TOPIC Partition: 0 Leader: 1001 Replicas: 1001 Isr: 1001

Yes,I'm able to consume from the topic from the console . The error comes and go on its own.

Don't have an account?
Coming from Hortonworks? Activate your account here