Support Questions

Find answers, ask questions, and share your expertise

Consume Kafka error Nifi

Explorer

Does anyone know about this error from Kafka? I am using Nifi 1.5.0 with ConsumerKafka processor.

ConsumeKafka[id=34753ed3-9dd6-15ed-9c91-147026236eee] Failed to retain connection due to No current assignment for partition TEST_KAFKA_TOPIC:

This is the first time we are testing Nifi to consume from over 200 topics and its failing terribly so far. When this error goes the other one comes up which is as below

Was interrupted while trying to communicate with Kafka with lease org.apache.nifi.processors.kafka.pubsub.ConsumerPool$SimpleConsumerLease@6cb8afba. Will roll back session and discard any partially received data.

2 REPLIES 2

Expert Contributor

Could you please try to "describe" the affected topic using command below:

kafka-topics.sh --describe --zookeeper <zkHost:zkPort> --topic TEST_KAFKA_TOPIC

Please share the output.

Are you able to consume from this topic? you can test by using kafka APIs below:

kafka-console-consumer.sh --bootstrap-server <brokerHost:brokerPort> --topic TEST_KAFKA_TOPIC --new-consumer  --from-beginning

Note: If you're using kerberos, make sure to have a valid ticket and include --security-protocol SASL_PLAINTEXT

Thanks.

Explorer

@mrodriguez

Thanks for your reply.

Please find below the output.

[]$ bin/kafka-topics.sh --describe --zookeeper localhost:2181 --topic TEST_KAFKA_TOPIC Topic:TEST_KAFKA_TOPIC PartitionCount:1 ReplicationFactor:1 Configs: Topic: TEST_KAFKA_TOPIC Partition: 0 Leader: 1001 Replicas: 1001 Isr: 1001

Yes,I'm able to consume from the topic from the console . The error comes and go on its own.