Does anyone know about this error from Kafka? I am using Nifi 1.5.0 with ConsumerKafka processor.
ConsumeKafka[id=34753ed3-9dd6-15ed-9c91-147026236eee] Failed to retain connection due to No current assignment for partition TEST_KAFKA_TOPIC:
This is the first time we are testing Nifi to consume from over 200 topics and its failing terribly so far. When this error goes the other one comes up which is as below
Was interrupted while trying to communicate with Kafka with lease org.apache.nifi.processors.kafka.pubsub.ConsumerPool$SimpleConsumerLease@6cb8afba. Will roll back session and discard any partially received data.
Could you please try to "describe" the affected topic using command below:
kafka-topics.sh --describe --zookeeper <zkHost:zkPort> --topic TEST_KAFKA_TOPIC
Please share the output.
Are you able to consume from this topic? you can test by using kafka APIs below:
kafka-console-consumer.sh --bootstrap-server <brokerHost:brokerPort> --topic TEST_KAFKA_TOPIC --new-consumer --from-beginning
Note: If you're using kerberos, make sure to have a valid ticket and include --security-protocol SASL_PLAINTEXT
Thanks for your reply.
Please find below the output.
$ bin/kafka-topics.sh --describe --zookeeper localhost:2181 --topic TEST_KAFKA_TOPIC Topic:TEST_KAFKA_TOPIC PartitionCount:1 ReplicationFactor:1 Configs: Topic: TEST_KAFKA_TOPIC Partition: 0 Leader: 1001 Replicas: 1001 Isr: 1001
Yes,I'm able to consume from the topic from the console . The error comes and go on its own.