Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

kafka publisher

kafka publisher

New Contributor

ERROR [Timer-Driven Process Thread-3] o.a.n.p.kafka.pubsub.PublishKafka PublishKafka[id=264f7f31-016a-1000-8187-adeac9672940] Failed to send all message for StandardFlowFileRecord[uuid=0047b7c4-59b4-4802-93f5-688f3fb00170,claim=StandardContentClaim [resourceClaim=StandardResourceClaim[id=1555938580502-1650, container=default, section=626], offset=5040, length=8388608],offset=0,name=system.journal,size=8388608] to Kafka; routing to failure due to org.apache.nifi.stream.io.exception.TokenTooLargeException: A message in the stream exceeds the maximum allowed message size of 2097152 bytes.: org.apache.nifi.stream.io.exception.TokenTooLargeException: A message in the stream exceeds the maximum allowed message size of 2097152 bytes.

org.apache.nifi.stream.io.exception.TokenTooLargeException: A message in the stream exceeds the maximum allowed message size of 2097152 bytes.

at org.apache.nifi.processors.kafka.pubsub.PublisherLease.publish(PublisherLease.java:69)

at org.apache.nifi.processors.kafka.pubsub.PublishKafka$1.process(PublishKafka.java:337)

at org.apache.nifi.controller.repository.StandardProcessSession.read(StandardProcessSession.java:2250)

at org.apache.nifi.controller.repository.StandardProcessSession.read(StandardProcessSession.java:2218)

at org.apache.nifi.processors.kafka.pubsub.PublishKafka.onTrigger(PublishKafka.java:333)

at org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)

at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1162)

at org.apache.nifi.controller.tasks.ConnectableTask.invoke(ConnectableTask.java:205)

at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:117)

at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)

at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)

at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)

at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)

at java.lang.Thread.run(Thread.java:748)


1 REPLY 1

Re: kafka publisher

@Habtamu Wubneh

What is your question?

Don't have an account?
Coming from Hortonworks? Activate your account here