Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Modify properties for Get/Put Kafka in HDF?

avatar
New Contributor

I'm seeing "kafka.common.MessageSizeTooLargeException" in my GetKafka processor. Based on some searching, I've found that by changing my properties files to include "fetch.message.max.bytes=10485760", I can alleviate the issue when using the Kafka console consumer. I'm wondering if there is any where I can add this property in HDF to allow for large sized messages to be consumer.

1 ACCEPTED SOLUTION

avatar
hide-solution

This problem has been solved!

Want to get a detailed solution you have to login/registered on the community

Register/Login
3 REPLIES 3

avatar
Master Mentor

avatar
Master Mentor

@Eric OReilly You shouldn't put fetch.message.max.bytes to config/server.properties but to your ConsumerConfi see this doc If you are using console consumer you may pass a --consumer.config consumer.properties flag where consumer.properties file will contain this config value.

avatar
hide-solution

This problem has been solved!

Want to get a detailed solution you have to login/registered on the community

Register/Login