Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Significance and impact of Max Request Size on publish kafka performance

avatar
Expert Contributor

Hi All,

Thanks a lot to this awesome community.

I was wondering about the significance of Max Request Size field in PublishKafka processor attached in the image.

To imporve performance I have set "Message Demaractor" as new line (shift+enter)

Also as per my understanding the custom property added in Publish kafka processor (see image attached) does the same thing.

My single event size is not more than 4 kb, when it pushed from source to listenTCP processor, in the listenTCP porcessor we batch them and them merge them to 128 MB , the block size of hdfs cluster. So my Max request size should be 128 MB or 4 Kb or not dependent on this.

39958-qkakfak.png

Thanks

Dheeru

1 ACCEPTED SOLUTION

avatar
Master Guru
hide-solution

This problem has been solved!

Want to get a detailed solution you have to login/registered on the community

Register/Login
2 REPLIES 2

avatar
Expert Contributor

@Bryan Bende Thanks a lot. Could you please help my clear my understanding on this. Appreciate it

avatar
Master Guru
hide-solution

This problem has been solved!

Want to get a detailed solution you have to login/registered on the community

Register/Login