i am using 3 virtual server (16 core / 56 Go Ram / 1 TO ) to setup a kafka cluster. i installed a broker on two of them. i have created a topic with two partitions.
my objectif is to attend 1 000 000 messages / second. until now i am between 150 000 m/s and 204 000 m/s
batch size: 8k (8192)
message size: 300b (0.3 ko)
compression codec: none
thread num: 1
please find bellow producer configuration:
Any help will be appreciated to get 1 000 000 m / s