question Re: kafka json slow in Support Questions

kafka json slow

roshanbi — Wed, 20 Oct 2021 14:21:02 GMT

Hello Team,

we are having some performance issue when sending data to Kafka using JSON as format. Performs is very slow.

Performance is faster when using DSV parser.

How can we fine tune JSON formatter?

Regards,

Roshan

Re: kafka json slow

arandive — Thu, 21 Oct 2021 08:12:35 GMT

@roshanbi Can you please confirm the way you are sending the JSON data to the Kafka topic? Are you using kafka-console-producer? Please provide producer.properties file parameters used.

Re: kafka json slow

Nandinin — Mon, 25 Oct 2021 08:17:29 GMT

Hello @roshanbi

JSON is one of the best data exchange format which is lightweight and compact. C/DSV can be used when large dataset, with bandwidth limits are to be sent, but DSV cannot be used where the data is complex and unstructured; there comes in JSON.

So, as you said, you are are seeing a better performance with DSV, that is because it does not contain attribute-value pair as in JSON (which makes it structured). To fine tune you application, you can use

Compression.

Re: kafka json slow

VidyaSargur — Fri, 29 Oct 2021 06:33:20 GMT

@roshanbi, Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future.