I use HDP 2.6.3 with Kafka and Storm. When i try to upload a topology the warning below is appeared. I use kafka client, storm client and so on with minor versions 2.6.3 (the same as the cluster versions).

imladenov — Tue, 16 Jan 2018 22:13:13 GMT

2018-01-12 15:12:30.429 o.a.k.c.p.ProducerConfig [WARN] The configuration 'key.deserializer' was supplied but isn't a known config.

2018-01-12 15:12:30.429 o.a.k.c.p.ProducerConfig [WARN] The configuration 'value.deserializer' was supplied but isn't a known config.

2018-01-12 15:12:30.429 o.a.k.c.p.ProducerConfig [WARN] The configuration 'sasl.jaas.config' was supplied but isn't a known config.

2018-01-12 15:12:30.430 o.a.k.c.p.ProducerConfig [WARN] The configuration 'serializer.class' was supplied but isn't a known config.

kafkaProperties.put("key.deserializer", "org.apache.kafka.common.serialization.StringDeserializer");

kafkaProperties.put("value.deserializer", "org.apache.kafka.common.serialization.ByteArrayDeserializer");

kafkaProperties.put("serializer.class", DefaultEncoder.class.getName());

Re: I use HDP 2.6.3 with Kafka and Storm. When i try to upload a topology the warning below is appeared. I use kafka client, storm client and so on with minor versions 2.6.3 (the same as the cluster versions).

sandyy006 — Wed, 17 Jan 2018 07:57:31 GMT

Looks like you are using the consumer properties in producer and hence kafka is ignoring.

Refer : https://kafka.apache.org/0100/documentation.html for all valid configs for the version you are using.