Support Questions

Find answers, ask questions, and share your expertise

NiFi Publishkafka processor adding custom properties to publishkafka processir

avatar
Expert Contributor

Hi All,

I am trying to tune my publish kafka processor and want to add custom properties such as batch.size and linger.ms

however I do not see any mention of them in the source code of the processor.

So if I add these properties will the publishkafka processor honor it and use it when publishing?

How wil it work?

Thanks

Dhiren

1 ACCEPTED SOLUTION

avatar
Master Guru

The documentation for the processor is here:

https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-kafka-0-9-nar/1.6.0/org.apach...

It says...

Dynamic Properties:

Dynamic Properties allow the user to specify both the name and value of a property.

The name of a Kafka configuration property.

The value of a given Kafka configuration property.

These properties will be added on the Kafka configuration after loading any provided configuration properties. In the event a dynamic property represents a property that was already set, its value will be ignored and WARN message logged. For the list of available Kafka properties please refer to: http://kafka.apache.org/documentation.html#configuration.

View solution in original post

2 REPLIES 2

avatar
Master Guru

The documentation for the processor is here:

https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-kafka-0-9-nar/1.6.0/org.apach...

It says...

Dynamic Properties:

Dynamic Properties allow the user to specify both the name and value of a property.

The name of a Kafka configuration property.

The value of a given Kafka configuration property.

These properties will be added on the Kafka configuration after loading any provided configuration properties. In the event a dynamic property represents a property that was already set, its value will be ignored and WARN message logged. For the list of available Kafka properties please refer to: http://kafka.apache.org/documentation.html#configuration.

avatar
Expert Contributor

@Bryan Bende

Thanks a lot, appreciate it!