Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

NiFi Publishkafka processor adding custom properties to publishkafka processir

avatar
Expert Contributor

Hi All,

I am trying to tune my publish kafka processor and want to add custom properties such as batch.size and linger.ms

however I do not see any mention of them in the source code of the processor.

So if I add these properties will the publishkafka processor honor it and use it when publishing?

How wil it work?

Thanks

Dhiren

1 ACCEPTED SOLUTION

avatar
Master Guru

The documentation for the processor is here:

https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-kafka-0-9-nar/1.6.0/org.apach...

It says...

Dynamic Properties:

Dynamic Properties allow the user to specify both the name and value of a property.

The name of a Kafka configuration property.

The value of a given Kafka configuration property.

These properties will be added on the Kafka configuration after loading any provided configuration properties. In the event a dynamic property represents a property that was already set, its value will be ignored and WARN message logged. For the list of available Kafka properties please refer to: http://kafka.apache.org/documentation.html#configuration.

View solution in original post

2 REPLIES 2

avatar
Master Guru

The documentation for the processor is here:

https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-kafka-0-9-nar/1.6.0/org.apach...

It says...

Dynamic Properties:

Dynamic Properties allow the user to specify both the name and value of a property.

The name of a Kafka configuration property.

The value of a given Kafka configuration property.

These properties will be added on the Kafka configuration after loading any provided configuration properties. In the event a dynamic property represents a property that was already set, its value will be ignored and WARN message logged. For the list of available Kafka properties please refer to: http://kafka.apache.org/documentation.html#configuration.

avatar
Expert Contributor

@Bryan Bende

Thanks a lot, appreciate it!