Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

NiFi Publishkafka processor adding custom properties to publishkafka processir

Solved Go to solution

NiFi Publishkafka processor adding custom properties to publishkafka processir

Contributor

Hi All,

I am trying to tune my publish kafka processor and want to add custom properties such as batch.size and linger.ms

however I do not see any mention of them in the source code of the processor.

So if I add these properties will the publishkafka processor honor it and use it when publishing?

How wil it work?

Thanks

Dhiren

1 ACCEPTED SOLUTION

Accepted Solutions

Re: NiFi Publishkafka processor adding custom properties to publishkafka processir

The documentation for the processor is here:

https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-kafka-0-9-nar/1.6.0/org.apach...

It says...

Dynamic Properties:

Dynamic Properties allow the user to specify both the name and value of a property.

The name of a Kafka configuration property.

The value of a given Kafka configuration property.

These properties will be added on the Kafka configuration after loading any provided configuration properties. In the event a dynamic property represents a property that was already set, its value will be ignored and WARN message logged. For the list of available Kafka properties please refer to: http://kafka.apache.org/documentation.html#configuration.

2 REPLIES 2

Re: NiFi Publishkafka processor adding custom properties to publishkafka processir

The documentation for the processor is here:

https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-kafka-0-9-nar/1.6.0/org.apach...

It says...

Dynamic Properties:

Dynamic Properties allow the user to specify both the name and value of a property.

The name of a Kafka configuration property.

The value of a given Kafka configuration property.

These properties will be added on the Kafka configuration after loading any provided configuration properties. In the event a dynamic property represents a property that was already set, its value will be ignored and WARN message logged. For the list of available Kafka properties please refer to: http://kafka.apache.org/documentation.html#configuration.

Highlighted

Re: NiFi Publishkafka processor adding custom properties to publishkafka processir

Contributor

@Bryan Bende

Thanks a lot, appreciate it!