Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

NiFi is automatically adding custom properties to ExecuteSQL, causing them to error

NiFi is automatically adding custom properties to ExecuteSQL, causing them to error

New Contributor

Hi, I'm working on creating NiFi workflows and packaging them using templates. However when the templates are uploaded into the new workspace, 3 custom properties are added to all of our ExecuteSQL processors, causing them to error out. We have verified that these properties are not present when the template is created & downloaded, and only become present when the template is uploaded. It is also weird because this only happens on some machines..

Below is a list of the 3 custom properties that get added to the ExecuteSQL processors, along with screenshots of the errors.

esql-max-rows
compression-format
esql-output-batch-size

108215-1556287761978.png

108254-1556287770476.png


What's causing this, and how do we fix it? Really at a loss here so any help is appreciated..

1 REPLY 1
Highlighted

Re: NiFi is automatically adding custom properties to ExecuteSQL, causing them to error

Master Guru

@Jake

As newer version of Apache NiFi are released, many components (processors, controller services, reporting tasks) get bug fixes and enhancements/new features added to them.

What you are seeing here is that the version of Apache NiFi where this dataflow template was originally generated was an older version which did not have these three new properties. These properties are not custom properties but rather new standard properties. When you upload a template build on Apache NiFi 1.5 for example to Apache NiFi 1.7 all the components in that template will use get upgraded to the Apache NiFi 1.7 versions. At times this may render some processors invalid (when new required properties (in bold) are added and do not have default values) and at other times the default values assigned to new properties may cause issues (as you are experiencing here).

The three new properties associated to lines you shared above are:

108333-1556540837410.png

108352-1556540853063.png

108343-1556540888114.png


You will need to set these properties to values needed for your SQL needs.


The documentation imbedded in each release of NiFi will be specific to that installed version. That documentation can be found by clicking on the global menu icon in the upper right corner of the NiFi UI and the clicking on "Help" in the presented menu.


Thank you,

Matt


If you found this answer addressed your question, please take a moment to login in and click the "ACCEPT" link.