What's New @ Cloudera

Find the latest Cloudera product news
Celebrating as our community reaches 100,000 members! Thank you!

Flow Management in Public Cloud DataHub - Hot loading of custom processors from object stores


With the release of CDP 7.2.11, it is now super easy to deploy your custom components on your Flow Management DataHub clusters by dropping your components in a bucket of your cloud provider.


Until now, when building custom components in NiFi, you had to SSH to all of your NiFi nodes to deploy your components and make them available to use in your flow definitions. This was adding an operational overhead and was also causing issues when scaling up clusters.


From now on, it's easy to configure your NiFi clusters to automatically fetch custom components from an external location in the object store of the cloud provider where NiFi is running. All of your nodes will fetch the components after you dropped them in the configured location.


You can find more information in the documentation.