How can NiFi integrate with hashicorp vault to store sensitive information

Umakanth — Thu, 13 Feb 2020 11:09:19 GMT

We want to store our sensitive information such as passwords, private keys in Vault and retrieve it from Vault on need basis, kindly share your inputs which is much needed.

Re: How can NiFi integrate with hashicorp vault to store sensitive information

MattWho — Thu, 13 Feb 2020 13:31:32 GMT

@Umakanth

NiFi components (Processors, controller services, reporting tasks, etc.) that have password properties do not support retrieving these passwords from an external source or service. NiFi not only obscures the passwords in the UI, but also encrypts all those passwords when they are written to disk in the flow.xml.gz. Additionally, for passwords entered in the various NiFi configuration files, NiFi offers and encrypt config toolkit that can encrypt all these sensitive properties in these configuration files on disk.

I suggest maybe opening an Apache NiFi Jira with details around what you are trying to accomplish here for a possible future feature.
- For passwords utilized through NiFi dataflow components, my thought here would be maybe around a NiFi controller service for connecting to such external services. This would also require that processors that would need to use this new NiFi Controller Service to retrieve passwords would all need to be modified as well with new configuration properties to interface with the new controller service. This is by no means a simple change in NiFi, but getting the idea out there with some strong use case for it can get the ball rolling in the community.

Hope this helps,

Matt

Re: How can NiFi integrate with hashicorp vault to store sensitive information

Umakanth — Thu, 13 Feb 2020 13:52:52 GMT

Thank you for sharing your thoughts around this integration, it really really helps.

I will try to do a POC based out of your suggestion

question How can NiFi integrate with hashicorp vault to store sensitive information in Support Questions

How can NiFi integrate with hashicorp vault to store sensitive information

Re: How can NiFi integrate with hashicorp vault to store sensitive information

Re: How can NiFi integrate with hashicorp vault to store sensitive information