Member since
07-30-2019
3472
Posts
1642
Kudos Received
1020
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 251 | 06-03-2026 06:06 PM | |
| 529 | 05-06-2026 09:16 AM | |
| 1040 | 05-04-2026 05:20 AM | |
| 586 | 05-01-2026 10:15 AM | |
| 702 | 03-23-2026 05:44 AM |
06-28-2023
01:44 PM
@Vasu_ While NiFi still generates a flow.xml.gz, it is no longer the file that is loaded during NiFi startup. If the flow.json.gz file exists, that is what is going to be loaded. So if you swap out only the flow.xml.gz with a flow.xml.gz from archive and do not remove the flow.json.gz, the flow.json.gz is still going to be loaded. When only the flow.xml.gz exists, NiFi will load it and convert it to a flow.json.gz which it will use from that point forward. At this time, NiFi will still output both a flow.json.gs and flow.xml.gz as you make changes to the canvas in the NiFi UI. Eventually the flow.xml.gz will go away completely. If you found that the provided solution(s) assisted you with your query, please take a moment to login and click Accept as Solution below each response that helped. Thank you, Matt
... View more
06-28-2023
12:40 PM
@RalphA @udayAle I encourage you to raise your question as a new question in Cloudera Community rather then asking your question as a comment on an existing article. You can certainly. reference this article in your new community question. You'll get better visibility that way to you query. Thank you, Matt
... View more
06-21-2023
01:46 PM
@jisaitua Definitely some weird unexpected behavior there. I was able to reproduce your issue, as well as some other unexpected behavior around same area. As a workaround to your specific issue, the following NiFi Expression Language (NEL) will get you what you are looking for: {${literal('')}"$${key}":"${literal('value')}"} I also filed an Apache NiFi jira for this issue: https://issues.apache.org/jira/browse/NIFI-11738 I reproduced on an Apache NiFi 1.18 cluster I have running, so it is not an issue that just recently appeared. If you found that the provided solution(s) assisted you with your query, please take a moment to login and click Accept as Solution below each response that helped. Thank you, Matt
... View more
06-16-2023
09:58 AM
@Kiranq 1. What version of NiFi and NiFi-Registry are you using? 2. How is your GitFlowPersistenceProvider configured? Matt
... View more
06-16-2023
09:43 AM
1 Kudo
@hule Welcome to the community. I am not completely clear on your use case from your description. What are you trying to accomplish? Are you trying to generate emails within NiFi and send to an external outlook email address or are trying to have your NiFi receive emails? It sounds like maybe sending an email from a NiFi dataflow to some email address. If so, the processor you want to use is the putEmail processor. As far as the SMTP settings, those need to come from the target SMTP server. For example: Microsoft provides SMTP settings here: https://support.microsoft.com/en-gb/office/pop-imap-and-smtp-settings-8361e398-8af4-4e97-b147-6c6c4ac95353 Google Gmail provides SMTP settings here: https://support.google.com/a/answer/176600?hl=en If you found that the provided solution(s) assisted you with your query, please take a moment to login and click Accept as Solution below each response that helped. Thank you, Matt
... View more
06-16-2023
06:25 AM
@MOUROU Is your NiFi configured to support Oauth2 based user authentication? It looks more like you are using either kerberos-provider or ldap-provider fro user authentication. My suggestion to create a client certificate and use a SSLContext service for client authentication for an automated dataflow like this is because: 1. No need to obtain an token ever. 2. Certs can be created with long expiration time. 3. Tokens are NiFi node specific (same token is not valid for a different NiFi node in a the same NiFi cluster). 4. Same certs works no matter which node in the cluster the invokeHTTP connects with. Matt
... View more
06-15-2023
01:20 PM
@MOUROU I'd recommend using a clientAuth certificate fro interacting with the NiFi rest-api. Certificate based authentication via a mutualTLS exchange (always enabled in a secure NiFi) is already how NiFi nodes communicate with one another. Using certificate does not require the extra step if obtaining a token, Token is only valid for use with the NiFi node that issues it. Certificated can be created with long expiration times (typically valid for 1 or 2 years by default) If you found that the provided solution(s) assisted you with your query, please take a moment to login and click Accept as Solution below each response that helped. Thank you, Matt
... View more
06-15-2023
01:16 PM
1 Kudo
@steven-matison Looking at your flow-definition, I see that your invokeHTTP processor are configured to use an SSLContextService. I am assuming that SSLContextService is configured with the HTTPS enabled NiFi keystore and Truststore. When you then access the https rest-api endpoint, NiFi in the TLS exchange WANTs a client certificate which would be provided via the SSLContextService. I am then guessing your NiFi servers have been authorized to access that rest-api endpoint. You are correct that you would not need an Access Token since authentication was handled via a mutual TLS exchange with NiFi. Using certificates is actually the recommend method for interacting with the NiFi rest-api for a number of reasons: - No need for extra step to get a token. - Token is only valid for the specific NiFi node that issued it. Thanks, Matt
... View more
06-15-2023
05:56 AM
1 Kudo
@noncitizen Welcome to the Community!!! Apache NiFi is a very large open source project. Over the 8+ years since it was originally open sources it has grown so large that the download distribution has reached the max allowable size and does not include all components that the community has developed for NiFi. There are more then 400+ unique components developed for NiFi and growing every year. Many of these "add-on" components can be found in various open source repositories and NiFi makes it every easy to add them to your NiFi (even hot loading is possible). As is true with many open source products with lots of contributors, the documentation usually comes after the development and may at times be lacking in detail. Sometimes this because the originator could not anticipate all the possible use cases for a given component or being so close to the development there is good amount of self inferred knowledge and understanding. I myself have been working with NiFi for more then 8 years and have been exposed to many use cases, bugs, improvements, etc. I look forward to seeing you more in the community as you learn and grow and begin to help others using that new found knowledge.
... View more
06-15-2023
05:36 AM
@Kiranq This is what I believe you executed from yoru description: You were originally using the the FileSystemFlowPersistenceProvider and has already version controlled one or more NiFi Process Groups (PG) to your NiFi-Registry? Then you change your configuration to use the GitFlowPersistenceProvider? This is what I believe you did not do: Prior to switching flow persistence providers, did you stop version control on all your PGs? Switching from other Flow Persistence Provider In order to switch the Flow Persistence Provider, it is necessary to reset NiFi Registry. For example, to switch from FileSystemFlowPersistenceProvider to GitFlowPersistenceProvider, follow these steps: Stop version control on all ProcessGroups in NiFi Stop NiFi Registry Move the H2 DB (specified as nifi.registry.db.directory in nifi-registry.properties) and Flow Storage Directory for FileSystemFlowPersistenceProvider directories somewhere for back up Configure GitFlowPersistenceProvider provider in providers.xml Start NiFi Registry Recreate any buckets Start version control on all ProcessGroups again. It appears as though you may not have followed the above documented steps in the NiFi-Registry admin guide (https://nifi.apache.org/docs/nifi-registry-docs/html/administration-guide.html#flow-persistence-providers). This leaves you with your Metadata Database with info about your version controlled PGs and that metadata references flows persisted that it can no longer find in the flow persistence provider configured. If you found that the provided solution(s) assisted you with your query, please take a moment to login and click Accept as Solution below each response that helped. Thank you, Matt
... View more