About alim

Kiranq · ‎06-20-2023

Hey, is there any solution to this issue? "The Flow Registry with ID {} reports that no Flow exists with Bucket {}, Flow {}, Version {}" Nifi in use: 1.21.0 Nifi registry: 1.21 (securely connected with Nifi) OS: Windows

Kiranq · ‎06-19-2023

Hi, I am trying to implemented this blog and so far have successfully completed till version controlling. However, I get an error when I am trying to import the flow in the PG. The prompted error says that FlowID does not exists in Bucket ID whereas I can see that the specific flow is present in the nifi registry in the UI. Can anyone help explain why this is happening? Additional info: Nifi version: 1.20.0 Nifi registry: 1.22.0 (securely connected to Nifi and buckets are given access to the CNs) Log: Error retrieving flow snapshot: An unexpected error has occurred. Please check the logs for additional details. at org.apache.nifi.registry.client.impl.AbstractJerseyClient.executeAction(AbstractJerseyClient.java:117) Caused by: javax.ws.rs.InternalServerErrorException: HTTP 500 Internal Server Error o.a.n.r.web.mapper.ThrowableMapper An unexpected error has occurred: java.lang.NullPointerException. Returning Internal Server Error response.

paulomelo · ‎11-01-2022

Hi! Anyone fixed this problem? I'm facing a similiar problem. PutKudu (or any kudu client script) when writing millions os rows, don't write some rows. No log entries and no errors in Nifi. Nifi: 1.15.1 Kudu: 1.9.1-cdh6.2.1 Thanks in advance.

VidyaSargur · ‎07-17-2022

@AbhishekSingh, as this is an older article, you would have a better chance of receiving a resolution by starting a new thread. This will also be an opportunity to provide details specific to your environment that could aid others in assisting you with a more accurate answer to your question. You can link this article as a reference in your new post.

alim · ‎05-25-2022

The ListS3 and FetchS3 processors in Apache NiFi are commonly used to retrieve objects from Amazon S3 buckets, but they can be easily configured to retrieve objects from IBM Cloud buckets. Assume, I have an IBM Cloud bucket that contains three CSV files: First, get the following from your IBM Cloud bucket configuration : Bucket Name Private Endpoint Then, from the Service Credentials of your Cloud Object Storage, get: Access Key ID Secret Access Key Note: If you don't have Service Credentials for the storage instance, create a new one with HMAC set to "true" (https://cloud.ibm.com/docs/cloud-object-storage?topic=cloud-object-storage-uhc-hmac-credentials-main) Create or confirm that your IBM Cloud user has the necessary Bucket Access Policy to view and download objects (https://cloud.ibm.com/docs/cloud-object-storage?topic=cloud-object-storage-iam-bucket-permissions) : With this setup information confirmed, add to and connect ListS3 and FetchS3 processors on your NiFi canvas, similar to the following: In the List S3 configuration, enter the Bucket, Access Key ID, Secret Access Key and Endpoint URL: Note: The Region property is ignored when the Endpoint Override URL property is used. Run the ListS3 processor and you will see a FlowFile generated for each of the bucket objects: Looking at the queue details: Now configure the FetchS3 similarly with the Bucket Name, Access Key ID, Secret Access Key and Endpoint Override URL: Run the FetchS3 processor and the three CSV files are retrieved from the IBM Cloud Bucket:

VidyaSargur · ‎02-06-2022

@Meghna_3 as this is an older article, you would have a better chance of receiving a resolution by starting a new thread. This will also be an opportunity to provide details specific to your environment that could aid others in assisting you with a more accurate answer to your question. You can link this thread as a reference in your new post.

raniaa · ‎01-17-2022

I suggest you try to set your path with "\" instead of "/" for example: C:\Users\kiran\Downloads\mysql\mysql-connector-java-8.0.17.jar it worked out for me!

Casian · ‎12-17-2021

Hello @alim, Can you please indicate where I can find the ./conf/providers.xml file ? Also regarding this "Flow snapshot histories are managed as Git commits, meaning only the latest version of Buckets and Flows exist in the Git directory.", is there any way to save all versions of a specific flow in GIT? Thank you!

John_Wise · ‎09-21-2021

@rajeshfss - Refer to the Registry docs -- Running registry and streamline web-services securely.

MattWho · ‎06-29-2021

@data-light NiFi nodes will always be authenticated via the clientAuth certificate they present. The Owner DN from the node's PrivateKeyEntry in the keystore file is what is used. What is important to know is that NiFi provides a mechanism that can trim/modify those full DNs through the uses of identity mapping properties [1]that users can configure in the nifi.properties file. After a mapping is applied against an identity string the resulting mapped value is what is actually passed to the configured NiFi Authorizer. So within the authorizer, that now mapped value is what the authorization policies need to be mapped to. The nifi-user.log will show the mapped value (case sensitive) that is being used during authorization. So if you see only "Nifi-node-0" in the nifi-user.log, then that exact string is what needs to exist in your authorizer and have policy assigned to it. If the nifi-user.log was showing "cn=Nifi-node-0, ou=mycompany, ou=nifi", then that full DN would need to be present in your authorizer with assigned policies. So you will want to get a verbose output of your nodes keystore files, your nifi.properties file to see what identity mapping patterns have been set, and the authorizers.xml to see how your authorization setup is done, and the nifi-user.log. [1] https://nifi.apache.org/docs/nifi-docs/html/administration-guide.html#identity-mapping-properties Hope this helps address your question. IF so, please take a moment to login and click "Accept" on this solution. Thank you, Matt

Online	Offline
Last Visited	‎10-02-2024 12:24 PM

Member Since	‎04-05-2016 03:36 PM
Last Visited	‎10-02-2024 12:24 PM
Posts	139
Kudos received	144

Cloudera Community

Re: How to Convert XML file into CSV file using NI...

Re: NiFi privilege - Allow modify but not operate ...

Re: I cannot see the data in the queue, I'm in Nif...

Re: Apache Nifi registry Issues with Git

Re: Client cert authentication without admin privi...

Re: Apache Nifi registry Issues with Git

Re: Setting Up a Secure NiFi to Integrate with a S...

Re: PutKudu processor doesn't throw any exceptions...

Re: Change Data Capture (CDC) with Apache NiFi (Pa...

Fetch objects from an IBM Cloud S3 bucket using Ap...

Re: Running SQL on FlowFiles using QueryRecord Pro...

Re: "Can't load database driver" in CaptureChanges...

Re: Storing Apache NiFi Versioned Flows in a Git R...

Re: Installing a local Hortonworks Registry to use...

Re: I cannot see the data in the queue, I'm in Nif...