Created 05-22-2024 09:10 AM
We save some flows into a registry with postgresql and now we want to transfer to a fresh nifi instance but we are getting this error:
The Flow Registry with ID ? reports that no Flow exists with Bucket ?, Flow
Any suggestion what is it happening?
Created 05-23-2024 05:57 AM
@alan18080
The Postgres DB only holds metadata and does not contain the actual datflow in NiFi-registry. The version controlled dataflows are stored in the configured FlowPersistenceProvider. So if you are not preserving the actual flow contents, then the metadata loaded from your postgresSQL will not find it after redeployment.
I would also recommend upgrading your NiFi-Registry and NiFi versions. NiFi-Registry is going on 4 years old.
Please help our community thrive. If you found any of the suggestions/solutions provided helped you with solving your issue or answering your question, please take a moment to login and click "Accept as Solution" on one or more of them that helped.
Thank you,
Matt
Created 05-22-2024 02:42 PM
@alan18080 Welcome to the Cloudera Community!
To help you get the best possible solution, I have tagged our NiFi expert @steven-matison who may be able to assist you further.
Please keep us updated on your post, and we hope you find a satisfactory solution to your query.
Regards,
Diana Torres,Created 05-23-2024 04:33 AM
@alan18080 It seems this may be related to Process Group within a Process Group ( a known bug), but its hard to know based only on this error. You may find more verbose information in the nifi log which will help better resolve.
Here is one solution for the same:
Created 05-23-2024 04:39 AM
@alan18080
Please provide more details around the steps you are performing and the exact versions of Apache NiFi and Apache NiFi-Registry you are using.
So you have an existing NiFi-Registry configured to use Postgres as its metadata database. You have already version controlled some NiFi process group(s) to buckets within this registry. And now you are trying to export those version controlled process groups from this NiFi-Registry and import into another NiFi-Registry?
What version are the two NiFi-Registries?
What steps did you perform that eventually resulted in the exception encountered? I am not clear on what you are doing when you say "transfer".
Sharing the complete error and stack trace can also be helpful.
Thank you,
Matt
Created 05-23-2024 04:52 AM
Hello,
Nifi registry: apache/nifi-registry;0.8.0
Steps:
We deploy nifi and nifi-registry in kubernetes cluster.
We set up nifi-registry with postgresql as flowprovider.
We create a PG with con flows from nifi and start version with nifi-registry.
We delete all deployments and pvc (nifi and nifi-registry) from kubernetes but we keep postgresql database.
We deploy again nifi and nifi-registry
We see in nifi-registry the PG that we versioned
We try to import in nifi the PG from nifi-registry and we get the message "
The Flow Registry with ID ? reports that no Flow exists with Bucket ?, Flow ?"
Thanks for the support.
Created 05-23-2024 05:57 AM
@alan18080
The Postgres DB only holds metadata and does not contain the actual datflow in NiFi-registry. The version controlled dataflows are stored in the configured FlowPersistenceProvider. So if you are not preserving the actual flow contents, then the metadata loaded from your postgresSQL will not find it after redeployment.
I would also recommend upgrading your NiFi-Registry and NiFi versions. NiFi-Registry is going on 4 years old.
Please help our community thrive. If you found any of the suggestions/solutions provided helped you with solving your issue or answering your question, please take a moment to login and click "Accept as Solution" on one or more of them that helped.
Thank you,
Matt
Created 05-23-2024 02:34 PM
@alan18080 Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. Thanks.
Regards,
Diana Torres,