Member since
02-12-2021
10
Posts
0
Kudos Received
0
Solutions
12-01-2021
06:30 AM
I was having the same problem, but I couldn't find any properties in the driver documentation that would help. This error, in my case, occurred to the detriment of the connection with the database breaking due to some reason of infrastructure or service failure. However, I noticed that it was possible to solve this problem in two ways using the controller service DBCPConnectionPool: - You can set a generic query in the Validation Query parameter. This way, at each new transaction with the database, the connection will be recreated executing this query. This can be a good alternative, however, if your flow performs many queries, it will slow down the processing slightly. - You can change the Max Connection Lifetime parameter, set a value other than -1 or 0. This value is the time interval in which your connection will be recreated with the database. For example, if you set 5 min, the connection will be recreated every five minutes. In my case the problem has been fixed, I hope I have helped.
... View more
11-22-2021
09:04 AM
@Venkikancharla You are absolutely correct that CFM 2.1.2 is also impacted by this. While CFM 2.1.2 is based off Apache NiFi 1.13.2, it includes many bug fixes that eventually went in to Apache NiFi 1.14. One of those changes happened to be NIFI-8723. Full list of changes made on top of Apache NiFi 1.13.2 in CFM 2.1.2 can be found here: https://docs.cloudera.com/cfm/2.1.2/release-notes/topics/cfm-fixed-issues.html CFM 2.1.3 will include https://issues.apache.org/jira/browse/NIFI-8938 Thank you, Matt
... View more
10-29-2021
03:57 PM
Hey, Although the Nifi Registry persists the changes made to a process group, a Nifi cluster will do that regardless of having a registry or not. The Nifi Registry gives you the ability to create CI/CD across your pipelines. We have four separate Nifi clusters. Dev, Test, UAT & Production, all using the same Nifi Registry, when we make the changes in Dev the registry easily allows us to promote those changes to each of the environments with a full audit trail of who changed what and when. Critical for real life dataflows. Changes should only ever be made in dev and not directly in any of the other environments. Hope that helps
... View more
02-22-2021
07:08 AM
Hi turns out it was a permissions issue, so I had created a policy to allow the user to view the data provenance inside the Process Group but for that to work you need to add a global policy to allow that user to view the data provenance. Seems like a bit of a hack to me but thats what I had to do to get it working. Thanks for your help
... View more
02-12-2021
01:44 AM
1 Kudo
Looks like the files are available here: https://repo.hortonworks.com/content/repositories/releases/org/apache/nifi/nifi-hive-nar/
... View more