Problems to Nifi 1.16.3

[#1]

Greetings,

I am trying to migrate from Nifi 1.16.2 to 1.16.3.

When I try to use my flow file form my 1.16.2 installation, the application goes up but the controller service StandardRestrictedSSLContextService 1.18.0, shows a problem with the sensitive properties that are not supported.
After updating anything inside the controller, everything starts working as expected. But if a restarts Nifi, the application does not restarts.

I try to find some errors in the  nifi-app.log but none is logged, just Warnings, here some of them

2022-11-23 17:01:00,812 WARN [main] o.a.nifi.fingerprint.FingerprintFactory Schema validation error parsing Flow Configuration at line 9, col 21: cvc-complex-type.2.4.a: Invalid content was found starting with element 'description'. One of '{url}' is expected.
2022-11-23 17:01:00,825 WARN [main] o.a.nifi.fingerprint.FingerprintFactory Schema validation error parsing Flow Configuration at line 71, col 19: cvc-complex-type.2.4.d: Invalid content was found starting with element 'property'. No child element is expected at this point.
2022-11-23 17:01:00,830 WARN [main] o.a.nifi.fingerprint.FingerprintFactory Schema validation error parsing Flow Configuration at line 117, col 19: cvc-complex-type.2.4.d: Invalid content was found starting with element 'property'. No child element is expected at this point.

2022-11-23 17:01:02,497 WARN [main] d.o.a.n.s.u.c.NiFiLegacyCipherProvider Insecure Cipher Provider Algorithm [PBEWITHMD5AND256BITAES-CBC-OPENSSL] cipher requested
org.apache.nifi.deprecation.log.DeprecationException: Reference Class [org.apache.nifi.security.util.crypto.NiFiLegacyCipherProvider] ClassLoader [org.apache.nifi.nar.NarClassLoader[/opt/nifi/nifi-current/work/nar/framework/nifi-framework-nar-1.18.0.nar-unpacked]]

2022-11-23 17:01:05,706 WARN [main] org.apache.nifi.web.server.JettyServer Failed to start web server... shutting down.
org.apache.nifi.controller.serialization.FlowSynchronizationException: java.lang.NullPointerException
at org.apache.nifi.controller.XmlFlowSynchronizer.sync(XmlFlowSynchronizer.java:306)
at org.apache.nifi.controller.serialization.StandardFlowSynchronizer.sync(StandardFlowSynchronizer.java:42)
at org.apache.nifi.controller.FlowController.synchronize(FlowController.java:1525)
at org.apache.nifi.persistence.StandardFlowConfigurationDAO.load(StandardFlowConfigurationDAO.java:104)
at org.apache.nifi.controller.StandardFlowService.loadFromBytes(StandardFlowService.java:837)
at org.apache.nifi.controller.StandardFlowService.load(StandardFlowService.java:558)
at org.apache.nifi.web.contextlistener.ApplicationStartupContextListener.contextInitialized(ApplicationStartupContextListener.java:67)
at org.eclipse.jetty.server.handler.ContextHandler.callContextInitialized(ContextHandler.java:1073)
at org.eclipse.jetty.servlet.ServletContextHandler.callContextInitialized(ServletContextHandler.java:572)
at org.eclipse.jetty.server.handler.ContextHandler.contextInitialized(ContextHandler.java:1002)
at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:765)
at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:379)
at org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1449)
at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1414)
at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:916)

at org.eclipse.jetty.servlet.ServletContextHandler.doStart(ServletContextHandler.java:288)
at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:524)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:73)
at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:169)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:117)
at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:97)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:73)
at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:169)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:110)
at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:97)
at org.eclipse.jetty.server.handler.gzip.GzipHandler.doStart(GzipHandler.java:426)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:73)
at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:169)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:117)
at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:97)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:73)
at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:169)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:117)
at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:97)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:73)
at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:169)
at org.eclipse.jetty.server.Server.start(Server.java:423)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:110)
at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:97)
at org.eclipse.jetty.server.Server.doStart(Server.java:387)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:73)
at org.apache.nifi.web.server.JettyServer.start(JettyServer.java:814)
at org.apache.nifi.NiFi.<init>(NiFi.java:172)
at org.apache.nifi.NiFi.<init>(NiFi.java:83)
at org.apache.nifi.NiFi.main(NiFi.java:332)
Caused by: java.lang.NullPointerException: null
at java.base/java.util.Objects.requireNonNull(Objects.java:221)
at org.apache.nifi.controller.flow.StandardFlowManager.createFlowRegistryClient(StandardFlowManager.java:378)
at org.apache.nifi.controller.XmlFlowSynchronizer.getOrCreateFlowRegistryClient(XmlFlowSynchronizer.java:817)
at org.apache.nifi.controller.XmlFlowSynchronizer.updateFlow(XmlFlowSynchronizer.java:430)
at org.apache.nifi.controller.XmlFlowSynchronizer.sync(XmlFlowSynchronizer.java:283)
... 44 common frames omitted

Thanks in advance.

[#2]

Were you able to solve this problem? 

[#3 · Accepted solution]

@jcsilva @gourexe 

The red flag that stands out here is that you stated you were using NiFi 1.16.2 and trying to upgrade to Nifi 1.16.3; however, you then state that the problematic component is version 1.18.0.  

This implies that you or someone else added additional nar files from NiFi 1.18.0 to your NiFi 1.16.2 install lib directory.  Those newer version components may have introduced new properties that do not exist in the NiFi 1.16.x versions.  When you upgraded to NiFi 1.16.3, those 1.18.0 nar versions no longer exist, so NiFi attempts to load the same class from 1.16.3 thus resulting in your issue.

You should instead upgrade to 1.18.0 or newer version or you'll need to add in the additional nars once added before from 1.18.

Please help our community thrive. If you found any of the suggestions/solutions provided helped you with solving your issue or answering your question, please take a moment to login and click "Accept as Solution" on one or more of them that helped.

Thank you,
Matt

[#4]

Thanks @MattWho ,

Maybe we tried to skip versions and created this problem. But we could solve it.

@gourexe 

I think the solution that we have applied at that moment, was to migrate the flow to 1.16.3 in a fresh installation. Reconfigure all the secrets and then move on the versions.

The lesson that we learned is that we should have a process to test and apply new versions from Nifi, as soon as possible. 🙂