Member since
01-28-2025
4
Posts
0
Kudos Received
0
Solutions
02-05-2025
10:22 PM
@MattWho Could you please suggest here? Really appreciate your insights here
... View more
02-05-2025
04:03 AM
Hi Community, I recently upgraded Apache NiFi from 1.27.0 to 2.2.0 in my Kubernetes environment. After the upgrade, I noticed that the web server is not getting the correct IP address in the logs, and my NiFi UI is not accessible. Setup Details: Previous Version: NiFi 1.27.0 Current Version: NiFi 2.2.0 Deployment: Running in Kubernetes Logs Behavior: In 1.27.0, the NiFi web server correctly binds to the expected IP. In 2.2.0, the web server logs do not show the correct IP, and the pod eventually restarts after a few minutes. Troubleshooting Done: Verified nifi.properties settings, including nifi.web.https.host. Checked kubectl logs --previous but did not find any fatal errors before the restart. Ensured the container has enough memory and CPU. Checked for readiness/liveness probe failures in Kubernetes but found no failures. Questions: Has anyone faced a similar issue after upgrading to NiFi 2.2.0? Are there any new configuration changes in 2.2.0 that could affect the web server binding/IP resolution? Any additional logs or debugging steps I should check?
... View more
Labels:
- Labels:
-
Apache NiFi
02-02-2025
11:50 PM
thanks @MattWho You are right i updated the properties file to use flow.json.gz instead of flow.xml.gz On deploying i got some another weird error which is quite much not clear to me to look after, it would be very grateful if you can suggest something on this. What i am getting from below error that it could be because of flow.json.gz might be corrupted or so. So for that i cleared out the old flow json file and did a quick restart for nifi. But getting same error now as below (pod logs context pasted below) org.apache.nifi.controller.serialization.FlowSerializationException: Could not parse flow as a VersionedDataflow at org.apache.nifi.cluster.protocol.StandardDataFlow.parseVersionedDataflow(StandardDataFlow.java:167) at org.apache.nifi.cluster.protocol.StandardDataFlow.getVersionedDataflow(StandardDataFlow.java:108) at org.apache.nifi.controller.serialization.VersionedFlowSynchronizer.isFlowEmpty(VersionedFlowSynchronizer.java:1290) at org.apache.nifi.controller.serialization.VersionedFlowSynchronizer.sync(VersionedFlowSynchronizer.java:159) at org.apache.nifi.controller.FlowController.synchronize(FlowController.java:1817) at org.apache.nifi.persistence.StandardFlowConfigurationDAO.load(StandardFlowConfigurationDAO.java:91) at org.apache.nifi.controller.StandardFlowService.loadFromBytes(StandardFlowService.java:778) at org.apache.nifi.controller.StandardFlowService.load(StandardFlowService.java:499) at org.apache.nifi.web.contextlistener.ApplicationStartupContextListener.contextInitialized(ApplicationStartupContextListener.java:67) at org.eclipse.jetty.ee10.servlet.ServletContextHandler.callContextInitialized(ServletContextHandler.java:1587) at org.eclipse.jetty.ee10.servlet.ServletContextHandler.contextInitialized(ServletContextHandler.java:498) at org.eclipse.jetty.ee10.servlet.ServletHandler.initialize(ServletHandler.java:675) at org.eclipse.jetty.ee10.servlet.ServletContextHandler.startContext(ServletContextHandler.java:1321) at org.eclipse.jetty.ee10.webapp.WebAppContext.startWebapp(WebAppContext.java:1346) at org.eclipse.jetty.ee10.webapp.WebAppContext.startContext(WebAppContext.java:1304) at org.eclipse.jetty.ee10.servlet.ServletContextHandler.lambda$doStart$0(ServletContextHandler.java:1047) at org.eclipse.jetty.server.handler.ContextHandler$ScopedContext.call(ContextHandler.java:1452) at org.eclipse.jetty.ee10.servlet.ServletContextHandler.doStart(ServletContextHandler.java:1044) at org.eclipse.jetty.ee10.webapp.WebAppContext.doStart(WebAppContext.java:503) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:93) at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:169) at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:120) at org.eclipse.jetty.server.Handler$Abstract.doStart(Handler.java:491) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:93) at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:169) at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:120) at org.eclipse.jetty.server.Handler$Abstract.doStart(Handler.java:491) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:93) at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:169) at org.eclipse.jetty.server.Server.start(Server.java:641) at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:120) at org.eclipse.jetty.server.Handler$Abstract.doStart(Handler.java:491) at org.eclipse.jetty.server.Server.doStart(Server.java:582) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:93) at org.apache.nifi.web.server.JettyServer.start(JettyServer.java:874) at org.apache.nifi.runtime.Application.startServer(Application.java:131) at org.apache.nifi.runtime.Application.run(Application.java:78) at org.apache.nifi.runtime.Application.run(Application.java:60) at org.apache.nifi.NiFi.main(NiFi.java:42) Caused by: com.fasterxml.jackson.core.JsonParseException: Unexpected character ('<' (code 60)): expected a valid value (JSON String, Number, Array, Object or token 'null', 'true' or 'false') at [Source: REDACTED (StreamReadFeature.INCLUDE_SOURCE_IN_LOCATION disabled); line: 1, column: 1] at com.fasterxml.jackson.core.JsonParser._constructReadException(JsonParser.java:2660) at com.fasterxml.jackson.core.base.ParserMinimalBase._reportUnexpectedChar(ParserMinimalBase.java:741) at com.fasterxml.jackson.core.json.UTF8StreamJsonParser._handleUnexpectedValue(UTF8StreamJsonParser.java:2752) at com.fasterxml.jackson.core.json.UTF8StreamJsonParser._nextTokenNotInObject(UTF8StreamJsonParser.java:867) at com.fasterxml.jackson.core.json.UTF8StreamJsonParser.nextToken(UTF8StreamJsonParser.java:753) at com.fasterxml.jackson.databind.ObjectMapper._initForReading(ObjectMapper.java:5004) at com.fasterxml.jackson.databind.ObjectMapper._readMapAndClose(ObjectMapper.java:4910) at com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:3921) at org.apache.nifi.cluster.protocol.StandardDataFlow.parseVersionedDataflow(StandardDataFlow.java:165) ... 38 common frames omitted
... View more
01-28-2025
01:07 AM
Thanks @MattWho for the suggestion, i am trying to upgrade from 1.27.0 to 2.0.0M3, and as you suggetsed for deprecation of flow xml file, i updated my nifi.properties accordingly and make it from nifi.flow.configuration.file=./conf/flow/flow.xml.gz to nifi.flow.configuration.file=./conf/flow/flow.json.gz Is my understanding correct? I am still getting nifi pod not coming back and aplication server getting shutdown in few minutes. Your suggestion would really be appreciated
... View more