Member since
07-12-2023
3
Posts
0
Kudos Received
0
Solutions
07-18-2023
03:09 AM
@vaishaakb @tjangid @steven-matison @MattWho I installed with cloudera manager CDH6 and CFM2.1.5.1000-56 through parcels. I created a cluster with 3 virtual machines, with cloudera manager. I installed distributed zookeeper on the 3 virtual machines. And I did the same installation for NIFI. So as you can see, the zookeeper it's started very well on the 3 virtuals machines: And You can see my nifi instances too: So when I run my nifi instances, on the cloudera web interface evrything going well. but on the nifi web interface I get this issue: You can see error message from : /var/log/nifi/nifi-app.log 2023-07-18 11:49:27,730 INFO org.apache.nifi.controller.repository.FileSystemRepository: Initializing FileSystemRepository with 'Always Sync' set to false 2023-07-18 11:49:27,906 INFO org.apache.nifi.controller.FlowController: Checking if there is already a Cluster Coordinator Elected... 2023-07-18 11:49:27,980 INFO org.apache.curator.framework.imps.CuratorFrameworkImpl: Starting 2023-07-18 11:49:27,996 INFO org.apache.zookeeper.common.X509Util: Setting -D jdk.tls.rejectClientInitiatedRenegotiation=true to disable client-initiated TLS renegotiation 2023-07-18 11:49:27,999 INFO org.apache.zookeeper.ClientCnxnSocket: jute.maxbuffer value is 1048575 Bytes 2023-07-18 11:49:28,014 INFO org.apache.curator.framework.imps.CuratorFrameworkImpl: Default schema 2023-07-18 11:49:28,066 INFO org.apache.curator.framework.state.ConnectionStateManager: State change: CONNECTED 2023-07-18 11:49:28,095 INFO org.apache.curator.framework.imps.CuratorFrameworkImpl: backgroundOperationsLoop exiting 2023-07-18 11:49:28,203 INFO org.apache.nifi.controller.FlowController: It appears that no Cluster Coordinator has been Elected yet. Registering for Cluster Coordinator Role. 2023-07-18 11:49:28,205 INFO org.apache.nifi.controller.leader.election.CuratorLeaderElectionManager: CuratorLeaderElectionManager[stopped=true] Registered new Leader Selector for role Cluster Coordinator; this node is an active participant in the election. 2023-07-18 11:49:28,205 INFO org.apache.curator.framework.imps.CuratorFrameworkImpl: Starting 2023-07-18 11:49:28,206 INFO org.apache.zookeeper.ClientCnxnSocket: jute.maxbuffer value is 1048575 Bytes 2023-07-18 11:49:28,206 INFO org.apache.curator.framework.imps.CuratorFrameworkImpl: Default schema 2023-07-18 11:49:28,208 INFO org.apache.nifi.controller.leader.election.CuratorLeaderElectionManager: CuratorLeaderElectionManager[stopped=false] Registered new Leader Selector for role Cluster Coordinator; this node is an active participant in the election. 2023-07-18 11:49:28,208 INFO org.apache.nifi.controller.leader.election.CuratorLeaderElectionManager: CuratorLeaderElectionManager[stopped=false] started 2023-07-18 11:49:28,208 INFO org.apache.nifi.cluster.coordination.heartbeat.AbstractHeartbeatMonitor: Heartbeat Monitor started 2023-07-18 11:49:28,212 INFO org.apache.curator.framework.state.ConnectionStateManager: State change: CONNECTED 2023-07-18 11:49:28,213 INFO org.apache.nifi.controller.leader.election.CuratorLeaderElectionManager: org.apache.nifi.controller.leader.election.CuratorLeaderElectionManager$ElectionListener@29fb18c1 Connection State changed to CONNECTED 2023-07-18 11:49:28,327 INFO org.apache.curator.framework.state.ConnectionStateManager: State change: SUSPENDED 2023-07-18 11:49:28,328 INFO org.apache.nifi.controller.leader.election.CuratorLeaderElectionManager: org.apache.nifi.controller.leader.election.CuratorLeaderElectionManager$ElectionListener@29fb18c1 Connection State changed to SUSPENDED 2023-07-18 11:49:28,409 INFO org.opensaml.core.config.InitializationService: Initializing OpenSAML using the Java Services API 2023-07-18 11:49:29,708 INFO org.apache.curator.framework.state.ConnectionStateManager: State change: RECONNECTED 2023-07-18 11:49:29,708 INFO org.apache.nifi.controller.leader.election.CuratorLeaderElectionManager: org.apache.nifi.controller.leader.election.CuratorLeaderElectionManager$ElectionListener@29fb18c1 Connection State changed to RECONNECTED 2023-07-18 11:49:29,823 INFO org.apache.curator.framework.state.ConnectionStateManager: State change: SUSPENDED 2023-07-18 11:49:29,824 INFO org.apache.nifi.controller.leader.election.CuratorLeaderElectionManager: org.apache.nifi.controller.leader.election.CuratorLeaderElectionManager$ElectionListener@29fb18c1 Connection State changed to SUSPENDED 2023-07-18 11:49:30,334 INFO org.apache.curator.framework.state.ConnectionStateManager: State change: RECONNECTED 2023-07-18 11:49:30,335 INFO org.apache.nifi.controller.leader.election.CuratorLeaderElectionManager: org.apache.nifi.controller.leader.election.CuratorLeaderElectionManager$ElectionListener@29fb18c1 Connection State changed to RECONNECTED 2023-07-18 11:49:30,444 INFO org.apache.curator.framework.state.ConnectionStateManager: State change: SUSPENDED 2023-07-18 11:49:30,445 INFO org.apache.nifi.controller.leader.election.CuratorLeaderElectionManager: org.apache.nifi.controller.leader.election.CuratorLeaderElectionManager$ElectionListener@29fb18c1 Connection State changed to SUSPENDED 2023-07-18 11:49:31,325 INFO org.apache.curator.framework.state.ConnectionStateManager: State change: RECONNECTED 2023-07-18 11:49:31,326 INFO org.apache.nifi.controller.leader.election.CuratorLeaderElectionManager: org.apache.nifi.controller.leader.election.CuratorLeaderElectionManager$ElectionListener@29fb18c1 Connection State changed to RECONNECTED 2023-07-18 11:49:31,432 INFO org.apache.curator.framework.state.ConnectionStateManager: State change: SUSPENDED 2023-07-18 11:49:31,433 INFO org.apache.nifi.controller.leader.election.CuratorLeaderElectionManager: org.apache.nifi.controller.leader.election.CuratorLeaderElectionManager$ElectionListener@29fb18c1 Connection State changed to SUSPENDED 2023-07-18 11:49:32,121 INFO org.apache.curator.framework.state.ConnectionStateManager: State change: RECONNECTED 2023-07-18 11:49:32,122 INFO org.apache.nifi.controller.leader.election.CuratorLeaderElectionManager: org.apache.nifi.controller.leader.election.CuratorLeaderElectionManager$ElectionListener@29fb18c1 Connection State changed to RECONNECTED 2023-07-18 11:49:32,233 INFO org.apache.curator.framework.state.ConnectionStateManager: State change: SUSPENDED 2023-07-18 11:49:32,233 INFO org.apache.nifi.controller.leader.election.CuratorLeaderElectionManager: org.apache.nifi.controller.leader.election.CuratorLeaderElectionManager$ElectionListener@29fb18c1 Connection State changed to SUSPENDED 2023-07-18 11:49:32,338 INFO org.eclipse.jetty.server.handler.ContextHandler: Started o.e.j.w.WebAppContext@3aebdb4{nifi-api,/nifi-api,file:///var/lib/nifi/cert/work/jetty/nifi-web-api-1.18.0.2.1.5.1000-56.war/webapp/,AVAILABLE}{/var/lib/nifi/cert/work/nar/extensions/nifi-server-nar-1.18.0.2.1.5.1000-56.nar-unpacked/NAR-INF/bundled-dependencies/nifi-web-api-1.18.0.2.1.5.1000-56.war} 2023-07-18 11:49:32,690 INFO org.eclipse.jetty.annotations.AnnotationConfiguration: Scanning elapsed time=166ms 2023-07-18 11:49:32,748 INFO org.eclipse.jetty.server.handler.ContextHandler._nifi_content_viewer: No Spring WebApplicationInitializer types detected on classpath 2023-07-18 11:49:32,784 INFO org.eclipse.jetty.server.handler.ContextHandler: Started o.e.j.w.WebAppContext@4fd70118{nifi-content-viewer,/nifi-content-viewer,file:///var/lib/nifi/cert/work/jetty/nifi-web-content-viewer-1.18.0.2.1.5.1000-56.war/webapp/,AVAILABLE}{/var/lib/nifi/cert/work/nar/extensions/nifi-server-nar-1.18.0.2.1.5.1000-56.nar-unpacked/NAR-INF/bundled-dependencies/nifi-web-content-viewer-1.18.0.2.1.5.1000-56.war} 2023-07-18 11:49:32,817 INFO org.eclipse.jetty.annotations.AnnotationConfiguration: Scanning elapsed time=7ms 2023-07-18 11:49:32,835 INFO org.eclipse.jetty.server.handler.ContextHandler._nifi_docs: No Spring WebApplicationInitializer types detected on classpath 2023-07-18 11:49:32,837 INFO org.eclipse.jetty.server.handler.ContextHandler: Started o.e.j.w.WebAppContext@1db7c267{nifi-docs,/nifi-docs,file:///var/lib/nifi/cert/work/jetty/nifi-web-docs-1.18.0.2.1.5.1000-56.war/webapp/,AVAILABLE}{/var/lib/nifi/cert/work/nar/extensions/nifi-server-nar-1.18.0.2.1.5.1000-56.nar-unpacked/NAR-INF/bundled-dependencies/nifi-web-docs-1.18.0.2.1.5.1000-56.war} 2023-07-18 11:49:32,854 INFO org.eclipse.jetty.annotations.AnnotationConfiguration: Scanning elapsed time=7ms 2023-07-18 11:49:32,855 INFO org.eclipse.jetty.server.handler.ContextHandler._: No Spring WebApplicationInitializer types detected on classpath 2023-07-18 11:49:32,870 INFO org.eclipse.jetty.server.handler.ContextHandler: Started o.e.j.w.WebAppContext@516370c1{nifi-error,/,file:///var/lib/nifi/cert/work/jetty/nifi-web-error-1.18.0.2.1.5.1000-56.war/webapp/,AVAILABLE}{/var/lib/nifi/cert/work/nar/extensions/nifi-server-nar-1.18.0.2.1.5.1000-56.nar-unpacked/NAR-INF/bundled-dependencies/nifi-web-error-1.18.0.2.1.5.1000-56.war} 2023-07-18 11:49:32,880 INFO org.eclipse.jetty.server.AbstractConnector: Started ServerConnector@159314ca{HTTP/1.1, (http/1.1)}{wdyc8594.net.intra.laposte.fr:8081} 2023-07-18 11:49:32,880 INFO org.eclipse.jetty.server.Server: Started @28372ms 2023-07-18 11:49:32,905 INFO org.apache.nifi.web.server.JettyServer: Loading Flow... 2023-07-18 11:49:32,933 INFO org.apache.nifi.io.socket.SocketListener: Now listening for connections from nodes on port 9991 2023-07-18 11:49:32,945 INFO org.apache.nifi.controller.serialization.VersionedFlowSynchronizer: Synchronizing FlowController with proposed flow: Controller Already Synchronized = false 2023-07-18 11:49:33,128 INFO org.apache.curator.framework.state.ConnectionStateManager: State change: RECONNECTED 2023-07-18 11:49:33,128 INFO org.apache.nifi.controller.leader.election.CuratorLeaderElectionManager: org.apache.nifi.controller.leader.election.CuratorLeaderElectionManager$ElectionListener@29fb18c1 Connection State changed to RECONNECTED 2023-07-18 11:49:33,239 INFO org.apache.curator.framework.state.ConnectionStateManager: State change: SUSPENDED 2023-07-18 11:49:33,241 INFO org.apache.nifi.controller.leader.election.CuratorLeaderElectionManager: org.apache.nifi.controller.leader.election.CuratorLeaderElectionManager$ElectionListener@29fb18c1 Connection State changed to SUSPENDED 2023-07-18 11:49:33,308 INFO org.apache.nifi.controller.serialization.VersionedFlowSynchronizer: In order to inherit proposed dataflow, will stop any components that will be affected by the update 2023-07-18 11:49:33,308 INFO org.apache.nifi.controller.serialization.AffectedComponentSet: Stopping the following components: AffectedComponentSet[inputPorts=[], outputPorts=[], remoteInputPorts=[], remoteOutputPorts=[], processors=[], parameterProviders=[], flowRegistryCliens=[], controllerServices=[], reportingTasks=[]] 2023-07-18 11:49:33,309 INFO org.apache.nifi.controller.serialization.AffectedComponentSet: Successfully stopped all components in 1 milliseconds 2023-07-18 11:49:33,313 INFO org.apache.nifi.wali.SequentialAccessWriteAheadLog: Recovering records from Write-Ahead Log at /var/lib/nifi/cert/flowfile_repository 2023-07-18 11:49:33,320 INFO org.apache.nifi.wali.HashMapSnapshot: org.apache.nifi.wali.HashMapSnapshot@399655ce restored 0 Records and 0 Swap Files from Snapshot, ending with Transaction ID -1 2023-07-18 11:49:33,321 INFO org.apache.nifi.wali.SequentialAccessWriteAheadLog: Successfully recovered 0 records and 0 swap files from Snapshot at /var/lib/nifi/cert/flowfile_repository/checkpoint with Max Transaction ID of -1 in 7 milliseconds. Now recovering records from 1 journal files 2023-07-18 11:49:33,324 INFO org.apache.nifi.wali.LengthDelimitedJournal: Recovering records from journal /var/lib/nifi/cert/flowfile_repository/journals/1.journal 2023-07-18 11:49:33,325 INFO org.apache.nifi.wali.LengthDelimitedJournal: Successfully recovered 0 updates from journal /var/lib/nifi/cert/flowfile_repository/journals/1.journal 2023-07-18 11:49:33,326 INFO org.apache.nifi.wali.SequentialAccessWriteAheadLog: Successfully recovered 0 records in 12 milliseconds. Now checkpointing to ensure that Write-Ahead Log is in a consistent state 2023-07-18 11:49:33,329 INFO org.apache.nifi.wali.SequentialAccessWriteAheadLog: Checkpointed Write-Ahead Log with 0 Records and 0 Swap Files in 3 milliseconds (Stop-the-world time = 0 milliseconds), max Transaction ID -1 2023-07-18 11:49:33,355 INFO org.apache.nifi.flow.synchronization.StandardVersionedComponentSynchronizer: No differences between current flow and proposed flow for StandardProcessGroup[identifier=64e54f67-0189-1000-1eea-020502baaa9f,name=NiFi Flow] 2023-07-18 11:49:33,372 INFO org.apache.nifi.controller.serialization.AffectedComponentSet: Starting the following components: AffectedComponentSet[inputPorts=[], outputPorts=[], remoteInputPorts=[], remoteOutputPorts=[], processors=[], parameterProviders=[], flowRegistryCliens=[], controllerServices=[], reportingTasks=[]] 2023-07-18 11:49:33,373 INFO org.apache.nifi.controller.serialization.VersionedFlowSynchronizer: Successfully synchronized dataflow with the proposed flow in 429 millis 2023-07-18 11:49:33,373 INFO org.apache.nifi.controller.FlowController: Successfully synchronized controller with proposed flow. Flow contains the following number of components: {Processors=0, Controller Services=0, Reporting Tasks=0, Process Groups=0, Remote Process Groups=0, Parameter Providers=0, Flow Registr y Clients=0, Local Input Ports=0, Local Output Ports=0, Public Input Ports=0, Public Output Ports=0} 2023-07-18 11:49:33,485 INFO org.apache.nifi.controller.StandardFlowService: Connecting Node: wdyc8594.net.intra.laposte.fr:8081 2023-07-18 11:49:33,802 INFO org.apache.curator.framework.state.ConnectionStateManager: State change: RECONNECTED 2023-07-18 11:49:33,803 INFO org.apache.nifi.controller.leader.election.CuratorLeaderElectionManager: org.apache.nifi.controller.leader.election.CuratorLeade rElectionManager$ElectionListener@29fb18c1 Connection State changed to RECONNECTED 2023-07-18 11:49:33,804 WARN org.apache.nifi.controller.StandardFlowService: There is currently no Cluster Coordinator. This often happens upon restart of Ni Fi when running an embedded ZooKeeper. Will register this node to become the active Cluster Coordinator and will attempt to connect to cluster again 2023-07-18 11:49:33,805 INFO org.apache.nifi.controller.leader.election.CuratorLeaderElectionManager: CuratorLeaderElectionManager[stopped=false] Attempted t o register Leader Election for role 'Cluster Coordinator' but this role is already registered 2023-07-18 11:49:33,904 INFO org.apache.curator.framework.state.ConnectionStateManager: State change: SUSPENDED 2023-07-18 11:49:33,904 INFO org.apache.nifi.controller.leader.election.CuratorLeaderElectionManager: org.apache.nifi.controller.leader.election.CuratorLeade rElectionManager$ElectionListener@29fb18c1 Connection State changed to SUSPENDED 2023-07-18 11:49:34,911 INFO org.apache.curator.framework.state.ConnectionStateManager: State change: RECONNECTED 2023-07-18 11:49:34,911 INFO org.apache.nifi.controller.leader.election.CuratorLeaderElectionManager: org.apache.nifi.controller.leader.election.CuratorLeade rElectionManager$ElectionListener@29fb18c1 Connection State changed to RECONNECTED 2023-07-18 11:49:35,012 INFO org.apache.curator.framework.state.ConnectionStateManager: State change: SUSPENDED 2023-07-18 11:49:35,012 INFO org.apache.nifi.controller.leader.election.CuratorLeaderElectionManager: org.apache.nifi.controller.leader.election.CuratorLeade rElectionManager$ElectionListener@29fb18c1 Connection State changed to SUSPENDED 2023-07-18 11:49:35,212 INFO org.apache.curator.framework.state.ConnectionStateManager: State change: RECONNECTED 2023-07-18 11:49:35,213 INFO org.apache.nifi.controller.leader.election.CuratorLeaderElectionManager: org.apache.nifi.controller.leader.election.CuratorLeade rElectionManager$ElectionListener@29fb18c1 Connection State changed to RECONNECTED 2023-07-18 11:49:35,213 WARN org.apache.nifi.controller.StandardFlowService: There is currently no Cluster Coordinator. This often happens upon restart of Ni Fi when running an embedded ZooKeeper. Will register this node to become the active Cluster Coordinator and will attempt to connect to cluster again 2023-07-18 11:49:35,213 INFO org.apache.nifi.controller.leader.election.CuratorLeaderElectionManager: CuratorLeaderElectionManager[stopped=false] Attempted t o register Leader Election for role 'Cluster Coordinator' but this role is already registered 2023-07-18 11:49:35,314 INFO org.apache.curator.framework.state.ConnectionStateManager: State change: SUSPENDED 2023-07-18 11:49:35,314 INFO org.apache.nifi.controller.leader.election.CuratorLeaderElectionManager: org.apache.nifi.controller.leader.election.CuratorLeade rElectionManager$ElectionListener@29fb18c1 Connection State changed to SUSPENDED 2023-07-18 11:49:35,314 ERROR org.apache.curator.framework.imps.CuratorFrameworkImpl: Background operation retry gave up org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss at org.apache.zookeeper.KeeperException.create(KeeperException.java:102) at org.apache.curator.framework.imps.CuratorFrameworkImpl.checkBackgroundRetry(CuratorFrameworkImpl.java:885) at org.apache.curator.framework.imps.CuratorFrameworkImpl.processBackgroundOperation(CuratorFrameworkImpl.java:677) at org.apache.curator.framework.imps.WatcherRemovalFacade.processBackgroundOperation(WatcherRemovalFacade.java:152) at org.apache.curator.framework.imps.FindAndDeleteProtectedNodeInBackground$2.processResult(FindAndDeleteProtectedNodeInBackground.java:104) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:668) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:553) 2023-07-18 11:49:35,980 INFO org.apache.nifi.web.server.RequestLog: 10.152.0.246 - - [18/Jul/2023:09:49:35 +0000] "GET / HTTP/1.0" 200 1068 "-" "-". So this is my nifi.properties nifi.administrative.yield.duration=30 sec nifi.authorizer.configuration.file=/var/lib/nifi/cert/authorizers.xml nifi.bored.yield.duration=10 millis nifi.cluster.firewall.file= nifi.cluster.flow.election.max.candidates= nifi.cluster.flow.election.max.wait.time=5 mins nifi.cluster.is.node=true nifi.cluster.load.balance.comms.timeout=30 sec nifi.cluster.load.balance.connections.per.node=4 nifi.cluster.load.balance.host= nifi.cluster.load.balance.max.thread.count=8 nifi.cluster.load.balance.port=6342 nifi.cluster.node.address=wdycxxxx.net.intra.laposte.fr nifi.cluster.node.connection.timeout=30 sec nifi.cluster.node.event.history.size=25 nifi.cluster.node.max.concurrent.requests=100 nifi.cluster.node.protocol.max.threads=50 nifi.cluster.node.protocol.port=9991 nifi.cluster.node.protocol.threads=50 nifi.cluster.node.read.timeout=30 sec nifi.cluster.protocol.heartbeat.interval=5 sec nifi.cluster.protocol.is.secure=false nifi.components.status.repository.buffer.size=1440 nifi.components.status.repository.implementation=org.apache.nifi.controller.status.history.VolatileComponentStatusRepository nifi.components.status.snapshot.frequency=1 min nifi.content.claim.max.appendable.size=1 MB nifi.content.claim.max.flow.files=100 nifi.content.repository.always.sync=false nifi.content.repository.archive.enabled=true nifi.content.repository.archive.max.retention.period=12 hours nifi.content.repository.archive.max.usage.percentage=50% nifi.content.repository.directory.default=/var/lib/nifi/cert/content-repository nifi.content.repository.implementation=org.apache.nifi.controller.repository.FileSystemRepository nifi.content.viewer.url=/var/lib/nifi/cert/nifi-content-viewer/ nifi.database.directory=/var/lib/nifi/cert/database_repository nifi.documentation.working.directory=/var/lib/nifi/work/docs/components nifi.flow.configuration.archive.dir=/var/lib/nifi/cert/archive/ nifi.flow.configuration.archive.enabled=true nifi.flow.configuration.archive.max.count= nifi.flow.configuration.archive.max.storage=500 MB nifi.flow.configuration.archive.max.time=30 days nifi.flow.configuration.file=/var/lib/nifi/cert/flow.xml.gz nifi.flow.configuration.json.file=/var/lib/nifi/cert/flow.json.gz nifi.flowcontroller.autoResumeState=true nifi.flowcontroller.graceful.shutdown.period=10 sec nifi.flowfile.repository.always.sync=false nifi.flowfile.repository.checkpoint.interval=2 mins nifi.flowfile.repository.directory=/var/lib/nifi/cert/flowfile_repository nifi.flowfile.repository.implementation=org.apache.nifi.controller.repository.WriteAheadFlowFileRepository nifi.flowfile.repository.partitions=256 nifi.flowfile.repository.wal.implementation=org.apache.nifi.wali.SequentialAccessWriteAheadLog nifi.flowservice.writedelay.interval=500 ms nifi.h2.url.append=;LOCK_TIMEOUT=25000;WRITE_DELAY=0;AUTO_SERVER=FALSE nifi.initial.admin.identity=EMAILADDRESS=srsi-ccs.dsictr@laposte.fr, OU=DSI Centrale, O=La Poste, L=Nantes, C=FR nifi.kerberos.krb5.file=/etc/krb5.conf nifi.kerberos.service.keytab.location=/var/run/cloudera-scm-agent/process/1546348221-nifi-NIFI_NODE/nifi.keytab nifi.kerberos.spnego.authentication.expiration=12 hours nifi.kerberos.spnego.keytab.location=/var/run/cloudera-scm-agent/process/1546348221-nifi-NIFI_NODE/nifi.keytab nifi.login.identity.provider.configuration.file=/var/lib/nifi/cert/login-identity-providers.xml nifi.nar.library.autoload.directory=/var/lib/nifi/cert/extensions nifi.nar.library.directory=/opt/cloudera/parcels/CFM-2.1.5.1000-56/NIFI/lib nifi.nar.working.directory=/var/lib/nifi/cert/work/nar/ nifi.provenance.repository.always.sync=false nifi.provenance.repository.buffer.size=100000 nifi.provenance.repository.compress.on.rollover=true nifi.provenance.repository.concurrent.merge.threads=2 nifi.provenance.repository.debug.frequency=1000 nifi.provenance.repository.directory.default=/var/lib/nifi/cert/provenance_repository nifi.provenance.repository.encryption.key.provider.location= nifi.provenance.repository.implementation=org.apache.nifi.provenance.WriteAheadProvenanceRepository nifi.provenance.repository.index.shard.size=500 MB nifi.provenance.repository.index.threads=2 nifi.provenance.repository.indexed.attributes= nifi.provenance.repository.indexed.fields=EventType, FlowFileUUID, Filename, ProcessorID, Relationship nifi.provenance.repository.max.attribute.length=65536 nifi.provenance.repository.max.storage.size=1 GB nifi.provenance.repository.max.storage.time=24 hours nifi.provenance.repository.query.threads=2 nifi.provenance.repository.rollover.time=30 secs nifi.queue.backpressure.count=10000 nifi.queue.backpressure.size=1 GB nifi.queue.swap.threshold=20000 nifi.remote.contents.cache.expiration=30 secs nifi.remote.input.http.enabled=true nifi.remote.input.http.transaction.ttl=30 sec nifi.remote.input.secure=false nifi.remote.input.socket.port=10443 nifi.security.allow.anonymous.authentication=true nifi.security.keyPasswd= nifi.security.keystore=/var/lib/nifi/cert/keystore.jks nifi.security.keystorePasswd=oNIuLqDYy8NVlU2h||vN03xKvdX7h8Rli8JsH4/0pvmtSYFO0p9/ixPQ== nifi.security.keystorePasswd.protected=aes/gcm/256 nifi.security.keystoreType=jks nifi.security.ocsp.responder.certificate= nifi.security.ocsp.responder.url= nifi.security.truststore=/var/lib/nifi/cert/truststore.jks nifi.security.truststorePasswd=x6LViRDw06iQorcX||0XITN2J+Xa0V++cjGXb98CEQG1GGF0VeIJGztA== nifi.security.truststorePasswd.protected=aes/gcm/256 nifi.security.truststoreType=jks nifi.security.user.authorizer=single-user-authorizer nifi.security.user.knox.audiences= nifi.security.user.knox.cookieName= nifi.security.user.oidc.client.id= nifi.security.user.oidc.client.secret= nifi.security.user.oidc.connect.timeout=5 secs nifi.security.user.oidc.discovery.url= nifi.security.user.oidc.preferred.jwsalgorithm= nifi.security.user.oidc.read.timeout=5 secs nifi.sensitive.props.additional.keys= nifi.sensitive.props.algorithm=PBEWITHMD5AND256BITAES-CBC-OPENSSL nifi.sensitive.props.key=6LZUvr4EBwEVav3m||WIgyzI8pFhRGJLhU+hl/FrOtbVATkMwiicT5q7R2Du/CacEfdlCIyqGm3Eos4w== nifi.sensitive.props.key.protected=aes/gcm/256 nifi.sensitive.props.provider=BC nifi.state.management.configuration.file=/var/lib/nifi/cert/state-management.xml nifi.state.management.embedded.zookeeper.properties=/opt/cloudera/parcels/CDH-6.3.4-1.cdh6.3.4.p0.6751098/lib/zookeeper/conf/zoo.cfg nifi.state.management.embedded.zookeeper.start=false nifi.state.management.provider.cluster=zk-provider nifi.swap.in.period=5 sec nifi.swap.in.threads=1 nifi.swap.manager.implementation=org.apache.nifi.controller.FileSystemSwapManager nifi.swap.out.period=5 sec nifi.swap.out.threads=4 nifi.templates.directory=/var/run/cloudera-scm-agent/process/1546348221-nifi-NIFI_NODE/templates nifi.toolkit.tls.regenerate=false nifi.ui.autorefresh.interval=30 sec nifi.ui.banner.text= nifi.web.http.host=wdycxxxx.net.intra.laposte.fr nifi.web.http.network.interface.default= nifi.web.http.port=8081 nifi.web.https.host= nifi.web.https.network.interface.default= nifi.web.https.port= nifi.web.jetty.threads=200 nifi.web.jetty.working.directory=/var/lib/nifi/cert/work/jetty nifi.web.max.header.size=16 KB nifi.web.proxy.globals.path= nifi.web.proxy.host=csgclouderamanagernode18081-dev.net.intra.laposte.fr nifi.web.war.directory=/opt/cloudera/parcels/CFM-2.1.5.1000-56/NIFI/lib nifi.zookeeper.auth.type= nifi.zookeeper.client.secure=false nifi.zookeeper.connect.string=wdycxxxx.net.intra.laposte.fr:2181,wdycxxxx.net.intra.laposte.fr:2181,wdycxxxx.net.intra.laposte.fr:2181 nifi.zookeeper.connect.timeout=60 secs nifi.zookeeper.kerberos.removeHostFromPrincipal= nifi.zookeeper.kerberos.removeRealmFromPrincipal= nifi.zookeeper.root.node=/nifi nifi.zookeeper.server.dir=/var/lib/zookeeper nifi.zookeeper.server.enabled=true nifi.zookeeper.session.timeout=60 secs nifi.state.management.provider.local=local-provider nifi.provenance.repository.rollover.size=100 MB
... View more
07-16-2023
07:03 AM
this is the error message: 2023-07-12 15:49:10,154 WARN org.apache.nifi.controller.StandardFlowService: There is currently no Cluster Coordinator. This often happens upon restart of NiFi when running an embedded ZooKeeper. Will register this node to become the active Cluster Coordinator and will attempt to connect to cluster again 2023-07-12 15:49:10,154 INFO org.apache.nifi.controller.leader.election.CuratorLeaderElectionManager: CuratorLeaderElectionManager[stopped=false] Attempted to register Leader Election for role 'Cluster Coordinator' but this role is already registered 2023-07-12 15:49:10,254 INFO org.apache.curator.framework.state.ConnectionStateManager: State change: SUSPENDED 2023-07-12 15:49:10,254 ERROR org.apache.curator.framework.imps.CuratorFrameworkImpl: Background operation retry gave up org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss at org.apache.zookeeper.KeeperException.create(KeeperException.java:102) at org.apache.curator.framework.imps.CuratorFrameworkImpl.checkBackgroundRetry(CuratorFrameworkImpl.java:885) at org.apache.curator.framework.imps.CuratorFrameworkImpl.processBackgroundOperation(CuratorFrameworkImpl.java:677) at org.apache.curator.framework.imps.WatcherRemovalFacade.processBackgroundOperation(WatcherRemovalFacade.java:152) at org.apache.curator.framework.imps.GetConfigBuilderImpl$2.processResult(GetConfigBuilderImpl.java:222) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:636) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:553) 2023-07-12 15:49:10,254 INFO org.apache.nifi.controller.leader.election.CuratorLeaderElectionManager: org.apache.nifi.controller.leader.election.CuratorLeaderElectionManager$ElectionListener@4a92d3c4 Connection State changed to SUSPENDED
... View more
Labels:
- Labels:
-
Cloudera Manager