Hi all, It is weird situation, my node nifi001 eject from the cluster now it could not joint the cluster. I've removed users.xml, authorizations.xml and flow.xml.gz 2017-06-22 16:25:55,434 INFO [main] o.a.n.c.c.n.LeaderElectionNodeProtocolSender Determined that Cluster Coordinator is located at nifi002:11443; will use this address for sending heartbeat messages 2017-06-22 16:25:55,907 INFO [main] o.a.n.c.c.node.NodeClusterCoordinator Resetting cluster node statuses from {} to {nifi001:9443=NodeConnectionStatus[nodeId=nifi001:9443, state=CONNECTING, updateId=103], nifi002:9443=NodeConnectionStatus[nodeId=nifi002:9443, state=CONNECTED, updateId=59], nifi003:9443=NodeConnectionStatus[nodeId=nifi003:9443, state=CONNECTED, updateId=86]} 2017-06-22 16:25:56,016 ERROR [main] o.a.nifi.controller.StandardFlowService Failed to load flow from cluster due to: org.apache.nifi.controller.UninheritableFlowException: Failed to connect node to cluster because local flow is different than cluster flow. org.apache.nifi.controller.UninheritableFlowException: Failed to connect node to cluster because local flow is different than cluster flow. at org.apache.nifi.controller.StandardFlowService.loadFromConnectionResponse(StandardFlowService.java:936) at org.apache.nifi.controller.StandardFlowService.load(StandardFlowService.java:515) at org.apache.nifi.web.server.JettyServer.start(JettyServer.java:800) at org.apache.nifi.NiFi.<init>(NiFi.java:160) at org.apache.nifi.NiFi.main(NiFi.java:267) Caused by: org.apache.nifi.controller.UninheritableFlowException: Proposed Authorizer is not inheritable by the flow controller because of Authorizer differences: Proposed Authorizations do not match current Authorizations at org.apache.nifi.controller.StandardFlowSynchronizer.sync(StandardFlowSynchronizer.java:277) at org.apache.nifi.controller.FlowController.synchronize(FlowController.java:1576) at org.apache.nifi.persistence.StandardXMLFlowConfigurationDAO.load(StandardXMLFlowConfigurationDAO.java:84) at org.apache.nifi.controller.StandardFlowService.loadFromBytes(StandardFlowService.java:722) at org.apache.nifi.controller.StandardFlowService.loadFromConnectionResponse(StandardFlowService.java:911) ... 4 common frames omitted 2017-06-22 16:25:56,017 INFO [main] o.a.n.c.c.node.NodeClusterCoordinator nifi001:9443 requested disconnection from cluster due to org.apache.nifi.controller.UninheritableFlowException: Failed to connect node to cluster because local flow is different than cluster flow. 2017-06-22 16:25:56,017 INFO [main] o.a.n.c.c.node.NodeClusterCoordinator Status of nifi001:9443 changed from NodeConnectionStatus[nodeId=nifi001:9443, state=CONNECTING, updateId=103] to NodeConnectionStatus[nodeId=nifi001:9443, state=DISCONNECTED, Disconnect Code=Node's Flow did not Match Cluster Flow, Disconnect Reason=org.apache.nifi.controller.UninheritableFlowException: Failed to connect node to cluster because local flow is different than cluster flow., updateId=1] 2017-06-22 16:25:56,137 ERROR [main] o.a.n.c.c.node.NodeClusterCoordinator Event Reported for nifi001:9443 -- Node disconnected from cluster due to org.apache.nifi.controller.UninheritableFlowException: Failed to connect node to cluster because local flow is different than cluster flow. 2017-06-22 16:25:56,137 INFO [main] o.a.n.c.l.e.CuratorLeaderElectionManager Cannot unregister Leader Election Role 'Primary Node' becuase that role is not registered 2017-06-22 16:25:56,138 WARN [main] org.apache.nifi.web.server.JettyServer Failed to start web server... shutting down. java.lang.IllegalStateException: Already closed or has not been started at com.google.common.base.Preconditions.checkState(Preconditions.java:173) at org.apache.curator.framework.recipes.leader.LeaderSelector.close(LeaderSelector.java:270) at org.apache.nifi.controller.leader.election.CuratorLeaderElectionManager.unregister(CuratorLeaderElectionManager.java:151) at org.apache.nifi.controller.FlowController.setClustered(FlowController.java:3744) at org.apache.nifi.controller.StandardFlowService.handleConnectionFailure(StandardFlowService.java:554) at org.apache.nifi.controller.StandardFlowService.load(StandardFlowService.java:518) at org.apache.nifi.web.server.JettyServer.start(JettyServer.java:800) at org.apache.nifi.NiFi.<init>(NiFi.java:160) at org.apache.nifi.NiFi.main(NiFi.java:267) 2017-06-22 16:25:56,141 INFO [Thread-1] org.apache.nifi.NiFi Initiating shutdown of Jetty web server... 2017-06-22 16:25:56,146 INFO [Thread-1] o.eclipse.jetty.server.AbstractConnector Stopped ServerConnector@785cfd33{SSL,[ssl, http/1.1]}{nifi001:9443} 2017-06-22 16:25:56,146 INFO [Thread-1] org.eclipse.jetty.server.session Stopped scavenging thanks for help ... View more

hi all, i have an issue after hdp upgrade, have you an idea what's happen ? 134746 [main] -5p org.apache.hadoop.hive.ql.exec.FileSinkOperator - Moving tmp dir: hdfs://hadoop/user/hive/testing/w1_log/.hive-staging_hive_2017-06-07_10-53-45_227_7234037059148387215-1/_tmp.-ext-10000 to: hdfs://hadoop/user/hive/testing/w1_log/.hive-staging_hive_2017-06-07_10-53-45_227_7234037059148387215-1/-ext-10000 134746 [main] -5p org.apache.hadoop.hive.ql.exec.FileSinkOperator - Moving tmp dir: hdfs://hadoop/user/hive/testing/w1_log/.hive-staging_hive_2017-06-07_10-53-45_227_7234037059148387215-1/_tmp.-ext-10000 to: hdfs://hadoop/user/hive/testing/w1_log/.hive-staging_hive_2017-06-07_10-53-45_227_7234037059148387215-1/-ext-10000 134750 [main] -5p org.apache.hadoop.hive.ql.exec.Task - Loading data to table testing.w1_log partition (year=null, month=null, day=null, hour=null) from hdfs://hadoop/user/hive/testing/w1_log/.hive-staging_hive_2017-06-07_10-53-45_227_7234037059148387215-1/-ext-10000 134750 [main] -5p org.apache.hadoop.hive.ql.exec.Task - Loading data to table testing.w1_log partition (year=null, month=null, day=null, hour=null) from hdfs://hadoop/user/hive/testing/w1_log/.hive-staging_hive_2017-06-07_10-53-45_227_7234037059148387215-1/-ext-10000 134776 [main] -5p org.apache.hadoop.hive.ql.exec.MoveTask - Partition is: {year=null, month=null, day=null, hour=null} 134776 [main] -5p org.apache.hadoop.hive.ql.exec.MoveTask - Partition is: {year=null, month=null, day=null, hour=null} 135464 [main] -5p hive.ql.metadata.Hive - Failed to move: org.apache.hadoop.hdfs.protocol.AclException: Invalid ACL: only directories may have a default ACL. at org.apache.hadoop.hdfs.server.namenode.AclStorage.updateINodeAcl(AclStorage.java:282) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.unprotectedSetAcl(FSDirAclOp.java:208) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.setAcl(FSDirAclOp.java:146) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.setAcl(FSNamesystem.java:8456) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.setAcl(NameNodeRpcServer.java:1968) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.setAcl(ClientNamenodeProtocolServerSideTranslatorPB.java:1338) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:640) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:982) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2351) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2347) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1865) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2345) 135464 [main] -5p hive.ql.metadata.Hive - Failed to move: org.apache.hadoop.hdfs.protocol.AclException: Invalid ACL: only directories may have a default ACL. [~]$ hdfs dfs -getfacl /user/hive/testing/w1_log log4j:ERROR Could not connect to remote log4j server at [localhost]. We will try again later. # file: /user/hive/testing/w1_log # owner: testing # group: testing user::rwx user:hive:rwx group::rwx mask::rwx other::r-x default:user::rwx default:user:hive:rwx default:group::rwx default:mask::rwx default:other::r-x ... View more

Hi all, I've configured my cluster nifi with https and ldap login. It works if i'm connecting with https://hostname/nifi but not when i'm trying over an proxy https://vip-hostname/nifi Unable to check Access Status Unable to validate the access token. 2017-05-17 15:42:06,466 ERROR [NiFi Web Server-294241] o.a.nifi.web.security.jwt.JwtService There was an error validating the JWT io.jsonwebtoken.JwtException: Unable to validate the access token. at org.apache.nifi.web.security.jwt.JwtService.parseTokenFromBase64EncodedString(JwtService.java:106) ~[nifi-web-security-1.1.0.jar:1.1.0] at org.apache.nifi.web.security.jwt.JwtService.getAuthenticationFromToken(JwtService.java:60) ~[nifi-web-security-1.1.0.jar:1.1.0] at org.apache.nifi.web.security.jwt.JwtAuthenticationProvider.authenticate(JwtAuthenticationProvider.java:48) [nifi-web-security-1.1.0.jar:1.1.0] at org.apache.nifi.web.api.AccessResource.getAccessStatus(AccessResource.java:179) [classes/:na] at sun.reflect.GeneratedMethodAccessor915.invoke(Unknown Source) ~[na:na] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_111] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_111] Are you some ideas ? ... View more