Support Questions
Find answers, ask questions, and share your expertise

Issues with upgrading to NiFi version 1.2.0.3.0.0.0-453 of HDF 3.0

Rising Star

Hello,

I tried upgrading NiFi from version 1.1.0.2.1.4.0-5 to NiFi version 1.2.0.3.0.0.0-453 of HDF 3.0 but I am having an issue when the node joins the cluster. I run a cluster with three NiFi nodes, I was trying a rolling upgrade to not stop all the nodes at the same time. I upgraded one of the nodes and tried to make it join the cluster. The node seemed to start up fine with no issues and said that the cluster had received the heartbeat. However, after the node joined the cluster the UI page in all three nodes started showing an error message saying "Unexpected error please check the logs for any errors". I went to the logs and I found the following warnings:

2017-06-14 11:36:49,279 WARN [main] org.apache.nifi.nar.ExtensionManager Component org.apache.nifi.processors.aws.s3.FetchS3Object is bundled with its referenced Controller Service APIs org.apache.nifi.processors.aws.credentials.provider.service.AWSCredentialsProviderService. The service APIs should not be bundled with component implementations that reference it.
2017-06-14 11:36:49,292 WARN [main] org.apache.nifi.nar.ExtensionManager Component org.apache.nifi.processors.aws.s3.PutS3Object is bundled with its referenced Controller Service APIs org.apache.nifi.processors.aws.credentials.provider.service.AWSCredentialsProviderService. The service APIs should not be bundled with component implementations that reference it.
2017-06-14 11:36:49,294 WARN [main] org.apache.nifi.nar.ExtensionManager Component org.apache.nifi.processors.aws.s3.DeleteS3Object is bundled with its referenced Controller Service APIs org.apache.nifi.processors.aws.credentials.provider.service.AWSCredentialsProviderService. The service APIs should not be bundled with component implementations that reference it.
2017-06-14 11:36:49,301 WARN [main] org.apache.nifi.nar.ExtensionManager Component org.apache.nifi.processors.aws.s3.ListS3 is bundled with its referenced Controller Service APIs org.apache.nifi.processors.aws.credentials.provider.service.AWSCredentialsProviderService. The service APIs should not be bundled with component implementations that reference it.
2017-06-14 11:36:49,310 WARN [main] org.apache.nifi.nar.ExtensionManager Component org.apache.nifi.processors.aws.sns.PutSNS is bundled with its referenced Controller Service APIs org.apache.nifi.processors.aws.credentials.provider.service.AWSCredentialsProviderService. The service APIs should not be bundled with component implementations that reference it.
2017-06-14 11:36:49,481 WARN [main] org.apache.nifi.nar.ExtensionManager Component org.apache.nifi.processors.aws.sqs.GetSQS is bundled with its referenced Controller Service APIs org.apache.nifi.processors.aws.credentials.provider.service.AWSCredentialsProviderService. The service APIs should not be bundled with component implementations that reference it.
2017-06-14 11:36:49,482 WARN [main] org.apache.nifi.nar.ExtensionManager Component org.apache.nifi.processors.aws.sqs.PutSQS is bundled with its referenced Controller Service APIs org.apache.nifi.processors.aws.credentials.provider.service.AWSCredentialsProviderService. The service APIs should not be bundled with component implementations that reference it.
2017-06-14 11:36:49,483 WARN [main] org.apache.nifi.nar.ExtensionManager Component org.apache.nifi.processors.aws.sqs.DeleteSQS is bundled with its referenced Controller Service APIs org.apache.nifi.processors.aws.credentials.provider.service.AWSCredentialsProviderService. The service APIs should not be bundled with component implementations that reference it.
2017-06-14 11:36:49,492 WARN [main] org.apache.nifi.nar.ExtensionManager Component org.apache.nifi.processors.aws.lambda.PutLambda is bundled with its referenced Controller Service APIs org.apache.nifi.processors.aws.credentials.provider.service.AWSCredentialsProviderService. The service APIs should not be bundled with component implementations that reference it.
2017-06-14 11:36:49,497 WARN [main] org.apache.nifi.nar.ExtensionManager Component org.apache.nifi.processors.aws.kinesis.firehose.PutKinesisFirehose is bundled with its referenced Controller Service APIs org.apache.nifi.processors.aws.credentials.provider.service.AWSCredentialsProviderService. The service APIs should not be bundled with component implementations that reference it.
2017-06-14 11:36:49,508 WARN [main] org.apache.nifi.nar.ExtensionManager Component org.apache.nifi.processors.aws.dynamodb.GetDynamoDB is bundled with its referenced Controller Service APIs org.apache.nifi.processors.aws.credentials.provider.service.AWSCredentialsProviderService. The service APIs should not be bundled with component implementations that reference it.
2017-06-14 11:36:49,510 WARN [main] org.apache.nifi.nar.ExtensionManager Component org.apache.nifi.processors.aws.dynamodb.PutDynamoDB is bundled with its referenced Controller Service APIs org.apache.nifi.processors.aws.credentials.provider.service.AWSCredentialsProviderService. The service APIs should not be bundled with component implementations that reference it.
2017-06-14 11:36:49,512 WARN [main] org.apache.nifi.nar.ExtensionManager Component org.apache.nifi.processors.aws.dynamodb.DeleteDynamoDB is bundled with its referenced Controller Service APIs org.apache.nifi.processors.aws.credentials.provider.service.AWSCredentialsProviderService. The service APIs should not be bundled with component implementations that reference it.
2017-06-14 11:36:49,517 WARN [main] org.apache.nifi.nar.ExtensionManager Component org.apache.nifi.processors.aws.kinesis.stream.PutKinesisStream is bundled with its referenced Controller Service APIs org.apache.nifi.processors.aws.credentials.provider.service.AWSCredentialsProviderService. The service APIs should not be bundled with component implementations that reference it.
2017-06-14 11:36:49,523 WARN [main] org.apache.nifi.nar.ExtensionManager Component org.apache.nifi.processors.aws.cloudwatch.PutCloudWatchMetric is bundled with its referenced Controller Service APIs org.apache.nifi.processors.aws.credentials.provider.service.AWSCredentialsProviderService. The service APIs should not be bundled with component implementations that reference it.
2017-06-14 11:36:49,610 WARN [main] org.apache.nifi.nar.ExtensionManager Controller Service org.apache.nifi.processors.aws.credentials.provider.service.AWSCredentialsProviderControllerService is bundled with its supporting APIs org.apache.nifi.processors.aws.credentials.provider.service.AWSCredentialsProviderService. The service APIs should not be bundled with the implementations.
2017-06-14 11:36:49,714 WARN [main] org.apache.nifi.nar.ExtensionManager Controller Service org.apache.nifi.jms.cf.JMSConnectionFactoryProvider is bundled with its supporting APIs org.apache.nifi.jms.cf.JMSConnectionFactoryProviderDefinition. The service APIs should not be bundled with the implementations.
2017-06-14 11:36:50,530 WARN [main] org.apache.nifi.nar.ExtensionManager Component org.apache.nifi.processors.gcp.storage.PutGCSObject is bundled with its referenced Controller Service APIs org.apache.nifi.processors.gcp.credentials.service.GCPCredentialsService. The service APIs should not be bundled with component implementations that reference it.
2017-06-14 11:36:50,533 WARN [main] org.apache.nifi.nar.ExtensionManager Component org.apache.nifi.processors.gcp.storage.FetchGCSObject is bundled with its referenced Controller Service APIs org.apache.nifi.processors.gcp.credentials.service.GCPCredentialsService. The service APIs should not be bundled with component implementations that reference it.
2017-06-14 11:36:50,534 WARN [main] org.apache.nifi.nar.ExtensionManager Component org.apache.nifi.processors.gcp.storage.DeleteGCSObject is bundled with its referenced Controller Service APIs org.apache.nifi.processors.gcp.credentials.service.GCPCredentialsService. The service APIs should not be bundled with component implementations that reference it.
2017-06-14 11:36:50,535 WARN [main] org.apache.nifi.nar.ExtensionManager Component org.apache.nifi.processors.gcp.storage.ListGCSBucket is bundled with its referenced Controller Service APIs org.apache.nifi.processors.gcp.credentials.service.GCPCredentialsService. The service APIs should not be bundled with component implementations that reference it.
2017-06-14 11:36:50,544 WARN [main] org.apache.nifi.nar.ExtensionManager Controller Service org.apache.nifi.processors.gcp.credentials.service.GCPCredentialsControllerService is bundled with its supporting APIs org.apache.nifi.processors.gcp.credentials.service.GCPCredentialsService. The service APIs should not be bundled with the implementations.
2017-06-14 11:36:52,743 WARN [main] org.apache.nifi.nar.ExtensionManager Component org.apache.nifi.processors.couchbase.GetCouchbaseKey is bundled with its referenced Controller Service APIs org.apache.nifi.couchbase.CouchbaseClusterControllerService. The service APIs should not be bundled with component implementations that reference it.
2017-06-14 11:36:52,746 WARN [main] org.apache.nifi.nar.ExtensionManager Component org.apache.nifi.processors.couchbase.PutCouchbaseKey is bundled with its referenced Controller Service APIs org.apache.nifi.couchbase.CouchbaseClusterControllerService. The service APIs should not be bundled with component implementations that reference it.
2017-06-14 11:36:52,748 WARN [main] org.apache.nifi.nar.ExtensionManager Controller Service org.apache.nifi.couchbase.CouchbaseClusterService is bundled with its supporting APIs org.apache.nifi.couchbase.CouchbaseClusterControllerService. The service APIs should not be bundled with the implementations.

However in the app-log file after those warnings everything else seemed to start up fine and the node was connected to the cluster, I was just not able to access the UI from any of the nodes. I saw no errors or warnings in the bootstrap or user logs. I wanted to see if there could be something wrong that I am doing to the cluster with the node configuration or if the problem is that I would have to upgrade all the nodes and start them together all in the same NiFi version 1.2.0.3.0.0.0-453 of HDF 3.0? Any insights on this would be incredible helpful.

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Issues with upgrading to NiFi version 1.2.0.3.0.0.0-453 of HDF 3.0

Currently a rolling upgrade is not supported and you'll have to stop all nodes and start them back up with 1.2.0.3.0.0 at the same time. If that still doesn't work please report back.

View solution in original post

3 REPLIES 3

Re: Issues with upgrading to NiFi version 1.2.0.3.0.0.0-453 of HDF 3.0

Currently a rolling upgrade is not supported and you'll have to stop all nodes and start them back up with 1.2.0.3.0.0 at the same time. If that still doesn't work please report back.

View solution in original post

Re: Issues with upgrading to NiFi version 1.2.0.3.0.0.0-453 of HDF 3.0

Also, those WARN messages above are actually OK and are not the cause of the problem. There should be some ERROR logs further down towards the bottom on the node that was started with the new version, it will most likely say something about "Uninheritable flow".

Re: Issues with upgrading to NiFi version 1.2.0.3.0.0.0-453 of HDF 3.0

Rising Star

thanks for the clarification @Bryan Bende!