Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Capture Change Mysql Processor is unable to start using minifi

Highlighted

Capture Change Mysql Processor is unable to start using minifi

New Contributor

Hello Team,

I am trying to replicate MYSQL data from multiple locations(sites) to central location. For this, we are using CaptureChangeMysql processor at sites to send change data to central location. We can only rely upon binary logs that taking snapshot of tables hence the reason to use CaptureChangeMysql. We tried NIFI 3.0/4.0 at sites which will push to central instance. This is working without any issues.

As NIFI is little heavier, we are thinking of using MINIFI 0.2 at sites ( Even tried 0.2.1 by building the source thinking https://issues.apache.org/jira/browse/MINIFI-403 will solve but no luck) and put NIFI server at central. When we run the MINIFI instance, we are getting following error, though we have put recommended libraries from NIFI instance into MINIFI Lib directory.

2017-10-10 19:25:10,000 ERROR [main] o.apache.nifi.controller.FlowController Unable to start CaptureChangeMySQL[id=7da38743-a33c-397f-0000-000000000000] due to java.lang.IllegalStateException: Processor CaptureChangeMySQL is not in a valid state due to ['Distributed Map Cache Client' validated against 'cda56c6d-0474-3249-0000-000000000000' is invalid because DistributedMapCacheClientService - 1.3.0 from org.apache.nifi - nifi-distributed-cache-services-nar is not compatible with DistributedMapCacheClient - unversioned from default - system, 'Relationship success' is invalid because Relationship 'success' is not connected to any component and is not auto-terminated]

2017-10-10 19:25:10,005 ERROR [main] o.apache.nifi.controller.FlowController Unable to start transmitting with RemoteGroupPort[name=ToMiNiFiProb,targets=http://172.16.9.120:8080/nifi/?processGroupId=root&componentIds=e73777db-015e-1000-d175-60d040746148] due to {}

java.lang.IllegalStateException: 89b230cc-8dc5-18e0-8b12-3acf989faff5 is not in a valid state: Port 'ToMiNiFiProb' has no outbound connections

at org.apache.nifi.controller.AbstractPort.verifyCanStart(AbstractPort.java:574)

at org.apache.nifi.remote.StandardRemoteGroupPort.verifyCanStart(StandardRemoteGroupPort.java:487)

at org.apache.nifi.remote.StandardRemoteProcessGroup.startTransmitting(StandardRemoteProcessGroup.java:1020)

at org.apache.nifi.controller.FlowController.onFlowInitialized(FlowController.java:811)

at org.apache.nifi.minifi.MiNiFiServer.start(MiNiFiServer.java:114)

at org.apache.nifi.minifi.MiNiFi.<init>(MiNiFi.java:140)

at org.apache.nifi.minifi.MiNiFi.main(MiNiFi.java:239)

2017-10-10 19:25:10,006 ERROR [main] o.apache.nifi.controller.FlowController Unable to start transmitting with RemoteGroupPort[name=Copy of ToMiNiFiProb,targets=http://172.16.9.120:8080/nifi/?processGroupId=root&componentIds=e73777db-015e-1000-d175-60d040746148] due to {}

java.lang.IllegalStateException: 89b230e2-8dc5-18e0-e93f-69f75f9ebeb9 is not in a valid state: Port 'Copy of ToMiNiFiProb' has no outbound connections

at org.apache.nifi.controller.AbstractPort.verifyCanStart(AbstractPort.java:574)

at org.apache.nifi.remote.StandardRemoteGroupPort.verifyCanStart(StandardRemoteGroupPort.java:487)

at org.apache.nifi.remote.StandardRemoteProcessGroup.startTransmitting(StandardRemoteProcessGroup.java:1020)

at org.apache.nifi.controller.FlowController.onFlowInitialized(FlowController.java:811)

at org.apache.nifi.minifi.MiNiFiServer.start(MiNiFiServer.java:114)

at org.apache.nifi.minifi.MiNiFi.<init>(MiNiFi.java:140)

at org.apache.nifi.minifi.MiNiFi.main(MiNiFi.java:239)

Kindly suggest.

Thanks

Rakesh