@Bharath Phatak I am also getting the same error some times while transferring files using NiFi S2S. Did you find any solution for this? 2019-01-16 12:18:12,566 ERROR [I/O dispatcher 8585] o.a.n.r.util.SiteToSiteRestApiClient Failed to send data to http://hdfnifiprod01.medassurant.local:9090/nifi-api/data-transfer/input-ports/3e9238a3-0168-1000-ffff-ffffef5118d5/transactions/5d14f229-cabd-47ce-91e4-9d90611f893e/flow-files due to java.net.SocketTimeoutException java.net.SocketTimeoutException: null at org.apache.http.nio.protocol.HttpAsyncRequestExecutor.timeout(HttpAsyncRequestExecutor.java:376) at org.apache.http.impl.nio.client.InternalIODispatch.onTimeout(InternalIODispatch.java:92) at org.apache.http.impl.nio.client.InternalIODispatch.onTimeout(InternalIODispatch.java:39) at org.apache.http.impl.nio.reactor.AbstractIODispatch.timeout(AbstractIODispatch.java:175) at org.apache.http.impl.nio.reactor.BaseIOReactor.sessionTimedOut(BaseIOReactor.java:263) at org.apache.http.impl.nio.reactor.AbstractIOReactor.timeoutCheck(AbstractIOReactor.java:492) at org.apache.http.impl.nio.reactor.BaseIOReactor.validate(BaseIOReactor.java:213) at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:280) at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104) at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:588) at java.lang.Thread.run(Thread.java:745) 2019-01-16 12:18:12,570 ERROR [Timer-Driven Process Thread-3] o.a.nifi.remote.StandardRemoteGroupPort RemoteGroupPort[name=FromPhProd,targets=http://hdfnifiprod01.medassurant.local:9090/nifi/,http://hdfnifiprod02.medassurant.local:9090/nifi/] failed to communicate with remote NiFi instance due to org.apache.nifi.processor.exception.ProcessException: IOException thrown from RemoteGroupPort[name=FromPhProd,targets=http://hdfnifiprod01.medassurant.local:9090/nifi/,http://hdfnifiprod02.medassurant.local:9090/nifi/]: java.io.IOException: Failed to send data to Peer[url=http://hdfnifiprod01.medassurant.local:9090/nifi-api] due to java.io.IOException: Pipe closed ... View more

Thanks for your response @Bryan Bende Do we have any workaround for this or any other workflow with different processors? Basically i want to move all these folders and files including empty folders to some other directory. ... View more

Thanks @Benoit Rousseau I followed your steps and restarted NiFi service. NiFi Service is getting failed with below error: ERROR [NiFi logging handler] org.apache.nifi.StdErr Error: Could not find or load main class "-javaagent:.root.software.jmx_prometheus_javaagent-0.3.1.jar=7071:.root.software.nifi.yml" ... View more

I have updated "Advanced nifi-bootstrap-env" config on Ambari as below and restarted NIFI service. But still I don't see any metrics coming up on http://nifi1:7071/metrics Am I missing anything ? ... View more

@Alvin Jin @Benoit Rousseau I am trying to monitor NIFI using JMX. Can you please provide steps to enable JMX for HDF Ambari based Nifi cluster? Thanks ... View more

@Santhosh B Gowda I am trying to monitor NIFI using JMX. Do you know how to enable JMX for HDF Ambari based Nifi cluster? Thanks ... View more

Thank you @Matt Clarke I tried but am not able to merge the truststore files using keytool. Can you please explain how to add a new entry in existing truststore file. Also You mentioned, The NiFi CA is not to be used in production environment. Is there any specific reason? Can you please suggest which option would be recommended to secure NIFI. Thanks. ... View more

Thank you @Matt Clarke So I just need to merge trustedCertEntries in truststore and keep everything else as it is like below. nifi1: Entry type: trustedCertEntry Owner: CN=hdfnifidev04.medassurant.local, OU=NIFI Issuer: CN=rsdevhdf3.medassurant.local, OU=NIFI nifi2: Entry type: trustedCertEntry Owner: CN=rsdevhdf3.medassurant.local, OU=NIFI Issuer: CN=hdfnifidev04.medassurant.local, OU=NIFI Then I need to copy this truststore file in nifi-toolkit/bin folder on both the nifi clusters. Then I need to restart the nifi services on both the clusters with NiFi CA Force Regenerate? as true. Please let me know if I am missing any step. Do i need to do anything with nifi-cert.pem files between the two nifi clusters. Thank You. ... View more