Member since
03-07-2018
15
Posts
0
Kudos Received
0
Solutions
01-17-2019
03:10 AM
@Bharath Phatak I am also getting the same error some times while transferring files using NiFi S2S. Did you find any solution for this? 2019-01-16 12:18:12,566 ERROR [I/O dispatcher 8585] o.a.n.r.util.SiteToSiteRestApiClient Failed to send data to http://hdfnifiprod01.medassurant.local:9090/nifi-api/data-transfer/input-ports/3e9238a3-0168-1000-ffff-ffffef5118d5/transactions/5d14f229-cabd-47ce-91e4-9d90611f893e/flow-files due to java.net.SocketTimeoutException
java.net.SocketTimeoutException: null
at org.apache.http.nio.protocol.HttpAsyncRequestExecutor.timeout(HttpAsyncRequestExecutor.java:376)
at org.apache.http.impl.nio.client.InternalIODispatch.onTimeout(InternalIODispatch.java:92)
at org.apache.http.impl.nio.client.InternalIODispatch.onTimeout(InternalIODispatch.java:39)
at org.apache.http.impl.nio.reactor.AbstractIODispatch.timeout(AbstractIODispatch.java:175)
at org.apache.http.impl.nio.reactor.BaseIOReactor.sessionTimedOut(BaseIOReactor.java:263)
at org.apache.http.impl.nio.reactor.AbstractIOReactor.timeoutCheck(AbstractIOReactor.java:492)
at org.apache.http.impl.nio.reactor.BaseIOReactor.validate(BaseIOReactor.java:213)
at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:280)
at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104)
at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:588)
at java.lang.Thread.run(Thread.java:745)
2019-01-16 12:18:12,570 ERROR [Timer-Driven Process Thread-3] o.a.nifi.remote.StandardRemoteGroupPort RemoteGroupPort[name=FromPhProd,targets=http://hdfnifiprod01.medassurant.local:9090/nifi/,http://hdfnifiprod02.medassurant.local:9090/nifi/] failed to communicate with remote NiFi instance due to org.apache.nifi.processor.exception.ProcessException: IOException thrown from RemoteGroupPort[name=FromPhProd,targets=http://hdfnifiprod01.medassurant.local:9090/nifi/,http://hdfnifiprod02.medassurant.local:9090/nifi/]: java.io.IOException: Failed to send data to Peer[url=http://hdfnifiprod01.medassurant.local:9090/nifi-api] due to java.io.IOException: Pipe closed
... View more
01-17-2019
02:58 AM
I am trying to copy files using NiFi RemoteProcessGroup S2S. Some times i am getting below error message and file coping is not happening. Please can someone help me out? ERROR [Timer-Driven Process Thread-8] o.a.nifi.remote.StandardRemoteGroupPort RemoteGroupPort[name=FromPhProd,targets=http://hdfnifiprod01.medassurant.local:9090/nifi/,http://hdfnifiprod02.medassurant.local:9090/nifi/] failed to communicate with remote NiFi instance due to org.apache.nifi.processor.exception.ProcessException: IOException thrown from RemoteGroupPort[name=FromPhProd,targets=http://hdfnifiprod01.medassurant.local:9090/nifi/,http://hdfnifiprod02.medassurant.local:9090/nifi/]: java.io.IOException: Failed to send data to Peer[url=http://hdfnifiprod01.medassurant.local:9090/nifi-api] due to java.io.IOException: Pipe closed
... View more
Labels:
- Labels:
-
Apache NiFi
11-01-2018
06:42 PM
Thanks for your response @Bryan Bende Do we have any workaround for this or any other workflow with different processors? Basically i want to move all these folders and files including empty folders to some other directory.
... View more
10-31-2018
02:11 PM
Thanks @Benoit Rousseau I followed your steps and restarted NiFi service. NiFi Service is getting failed with below error: ERROR [NiFi logging handler] org.apache.nifi.StdErr Error: Could not find or load main class "-javaagent:.root.software.jmx_prometheus_javaagent-0.3.1.jar=7071:.root.software.nifi.yml"
... View more
10-30-2018
08:40 PM
I have updated "Advanced nifi-bootstrap-env" config on Ambari as below and restarted NIFI service. But still I don't see any metrics coming up on http://nifi1:7071/metrics Am I missing anything ?
... View more
10-30-2018
07:54 PM
@Alvin Jin @Benoit Rousseau I am trying to monitor NIFI using JMX. Can you please provide steps to enable JMX for HDF Ambari based Nifi cluster? Thanks
... View more
10-30-2018
07:49 PM
@Santhosh B Gowda I am trying to monitor NIFI using JMX. Do you know how to enable JMX for HDF Ambari based Nifi cluster? Thanks
... View more
10-30-2018
07:02 PM
I am trying to copy files and directories from one HDFS to another HDFS location using NIFI. It is working fine and copying directories and files in case of directory has some files but it is not copying empty directories. My work flow is: ListHDFS > FetchHDFS > PutHDFS Example:
/tmp/folder1/file1.txt
/tmp/folder2
/tmp/folder3/file2.txt
/tmp/folder4
folder2 and folder4 are not copied because of empty directories. Do i need to change any processor configurations?
Could somebody please point me in the right direction?
Thank you
... View more
Labels:
- Labels:
-
Apache NiFi
-
Cloudera DataFlow (CDF)
05-23-2018
07:57 PM
Thank you @Matt Clarke I tried but am not able to merge the truststore files using keytool. Can you please explain how to add a new entry in existing truststore file. Also You mentioned, The NiFi CA is not to be used in production environment. Is there any specific reason? Can you please suggest which option would be recommended to secure NIFI. Thanks.
... View more
05-23-2018
04:04 PM
Thank you @Matt Clarke So I just need to merge trustedCertEntries in truststore and keep everything else as it is like below. nifi1: Entry type: trustedCertEntry Owner: CN=hdfnifidev04.medassurant.local, OU=NIFI Issuer: CN=rsdevhdf3.medassurant.local, OU=NIFI nifi2: Entry type: trustedCertEntry Owner: CN=rsdevhdf3.medassurant.local, OU=NIFI Issuer: CN=hdfnifidev04.medassurant.local, OU=NIFI Then I need to copy this truststore file in nifi-toolkit/bin folder on both the nifi clusters. Then I need to restart the nifi services on both the clusters with NiFi CA Force Regenerate? as true. Please let me know if I am missing any step. Do i need to do anything with nifi-cert.pem files between the two nifi clusters. Thank You.
... View more