Member since
09-29-2015
871
Posts
723
Kudos Received
255
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
3349 | 12-03-2018 02:26 PM | |
2302 | 10-16-2018 01:37 PM | |
3615 | 10-03-2018 06:34 PM | |
2392 | 09-05-2018 07:44 PM | |
1814 | 09-05-2018 07:31 PM |
11-27-2019
12:51 AM
did you solve the issue?, because I am facing a similar one with a different automatically generated pom
... View more
10-21-2019
04:22 AM
Hi, Did adding Nifi hostnames to the load balancer certificate's SAN help?
... View more
09-11-2019
12:16 AM
1 Kudo
Did you find a solution? It makes sense to put a protected password field on a single processor (or controller service). The password won't be passed as an attribute along the flow. It does not make sense to put a (protected) password into a flow attribute, because the password will be exposed. So just make sure that your nifi/-registry is secure. Make sure that the FTP user has limit capabilities.
... View more
09-06-2018
01:01 PM
I think in the controller service for Hortonworks Schema Registry the URL needs to be http://localhost:7788/api/v1 where as in your screenshot it is missing the http:// Also if you can upgrade to HDF 3.2 there is an option in the writers to inherit the schema from the reader, so the writer doesn't even need to be configured with the schema registry, only the reader would need it.
... View more
07-31-2018
12:59 PM
@Bryan Bende I checked the nifi-app.log, the JVM heap size is max, whcih is rejecting the connections and failing the processor. It got resolved as the heap size issue is solved. Thank you for you support.
... View more
07-13-2018
04:02 PM
Let me tell the environment which i am trying. I am using files.bcogc.ca ftp server which uses FTPS (FTP over explict SSL), When i connect using filezilla a certificate accept pop-up apperas after accepting connection gets open and able to do listing. Similarly used ftp-ssl protocol from ubuntu cli and it got opened. But when i use in ftp nifi processor with passive mode its giving connection timeout tried with active but still same error. Nifi vm is in Azure cloud and outgoing ports are open and some incoming ports also. Below is the stacktrace. ------------------------------------------------------------------------------------------------------------------------------------------------------- This is the log that I got from nifi-app-log:- 2018-07-13 15:53:40,428 ERROR [Timer-Driven Process Thread-8] o.a.nifi.processors.standard.ListFTP ListFTP[id=01641010-7d8e-102b-2639-020d0b6d6867] Failed to perform listing on remote host due to java.net.ConnectException: Connection timed out (Connection timed out): {}
java.net.ConnectException: Connection timed out (Connection timed out)
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:589)
at org.apache.commons.net.SocketClient._connect(SocketClient.java:243)
at org.apache.commons.net.SocketClient.connect(SocketClient.java:181)
at org.apache.nifi.processors.standard.util.FTPTransfer.getClient(FTPTransfer.java:582)
at org.apache.nifi.processors.standard.util.FTPTransfer.getListing(FTPTransfer.java:227)
at org.apache.nifi.processors.standard.util.FTPTransfer.getListing(FTPTransfer.java:191)
at org.apache.nifi.processors.standard.ListFileTransfer.performListing(ListFileTransfer.java:106)
at org.apache.nifi.processor.util.list.AbstractListProcessor.onTrigger(AbstractListProcessor.java:405)
at org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)
at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1165)
at org.apache.nifi.controller.tasks.ConnectableTask.invoke(ConnectableTask.java:203)
at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:117)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
... View more
07-03-2018
01:08 PM
perfect, thanks guys!
... View more
06-19-2018
04:41 PM
2 Kudos
ListSFTP writes two attributes on each flow file - filename and path. In FetchSFTP you want to set the remote file to be a dynamic expression that uses these attributes: ${path}/${filename}
... View more
06-16-2018
09:37 PM
@Bal P For avro data file schema will be embedded and you want to write all the fields in CSV format so we don't need to setup the registry. if you are writing only specific columns not all and for other formats JSON.. then schema registry is required
... View more