Member since
03-10-2017
3
Posts
0
Kudos Received
0
Solutions
03-17-2017
07:10 PM
The local directory is /tmp/ and Nifi has permissions to access this. What I'm seeing is that there is no data coming in from GetFTP even though the number of tasks increases. I've checked the logs and I cannot see clearly why this is happening. This is why even if I change the output of GetFTP from PutFile to PutS3 or whatever, nothing is being created. The question is, why is my GetFTP component unable to retrieve files from the FTP server? and how I can dig into why?
... View more
03-16-2017
02:28 PM
Hi @Balakrishnan Ramasamy, thank you for the quick response. I updated my question to make the parameters more clear and I'm using a very global regular expression .* to pull all files that are in my remote path.
... View more
03-16-2017
01:47 AM
I have an FTP server that I can connect to manually. Inside my FTP server, I have to navigate to the directory /amazon/jungle/ where there are a bunch of tree manifest files that end in .dat. Param Value Password ******* Username password Hostname hostname.site.com Transfer Mode
Binary Remote Path
/amazon/jungle/ File Filter Regex
.*
Delete original
False I have tried linking this component to either PutFile and configured a local directory "/tmp/" and tried PutS3. When I run my pipeline, I cannot get any of my files from the FTP server to download locally or push into S3. Any idea what I may be doing wrong? Is there a way to see what is causing the issue?
... View more
Labels:
- Labels:
-
Apache NiFi