Created 12-05-2017 06:22 PM
HI Everyone,
I Need to automate to copy FTP files from a drive to HDFS.
OS : Centos 7
HDP : 2.5
ambari :2.4
Please Guide me how to copy or to automate files from FTP to HDFS or to local Directory.
Created 12-06-2017 06:16 PM
you can setup nfs gateway and mount it and copy it to that directory.The NFS Gateway for HDFS allows clients to mount HDFS and interact with it through NFS, as if it were part of their local file system.
https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.2/bk_hdfs_nfs_gateway/content/user-guide-hdfs...
Created on 12-06-2017 06:27 PM - edited 08-17-2019 07:44 PM
See: https://community.hortonworks.com/questions/150046/can-we-import-filles-from-sftp-to-hdfs-directly.h...
https://community.hortonworks.com/questions/149996/ni-fi-processors-to-get-a-file-from-hdfs-and-invo...
]
Just use the FTP one.