Reply
Highlighted
New Contributor
Posts: 4
Registered: ‎06-29-2017

Any recommendations loading SFTP files to HDFS?

Reading this, but find it's not recommended to use spark sftp as it uses jsch and doesn't support spark cluster. However, flume also do not support reading from sftp. So I would like check if any recommended way to ingest sftp files to HDFS?

 

Thanks 

 

https://community.cloudera.com/t5/Data-Ingestion-Integration/sftp-transfer-to-hdfs-in-spark-as-oppos...

 

Announcements