Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Any recommendations loading SFTP files to HDFS?

Highlighted

Any recommendations loading SFTP files to HDFS?

New Contributor

Reading this, but find it's not recommended to use spark sftp as it uses jsch and doesn't support spark cluster. However, flume also do not support reading from sftp. So I would like check if any recommended way to ingest sftp files to HDFS?

 

Thanks 

 

https://community.cloudera.com/t5/Data-Ingestion-Integration/sftp-transfer-to-hdfs-in-spark-as-oppos...