Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: The Cloudera Community will undergo maintenance on Saturday, August 17 at 12:00am PDT. See more info here.

SFTP Built-in

SFTP Built-in

Rising Star

Will there be SFTP built into hadoop-commons anytime soon? I see in HADOOP-5732 that it'll be included in Hadoop 3.8. I'm hoping that I'll be able to use it soon. The reason is that our company uses SFTP to get 3rd party CSV's. It would be great to directly DistCp into HDFS, or, even better yet, directly access the file on the SFTP server using Spark by bringing it into a Dataframe.

 

Thanks,

Ben