Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created 02-18-2016 04:00 PM
Does Sqoop support SFTP protocol? Pulling data from mainframe using SFTP.
I see FTP is used but not sftp
Created 02-18-2016 04:15 PM
@Sunile Manjee Very good questions..I don't think so but sqoop2 jira is open
Created 02-18-2016 04:15 PM
@Sunile Manjee Very good questions..I don't think so but sqoop2 jira is open
Created 02-18-2016 04:25 PM
Thanks @Neeraj Sabharwal. Outside of NiFi, what other options do we have to pull data from SFTP if sqoop does not support it?
Created 02-18-2016 05:09 PM
@Sunile Manjee Do you want to transfer data from RDBMS to Hadoop? Or any source?
Created 02-18-2016 05:14 PM
@Neeraj Sabharwal Transfer data using SFTP to hadoop.
Created 02-18-2016 05:17 PM
@Sunile Manjee https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/WebHDFS.html
You can use webhdfs to transfer data into HDFS.
http://hortonworks.com/blog/webhdfs-%E2%80%93-http-rest-access-to-hdfs/