question transfer files from local to hdfs in AWS instance in Archives of Support Questions (Read Only)

transfer files from local to hdfs in AWS instance

eswarloges — Fri, 16 Sep 2022 10:43:08 GMT

Hi Team,

I am new to linux environment and I m trying to practice my hdpcd exam in AWS instance. I am trying to copy the file from local to hdfs it throws access denied exception.

If i tried with hdfs sudo user it is asking for the password for the sudo user horton.

If i ssh using root@namenode I m not able to access the local file system,

Help me with the steps to do the file transfer in aws instance from local the hdfs system.

Re: transfer files from local to hdfs in AWS instance

chennuri_gouris — Tue, 04 Oct 2016 03:08:44 GMT

You can can use simple hadoop -put source(local file system) destination (hdfs path). Make sure you have permission to access files on both local file system and hdfs.

Re: transfer files from local to hdfs in AWS instance

eswarloges — Tue, 04 Oct 2016 03:52:18 GMT

I have given the write access to the destination folder in hdfs and it worked. Thanks for the reply

Re: transfer files from local to hdfs in AWS instance

chennuri_gouris — Tue, 04 Oct 2016 03:56:31 GMT

@Logeswaran Radhakrishnan Please accept the answer if this worked for you