I recently deployed single node Hadoop cluster using Ambari wizard and then enabled Kerberos. Please give suggestions how can I test with interactive hdfs commands to GET and PUT files in hdfs in this secured cluster?

[#1]

I am specifically looking for what commands on terminal I should run to create file in hdfs and get files in hdfs.

[#2 · Accepted solution]

@Neha G

You can use the basic hdfs commands to achieve this.

hdfs dfs -copyFromLocal <local file system path> <hdfs path> - to copy files from local to hdfs

hdfs dfs -copyToLocal <hdfs path> <local fs path> - copy from hdfs to local

hdfs dfs -put <local file system path> <hdfs path> - to copy files from local to hdfs

hdfs dfs -get <hdfs path> <local fs path> - copy from hdfs to local

hdfs dfs -ls <path> - list the files.

Check this link for more commands.

https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/FileSystemShell.html

Make sure to run kinit with hdfs keytab before running the above commands as it is a secure enviroment

( kinit -kt /etc/security/keytabs/hdfs.headless.keytab <principal>)

If you don't know the value of principal , you can run the below command and get it

[root@xxxxx ~]# klist -kte /etc/security/keytabs/hdfs.headless.keytab
Keytab name: FILE:/etc/security/keytabs/hdfs.headless.keytab
KVNO Timestamp         Principal
---- ----------------- --------------------------------------------------------
   1 09/10/17 14:06:14 [email protected] (aes128-cts-hmac-sha1-96)
   1 09/10/17 14:06:14 [email protected] (arcfour-hmac)
   1 09/10/17 14:06:14 [email protected] (des-cbc-md5)
   1 09/10/17 14:06:14 [email protected] (des3-cbc-sha1)
   1 09/10/17 14:06:14 [email protected] (aes256-cts-hmac-sha1-96)

In the above output [email protected] is the principal, so your kinit command would be

kinit -kt /etc/security/keytabs/hdfs.headless.keytab [email protected]

Note : You can also use ambari files view to do these operations. GUI would be easy.

Thanks,

Aditya