Community Articles

Find and share helpful community-sourced technical articles.
Labels (1)
avatar

Snakebite is a pure python based HDFS client which is much faster than the classic hdfs client operations(hadoop fs / hdfs dfs).Snakebite is developed by Spotify. More details can be found at

https://github.com/spotify/snakebite

I am using HDP 2.4 and Ambari 2.2.1.1 on CentOS/

1). Install Python Pip.

yum install python-pip

2).Install Snakebite.

pip install snakebite

Now snakebite is installed.

You can run below sample commands.

snakebite ls /tmp

snakebite ls /

Use snakebite help for more options.

Happy Snakebiting!

7,846 Views
Comments
avatar
Master Guru

Does it support Kerberos by now? Would be very nice to be able to use it instead of os.system("hadoop ... ") commands as I currently do.

avatar

@Benjamin Leonhardi. Yes. you need to do

pip install "snakebite[kerberos]"

I haven't installed on kerberized cluster. Will try and let you know.

avatar
Master Guru

cool thanks, that should speed things up.