What is Snakebite ? and How to use it with HDP ?

[#1]

Snakebite is a pure python based HDFS client which is much faster than the classic hdfs client operations(hadoop fs / hdfs dfs).Snakebite is developed by Spotify. More details can be found at

https://github.com/spotify/snakebite

I am using HDP 2.4 and Ambari 2.2.1.1 on CentOS/

1). Install Python Pip.

yum install python-pip

2).Install Snakebite.

pip install snakebite

Now snakebite is installed.

You can run below sample commands.

snakebite ls /tmp

snakebite ls /

Use snakebite help for more options.

Happy Snakebiting!

[#2]

Does it support Kerberos by now? Would be very nice to be able to use it instead of os.system("hadoop ... ") commands as I currently do.

[#3]

@Benjamin Leonhardi. Yes. you need to do

pip install "snakebite[kerberos]"

I haven't installed on kerberized cluster. Will try and let you know.

[#4]

cool thanks, that should speed things up.