Community Articles
Find and share helpful community-sourced technical articles
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.
Labels (1)

Snakebite is a pure python based HDFS client which is much faster than the classic hdfs client operations(hadoop fs / hdfs dfs).Snakebite is developed by Spotify. More details can be found at

https://github.com/spotify/snakebite

I am using HDP 2.4 and Ambari 2.2.1.1 on CentOS/

1). Install Python Pip.

yum install python-pip

2).Install Snakebite.

pip install snakebite

Now snakebite is installed.

You can run below sample commands.

snakebite ls /tmp

snakebite ls /

Use snakebite help for more options.

Happy Snakebiting!

2,917 Views
Comments

Does it support Kerberos by now? Would be very nice to be able to use it instead of os.system("hadoop ... ") commands as I currently do.

@Benjamin Leonhardi. Yes. you need to do

pip install "snakebite[kerberos]"

I haven't installed on kerberized cluster. Will try and let you know.

cool thanks, that should speed things up.

Don't have an account?
Coming from Hortonworks? Activate your account here
Version history
Revision #:
1 of 1
Last update:
‎04-07-2016 02:56 PM
Updated by:
 
Contributors
Top Kudoed Authors