HDFS Space Usage Visualization

[#1]

Repo Description

.

.

.

Use zeppelin to explore your HDFS space usage (and/or number of files).

Preview notebook here

Import notebook in your zeppelin instance from this URL:

https://raw.githubusercontent.com/gbraccialli/HdfsUtils/master/zeppelin/hdfs-d3.json

Or take a deeper look in github project:

https://github.com/gbraccialli/HdfsUtils

Special thanks to:

• Dave Patton who first created HDP-Viz where I got insipered and copied lots of code
• Ali Bajwa who created ambari stack for Dave's project (and helped me get it working)
• David Streever who created (or forked) hdfs-cli, where I also copied lots of code

Repo Info
Github Repo URL https://github.com/gbraccialli/HdfsUtils
Github account name gbraccialli
Repo name HdfsUtils

[#2]

@Guilherme Braccialli very nice.

[#3]

@Guilherme Braccialli: It is very nice article but when I tried to install it I am getting below error.SO can you please help me to get it resolved.

File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 291, in _call
    raise Fail(err_msg)
resource_management.core.exceptions.Fail: Execution of '/var/lib/ambari-server/resources/stacks/HDP/2.3/services/hdpviz_stack/package/scripts/setup.sh /root m1.hdp22 9001 >> /var/log/hdp-viz.log' returned 1.   % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:--  0:00:01 --:--:--     0
162   162    0   162    0     0     69      0 --:--:--  0:00:02 --:--:--   234
Error: Nothing to do

[root@m1 yum.repos.d]# vi /var/log/hdp-viz.log

Installing nodejs and npm

Loaded plugins: fastestmirror

Setting up Install Process

Loading mirror speeds from cached hostfile

* base: centos.excellmedia.net

* extras: centos.excellmedia.net

* updates: centos.excellmedia.net

No package nodejs available.

No package npm available.

[#4]

I followed given URL to get it installed.

https://github.com/abajwa-hw/hdpviz

[#5]

@Saurabh Kumar Sorry for late reply. I used few code from hdp_viz project, but the new version runs directly on zeppelin, no need to install anything. Just import zeppelin notebook and follow steps there.

Let me know if you need any help.