Skip to main content
ansarifah
ansarifah
Gold ⭐️
July 21, 2016
Solved

HDFS Guide: How to Check Cluster Storage Capacity via Edge Node

Storage limit of NN and total storage capacity?

sunile_manjee
sunile_manjeeAnswer
Gold ⭐️
July 21, 2016

Run sudo -u hdfs hdfs dfsadmin -report

This will give you full report on hdfs.

View in thread

5 replies

sunile_manjee
Gold ⭐️
sunile_manjeeAnswer
Gold ⭐️
July 21, 2016

Run sudo -u hdfs hdfs dfsadmin -report

This will give you full report on hdfs.

Translate
    sunile_manjee
    Gold ⭐️
    sunile_manjee
    Gold ⭐️
    July 21, 2016

    Report example

     sudo -u hdfs hdfs dfsadmin -report
    Configured Capacity: 7504658432 (6.99 GB)
    Present Capacity: 527142912 (502.72 MB)
    DFS Remaining: 36921344 (35.21 MB)
    DFS Used: 490221568 (467.51 MB)
    DFS Used%: 93.00%
    Under replicated blocks: 128
    Blocks with corrupt replicas: 0
    Missing blocks: 0
    Missing blocks (with replication factor 1): 0

    -------------------------------------------------
    Live datanodes (1):

    Name: 192.168.114.48:50010 (host-192-168-114-48.td.local)
    Hostname: host-192-168-114-48.td.local
    Decommission Status : Normal
    Configured Capacity: 7504658432 (6.99 GB)
    DFS Used: 490221568 (467.51 MB)
    Non DFS Used: 6977515520 (6.50 GB)
    DFS Remaining: 36921344 (35.21 MB)
    DFS Used%: 6.53%
    DFS Remaining%: 0.49%
    Configured Cache Capacity: 0 (0 B)
    Cache Used: 0 (0 B)
    Cache Remaining: 0 (0 B)
    Cache Used%: 100.00%
    Cache Remaining%: 0.00%
    Xceivers: 2
    Translate
    shivkumar82015
    shivkumar82015
    Gold ⭐️
    July 22, 2016

    you can check this $hadoop dfsadmin -report as below . You can check without "ROOT" user as well.

    :~> hadoop dfsadmin -report

    Use of this script to execute hdfs command is deprecated. Instead use the hdfs command for it.

    Configured Capacity: 95930 (87.50 TB) Present Capacity: 95869819 (87.93 TB)

    DFS Remaining: 37094235 (33.37 TB)

    DFS Used: 587755833 (53.56 TB)

    DFS Used%: 61.31%

    Under replicated blocks: 0

    Blocks with corrupt replicas: 5

    Missing blocks: 0 -------------------------------------------------

    report: Access denied for user "username".

    Superuser privilege is required :~>

    Translate
    Terms & ConditionsAccessibility statement