question Re: How to make "hdfs dfs -du" command show 2 size columns "Size - Size with replication" in Support Questions

How to make "hdfs dfs -du" command show 2 size columns "Size - Size with replication"

JLo_Hernandez — Fri, 13 Sep 2019 22:30:44 GMT

I am tyring to get this output. Nevertheless some articles points out this is due to a version matter, which I doubt, since I've seen this behavior on multiple environments with different versions is just that I don't know how to enable it.

If someone can point me to the right path I would highly appreciate it.

Regards!

Re: How to make "hdfs dfs -du" command show 2 size columns "Size - Size with replication"

dnavarro — Tue, 17 Sep 2019 15:58:43 GMT

what version are you running and what output are you seeing?

Re: How to make "hdfs dfs -du" command show 2 size columns "Size - Size with replication"

JLo_Hernandez — Mon, 21 Oct 2019 16:35:18 GMT

Hello dnavarro.

Thank you for asking... Actually my question was because I wasn't getting complete size of hdfs that I have on the output command hdfs -du against the size I was watching on the ambari UI. There was a significant difference on it.

At the end, it turned up that that difference was due to that hdp 2.6.5 version command hdfs dfs -du is not taking in count the snapshots sizes, therefore, there we have the missmatching I was looking since the beginning and why I needed that output.

Just keep in mind that for version grater than 2.6.5 you need to take snapshots size separately if you want to check entire hdfs size 😉

😉

Re: How to make "hdfs dfs -du" command show 2 size columns "Size - Size with replication"

dnavarro — Mon, 21 Oct 2019 18:27:12 GMT

I see, thanks for the update and closing the loop on the difference.