Hello @Rob Ketcherside, @emaxwell, thanks a lot to remind me about that. It looks I still think to much in a hdfs way here. You see first I deployed a HDP on VM's and running it in a production for a few months. After few months I had about 300 mio of records in hive and I had to move everything to a new infrastructure HPD on Isilon. The deployment and migration was successfull and I'm loading new data now every day...
It was easy to check if hdfs is healthy before, I could check it from ambari or command line, but now with Isilon I'm not so sure about it. Ambari is not showing me some useful info about it and also from shell I could not find some real info. I can run hdfs dfsadmin -report, but I'm no sure if this is a right way now.
There is about 350GB of data in hdfs in the moment, but report shows a different number... hdfs dfsadmin -report Configured Capacity: 356881289379840 (324.58 TB)
Present Capacity: 356881289379840 (324.58 TB)
DFS Remaining: 350800989585408 (319.05 TB)
DFS Used: 6080299794432 (5.53 TB)
DFS Used%: 1.70%
Under replicated blocks: 0
Blocks with corrupt replicas: 0
Missing blocks: 0
Missing blocks (with replication factor 1): 0 How do you cope with that? How can you realy monitor hdp and hdfs on Isilon to be sure everything is running ok?
... View more
