yarn-cacity-scheduler.pngHi..i am using HDP 2.1.2 with 7 node PROD cluster(5 data nodes and 2 name nodes) and name nodes having 32Core s and 256 gb ram ,data nodes have 24 cores and 125gb rams ... View more

what commodity or appliance hardware ? and how can i know that what my cluster is ? I am using HDP 2.1.2 with support of TERADATA i am using DEV and PROD clusters(130TB) Prod cluster has 4 data node(24 cores +125gb ram)2 name nodes(32 cores +300gb ram) 1 Edge node with configure what are the other hardware configuration need to verify? ... View more

I have 4 nodes cluster with NN-HA ..when i restart two datanodes i have 100+ corrupted blocks(shown in ambari>hdfs>servieces ) and i have replication factor 3 so i want to deleted these corrupted blocks..before i deleted this i want to check which are files are corrupted so i run below command and got below ouput ,here did not get any corrupted blocks or files? please help me ..i have this issue since long .. P1-230-8:/root> hdfs fsck / | egrep -v '^\.+ Connecting to namenode via http://stlpr8711:50070 FSCK started by hdfs (auth:SIMPLE) from /39.6.64.8 for path / at Fri Aug 05 06:27:52 CDT 2016 ...........................Status: HEALTHY T otal size: 39189208876540 B (Total open files size: 83162 B) Total dirs: 710383 Total files: 2184527 Total symlinks: 0 (Files currently being written: 7) Total blocks (validated): 2309173 (avg. block size 16971101 B) (Total open file blocks (not validated): 7) Corrupt blocks: 0 Number of data-nodes: 4 Number of racks: 1 FSCK ended at Fri Aug 05 06:28:40 CDT 2016 in 47634 milliseconds The filesystem under path '/' is HEALTHY ... View more