This response is NOT to fix "files with corrupt replicas" but to find and fix files that are completely corrupt, that is that there are not good replicas to recover the files. The warning of files with corrupt replicas is when the file has at least one replica which is corrupt, but the file can still be recovered from the remaining replicas. In this case hdfs fsck /path ...  will not show these files because it considere these healty. These files and the corrupted replicas are only reported by the command hdfs dfsadmin -report  and as far as I known there is no direct command to fix this. Only way I have found I to wait for the Hadoop cluster to health itself by reallocating the bad replicas from the good ones. ... View more

In my case I had to restart HiveServer2 services on nodes after I had connected the hosts to the domain (using sssd service). ... View more

I see that you use Active DIrecyory   Did you use the below property?   +++ <property> <name>hive.server2.authentication.ldap.Domain</name> <value>AD_Domain</value> </property> +++ ... View more

great . please accept your answer as best answer and close this threaad . ... View more

If it states "Decommissioning" like so Then it means blocks are being replicated to other nodes. Be patient - it takes time. When finished it will change to "Decommissioned" ... View more

@Jay Kumar SenSharma The old hosts are still in the AMS metrics. I will take care of the TTL in AMS as per your recommendations. Thank you ! ... View more

Hi @Eric Leme Thank you for your response. I'm familiar with the information you provided (yet it is appreciated... points rewarded...) but i was hoping to hear from people who actually did the switch from 1500 to Jumbo. Learn from their first hand experience. Thanks! ... View more