Created 08-18-2016 02:06 AM
We met Namenode slow issue, and found two ticket, and said release in hadoop 2.8 and I tried hdp2.5 pre, found hadoop version is 2.7.1, So we want to apply the patches to hdp2.4.2, is that possible?
https://issues.apache.org/jira/browse/HDFS-7858
patch -R -p1 < /mnt/tmp/HDFS-7858.13.patch patching file hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/retry/MultiException.java patching file hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/retry/RetryInvocationHandler.java Hunk #1 succeeded at 23 with fuzz 2. Hunk #2 FAILED at 101. Hunk #3 succeeded at 115 (offset 5 lines). Hunk #4 succeeded at 131 (offset 5 lines). Hunk #5 succeeded at 140 (offset 5 lines). Hunk #6 succeeded at 174 (offset 5 lines). 1 out of 6 hunks FAILED -- saving rejects to file hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/retry/RetryInvocationHandler.java.rej patching file hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ha/ConfiguredFailoverProxyProvider.java Hunk #2 succeeded at 39 (offset 1 line). Hunk #3 succeeded at 52 (offset 1 line). Hunk #4 succeeded at 79 with fuzz 2 (offset 1 line). Hunk #5 succeeded at 103 (offset 1 line). Hunk #6 succeeded at 121 (offset 1 line). Hunk #7 succeeded at 132 (offset 1 line). patching file hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ha/RequestHedgingProxyProvider.java Unreversed patch detected! Ignore -R? [n] y Hunk #1 FAILED at 1. 1 out of 1 hunk FAILED -- saving rejects to file hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ha/RequestHedgingProxyProvider.java.rej patching file hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSHighAvailabilityWithNFS.md Hunk #1 succeeded at 189 (offset -6 lines). patching file hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSHighAvailabilityWithQJM.md Hunk #1 succeeded at 208 (offset -8 lines). patching file hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestRequestHedgingProxyProvider.java Unreversed patch detected! Ignore -R? [n] y Hunk #1 FAILED at 1. 1 out of 1 hunk FAILED -- saving rejects to file hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestRequestHedgingProxyProvider.java.rejhttps://issues.apache.org/jira/browse/HDFS-6763
patch -p1 < /mnt/tmp/HDFS-6763.v3.patch patching file hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/BackupImage.java Reversed (or previously applied) patch detected! Assume -R? [n] y Hunk #1 succeeded at 25 (offset 1 line). Hunk #2 succeeded at 93 (offset -1 lines). Hunk #3 FAILED at 222. 1 out of 3 hunks FAILED -- saving rejects to file hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/BackupImage.java.rej patching file hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java Hunk #1 succeeded at 64 with fuzz 1 (offset 7 lines). Hunk #2 succeeded at 77 (offset 7 lines). Hunk #3 succeeded at 148 (offset 6 lines). Hunk #4 succeeded at 320 (offset 3 lines). Hunk #5 succeeded at 659 (offset 147 lines). patching file hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImage.java Reversed (or previously applied) patch detected! Assume -R? [n] y Hunk #2 FAILED at 42. Hunk #3 FAILED at 59. Hunk #4 FAILED at 67. Hunk #5 FAILED at 142. Hunk #6 FAILED at 843. 5 out of 6 hunks FAILED -- saving rejects to file hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImage.java.rej patching file hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java Hunk #1 succeeded at 1135 (offset 16 lines). patching file hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestDiskspaceQuotaUpdate.java Hunk #1 FAILED at 339. 1 out of 1 hunk FAILED -- saving rejects to file hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestDiskspaceQuotaUpdate.java.rej patching file hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSImageWithSnapshot.java Hunk #1 FAILED at 158. 1 out of 1 hunk FAILED -- saving rejects to file hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSImageWithSnapshot.java.rej
Or Anything wrong?
Created 08-20-2016 01:45 PM
HDP 2.5 will contain Hadoop 2.7.3 not 2.8, if you need to apply patch, please involve Hortonworks support. If you are a customer, HWX can release a patch for you if it's technically possible based on specifics of the JIRAs. If you don't have support, you can certainly do it but test it first. All that said, I would check release notes for HDP 2.5, we may be back porting some 2.8 JIRAs to 2.7.x branch.
Created 08-18-2016 02:11 AM
Are you a supported Hortonworks customer? If yes, then you should not do this and reach out to Hortonworks support. You should not apply patch. Hortonworks support team keeps a track of which customers are on what patch so future help can be provided based on what version and additional patches you have.
If you are not a Hortonworks customer, I still don't recommend but you can try applying the patch in dev/test and see if it resolves your problem.
Created 08-20-2016 01:45 PM
HDP 2.5 will contain Hadoop 2.7.3 not 2.8, if you need to apply patch, please involve Hortonworks support. If you are a customer, HWX can release a patch for you if it's technically possible based on specifics of the JIRAs. If you don't have support, you can certainly do it but test it first. All that said, I would check release notes for HDP 2.5, we may be back porting some 2.8 JIRAs to 2.7.x branch.