Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created 08-18-2016 02:06 AM
We met Namenode slow issue, and found two ticket, and said release in hadoop 2.8 and I tried hdp2.5 pre, found hadoop version is 2.7.1, So we want to apply the patches to hdp2.4.2, is that possible?
https://issues.apache.org/jira/browse/HDFS-7858
patch -R -p1 < /mnt/tmp/HDFS-7858.13.patch patching file hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/retry/MultiException.java patching file hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/retry/RetryInvocationHandler.java Hunk #1 succeeded at 23 with fuzz 2. Hunk #2 FAILED at 101. Hunk #3 succeeded at 115 (offset 5 lines). Hunk #4 succeeded at 131 (offset 5 lines). Hunk #5 succeeded at 140 (offset 5 lines). Hunk #6 succeeded at 174 (offset 5 lines). 1 out of 6 hunks FAILED -- saving rejects to file hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/retry/RetryInvocationHandler.java.rej patching file hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ha/ConfiguredFailoverProxyProvider.java Hunk #2 succeeded at 39 (offset 1 line). Hunk #3 succeeded at 52 (offset 1 line). Hunk #4 succeeded at 79 with fuzz 2 (offset 1 line). Hunk #5 succeeded at 103 (offset 1 line). Hunk #6 succeeded at 121 (offset 1 line). Hunk #7 succeeded at 132 (offset 1 line). patching file hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ha/RequestHedgingProxyProvider.java Unreversed patch detected! Ignore -R? [n] y Hunk #1 FAILED at 1. 1 out of 1 hunk FAILED -- saving rejects to file hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ha/RequestHedgingProxyProvider.java.rej patching file hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSHighAvailabilityWithNFS.md Hunk #1 succeeded at 189 (offset -6 lines). patching file hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSHighAvailabilityWithQJM.md Hunk #1 succeeded at 208 (offset -8 lines). patching file hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestRequestHedgingProxyProvider.java Unreversed patch detected! Ignore -R? [n] y Hunk #1 FAILED at 1. 1 out of 1 hunk FAILED -- saving rejects to file hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestRequestHedgingProxyProvider.java.rejhttps://issues.apache.org/jira/browse/HDFS-6763
patch -p1 < /mnt/tmp/HDFS-6763.v3.patch patching file hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/BackupImage.java Reversed (or previously applied) patch detected! Assume -R? [n] y Hunk #1 succeeded at 25 (offset 1 line). Hunk #2 succeeded at 93 (offset -1 lines). Hunk #3 FAILED at 222. 1 out of 3 hunks FAILED -- saving rejects to file hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/BackupImage.java.rej patching file hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java Hunk #1 succeeded at 64 with fuzz 1 (offset 7 lines). Hunk #2 succeeded at 77 (offset 7 lines). Hunk #3 succeeded at 148 (offset 6 lines). Hunk #4 succeeded at 320 (offset 3 lines). Hunk #5 succeeded at 659 (offset 147 lines). patching file hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImage.java Reversed (or previously applied) patch detected! Assume -R? [n] y Hunk #2 FAILED at 42. Hunk #3 FAILED at 59. Hunk #4 FAILED at 67. Hunk #5 FAILED at 142. Hunk #6 FAILED at 843. 5 out of 6 hunks FAILED -- saving rejects to file hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImage.java.rej patching file hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java Hunk #1 succeeded at 1135 (offset 16 lines). patching file hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestDiskspaceQuotaUpdate.java Hunk #1 FAILED at 339. 1 out of 1 hunk FAILED -- saving rejects to file hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestDiskspaceQuotaUpdate.java.rej patching file hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSImageWithSnapshot.java Hunk #1 FAILED at 158. 1 out of 1 hunk FAILED -- saving rejects to file hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSImageWithSnapshot.java.rej
Or Anything wrong?
Created 08-20-2016 01:45 PM
HDP 2.5 will contain Hadoop 2.7.3 not 2.8, if you need to apply patch, please involve Hortonworks support. If you are a customer, HWX can release a patch for you if it's technically possible based on specifics of the JIRAs. If you don't have support, you can certainly do it but test it first. All that said, I would check release notes for HDP 2.5, we may be back porting some 2.8 JIRAs to 2.7.x branch.
Created 08-18-2016 02:11 AM
Are you a supported Hortonworks customer? If yes, then you should not do this and reach out to Hortonworks support. You should not apply patch. Hortonworks support team keeps a track of which customers are on what patch so future help can be provided based on what version and additional patches you have.
If you are not a Hortonworks customer, I still don't recommend but you can try applying the patch in dev/test and see if it resolves your problem.
Created 08-20-2016 01:45 PM
HDP 2.5 will contain Hadoop 2.7.3 not 2.8, if you need to apply patch, please involve Hortonworks support. If you are a customer, HWX can release a patch for you if it's technically possible based on specifics of the JIRAs. If you don't have support, you can certainly do it but test it first. All that said, I would check release notes for HDP 2.5, we may be back porting some 2.8 JIRAs to 2.7.x branch.