Can I apply apache patch to hdp2.4.2

linou — Thu, 18 Aug 2016 09:06:49 GMT

We met Namenode slow issue, and found two ticket, and said release in hadoop 2.8 and I tried hdp2.5 pre, found hadoop version is 2.7.1, So we want to apply the patches to hdp2.4.2, is that possible?

https://issues.apache.org/jira/browse/HDFS-7858

patch -R -p1 < /mnt/tmp/HDFS-7858.13.patch 
patching file hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/retry/MultiException.java
patching file hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/retry/RetryInvocationHandler.java
Hunk #1 succeeded at 23 with fuzz 2.
Hunk #2 FAILED at 101.
Hunk #3 succeeded at 115 (offset 5 lines).
Hunk #4 succeeded at 131 (offset 5 lines).
Hunk #5 succeeded at 140 (offset 5 lines).
Hunk #6 succeeded at 174 (offset 5 lines).
1 out of 6 hunks FAILED -- saving rejects to file hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/retry/RetryInvocationHandler.java.rej
patching file hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ha/ConfiguredFailoverProxyProvider.java
Hunk #2 succeeded at 39 (offset 1 line).
Hunk #3 succeeded at 52 (offset 1 line).
Hunk #4 succeeded at 79 with fuzz 2 (offset 1 line).
Hunk #5 succeeded at 103 (offset 1 line).
Hunk #6 succeeded at 121 (offset 1 line).
Hunk #7 succeeded at 132 (offset 1 line).
patching file hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ha/RequestHedgingProxyProvider.java
Unreversed patch detected!  Ignore -R? [n] y
Hunk #1 FAILED at 1.
1 out of 1 hunk FAILED -- saving rejects to file hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ha/RequestHedgingProxyProvider.java.rej
patching file hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSHighAvailabilityWithNFS.md
Hunk #1 succeeded at 189 (offset -6 lines).
patching file hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSHighAvailabilityWithQJM.md
Hunk #1 succeeded at 208 (offset -8 lines).
patching file hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestRequestHedgingProxyProvider.java
Unreversed patch detected!  Ignore -R? [n] y
Hunk #1 FAILED at 1.
1 out of 1 hunk FAILED -- saving rejects to file hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestRequestHedgingProxyProvider.java.rej

https://issues.apache.org/jira/browse/HDFS-6763

patch -p1 < /mnt/tmp/HDFS-6763.v3.patch 
patching file hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/BackupImage.java
Reversed (or previously applied) patch detected!  Assume -R? [n] y
Hunk #1 succeeded at 25 (offset 1 line).
Hunk #2 succeeded at 93 (offset -1 lines).
Hunk #3 FAILED at 222.
1 out of 3 hunks FAILED -- saving rejects to file hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/BackupImage.java.rej
patching file hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java
Hunk #1 succeeded at 64 with fuzz 1 (offset 7 lines).
Hunk #2 succeeded at 77 (offset 7 lines).
Hunk #3 succeeded at 148 (offset 6 lines).
Hunk #4 succeeded at 320 (offset 3 lines).
Hunk #5 succeeded at 659 (offset 147 lines).
patching file hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImage.java
Reversed (or previously applied) patch detected!  Assume -R? [n] y
Hunk #2 FAILED at 42.
Hunk #3 FAILED at 59.
Hunk #4 FAILED at 67.
Hunk #5 FAILED at 142.
Hunk #6 FAILED at 843.
5 out of 6 hunks FAILED -- saving rejects to file hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImage.java.rej
patching file hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
Hunk #1 succeeded at 1135 (offset 16 lines).
patching file hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestDiskspaceQuotaUpdate.java
Hunk #1 FAILED at 339.
1 out of 1 hunk FAILED -- saving rejects to file hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestDiskspaceQuotaUpdate.java.rej
patching file hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSImageWithSnapshot.java
Hunk #1 FAILED at 158.
1 out of 1 hunk FAILED -- saving rejects to file hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSImageWithSnapshot.java.rej

Or Anything wrong?

Re: Can I apply apache patch to hdp2.4.2

mqureshi — Thu, 18 Aug 2016 09:11:29 GMT

@linou zhang

Are you a supported Hortonworks customer? If yes, then you should not do this and reach out to Hortonworks support. You should not apply patch. Hortonworks support team keeps a track of which customers are on what patch so future help can be provided based on what version and additional patches you have.

If you are not a Hortonworks customer, I still don't recommend but you can try applying the patch in dev/test and see if it resolves your problem.

Re: Can I apply apache patch to hdp2.4.2

aervits — Sat, 20 Aug 2016 20:45:32 GMT

HDP 2.5 will contain Hadoop 2.7.3 not 2.8, if you need to apply patch, please involve Hortonworks support. If you are a customer, HWX can release a patch for you if it's technically possible based on specifics of the JIRAs. If you don't have support, you can certainly do it but test it first. All that said, I would check release notes for HDP 2.5, we may be back porting some 2.8 JIRAs to 2.7.x branch.

question Can I apply apache patch to hdp2.4.2 in Support Questions

Can I apply apache patch to hdp2.4.2

Re: Can I apply apache patch to hdp2.4.2

Re: Can I apply apache patch to hdp2.4.2