You can do it but it is not supported by hortonworks, you'd need to follow Spark Standalone instructions. it defeats the purpose though as you lose benefit of Ambari provisioning, security features (no kerberos unless you run Spark on YARN) and no support from vendor. you will also have to package and deploy yourself, all that said here's the 2.0 guide https://spark.apache.org/docs/latest/spark-standalone.html Our doc does not say it is possible, it says we do not support it. ... View more

HDP 2.5 will contain Hadoop 2.7.3 not 2.8, if you need to apply patch, please involve Hortonworks support. If you are a customer, HWX can release a patch for you if it's technically possible based on specifics of the JIRAs. If you don't have support, you can certainly do it but test it first. All that said, I would check release notes for HDP 2.5, we may be back porting some 2.8 JIRAs to 2.7.x branch. ... View more