Apache Spark 2.3.1 does not work with Hadoop 3.0

[#1]

There seems to be some major bugs in Apache Spark 2.3.x and its integration with Hadoop 3.0, which are still unresolved in Apache Spark JIRA issues. Are these issues resolved by Hortonworks team, or do they still exist in HDP 3.0?

List of unresolved issues with NO Fixed versions

• Spark Data Frames does not work with Hadoop 3.0 https://issues.apache.org/jira/browse/SPARK-18673
• Kerberos Ticket renewal fails in Hadoop 3 https://issues.apache.org/jira/browse/SPARK-24493
• Spark run on Hadoop 3 https://issues.apache.org/jira/browse/SPARK-23534

Nothing is mention in HDP 3.0 release notes regarding these issues, Not even in the KNOWN ISSUES section. hdp-release-notes.pdf

[#2]

Hi @Sangram Gaikwad,

They have been resolved and do not exist in HDP 3.0.1. They're just probably just missing on the Known Issues notes.