I am curious about when CDH will officially move to Spark 2.x and no longer default to 1.6. Anyone have any information about this?
CDH has been on Spark 2 for almost a year.
CDH5 can't remove Spark 1.x support because that would of course break any apps using Spark 1.
Spark 2 is provided in parallel.
Breaking changes like that would have to happen in major releases of the distro.