Spark is the platform used by Oryx 2.
Due to this dependency, how Oryx 2 is releasing with Spark ?
For example, Oryx 2 uses SparkML-ALS and there is reported issue with Spark1.3
It's indicated there was a fix for Spark1.4.
Can we just get Oryx 2 and compile with Spark 1.4 ?
Or, if CDH has updated with Spark 1.4 and it will just work with Oryx 2 we installed (as long as the SparkML-ALS interfaces not changed).
It looks the latest CDH5.4.5 still uses Spark 1.3 which indicates there is no resolution posted for Spark 1.4.
Any suggestion to handle these dependencies issue related to Oryx 2?