Thank you for your reply Stunos!
You are proposing to upgrade from CDH 5.3 to CDH 5.4.
Is this the only way to install Spark 1.3?? Or basically is the recommended way?
As I have mentioned I am having a fully installed and configured env on CDH 5.3 with Spark 1.2.
Could or should Spark 1.2 & Spark 1.3 co-exist or it doesn't make sense?
As far as YARN's JobHistory server I'll open up another thread.
Updating to CDH 5.4 is certainly the recommended way. CDH will provide one supported version and I suppose you can run whatever else you like on YARN but the other version wouldn't be in any way known to or supported by the platform.