I want to ask you if it's possible to install an official Spark version (1.6 now) using Cloudera Manager 5.3 and in the same the spark to be managed by CM ?
Suggested to upgrade to CDH 5.5.2 where 1.5.2 spark will come by default. Customizing installation might create dependeancy issues. Or else you can install a seperate 1.6 for testing purpose in different location as standalone.