Spark 2

[#1]

CDH (lower than 5.12) parcel required for SPARK2 (2.0.0.cloudera1-1.cdh5.7.0.p0.113931) is not available. How to solve this problem? I already copy SPARK2_ON_YARN-2.0.0.cloudera1.jar to the system and follow all steps from manuals.

[#2 · Accepted solution]

We were able to install the official parcel.  The only problem encountered was that all the signature files in the repository have extension .sha1.  Our CM (5.8.3) were expecting .sha .  Manually renaming it allowed the install to complete.

[#3]

How i can know if the parcels files should has sha or sha1 signature?

When Spark2 will be part of CDH4 parcels, which version?

currently i have 1.6, when i add 2.0 will the spark history server be 2.0 also? if i used 2.0 parcels, which one will be the active one on the cluster 1.6 or 2.0?