Archives of Support Questions (Read Only)

This is an archived board for historical reference. Information and links may no longer be available or relevant
Announcements
This board is archived and read-only for historical reference. To ask a new question, please post a new topic on the appropriate active board.

Spark2 version mismatch in cloudera documentation

avatar

Hello,

 

I've noticed a version mismatch in the cloudera doc for the spark2 installation.

 

 

From this url ; https://www.cloudera.com/documentation/spark2/latest/topics/spark2_packaging.html#packaging

 

The CSD version (cloudera1) isn't the latest and then fails when installed along with the "cloudera2" parcel.

 

 The exact error I got during spark2 startup : The CSD version (2.0.0.cloudera1) is not compatible with the current installed version.

 

For thos who encounter the same issue here is the workaround.

 

Simply get the latest CSD from here : http://archive.cloudera.com/spark2/csd/SPARK2_ON_YARN-2.0.0.cloudera2.jar

 

Remove the old cloudera1 CSD, restart cld manager and reinstall spark2.

 

 

Cheers!

 

 

1 ACCEPTED SOLUTION

avatar
Master Guru

@guillaume_vande,

 

A big thanks for pointing that out.  We have updated the Spark2 page to include both versions with respective links.

https://www.cloudera.com/documentation/spark2/latest/topics/spark2_packaging.html#packaging

Let us know if you find anything else that needs correcting.

 

Regards,

 

Ben

View solution in original post

1 REPLY 1

avatar
Master Guru

@guillaume_vande,

 

A big thanks for pointing that out.  We have updated the Spark2 page to include both versions with respective links.

https://www.cloudera.com/documentation/spark2/latest/topics/spark2_packaging.html#packaging

Let us know if you find anything else that needs correcting.

 

Regards,

 

Ben