Support Questions

Find answers, ask questions, and share your expertise
Announcements
Check out our newest addition to the community, the Cloudera Data Analytics (CDA) group hub.

Spark2 version mismatch in cloudera documentation

Hello,

 

I've noticed a version mismatch in the cloudera doc for the spark2 installation.

 

 

From this url ; https://www.cloudera.com/documentation/spark2/latest/topics/spark2_packaging.html#packaging

 

The CSD version (cloudera1) isn't the latest and then fails when installed along with the "cloudera2" parcel.

 

 The exact error I got during spark2 startup : The CSD version (2.0.0.cloudera1) is not compatible with the current installed version.

 

For thos who encounter the same issue here is the workaround.

 

Simply get the latest CSD from here : http://archive.cloudera.com/spark2/csd/SPARK2_ON_YARN-2.0.0.cloudera2.jar

 

Remove the old cloudera1 CSD, restart cld manager and reinstall spark2.

 

 

Cheers!

 

 

1 ACCEPTED SOLUTION

Super Guru

@guillaume_vande,

 

A big thanks for pointing that out.  We have updated the Spark2 page to include both versions with respective links.

https://www.cloudera.com/documentation/spark2/latest/topics/spark2_packaging.html#packaging

Let us know if you find anything else that needs correcting.

 

Regards,

 

Ben

View solution in original post

1 REPLY 1

Super Guru

@guillaume_vande,

 

A big thanks for pointing that out.  We have updated the Spark2 page to include both versions with respective links.

https://www.cloudera.com/documentation/spark2/latest/topics/spark2_packaging.html#packaging

Let us know if you find anything else that needs correcting.

 

Regards,

 

Ben

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.