Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

upgrade spark from 1.2 to 1.3

Re: upgrade spark from 1.2 to 1.3

Rising Star

Thank you for your reply Stunos!

You are proposing to upgrade from CDH 5.3 to CDH 5.4.

Is this the only way to install Spark 1.3?? Or basically is the recommended way?

As I have mentioned I am having a fully installed and configured env on CDH 5.3 with Spark 1.2.

Could or should Spark 1.2 & Spark 1.3 co-exist or it doesn't make sense?

---

As far as YARN's JobHistory server I'll open up another thread.

 

Cheers!

 

 

Re: upgrade spark from 1.2 to 1.3

Master Collaborator

Updating to CDH 5.4 is certainly the recommended way. CDH will provide one supported version and I suppose you can run whatever else you like on YARN but the other version wouldn't be in any way known to or supported by the platform.

Re: upgrade spark from 1.2 to 1.3

Rising Star

Agree!

Could you please provide links/docs for upgrading CDH 5.3 to CDH 5.4.

Also, the CM release is 5.3 do I upgrade that too?

 

Thank you.

 

Re: upgrade spark from 1.2 to 1.3

Master Collaborator