Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Spark/Shark version for CDH4.6.0

Spark/Shark version for CDH4.6.0

Explorer

Hello,

 

Which version of Spark and Shark does CDH4.6.0 support?

 

Thanks.

4 REPLIES 4

Re: Spark/Shark version for CDH4.6.0

Explorer

or for CDH 4.70?

Highlighted

Re: Spark/Shark version for CDH4.6.0

Master Collaborator

It's Spark 0.9.0 in 4.4 through 5.0.x, and Spark 1.0 starting in 5.1.

Re: Spark/Shark version for CDH4.6.0

Explorer

Thanks.

Re: Spark/Shark version for CDH4.6.0

Master Collaborator

0.9.0, in Standalone mode only. To run Spark 0.9.0 on YARN, you would need CDH 5.0.x, and for Spark 1.0 on YARN, CDH 5.1.

 

Note: Shark is not supported in any release of CDH (and, in fact, Shark development is now in sunset mode).