Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

spark 2.2 parcel availability in CDH

avatar
New Contributor

Hi,

 

Spark 2.2 is now realeased and is production ready. any estimate on when will the spark 2.2 will be available as CDH parcel? Any estimated/exact dates of parcel release is highly appriciated.

 

Thanks

1 ACCEPTED SOLUTION
4 REPLIES 4

avatar
Expert Contributor

That's good news. But I think the requester would like to know when Cloudera plans to integrate Spark 2 into CDH, not as a separate install (like what Hortonworks does). 

 

Thanks,

Miles

 

avatar
Master Collaborator

It's as integrated and supported as anything else.

If you mean replacing Spark 1, no that's not possible as it would break any apps using Spark 1.

If you mean you just don't want a separate add-on, I get it, but, it's just a delivery mechanism.

C6 would not have both.

avatar
Champion
@MilesYao That may be. On that topic, I don't think anytime soon as Cloudera does not support many features that it does for Spark 1.6. I suspect that sometime post CDH 6 we will see Spark 2.x supplant Spark 1.x as the only version of Spark in CDH.

Ah, I checked out HDP and see what you are getting at. It is really trivial on the difference. Cloudera asks you to put a file on the CM host and configure a separate parcel while HDP includes both Spark1 and Spark2 packages in the same repo.