Reply
Highlighted
Expert Contributor
Posts: 61
Registered: ‎02-03-2016

Spark 2.1 official beta

Are there any plans soon to have Spark 2.1 installable alongside with Spark 1.6 in CDH? There are many issues and instabilities resolved in Spark 2.1 that were introduced in Spark 2.0. Plus, it would be nice to get our hands on it before the Spark Summits for 2017.

 

Thanks,

Ben

New Contributor
Posts: 1
Registered: ‎03-20-2017

Re: Spark 2.1 official beta

Hi folks,

 

Do we have any release dates for Spark 2.1 in CDH?

It'd be great to use new features from the latest stable version.

Expert Contributor
Posts: 61
Registered: ‎02-03-2016

Re: Spark 2.1 official beta

I am using Spark Release 2 for CDH to test, and I found that a MLlib library is missing org.apache.spark.ml.feature.BucketedRandomProjectionLSH. We would need this for a project we are working on. It is included in Spark 2.1. Any idea on when it will become available or is there a way to get it?

New Contributor
Posts: 4
Registered: ‎07-29-2013

Re: Spark 2.1 official beta

+1, especially via .deb packages.  Is there a plan to make some available soon?  

 

Thanks!

Announcements
Unanswered Topics
No posts to display.