Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]

What's New @ Cloudera

Find the latest Cloudera product news
Announcements
Share your experience with Cloudera on G2 and get a $25 Amazon Gift card.
Hi, I'm CLEO! Something exciting is coming to the Community. Stay Tuned!

[ANNOUNCE] Cloudera Distribution of Apache Spark 2.1 Release 2

avatar
Rising Star

We are happy to announce Apache Spark 2.1 release 2. You can download the parcel and apply it directly to provisioned clusters without disrupting your currently running Spark workloads.

 

This component is generally available and is supported on CDH 5.7 and all subsequent CDH 5.x releases.

 

Issues Fixed in Cloudera Distribution of Apache Spark 2.1 release 2

  • [SPARK-22083][CORE] Release locks in MemoryStore.evictBlocksToFreeSpace
  • [SPARK-20603][SS][TEST] Set default number of topic partitions to 1 to reduce the load
  • [SPARK-21928][CORE] Set classloader on SerializerManager's private kryo
  • [SPARK-20555][SQL] Fix mapping of Oracle DECIMAL types to Spark types in read path
  • [SPARK-20848][SQL] Shutdown the pool after reading parquet files

For a full list of fixed issues, see the list here. 

 

 

Download Cloudera Distribution of Apache Spark 2.1 release 2.

Read the documentation.

Want to become a pro Spark user?  Sign up for Apache Spark Training.