Product Announcements
Find the latest product announcements and version updates
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

[ANNOUNCE] Cloudera Distribution of Apache Spark 2.1 Release 2

Highlighted

[ANNOUNCE] Cloudera Distribution of Apache Spark 2.1 Release 2

Cloudera Employee

We are happy to announce Apache Spark 2.1 release 2. You can download the parcel and apply it directly to provisioned clusters without disrupting your currently running Spark workloads.

 

This component is generally available and is supported on CDH 5.7 and all subsequent CDH 5.x releases.

 

Issues Fixed in Cloudera Distribution of Apache Spark 2.1 release 2

  • [SPARK-22083][CORE] Release locks in MemoryStore.evictBlocksToFreeSpace
  • [SPARK-20603][SS][TEST] Set default number of topic partitions to 1 to reduce the load
  • [SPARK-21928][CORE] Set classloader on SerializerManager's private kryo
  • [SPARK-20555][SQL] Fix mapping of Oracle DECIMAL types to Spark types in read path
  • [SPARK-20848][SQL] Shutdown the pool after reading parquet files

For a full list of fixed issues, see the list here

 

 

Download Cloudera Distribution of Apache Spark 2.1 release 2.

Read the documentation.

Want to become a pro Spark user?  Sign up for Apache Spark Training.

Don't have an account?
Coming from Hortonworks? Activate your account here