[ANNOUNCE] Cloudera Distribution of Apache Spark 2.1 Release 1

[#1]

We are happy to announce Apache Spark 2.1 release 1. You can download the parcel and apply it directly to provisioned clusters without disrupting your currently running Spark workloads.

Cloudera Distribution of Apache Spark 2.1 release 1 is compatible with the following CDH versions: CDH 5.7, CDH 5.8, CDH 5.9, CDH 5.10.

What's New in Cloudera Distribution of Apache Spark 2.1 Release 1

• New direct connector to Kafka that uses the new Kafka consumer API. See Spark 2 Kafka Integration for details.

Issues Fixed in Cloudera Distribution of Apache Spark 2.1 - Release 1

• [SPARK-19554][UI,YARN] Allow SHS URL to be used for tracking in YARN RM.
• [SPARK-16554][CORE] Automatically Kill Executors and Nodes when they are Blacklisted
• [SPARK-16654][CORE] Add UI coverage for Application Level Blacklisting
• [SPARK-8425][CORE] Application Level Blacklisting
• [SPARK-18117][CORE] Add test for TaskSetBlacklist
• [SPARK-18949][SQL][BACKPORT-2.1] Add recoverPartitions API to Catalog
• [SPARK-19459][SQL][BRANCH-2.1] Support for nested char/varchar fields in ORC
• [SPARK-19611][SQL] Introduce configurable table schema inference

Download Cloudera Distribution of Apache Spark 2.1 release 1.

Read the documentation.

Want to become a pro Spark user?  Sign up for Apache Spark Training.