We're pleased to announce the release of Cloudera Data Platform (CDP) Private Cloud (PvC) Base 7.1.6, which provides additional platform support and introduces key new features. This is a cumulative maintenance release that carries forward the improvements from CDP PvC Base 7.1.5 and prior releases.
A key focus of this release has been to make migrations to CDP PvC Base easier, in addition to new features, and general platform support. Here’s an overview of the new features and improvements we’ve added in this release.
Upgrade enhancements
To help customers with their move to CDP PvC Base, we’ve made the following features available in this release:
- To support upgrading from HDP 3, we’ve released in-place upgrades for directly migrating your clusters to CDP PVC Base, and released a new version of the AM2CM tool (1.2.0) to support migrating from Ambari to Cloudera Manager.
- Documented rollback procedures for CDH 5 to CDP 7.1.6 and HDP 2 to CDP 7.1.6 are now available.
- CDP Private Cloud Base now supports Operational Database (OpDB) powered by Apache Accumulo, based on Accumulo 2.0, which adds new capabilities such as semantic versioning, bulk imports, and simplified scripts. This enables CDH 5, HDP 2, and HDP 3 customers that utilize Accumulo to upgrade to CDP Private Cloud Base. More details here.
- To enhance upgrading from CDH 5, we’ve improved the YARN FS2CS Tool for scheduler migration. This provides better scheduler transition for customers who are upgrading or migrating from CDH 5.13 - 5.16 with improved placement rules, a new placement rule evaluation engine, and a new weight mode for capacity allocation with flexible auto-queue creation for Capacity Scheduler.
We’ve released a number of YARN enhancements for your upgrade, including dynamic and auto-child-queue creation in YARN and YARN Queue Manager, support for partitions and node labels, managing YARN partitions with Queue Manager UI, enhanced placement rules, and Weight Mode has been introduced for YARN resource allocation for additional flexibility and easier migration from fair scheduler configurations.
General Feature Enhancements
To further improve the management, security, and analytical capabilities of the platform, we’ve made the following features and enhancements available in this release:
- We’ve added a number of enhancements in Cloudera Manager 7.3.1, including the ability for Ranger audit to use a local file system instead of HDFS for storage, customer Kerberos principal support for streaming components (SRM, SMM, Cruise Control, Kafka Connect, and Schema Registry), (de)commission steps can be defined as part of CSD services, and service and role metrics collection now supports gathering enumerated text values.
- We’ve added OpDB to support complex distributed transactions across rows and tables using ANSI SQL semantics (supports TPC-C). This capability helps transition overgrown MySQL / PostGres / Oracle databases to OpDB. See this blog for details and benchmarking results.
- We’ve added a number of Data Warehouse enhancements, including ROLE-related statements in Impala, Hive Warehouse Connector Simplification to deliver a common configuration to specify the mode of operation, support for the Impyla client, Kudu support for INSERT_IGNORE, UPDATE_IGNORE, and DELETE_IGNORE operations, simplifying client applications and improving ingest performance, and faster cluster restart and rebalance for Kudu.
- We’ve added a number of Object Store enhancements, including Ozone enhancements to support Kafka Connect, Atlas and Nifi sinks, the ability to recover accidentally deleted keys with Ozone, and Ozone Multiraft protocol support increasing write performance by upto 30%.
We’ve added a number of Authorization & Audit enhancements, including Ranger Audit Filter (Tech Preview), Ranger audit access improvements, and improved performance for Hive-HDFS ACL sync.
Platform Support Enhancements
CDP PvC Base now also supports the following operating system and database versions:
- RHEL/CENTOS 7.9 for Intel x86 and IBM PPC hardware.
See the 7.1.6 Release Summary for more details of these features.
CDH and HDP customers are encouraged to upgrade to CDP PvC Base for improved enterprise data management capabilities and new platform innovations.
Cloudera’s Professional Services team is available to ensure your migration to CDP is successful. In addition, Cloudera’s Support Team is available for your mission critical support needs. We encourage you to open a support case via our Support Portal to alert us of your planned upgrade.
Additional resources to help:
As always, we welcome your feedback. Please post your comments and suggestions to our community forums.