What's New @ Cloudera

Visit Cloudera documentation to discover our revamped Hue Guide. It has been re-organized and additional content has been added. Look out or further improvements in the areas of performance tuning and reference architectures to be released soon. You can also get information about other important updates for Apache Kudu and Impala. Check out What's New in Cloudera Documentation for a full summary. 

Visit Cloudera documentation to discover our revamped Hue Guide. It has been re-organized, updated and additional content has been added. Look out for further improvements in the areas of performance tuning and reference architectures to be released soon. You can also get more information on how CDH 6.1.0 supports Google Cloud Storage as the persistent storage layer for CDH clusters, and other important updates for Apache Kudu and Impala. Check out What's New in Cloudera Documentation for a full summary. 

We are pleased to announce the release of Hive JDBC v2.6.5. The release has the following fixes and enhancements:Resolved Issues[00139103][HIVEJ-534] If a SQL query ends in a semicolon, the driver reports an error. This issue has been resolved. The driver now removes trailing semicolons from queries before sending them to the server.Breaking ChangesThe following are breaking changes to driver functionality. Thee changes may cause some workflow from earlier versions of the driver to fail.2.6.1 - Removed support for JDBC 3 (Java 5). Beginning with this release, the driver no longer supports JDBC 3 (Java 5). Only JDBC 4 (Java 6) and JDBC 4.1 (Java 7) are supportedGetting Started with the Cloudera DriverRead the Cloudera JDBC 2.6.5 Driver for Hive Release Notes and Installation Guide.Download the connector from the Cloudera Connectors page.As always, we welcome your feedback. Please send your comments and suggestions to the user group of through our community forums. You can also file bugs

 Dear CDH, Cloudera Manager, and Cloudera Navigator users, We are pleased to announce the release of Cloudera Enterprise 6.1.1 (CDH 6.1.1, Cloudera Manager 6.1.1, and Cloudera Navigator 6.1.1).This release fixes key bugs and includes the following: The following upstream issues are fixed in CDH 6.1.1:IMPALA-7777 - Fixed a crash due to arithmetic overflows in the Exchange Node.HBASE-21503 - Replication normal source can get stuck due potential race conditions between source wal reader and wal provider initialization threads.HBASE-21621 - Reversed scan does not return expected number of rowsHIVE-14557 - Nullpointer When both SkewJoin and Mapjoin EnabledKUDU-1678 - Fixed a rare crash caused by a race condition when a replica is shutting down while processing an alter table.For a full list of upstream JIRAs fixed in CDH 6.1.1, see the issues fixed section of the Release Notes.Cloudera Manager fixes for the following issues:Backup and disaster recovery (BDR) HDFS and Hive rep

Visit Cloudera documentation to:Learn how to configure Spark ML to use native math libraries that accelerate model training speed for algorithms like Alternating Least Squares (ALS).Learn more about Workload XM' new Workload View feature that enables you to break down workloads by specific criteria to perform deep-dive analysis on the queries.A new video will also help you to classify workloads to gain insights.Check out What's New in Cloudera Documentation for a full summary.

Cloudera is delighted to announce the release of Cloudera Data Science Workbench 1.5.0. With this release, Cloudera Data Science Workbench includes direct integration with Hortonworks Data Platform (HDP), adds support for Cloudera Enterprise 6.1 (and higher), and ships some noteworthy bug fixes and enhancements.  Cloudera Data Science Workbench on Hortonworks Data PlatformCloudera Data Science Workbench is now ready to help Hortonworks customers accelerate the delivery of new data products through secure, collaborative data science at scale.  Built using Docker containers, Cloudera Data Science Workbench offers data science teams per-project isolation and reproducibility, in addition to easier collaboration. By leveraging HDP’s support for Apache Ranger and Apache Atlas, IT teams can take advantage of their previous investment in security, audit, and governance policies along with seamless Kerberos and LDAP integration. Add Cloudera Data Science Workbench to an existing HDP c

We are pleased to announce the release of Cloudera Director 6.0.1. Cloudera Director 6.0.1 provides bug fixes and and product improvements, as outlined in the Cloudera Director 6.0.1 release notes. For more info on downloading and installing Altus Director, see the links below. Download Altus DirectorAltus Director Release NotesGetting Started with Altus DirectorUpgrading from a previous Altus Director version As always, we are happy to hear your feedback. Please post your questions and comments on our community forum.

We are pleased to announce the release of Cloudera Director 2.8.1. Cloudera Director 2.8.1 provides bug fixes and and product improvements, as outlined in the Cloudera Director 2.8.1 release notes. For more info on downloading and installing Altus Director, see the links below. Download Altus DirectorAltus Director Release NotesGetting Started with Altus DirectorUpgrading from a previous Altus Director version As always, we are happy to hear your feedback. Please post your questions and comments on our community forum.

We are happy to announce CDS 2.1 Release 4 Powered By Apache Spark. You can download the parcel and apply it directly to provisioned clusters without disrupting your currently running Spark workloads. This component is generally available and is supported on CDH 5.7 and higher. What's New in CDS 2.1 release 4This is purely a maintenance release. See CDS Powered By Apache Spark Fixed Issues for the list of fixed issues.Download CDS 2.1 Release 4 Powered By Apache Spark.Read the documentation.Want to become a pro Spark user?  Sign up for Apache Spark Training.

With the release Cloudera Enterprise 6.1, we are limiting Cloudera Express customers using both CM6 and CDH6 to a maximum of 100 deployable nodes across all of their environments.   Each Cloudera Manager (CM) instance will monitor the total nodes of all CDH6 clusters it manages.   We believe customers will be better served and better protected by deploying a supported version of Cloudera Enterprise for these large (100+ node) clusters.   At the same time, it’s important for Cloudera to continue to provide potential customers the ability to trial our platform at a meaningful scale.    The following specific points are worth noting as it relates to this change.      Cloudera Manager will not allow you to add hosts to a CDH 6.x cluster if the total number of Express managed hosts across all CDH 6.x clusters will exceed 100.   Cloudera Manager will not allow you to upgrade any cluster to CDH 6.x if the total number of Express managed

We are pleased to announce a new minor release of our supported packaging of Apache Accumulo for use on CDH6.0.0.This release is the latest stable Apache Accumulo and it supports C6.0.0 and later.Please refer to the installation guide for known issues and a list of unsupported upstream features.Existing users should see a new parcel available for Accumulo 1.9.2.This release is supported with Cloudera Manager and CDH versions 6.0.0or later. Cloudera recommends using the latest version of ClouderaManager available.

We are pleased to announce the release of Cloudera Altus Director 6.1.0. Altus Director provides a simple, reliable, enterprise-grade way to deploy, scale, and manage Apache Hadoop in the cloud of your choice. Altus Director is fully supported with Cloudera Enterprise 5 and Cloudera Enterprise 6. What's New in Altus Director 6.1.0CM6.1 and CDH6.1 supportStrengthened security through improved support for running behind a proxyImproved cluster customization through enhancements to lifecycle scriptsBetter support for long-running clusters through relaxed validation of images when growingSupport for deploying with OpenJDKBetter Google Cloud Platform experience through support for Subnetworks For more info on downloading and installing Altus Director, see the links below. Download Altus DirectorAltus Director Release NotesGetting Started with Altus DirectorUpgrading from a previous Altus Director version As always, we are happy to hear your feedback. Please post you

We are pleased to announce the general availability of Cloudera Enterprise 6.1.0, the modern platform for machine learning and analytics optimized for the cloud. This release delivers a number of new capabilities, improved usability, and better performance.  New capabilities include:ManagementCloudera Manager can test the network latency of all network links within a cluster or between clusters to identify performance bottlenecks or misconfigured networksBDR now supports backup from non-secure (non-Kerbrerized) clusters to secure (Kerberized) clusters Impala health monitoring diagnostics have been significantly improvedNew guardrails for Impala query memory usage are available for Impala resource pools, improving multi-tenancy for ImpalaStorageSupport for HDFS Erasure encoding for Hive, Navigator, BDR, MapReduce and Spark workloads can reduce storage requirements by up to 50% with a negligible performance impactSupport for Azure Data Lake Storage Gen 2 enables better performance a

We are pleased to announce the release of Cloudera Data Science Workbench 1.4.3. This release adds new customizations and fixes some critical bugs, including a permanent fix for TSB-346: Risk of Data Loss on Cloudera Data Science Workbench Shutdown and Restart. Please read the Release Notes carefully before you start upgrading or perform a shutdown/restart operation on any previous version of CDSW.   For a complete list of new features and bug fixes in this release, please see the Release Notes.  For more information on downloading, installing and using Cloudera Data Science Workbench, see:Download Cloudera Data Science WorkbenchCloudera Data Science Workbench OverviewGetting Started with Cloudera Data Science WorkbenchCloudera Data Science Workbench Release NotesInstalling and Upgrading Cloudera Data Science Workbench As always, we welcome your feedback. Please send your comments and suggestions on our community forums.

Dear CDH, Cloudera Manager, and Cloudera Navigator users,We are pleased to announce the release of Cloudera Enterprise 5.15.2 (CDH 5.15.2, Cloudera Manager 5.15.2, and Cloudera Navigator 2.14.2).This release fixes key bugs and includes the following: The following upstream issues are fixed in CDH 5.15.2:HIVE-12981 - ThriftCLIService uses incompatible getShortName() implementationHUE-8487 - [useradmin] Fix Add Sync LDAP user fails when using DN with special characterHUE-8467 - [jobbrowser] Support impala digest auth for queriesHDFS-12299 - Fixed a race between update pipeline and DataNode Re-Registration.KUDU-2463 - Fixed an issue in which incorrect results would be returned in scans following a server restart.For a full list of upstream JIRAs fixed in CDH 5.15.2, see the issues fixed section of the Release Notes.Cloudera Manager fixes for the following issues:Restart Warnings are incorrect after starting a role with an outdated configurationUpgrade to CDH 5.15.2 fails with CM 5.15

We are pleased to announce the general availability of Cloudera Enterprise 5.16, the modern platform for machine learning and analytics optimized for the cloud. This release delivers a number of enhancements focusing on ease of administration, improved stability and performance at increased scale.   The Cloudera Enterprise 5.16 release includes updated versions of many of our platform components, including:CDHCloudera Manager Apache ImpalaCloudera NavigatorApache Kudu Apache Sentry5.16 adds new capabilities across four key themes:Easier Administration Sentry adds CREATE permission and user-level ownership of tables.   Enables securely sharing a single sandbox database among many users. Eliminates the administrative overhead of creating separate databases, roles and groups to preserve privacy for one person or a small group.Customized upgrade guide puts all the steps needed for your upgrade in one document. Scale and PerformanceNavigator handles larger volumes o

We are pleased to announce the release of the CDK 3.1.1 Powered by Apache Kafka for CDH 5.  Apache Kafka is a highly scalable, distributed, publish-subscribe messaging system.CDK 3.1.1 Powered by Apache Kafka is a maintenance release based on Apache Kafka 1.0.1.Notable Issues Fixed in CDK 3.1.1 Powered by Apache Kafka:KAFKA-3978 - Ensure high watermark is always positiveKAFKA-6593 - Fix livelock with consumer heartbeat thread in commitSyncKAFKA-6857 - Leader should reply with undefined offset if undefined leader epoch requestedKAFKA-6917 - Process txn completion asynchronously to avoid deadlockKAFKA-6975 - Fix replica fetching from non-batch-aligned log start offsetKAFKA-7012 - Don't process SSL channels without data to processKAFKA-7104 - More consistent leader's state in fetch responseKAFKA-7278 - replaceSegments() should not call asyncDeleteSegment() for segments which have been removed from segments listAll backported fixes can be viewed in the git release notes here or on our

CDH, New DocumentationVisit Cloudera documentation to learn about Cloudera's new Workload Experience Manager, a tool to gain an in-depth understanding of cluster workloads, to troubleshoot failed jobs, and to optimize slow jobs. We’ve added new videos for:Navigator: How to make sure your audit system is doing what you expectSentry: How to verify that HDFS ACLs are synching with SentryCloudera Data Science Workbench:How to run experimentsHow to deploy modelsYou can get information about other important updates for Impala, Kudu, and Yarn as well.Check out What's New in Cloudera Documentation for a full summary. 

We are pleased to announce the release of Cloudera Data Science Workbench 1.4.2. This release adds support for RHEL/CentOS 7.5 and fixes some critical bugs, including TSB-346: Risk of Data Loss on Cloudera Data Science Workbench Shutdown and Restart. Please read the TSB and Release Notes carefully before you start upgrading or perform a shutdown/restart operation on any previous version of CDSW.   Note that Cloudera Data Science Workbench 1.4.2 is the next official maintenance release after Cloudera Data Science Workbench 1.4.0. Version 1.4.1 is no longer publicly available. For more information on downloading, installing and using Cloudera Data Science Workbench, see:Download Cloudera Data Science WorkbenchCloudera Data Science Workbench OverviewGetting Started with Cloudera Data Science WorkbenchCloudera Data Science Workbench Release NotesInstalling and Upgrading Cloudera Data Science WorkbenchAs always, we welcome your feedback. Please send your comments and sug

 Dear CDH, Cloudera Manager, and Cloudera Navigator users, We are pleased to announce the release of Cloudera Enterprise 6.0.1 (CDH 6.0.1, Cloudera Manager 6.0.1, and Cloudera Navigator 6.0.1). This release fixes key bugs and includes the following: The following upstream issues are fixed in CDH 6.0.1:Rebase to HBase 2.0.2HDFS-10240 - Fixed an issue where the race between close/recoverLease leads to missing blocks.HDFS-10453 - Fixed an issue where the ReplicationMonitor thread could get stuck for a long time due to the race between replication and delete of the same file in a large cluster.SOLR-12450 - Don't allow referral to external resources in various config files.HDFS-13281 - Fixed an issue where the Namenode#createFile was not /.reserved/raw/ aware.HADOOP-15698 - Fixed an issue where the KMS log4j is not initialized properly at startup.OOZIE-3193 - Applications are not killed when submitted via subworkflow.FLUME-3237 - Handling RuntimeExceptions coming from th

We are happy to announce CDS 2.3 Release 4 Powered By Apache Spark. You can download the parcel and apply it directly to provisioned clusters without disrupting your currently running Spark workloads. This component is generally available and is supported on CDH 5.9 and higher, and Cloudera Manager 5.11 and higher. What's New in CDS 2.3 release 4This is purely a maintenance release. See CDS Powered By Apache Spark Fixed Issues for the list of fixed issues.Download CDS 2.3 Release 4 Powered By Apache Spark.Read the documentation.Want to become a pro Spark user?  Sign up for Apache Spark Training.

We are pleased to announce the release of Hive ODBC v2.6.1. The release has the following resolved issue. Resolved Issues[00119275][HAR-833] CAST AS VARCHAR(n) returns incorrect metadata. Getting Started with the Cloudera DriverRead the Cloudera Hive ODBC 2.6.1 Driver for Hive Release Notes and Installation Guide. Download the connector from the Cloudera Connectors page.  As always, we welcome your feedback. Please send your comments and suggestions to the user group of through our community forums. You can also file bugs through our external Jira projects on issues.cloudera.org.

We are happy to announce CDS 2.2 Release 4 Powered By Apache Spark. You can download the parcel and apply it directly to provisioned clusters without disrupting your currently running Spark workloads. This component is generally available and is supported on CDH 5.8 and higher, and Cloudera Manager 5.8.3, 5.9 and higher. What's New in CDS 2.2 release 4This is purely a maintenance release. See CDS Powered By Apache Spark Fixed Issues for the list of fixed issues.Download CDS 2.2 Release 4 Powered By Apache Spark.Read the documentation.Want to become a pro Spark user?  Sign up for Apache Spark Training.

We are happy to announce CDS 2.1 Release 3 Powered By Apache Spark. You can download the parcel and apply it directly to provisioned clusters without disrupting your currently running Spark workloads.This component is generally available and is supported on CDH 5.7 and higher.What's New in CDS 2.1 release 3This is purely a maintenance release. See CDS Powered By Apache Spark Fixed Issues for the list of fixed issues.Download CDS 2.1 Release 3 Powered By Apache Spark.Read the documentation.Want to become a pro Spark user?  Sign up for Apache Spark Training. 

We are pleased to announce the release of Cloudera Altus Director 6.0.0. Altus Director provides a simple, reliable, enterprise-grade way to deploy, scale, and manage Apache Hadoop in the cloud of your choice. Altus Director is fully supported with Cloudera Enterprise 5 and Cloudera Enterprise 6. What's New in Altus Director 6.0.0New Name - Although renamed from Cloudera Director to Altus Director, it is still the same product.Cloudera Enterprise 6 and Cloudera Manager 6 supportAs a major release version, Altus Director 6.0 includes changes (see Release Notes) that may not be backwards compatible with existing integrations. For more info on downloading and installing Altus Director, see the links below. Download Altus DirectorAltus Director Release NotesGetting Started with Altus DirectorUpgrading from a previous Altus Director version As always, we are happy to hear your feedback. Please post your questions and comments on our community forum.