Announcements

We are pleased to announce the release of the CDK 3.1.1 Powered by Apache Kafka for CDH 5.  Apache Kafka is a highly scalable, distributed, publish-subscribe messaging system.CDK 3.1.1 Powered by Apache Kafka is a maintenance release based on Apache Kafka 1.0.1.Notable Issues Fixed in CDK 3.1.1 Powered by Apache Kafka:KAFKA-3978 - Ensure high watermark is always positiveKAFKA-6593 - Fix livelock with consumer heartbeat thread in commitSyncKAFKA-6857 - Leader should reply with undefined offset if undefined leader epoch requestedKAFKA-6917 - Process txn completion asynchronously to avoid deadlockKAFKA-6975 - Fix replica fetching from non-batch-aligned log start offsetKAFKA-7012 - Don't process SSL channels without data to processKAFKA-7104 - More consistent leader's state in fetch responseKAFKA-7278 - replaceSegments() should not call asyncDeleteSegment() for segments which have been removed from segments listAll backported fixes can be viewed in the git release notes here or on our

CDH, New DocumentationVisit Cloudera documentation to learn about Cloudera's new Workload Experience Manager, a tool to gain an in-depth understanding of cluster workloads, to troubleshoot failed jobs, and to optimize slow jobs. We’ve added new videos for:Navigator: How to make sure your audit system is doing what you expectSentry: How to verify that HDFS ACLs are synching with SentryCloudera Data Science Workbench:How to run experimentsHow to deploy modelsYou can get information about other important updates for Impala, Kudu, and Yarn as well.Check out What's New in Cloudera Documentation for a full summary. 

We are pleased to announce the release of Cloudera Data Science Workbench 1.4.2. This release adds support for RHEL/CentOS 7.5 and fixes some critical bugs, including TSB-346: Risk of Data Loss on Cloudera Data Science Workbench Shutdown and Restart. Please read the TSB and Release Notes carefully before you start upgrading or perform a shutdown/restart operation on any previous version of CDSW.   Note that Cloudera Data Science Workbench 1.4.2 is the next official maintenance release after Cloudera Data Science Workbench 1.4.0. Version 1.4.1 is no longer publicly available. For more information on downloading, installing and using Cloudera Data Science Workbench, see:Download Cloudera Data Science WorkbenchCloudera Data Science Workbench OverviewGetting Started with Cloudera Data Science WorkbenchCloudera Data Science Workbench Release NotesInstalling and Upgrading Cloudera Data Science WorkbenchAs always, we welcome your feedback. Please send your comments and sug

 Dear CDH, Cloudera Manager, and Cloudera Navigator users, We are pleased to announce the release of Cloudera Enterprise 6.0.1 (CDH 6.0.1, Cloudera Manager 6.0.1, and Cloudera Navigator 6.0.1). This release fixes key bugs and includes the following: The following upstream issues are fixed in CDH 6.0.1:Rebase to HBase 2.0.2HDFS-10240 - Fixed an issue where the race between close/recoverLease leads to missing blocks.HDFS-10453 - Fixed an issue where the ReplicationMonitor thread could get stuck for a long time due to the race between replication and delete of the same file in a large cluster.SOLR-12450 - Don't allow referral to external resources in various config files.HDFS-13281 - Fixed an issue where the Namenode#createFile was not /.reserved/raw/ aware.HADOOP-15698 - Fixed an issue where the KMS log4j is not initialized properly at startup.OOZIE-3193 - Applications are not killed when submitted via subworkflow.FLUME-3237 - Handling RuntimeExceptions coming from th

We are happy to announce CDS 2.3 Release 4 Powered By Apache Spark. You can download the parcel and apply it directly to provisioned clusters without disrupting your currently running Spark workloads. This component is generally available and is supported on CDH 5.9 and higher, and Cloudera Manager 5.11 and higher. What's New in CDS 2.3 release 4This is purely a maintenance release. See CDS Powered By Apache Spark Fixed Issues for the list of fixed issues.Download CDS 2.3 Release 4 Powered By Apache Spark.Read the documentation.Want to become a pro Spark user?  Sign up for Apache Spark Training.

We are pleased to announce the release of Hive ODBC v2.6.1. The release has the following resolved issue. Resolved Issues[00119275][HAR-833] CAST AS VARCHAR(n) returns incorrect metadata. Getting Started with the Cloudera DriverRead the Cloudera Hive ODBC 2.6.1 Driver for Hive Release Notes and Installation Guide. Download the connector from the Cloudera Connectors page.  As always, we welcome your feedback. Please send your comments and suggestions to the user group of through our community forums. You can also file bugs through our external Jira projects on issues.cloudera.org.

We are happy to announce CDS 2.2 Release 4 Powered By Apache Spark. You can download the parcel and apply it directly to provisioned clusters without disrupting your currently running Spark workloads. This component is generally available and is supported on CDH 5.8 and higher, and Cloudera Manager 5.8.3, 5.9 and higher. What's New in CDS 2.2 release 4This is purely a maintenance release. See CDS Powered By Apache Spark Fixed Issues for the list of fixed issues.Download CDS 2.2 Release 4 Powered By Apache Spark.Read the documentation.Want to become a pro Spark user?  Sign up for Apache Spark Training.

We are happy to announce CDS 2.1 Release 3 Powered By Apache Spark. You can download the parcel and apply it directly to provisioned clusters without disrupting your currently running Spark workloads.This component is generally available and is supported on CDH 5.7 and higher.What's New in CDS 2.1 release 3This is purely a maintenance release. See CDS Powered By Apache Spark Fixed Issues for the list of fixed issues.Download CDS 2.1 Release 3 Powered By Apache Spark.Read the documentation.Want to become a pro Spark user?  Sign up for Apache Spark Training. 

We are pleased to announce the release of Cloudera Altus Director 6.0.0. Altus Director provides a simple, reliable, enterprise-grade way to deploy, scale, and manage Apache Hadoop in the cloud of your choice. Altus Director is fully supported with Cloudera Enterprise 5 and Cloudera Enterprise 6. What's New in Altus Director 6.0.0New Name - Although renamed from Cloudera Director to Altus Director, it is still the same product.Cloudera Enterprise 6 and Cloudera Manager 6 supportAs a major release version, Altus Director 6.0 includes changes (see Release Notes) that may not be backwards compatible with existing integrations. For more info on downloading and installing Altus Director, see the links below. Download Altus DirectorAltus Director Release NotesGetting Started with Altus DirectorUpgrading from a previous Altus Director version As always, we are happy to hear your feedback. Please post your questions and comments on our community forum.

We are happy to announce CDS 2.2 Release 3 Powered By Apache Spark. You can download the parcel and apply it directly to provisioned clusters without disrupting your currently running Spark workloads. This component is generally available and is supported on CDH 5.8 and higher. What's New in CDS 2.2 release 3This is purely a maintenance release. See CDS Powered By Apache Spark Fixed Issues for the list of fixed issues.Download CDS 2.2 Release 3 Powered By Apache Spark.Read the documentation.Want to become a pro Spark user?  Sign up for Apache Spark Training.

Cloudera is proud to announce the general availability of Cloudera Enterprise 6.0, featuring a number of enhancements that improve workload performance and build on our enterprise-grade tooling and SDX (shared data experience) capabilities.     In addition to upgrading differentiated administration and productivity tools like Cloudera Manager and Navigator, we have also updated several components of our open source core.   Cloudera Enterprise 6.0 delivers the data management foundation for your mission-critical machine learning and analytics workloads today and into the future.  Please read on for more detail on component updates and benefits: Cloudera Manager 6.0 Cloudera Manager 6 delivers a number of major new capabilities, all of which can be leveraged with both CDH6 and CDH5 environments Fine-grained administrative access controls on individual clusters allows organizations to manage more clusters, including those supporting sensitive & confidential proje

Dear CDH, Cloudera Manager, and Cloudera Navigator users, We are pleased to announce the release of Cloudera Enterprise 5.15.1 (CDH 5.15.1, Cloudera Manager 5.15.1, and Cloudera Navigator 2.14.1). This release fixes key bugs and includes the following: The following upstream issues are fixed in CDH 5.15.1:FLUME-3222 - Fix for NoSuchFileException thrown when files are being deletedHADOOP-15317 - Improve NetworkTopology chooseRandom's loopHDFS-13281 - Namenode#createFile should be /.reserved/raw/ awareHDFS-12710 - HTTPFS HTTP max header size env variable is not respected in branch-2HIVE-19231 - Beeline generates garbled output when using UnsupportedTerminalHIVE-16080 - Add parquet to possible values for hive.default.fileformat and hive.default.fileformat.managedHUE-6697 - [jb] Prevent reset of job page tabs when job is runningHUE-8344 - [hbase] Hbase old version of data can not display in HueHUE-8409 - [core] When idle session timeout is enabled it causes issues with Spneg

Visit Cloudera documentation to see how to migrate from the Cloudera Manager Embedded PostgreSQL database server to an external PostgreSQL database. We’ve also added a new Navigator overview video and information on determining the cause of issues with Sentry after upgrading. https://www.cloudera.com/documentation/enterprise/release-notes/topics/whats_new_in_doc.html

We are pleased to announce the release of Impala ODBC v2.6.0.  The release has the following fixes:Enhancements and New Features: [IMP-478] Updated SSL Support[IMP-519] Minimum TLS Support[IMP-472] TLS Server Name Indication[IMP-508] Standardized Log File Names[IMP-462] More Informative SSL Error Messages[00116516] [IMP-484] Renamed Keytab Property[IMP-520] Linux Installation Workflow Improvement[IMP-317] Support for Result Set Cache and Query RetryResolved Issues:[00131357] [IMP-511] In some cases queries are not properly closed on the server, negatively impacting server resources.[IMP-486] In some cases, CAST AS VARCHAR does not function correctly. [00119275] [IMP-503] Connections from a machine with large amounts of RAM are slower than expected. [00132211] [IMP-523] Driver wide properties cannot be read from the .ini file.Getting Started with the Cloudera DriverRead the Cloudera ODBC 2.6.0 Driver for Impala Release Notes and Installation Guide. Download the connector from the C

 We are pleased to announce the release of Impala JDBC v2.6.4.  The release has the following resolved issues: Resolved Issues[00116966] [IMPJ-386] Documentation for the SocketTimeout configuration option is incorrect.  Breaking ChangesThe following are breaking changes to driver functionality. These changes may cause some workflows from earlier versions to fail. 2.6.1 - Removed support for JDBC 3 (Java 5)Beginning with this release, the driver no longer supports JDBC 3 (Java 5). Only JDBC 4 (Java 6) and JDBC 4.1 (Java 7) are supported.  Getting Started with the Cloudera DriverRead the Cloudera Impala JDBC 2.6.4 Driver for Impala Release Notes and Installation Guide. Download the connector from the Cloudera Connectors page. As always, we welcome your feedback. Please send your comments and suggestions to the user group of through our community forums. You can also file bugs through our external Jira projects on issues.cloudera.org. 

We are pleased to announce the release of Cloudera Data Science Workbench 1.3.1.   This release includes fixes for some critical bugs. Details are in the Release Notes.   For more information on downloading, installing and using, please see the links below: Download Cloudera Data Science Workbench Cloudera Data Science Workbench Overview Getting Started with Cloudera Data Science Workbench Cloudera Data Science Workbench Release Notes Installing Cloudera Data Science Workbench As always, we welcome your feedback. Please send your comments and suggestions on our community forums.

 We are pleased to announce the release of Impala ODBC v2.5.44.  The release has the following fixes: Resolved Issues in Impala ODBC 2.5.44[00117025] [IMP-494] In some cases, when querying a table with a name that contains the suffix “_impala”, the driver truncates the suffix and then fails to query the table.  This issue has been resolved.  The driver no longer automatically truncates the “_impala” suffix, ensuring that the intended table name is used in the query.[IMP-504] The driver does not behave according to the Socket Timeout (or SocketTimeout) setting, and stops responding instead of returning an error when the server takes too long to respond to a request. This issue has been resolved. The driver now returns an error if the amount of time taken by the server to respond to a request exceeds the number of seconds specified by the Socket Timeout or (SocketTimeout) setting.  Getting Started with the Cloudera DriverRead the Cloudera

 We are pleased to announce the release of Impala ODBC v2.5.43.  The release has the following fixes: Resolved Issues in Impala ODBC 2.5.43[00116516] The driver does not use the keytab mapping files as specified in the UPN Keytab Mapping File configuration option.The driver cannot file ODBCMessages.xml files in folders with names that include Japanese characters.[00115866] The driver treats the string “NULL” as a null value.[00116560] The driver inserts explicit “CROSS JOIN” in some queries for Impala versions higher than 1.2.1 and lower than 2.1.0, resulting in some inefficient queries. Getting Started with the Cloudera DriverRead the Cloudera ODBC 2.5.43 Driver for Impala Release Notes and Installation Guide. Download the connector from the Cloudera Connectors page.  As always, we welcome your feedback. Please send your comments and suggestions to the user group of through our community forums. You can also file bugs through our external Jira projects on issu

 Subject: [ANNOUNCE] New Hive JDBC Driver Released We are pleased to announce the release of Hive JDBC v2.6.2. The release has the following resolved issue.  Resolved IssuesThe driver does not behave according to the SocketTimeout setting, and stops responding instead of returning an error when the server takes too long to respond to a request. This issue has been resolved. The driver now returns an error if the amount of time by the server to respond to a request exceeds the number of seconds specified by the SocketTimeout setting.  Getting Started with the Cloudera DriverRead the Cloudera JDBC 2.6.2 Driver for Hive Release Notes and Installation Guide. Download the connector from the Cloudera Connectors page.  As always, we welcome your feedback. Please send your comments and suggestions to the user group of through our community forums. You can also file bugs through our external Jira projects on issues.cloudera.org. 

Dear CDH, Cloudera Manager, and Cloudera Navigator users, We are pleased to announce the release of Cloudera Enterprise 5.14.4 (CDH 5.14.4, Cloudera Manager 5.14.4, and Cloudera Navigator 2.13.4). This release fixes key bugs and includes the following: The following upstream issues are fixed in CDH 5.14.4:HADOOP-15317 - Improve NetworkTopology chooseRandom's loop.HDFS-13170 - Port webhdfs unmaskedpermission parameter to HTTPFSHUE-8159 - [oozie] Unable to create Workflow/Schedule using Java document ActionHUE-8217 - [dashboard] Fix HTML resultset widget templatingHUE-8170 - [useradmin] Fix LDAP sync (ldap_access.py) certificate validation logicHUE-8159 - [oozie] Unable to create Workflow/Schedule using Java document ActionHUE-7946 - [jb] Link to subworkflow on workflow dashboard page 404s in Hue 4KUDU-2331 - The `kudu tablet change_config move_replica` tool no longer fails for an unavailable tablet server if the tablet server is not the source or destination of the move.S

We are happy to announce CDS 2.3 release 3 Powered by Apache Spark. You can download the parcel and apply it directly to provisioned clusters without disrupting your currently running Spark workloads.  This component is generally available and is supported on CDH 5.9 and higher, and Cloudera Manager 5.11 and higher.This is purely a maintenance release and it includes all fixes that are in the Apache Spark 2.3.1 upstream release. Test-only changes are omitted.  For more information, see the Apache Spark 2.3.1 upstream release notes. SPARK-16451 - [REPL] Spark-shell / pyspark should finish gracefully when "SaslException: GSS initiate failed" is hitSPARK-17756 - [PYTHON][STREAMING] java.lang.ClassCastException returned when using 'cartesian' with DStream.transformSPARK-24029 - Set the "reuse address" flag on listen socketsSPARK-24216 - [SQL] Spark TypedAggregateExpression uses getSimpleName this is not safe in ScalaSPARK-24369 - [SQL] Correct handling for multiple distinct

Cloudera is delighted to announce the release of Cloudera Data Science Workbench 1.4.0. With this release, Cloudera Data Science Workbench extends the machine learning platform experience from research to production. Data scientists can now build, train, and deploy models in a unified workflow with two new key capabilities: experiments and models.  Experiments: Experiments let data scientists train, compare, and reproduce versioned models. With this feature,, data scientists can run a batch job that will:create a snapshot of model code, dependencies, and configuration parameters necessary to train the modelbuild and execute the training run in an isolated containertrack model metrics, performance, and any model artifacts the user specifiesModels: Models let data scientists build, deploy, and manage models as REST APIs to serve predictions. With this feature, data scientists can simply select a Python or R function within a project file, and Cloudera Data Science Workbench will:&nb

We are pleased to announce the release of Cloudera Director 2.8.0. Cloudera Director provides a simple, reliable, enterprise-grade way to deploy, scale, and manage Apache Hadoop in the cloud of your choice. Cloudera Director is available as a free download for use with Cloudera Express and is fully supported with Cloudera Enterprise. What's New in Cloudera Director 2.8.0 Simple cluster setupUsabilityAzure plugin improvementsThe command line client's standalone functionality has been deprecated. The standalone CLI commands will be removed in a future release (bootstrap, status, terminate, update, and validate), and the Cloudera Director client will be used only for command line interactions with a Cloudera Director server. When the validate command is removed, a new CLI command will be provided for validating a configuration file. For more info on downloading and installing Director, see the links below. Download Cloudera DirectorCloudera Director Release NotesG

Cloudera is delighted to announce availability of the next iteration of our modern platform for machine learning and analytics, optimized for cloud. This release continues to demonstrate innovation and a commitment to enterprise-grade quality.   Included in the Cloudera Enterprise 5.15 release is support for new versions of many of our platform components: CDH 5.15.0 Cloudera Manager 5.15.0 Director 2.8 Navigator 2.14 Cloudera Data Science Workbench (CDSW) 1.4 Apache Kafka CDK 3.1.0, based on the upstream version 1.0.1 Navigator Encrypt 3.15.0 Key Trustee Server 5.15.0 Of special note, 5.15 adds new capabilities aligned to our machine learning, analytics, and cloud focus.   Machine Learning: Easily track and move models from research to production, helping to launch and compare versioned experiments. Also making it easy to deploy and manage versioned models as micro-services (REST APIs)   Analytics: Apache Kudu now supports the dec

Cloudera is pleased to announce the release of CDK 3.1.0 powered by Apache Kafka. Apache Kafka is a highly scalable, distributed, publish-subscribe messaging system. CDK 3.1.0 is a minor release based on Apache Kafka 1.0.1. Notable Issues Fixed in CDK 3.1.0:[KAFKA-5970] - Deadlock due to locking of DelayedProduce and group[KAFKA-6739] - Down-conversion fails for records with headers[KAFKA-6185] - Selector memory leak with high likelihood of OOM in case of down conversion.[KAFKA-6134] - High memory usage on controller during partition reassignment.[KAFKA-6042] - Kafka Request Handler deadlocks and brings down the cluster.[KAFKA-6003] - Replication Fetcher thread for a partition with no data fails to start.All backported fixes can be viewed in the git release notes here or on our website under the Issues fixed section. We look forward to you trying CDK 3.1.0. For more information, please use the links below:Install or upgrade KafkaReview the documentationReview t