What's New @ Cloudera

We are happy to announce CDS 2.2 Release 3 Powered By Apache Spark. You can download the parcel and apply it directly to provisioned clusters without disrupting your currently running Spark workloads. This component is generally available and is supported on CDH 5.8 and higher. What's New in CDS 2.2 release 3This is purely a maintenance release. See CDS Powered By Apache Spark Fixed Issues for the list of fixed issues.Download CDS 2.2 Release 3 Powered By Apache Spark.Read the documentation.Want to become a pro Spark user?  Sign up for Apache Spark Training.

Cloudera is proud to announce the general availability of Cloudera Enterprise 6.0, featuring a number of enhancements that improve workload performance and build on our enterprise-grade tooling and SDX (shared data experience) capabilities.     In addition to upgrading differentiated administration and productivity tools like Cloudera Manager and Navigator, we have also updated several components of our open source core.   Cloudera Enterprise 6.0 delivers the data management foundation for your mission-critical machine learning and analytics workloads today and into the future.  Please read on for more detail on component updates and benefits: Cloudera Manager 6.0 Cloudera Manager 6 delivers a number of major new capabilities, all of which can be leveraged with both CDH6 and CDH5 environments Fine-grained administrative access controls on individual clusters allows organizations to manage more clusters, including those supporting sensitive & confidential proje

Dear CDH, Cloudera Manager, and Cloudera Navigator users, We are pleased to announce the release of Cloudera Enterprise 5.15.1 (CDH 5.15.1, Cloudera Manager 5.15.1, and Cloudera Navigator 2.14.1). This release fixes key bugs and includes the following: The following upstream issues are fixed in CDH 5.15.1:FLUME-3222 - Fix for NoSuchFileException thrown when files are being deletedHADOOP-15317 - Improve NetworkTopology chooseRandom's loopHDFS-13281 - Namenode#createFile should be /.reserved/raw/ awareHDFS-12710 - HTTPFS HTTP max header size env variable is not respected in branch-2HIVE-19231 - Beeline generates garbled output when using UnsupportedTerminalHIVE-16080 - Add parquet to possible values for hive.default.fileformat and hive.default.fileformat.managedHUE-6697 - [jb] Prevent reset of job page tabs when job is runningHUE-8344 - [hbase] Hbase old version of data can not display in HueHUE-8409 - [core] When idle session timeout is enabled it causes issues with Spneg

Visit Cloudera documentation to see how to migrate from the Cloudera Manager Embedded PostgreSQL database server to an external PostgreSQL database. We’ve also added a new Navigator overview video and information on determining the cause of issues with Sentry after upgrading. https://www.cloudera.com/documentation/enterprise/release-notes/topics/whats_new_in_doc.html

We are pleased to announce the release of Impala ODBC v2.6.0.  The release has the following fixes:Enhancements and New Features: [IMP-478] Updated SSL Support[IMP-519] Minimum TLS Support[IMP-472] TLS Server Name Indication[IMP-508] Standardized Log File Names[IMP-462] More Informative SSL Error Messages[00116516] [IMP-484] Renamed Keytab Property[IMP-520] Linux Installation Workflow Improvement[IMP-317] Support for Result Set Cache and Query RetryResolved Issues:[00131357] [IMP-511] In some cases queries are not properly closed on the server, negatively impacting server resources.[IMP-486] In some cases, CAST AS VARCHAR does not function correctly. [00119275] [IMP-503] Connections from a machine with large amounts of RAM are slower than expected. [00132211] [IMP-523] Driver wide properties cannot be read from the .ini file.Getting Started with the Cloudera DriverRead the Cloudera ODBC 2.6.0 Driver for Impala Release Notes and Installation Guide. Download the connector from the C

 We are pleased to announce the release of Impala JDBC v2.6.4.  The release has the following resolved issues: Resolved Issues[00116966] [IMPJ-386] Documentation for the SocketTimeout configuration option is incorrect.  Breaking ChangesThe following are breaking changes to driver functionality. These changes may cause some workflows from earlier versions to fail. 2.6.1 - Removed support for JDBC 3 (Java 5)Beginning with this release, the driver no longer supports JDBC 3 (Java 5). Only JDBC 4 (Java 6) and JDBC 4.1 (Java 7) are supported.  Getting Started with the Cloudera DriverRead the Cloudera Impala JDBC 2.6.4 Driver for Impala Release Notes and Installation Guide. Download the connector from the Cloudera Connectors page. As always, we welcome your feedback. Please send your comments and suggestions to the user group of through our community forums. You can also file bugs through our external Jira projects on issues.cloudera.org. 

We are pleased to announce the release of Cloudera Data Science Workbench 1.3.1.   This release includes fixes for some critical bugs. Details are in the Release Notes.   For more information on downloading, installing and using, please see the links below: Download Cloudera Data Science Workbench Cloudera Data Science Workbench Overview Getting Started with Cloudera Data Science Workbench Cloudera Data Science Workbench Release Notes Installing Cloudera Data Science Workbench As always, we welcome your feedback. Please send your comments and suggestions on our community forums.

 We are pleased to announce the release of Impala ODBC v2.5.44.  The release has the following fixes: Resolved Issues in Impala ODBC 2.5.44[00117025] [IMP-494] In some cases, when querying a table with a name that contains the suffix “_impala”, the driver truncates the suffix and then fails to query the table.  This issue has been resolved.  The driver no longer automatically truncates the “_impala” suffix, ensuring that the intended table name is used in the query.[IMP-504] The driver does not behave according to the Socket Timeout (or SocketTimeout) setting, and stops responding instead of returning an error when the server takes too long to respond to a request. This issue has been resolved. The driver now returns an error if the amount of time taken by the server to respond to a request exceeds the number of seconds specified by the Socket Timeout or (SocketTimeout) setting.  Getting Started with the Cloudera DriverRead the Cloudera

 We are pleased to announce the release of Impala ODBC v2.5.43.  The release has the following fixes: Resolved Issues in Impala ODBC 2.5.43[00116516] The driver does not use the keytab mapping files as specified in the UPN Keytab Mapping File configuration option.The driver cannot file ODBCMessages.xml files in folders with names that include Japanese characters.[00115866] The driver treats the string “NULL” as a null value.[00116560] The driver inserts explicit “CROSS JOIN” in some queries for Impala versions higher than 1.2.1 and lower than 2.1.0, resulting in some inefficient queries. Getting Started with the Cloudera DriverRead the Cloudera ODBC 2.5.43 Driver for Impala Release Notes and Installation Guide. Download the connector from the Cloudera Connectors page.  As always, we welcome your feedback. Please send your comments and suggestions to the user group of through our community forums. You can also file bugs through our external Jira projects on issu

 Subject: [ANNOUNCE] New Hive JDBC Driver Released We are pleased to announce the release of Hive JDBC v2.6.2. The release has the following resolved issue.  Resolved IssuesThe driver does not behave according to the SocketTimeout setting, and stops responding instead of returning an error when the server takes too long to respond to a request. This issue has been resolved. The driver now returns an error if the amount of time by the server to respond to a request exceeds the number of seconds specified by the SocketTimeout setting.  Getting Started with the Cloudera DriverRead the Cloudera JDBC 2.6.2 Driver for Hive Release Notes and Installation Guide. Download the connector from the Cloudera Connectors page.  As always, we welcome your feedback. Please send your comments and suggestions to the user group of through our community forums. You can also file bugs through our external Jira projects on issues.cloudera.org. 

Dear CDH, Cloudera Manager, and Cloudera Navigator users, We are pleased to announce the release of Cloudera Enterprise 5.14.4 (CDH 5.14.4, Cloudera Manager 5.14.4, and Cloudera Navigator 2.13.4). This release fixes key bugs and includes the following: The following upstream issues are fixed in CDH 5.14.4:HADOOP-15317 - Improve NetworkTopology chooseRandom's loop.HDFS-13170 - Port webhdfs unmaskedpermission parameter to HTTPFSHUE-8159 - [oozie] Unable to create Workflow/Schedule using Java document ActionHUE-8217 - [dashboard] Fix HTML resultset widget templatingHUE-8170 - [useradmin] Fix LDAP sync (ldap_access.py) certificate validation logicHUE-8159 - [oozie] Unable to create Workflow/Schedule using Java document ActionHUE-7946 - [jb] Link to subworkflow on workflow dashboard page 404s in Hue 4KUDU-2331 - The `kudu tablet change_config move_replica` tool no longer fails for an unavailable tablet server if the tablet server is not the source or destination of the move.S

We are happy to announce CDS 2.3 release 3 Powered by Apache Spark. You can download the parcel and apply it directly to provisioned clusters without disrupting your currently running Spark workloads.  This component is generally available and is supported on CDH 5.9 and higher, and Cloudera Manager 5.11 and higher.This is purely a maintenance release and it includes all fixes that are in the Apache Spark 2.3.1 upstream release. Test-only changes are omitted.  For more information, see the Apache Spark 2.3.1 upstream release notes. SPARK-16451 - [REPL] Spark-shell / pyspark should finish gracefully when "SaslException: GSS initiate failed" is hitSPARK-17756 - [PYTHON][STREAMING] java.lang.ClassCastException returned when using 'cartesian' with DStream.transformSPARK-24029 - Set the "reuse address" flag on listen socketsSPARK-24216 - [SQL] Spark TypedAggregateExpression uses getSimpleName this is not safe in ScalaSPARK-24369 - [SQL] Correct handling for multiple distinct

Cloudera is delighted to announce the release of Cloudera Data Science Workbench 1.4.0. With this release, Cloudera Data Science Workbench extends the machine learning platform experience from research to production. Data scientists can now build, train, and deploy models in a unified workflow with two new key capabilities: experiments and models.  Experiments: Experiments let data scientists train, compare, and reproduce versioned models. With this feature,, data scientists can run a batch job that will:create a snapshot of model code, dependencies, and configuration parameters necessary to train the modelbuild and execute the training run in an isolated containertrack model metrics, performance, and any model artifacts the user specifiesModels: Models let data scientists build, deploy, and manage models as REST APIs to serve predictions. With this feature, data scientists can simply select a Python or R function within a project file, and Cloudera Data Science Workbench will:&nb

We are pleased to announce the release of Cloudera Director 2.8.0. Cloudera Director provides a simple, reliable, enterprise-grade way to deploy, scale, and manage Apache Hadoop in the cloud of your choice. Cloudera Director is available as a free download for use with Cloudera Express and is fully supported with Cloudera Enterprise. What's New in Cloudera Director 2.8.0 Simple cluster setupUsabilityAzure plugin improvementsThe command line client's standalone functionality has been deprecated. The standalone CLI commands will be removed in a future release (bootstrap, status, terminate, update, and validate), and the Cloudera Director client will be used only for command line interactions with a Cloudera Director server. When the validate command is removed, a new CLI command will be provided for validating a configuration file. For more info on downloading and installing Director, see the links below. Download Cloudera DirectorCloudera Director Release NotesG

Cloudera is delighted to announce availability of the next iteration of our modern platform for machine learning and analytics, optimized for cloud. This release continues to demonstrate innovation and a commitment to enterprise-grade quality.   Included in the Cloudera Enterprise 5.15 release is support for new versions of many of our platform components: CDH 5.15.0 Cloudera Manager 5.15.0 Director 2.8 Navigator 2.14 Cloudera Data Science Workbench (CDSW) 1.4 Apache Kafka CDK 3.1.0, based on the upstream version 1.0.1 Navigator Encrypt 3.15.0 Key Trustee Server 5.15.0 Of special note, 5.15 adds new capabilities aligned to our machine learning, analytics, and cloud focus.   Machine Learning: Easily track and move models from research to production, helping to launch and compare versioned experiments. Also making it easy to deploy and manage versioned models as micro-services (REST APIs)   Analytics: Apache Kudu now supports the dec

Cloudera is pleased to announce the release of CDK 3.1.0 powered by Apache Kafka. Apache Kafka is a highly scalable, distributed, publish-subscribe messaging system. CDK 3.1.0 is a minor release based on Apache Kafka 1.0.1. Notable Issues Fixed in CDK 3.1.0:[KAFKA-5970] - Deadlock due to locking of DelayedProduce and group[KAFKA-6739] - Down-conversion fails for records with headers[KAFKA-6185] - Selector memory leak with high likelihood of OOM in case of down conversion.[KAFKA-6134] - High memory usage on controller during partition reassignment.[KAFKA-6042] - Kafka Request Handler deadlocks and brings down the cluster.[KAFKA-6003] - Replication Fetcher thread for a partition with no data fails to start.All backported fixes can be viewed in the git release notes here or on our website under the Issues fixed section. We look forward to you trying CDK 3.1.0. For more information, please use the links below:Install or upgrade KafkaReview the documentationReview t

We are pleased to announce the release of Impala ODBC v2.5.42.  The release has the following fixes and enhancements:Enhancements and New Features in Impala ODBC 2.5.42[00097802] Backward compatibility added for Database connection property. When configuring your connection on a non-Windows machine or through a connection string, you can now use either the Schema or Database connection property to specify the name of the database schema for the connection. Prior to this update, support for the Database connection property had been removed.Resolved Issues in Impala ODBC 2.5.42[00097666] Driver returns incorrect error code for when the Impala session times out and the auto-reconnection feature is disabled. This issue has been resolved. Before, the driver incorrectly returned a generic error code (SQL state HY000). The driver now returns SQL state 08S01 instead.In some cases, the driver fails to authenticate the connection through Kerberos.In certain scenarios, during query execution

We are pleased to announce the release of Impala JDBC v2.5.45.  The release has the following resolved issues: Impala JDBC 2.5.45 Resolved Issues in Impala JDBC 2.5.45[00115543] A string literal after a back-tick ( ` ) is treated as a comment.[00115424] When the driver attempts to connect to the server using Beeline, an error occurs on the server and an exception is logged by the driver.This issue has been resolved. Now, when connecting the server using Beeline, connection properties such as “driver” and “url” are no longer treated as configurations properties for the server, and the driver does not send SET queries to the server with these properties. Getting Started with the Cloudera DriverRead the Cloudera Impala JDBC 2.5.45 Driver for Impala Release Notes and Installation Guide. Download the connector from the Cloudera Connectors page.  As always, we welcome your feedback. Please send your comments and suggestions to the user group of through our community

We are pleased to announce the release of Impala JDBC v2.6.3.  The release has the following enhancements: Impala JDBC 2.6.3 Enhancements and New Features in Impala JDBC 2.6.3[IMPJ-380] The driver has been upgraded to use Apache ZooKeeper 3.4.11.[IMPJ-381] The driver package now includes the file third-party-license.txt. This text file contains the license for all third-party software used in the driver. The third-party license information is also available in the Installation and Configuration Guide.  Resolved Issues in Impala JDBC 2.6.3[00115517] [IMPJ-353] When attempting to close a statement that is already closed, the driver logs an error Breaking ChangesThe following are breaking changes to driver functionality. These changes may cause some workflows from earlier versions to fail. 2.6.1 - Removed support for JDBC 3 (Java 5)Beginning with this release, the driver no longer supports JDBC 3 (Java 5). Only JDBC 4 (Java 6) and JDBC 4.1 (Java 7) are suppor

We are pleased to announce the release of Hive JDBC v2.6.1  The release has the following enhancements and fixes: Enhancements and New Features in Hive JDBC 2.6.1Improved installation process: Third-party libraries are now bundled with the driver as a shaded jar file.Updated hive-services: The driver has been upgraded to use hive-service-2.0.1 with JDBC 4.1 and hive-service-1.1.1 for JDBC 4.Updated third-party libraries: The driver has been upgraded to use http-client 4.5.3, http-core 4.4.6, commons-codec 1.9, commons-logging 1.2, and Zookeeper 3.4.11. Resolved Issues[00115543] A string literal after a back-tick ( ` ) is treated as a comment.[00115424] When the driver attempts to connect to the server using Beeline, an error occurs on the server and an exception is logged by the driver. This issue has been resolved. Now, when connecting to the server using Beeline, connection properties such as "driver" and "url" are no longer treated as configuration properties for the

We are pleased to announce the release of Impala JDBC v2.6.2.  The release has the following enhancements:  Enhancements and New Features in Impala JDBC 2.6.2[IMPJ-372] Updated Apache ZooKeeper library: The driver has been upgraded to use Apache ZooKeeper 3.4.7.Breaking ChangesThe following are breaking changes to driver functionality. These changes may cause some workflows from earlier versions of the driver to fail. 2.6.1 -  [IMPJ-321] Removed support for JDBC 3 (Java 5)Beginning with this release, the driver no longer supports JDBC 3 (Java 5). Only JDBC 4 (Java 6) and JDBC 4.1 (Java 7) are supported.Getting Started with the Cloudera DriverRead the Cloudera Impala JDBC 2.6.2 Driver for Impala Release Notes and Installation Guide. Download the connector from the Cloudera Connectors page. As always, we welcome your feedback. Please send your comments and suggestions to the user group of through our community forums. You can also file bugs through our exter

Cloudera is proud to announce the beta availability of Cloudera Enterprise 6. The new release includes a large number of important upgrades to our open source core components as well as improvements to our unique innovations. We believe Cloudera Enterprise 6 will make your experience more productive and efficient. Please read on to learn about the new features that make Cloudera Enterprise 6 a must-have release. Customer BenefitsGain better insights from structured and unstructured data with Solr 7 integrated search. The vast majority of the data being created is unstructured and tapping that data has been cumbersome. Furthermore, fitting that data into the existing structured data paradigm has required a normalization process that is time-consuming. Solr 7 provides both a deeper level of analysis and opens up the unstructured data universe to traditional BI tools through a SQL interface. For Cloudera Enterprise 6.0 we support the new JSON Facet Module and Nested Documents, while

We are pleased to announce the general availability of the Cloudera Connector Powered by Teradata 1.7c5. New Features in Cloudera Connector Powered by Teradata Version 1.7c5Support for Teradata 16.x.Support for importing tables without split-by column specified when the number of mappers is set to 1.Support for the internal.fastexport input method.For more details on new features and usage of Cloudera Connector Powered by Teradata, see Download Cloudera Connector Powered by TeradataRelease Notes Cloudera Connector Powered by Teradata version 1.7c5Cloudera Connector Powered by Teradata User Guide, version 1.7c5As always, we welcome your feedback. Please send your comments and suggestions to the user group or through our community forums. You can also file bugs through our external JIRA projects at issues.cloudera.org.

 Dear CDH, Cloudera Manager, and Cloudera Navigator users, On April 11, 2018, we announced the release of Cloudera Enterprise 5.14.2. Shortly after, we discovered a serious bug in Cloudera Manager 5.14.2. This resulted in Backup and Disaster Recovery (BDR) HDFS and Hive Replications potentially failing when replicating from source clusters that use HDFS HA and are managed by Cloudera Manager 5.13.3 or 5.14.2 to destination clusters managed by Cloudera 5.14.2. Today we released Cloudera Manager 5.14.3 to fix these issues. Please upgrade to this release instead of Cloudera Manager 5.14.2. For more details, see the Fixed Issues section of the Release Notes.Please use the following information to assist in your implementation:Download Cloudera EnterpriseView the documentation As always, we welcome your feedback. Please send your comments and suggestions to the user group or through our community forums. You can also file bugs through our external JIRA projects at issues

We are happy to announce CDS 2.3 release 2 Powered by Apache Spark. You can download the parcel and apply it directly to provisioned clusters without disrupting your currently running Spark workloads.   This component is generally available and is supported on CDH 5.9 and higher.   A Hive compatibility issue in CDS 2.0 release 2 Powered By Apache Spark affects CDH 5.10.1 and higher, CDH 5.9.2 and higher, CDH 5.8.5 and higher, and CDH 5.7.6 and higher. If you are using one of these CDH versions, you must upgrade to the Spark 2.0 release 2 or higher parcel, to avoid Spark 2 job failures when using Hive functionality. There are no new incompatible changes in this release. What's New in CDS 2.3 release 2 Powered By Apache Spark Spark lineage support, which can be used with Navigator in CM 5.14 for metadata and transformation analysis and better regulatory compliance. Vectorized PySpark UDF support which improves PySpark performance History Server Scalability with a more UI whi