Announcements

Dear CDH, Cloudera Manager, and Cloudera Navigator users,We are pleased to announce the release of Cloudera Enterprise 5.3.9 (CDH 5.3.9, Cloudera Manager 5.3.9, Cloudera Navigator 2.2.9).  This release fixes key bugs and includes the following.CDH fixes for the following issues:Apache Commons Collections deserialization vulnerability, described in TSB-98Improve diagnostics information for HttpPutFailedExceptionCheckpointing failure caused by shared KerberosAuthenticatorCopying from the root to a subdirectory should be forbiddenEncryption zone on root not loaded from fsimage after NameNode restartKerberos credentials can expire if the KDC is slow to respondFor a full list of upstream JIRAs fixed in CDH 5.3.9, see the issues fixed section of the Release Notes.Cloudera Manager fixes for the following issues:Apache Commons Collections deserialization vulnerability, described in TSB-98For full list of issues fixed in Cloudera Manager 5.3.9, see the issues fixed section of the Release N

We are pleased to announce the availability of Cloudera Navigator Encrypt 3.8.0.   Navigator Encrypt is a key component of Cloudera's Security and Governance solution.  It complements HDFS encryption to provide encryption at rest for sensitive data in the hadoop cluster in temp/spill files, metadata databases and ingest volumes.      It works together with Navigator Key Trustee, so that encryption keys are managed following security best-practices required by a number of compliance regulations, including PCI and HIPAA.    Navigator Encrypt is available to all Cloudera customers licensed for Navigator use. Here's what's new in this release:Support for Red Hat Enterprise Linux (RHEL) 7.x - starting with 7.1Easier deployment on existing server volumes, through automatic mounting of encrypted loop devices on boot (see Block-Level Encryption with a Loop Device for details)The use of loop devices simplifies adding Navigator Encrypt to ex

Dear CDH, Cloudera Manager, and Cloudera Navigator users,We are pleased to announce the release of Cloudera Enterprise 5.4.9 (CDH 5.4.9, Cloudera Manager 5.4.9, Cloudera Navigator 2.3.9, and Key Trustee Server 5.4.9).  This release fixes key bugs and includes the following.CDH fixes for the following issues:Apache Commons Collections Deserialization Vulnerability, described in TSB - 98Enable using a proxy server to connect to S3aImprove diagnostics information for HttpPutFailedExceptionFix precondition failures from NameNodeEditLogRoller while saving namespaceImprove clearing stale state of Java serializationCheckpointing failure caused by shared KerberosAuthenticatorEncryption zone on root not loaded from fsimage after NN restartException on HBaseSerDe.serialize binary fieldAnalysis exception when a binary operator contains an IN operator with valuesConnection idle time 1 second is too short and the connection is closed too quickly by the ChoreServiceAdded resource path is sent t

Cloudera Enterprise 5.5.1 and Director 1.5.2 provide fixes for critical issues found in the Apache Commons library. For a description of issues fixed in Cloudera Enterprise 5.5.1, see the issues fixed section of the Release Notes for CDH and Cloudera Manager. For a description of the issues fixed in Director 1.5.2, see the issues fixed section of the Release Notes. We look forward to you trying it out, using the information below:Download Cloudera EnterpriseDownload Cloudera Director View the documentation for Cloudera Enterprise and Cloudera Director As always, we are happy to hear your feedback. Please send your comments and suggestions to the user group or through our community forums. You can also file bugs through our external JIRA projects on issues.cloudera.org.

We are pleased to announce the release of the Cloudera Distribution of Apache Kafka 1.4.0 for CDH 5.  Apache Kafka is a distributed publish-subscribe messaging system. This release is based on Apache Kafka 0.8.2, adds support for distribution as a package as well as a parcel, and includes fixes for key issues.   New Features:   Cloudera Distribution of Apache Kafka 1.4 is now distributed via native packages as well as a parcel Notable Fixes:   KAFKA-2633: Default logging from tools to Stderr. KAFKA-1664: Kafka does not properly parse multiple ZK nodes with non-root chroot. KAFKA-2477: Fix a race condition between log append and fetch that causes OffsetOutOfRangeException. KAFKA-2024: Cleaner can generate unindexable log segments. KAFKA-2118: Cleaner can not clean after shutdown during replaceSegments. We look forward to you trying it out, using the information below:   Install or upgrade Kafka Review the Documentation Review the Release No

Today, we’re pleased to announce the availability of a Cloudera QuickStart Docker image!   If you or your organization is using Docker, this image may provide the ideal lightweight, disposable environment for learning and exploring new technology, playing with new ideas, and for doing continuous integration before testing at scale. (However, Cloudera recommends using a more realistic test environment before moving to production.)   More details/docs here:   http://blog.cloudera.com/blog/2015/12/docker-is-the-new-quickstart-option-for-apache-hadoop-and-cloudera/

We are happy to announce Kudu 0.6.0, the second beta release of Kudu, the industry’s first columnar storage manager developed for the Hadoop ecosystem. This release includes the following fixes and enhancements: The Java client's CreateTableBuilder and AlterTableBuilder classes have been renamed to CreateTableOptions and AlterTableOptions. Their methods now also return these objects, allowing them to be used as builders. The Java client's AbstractKuduScannerBuilder#maxNumBytes() setter is now called batchSizeBytes, as is the corresponding property in AsyncKuduScanner. This makes it consistent with the C++ client. The kudu-admin tool can now list and delete tables: kudu-admin listkudu-admin delete <table_name> OS X is now supported for single-node development For a full list of issues addressed in Kudu 0.6.0, see this JIRA query. For more details on Kudu, see http://getkudu.io/ Kudu already has an extensive set of capabilities, but there’s still work to be don

Cloudera Enterprise 5.5 is now generally available (comprising CDH 5.5, Cloudera Manager 5.5, and Cloudera Navigator 2.4). Cloudera is excited to bring you news of Cloudera Enterprise 5.5 (Release Notes). Our persistent emphasis on quality is especially pronounced in this release, with more than 500 issues identified and triaged during its development. Here are some of the highlights (see the Release Notes for full lists of features and fixes):SecurityColumn-level security is now provided in Impala and Apache Hive (via Apache Sentry [incubating]).In Cloudera Manager-managed clusters, cleartext passwords can now be redacted from configuration files.Cloudera Manager includes a new wizard for setting up HDFS encryption, KMS, and Navigator Key Trustee.In Cloudera Navigator Encrypt, dmcrypt+loopfile replaces eCryptfs (deprecated) for file encryption.LDAP/AD auth is now supported for Apache Solr clients.Apache HBase replication is now encrypted.Performance, Scale, and OperationsHDF

We are pleased to announce the release of Impala JDBC v2.5.29 driver. This release has the following fixes and enhancements: Issues resolved:When executing a query with parameter in Native query mode,the setObject operation fails. This issue has been resolvedexecuteBatch() operation does not work properly when multiple parameter sets are added to the batch. Only the first insert is working. This issue has been resolved. Please see Release Notes for JDBC for details on all of the fixes. Getting started with the Cloudera Drivers:Read the Cloudera JDBC 2.5.29  Driver for Impala Release Notes and Installation Guide.Download the connector from the Cloudera Connectors page.As always, we welcome your feedback. Please send your comments and suggestions to the user group or through our community forums.  You can also file bugs through our external JIRA projects on issues.cloudera.org

We are pleased to announce the release of Cloudera Enterprise 5.4.8 (CDH 5.4.8, Cloudera Manager 5.4.8, and Cloudera Navigator 2.3.8).     Cloudera Enterprise 5.4.8 This release fixes key bugs and includes the following. CDH fixes for the following issues: Handling NullPointer in ZKProcedureMemberRpcs while getting ZNode data. "Alter index rebuild" statements submitted through HiveServer2 fail when Sentry is enabled. Duplicate groupby keys cause ClassCastException. IndexOutOfBounds compiling query with duplicated groupby keys. Indexing threads stuck during network partition can put leader into down state. For a full list of upstream JIRAs fixed in CDH 5.4.8, see the issues fixed section of the Release Notes.   Cloudera Manager fixes for the following issues: Clusters can fail if Java 1.6 is installed. OutOfMemory error when running HDFS replication. Cloudera Management Service can fail with a large Flume configuration file. Client configuration

We are pleased to announce the release of Cloudera Enterprise 5.3.8 (CDH 5.3.8, Cloudera Manager 5.3.8, and Cloudera Navigator 2.2.8).  Cloudera Enterprise 5.3.8This release fixes key bugs and includes the following.CDH fixes for the following issues:Spooling Directory Source dies on encountering zero-byte files.Applications fail on NodeManager restart on some Linux distributions because NodeManager container recovery declares AM container as LOST.Fixed a race condition in the ResourceManager's ZooKeeper-based state-store to avoid crashing on duplicate deletes.Allow mlockagent to be used when not starting as root.java.lang.IndexOutOfBoundsException when union all with if function.For a full list of upstream JIRAs fixed in CDH 5.3.8, see the issues fixed section of the Release Notes.Cloudera Manager fixes for the following issues:Rolling Restart fails when inheriting inappropriate JVM properties.Exception thrown when viewing host configuration change.  For full list of issues

We are pleased to announce the release of Impala JDBC v2.5.28 and Impala ODBC v2.5.30. This release has the following fixes and enhancements: JDBC:Features addedNested data types (ARRAY, MAP, and STRUCT) now supported.Issues resolvedWhen using executeUpdate in a prepared statement to insert more than 2 rows, the driver returns an error.ODBC:Features addedNested data types (ARRAY, MAP, and STRUCT) now supported.Added MANIFEST file for the OpenSSL library.Data encryption and integrity support implemented for the SASL SSPI plug-in.Issues resolvedSQLCancel was slow to execute and did not cancel the query in the Impala server. Now, SQLCancel works as expected. Please see Release Notes for ODBC and JDBC for details on all of the fixes and enhancements. Getting started with the Cloudera Drivers:Read the Cloudera JDBC 2.5.28  Driver for Impala Release Notes and Installation Guide.Read the Cloudera ODBC 2.5.30  Driver for Impala Release Notes and Installation Guide.Download the c

We are pleased to announce the release of Cloudera Director 1.5.1.   Cloudera Director provides a simple, reliable, enterprise-grade way to deploy, scale, and manage Apache Hadoop in the cloud of your choice. Cloudera Director is available as a free download for use with Cloudera Express and is fully supported with Cloudera Enterprise.   Cloudera Director 1.5.1 has bug fixes and and product improvements, as outlined in Cloudera Director 1.5.1 release notes.   Links to the product and documentation are listed below: Download Cloudera Director from http://www.cloudera.com/content/support/en/downloads.html View the documentation: Cloudera Director Release Notes Getting Started Installing Cloudera Director Client Installing Cloudera Director Server To learn more about the Director SPI and plug-in implementations: Cloudera Director Service Provider Interface (Cloudera Director SPI) Cloud Provider Technology Compatibility Kit (Cloudera Director SPI TCK)

Dear CDH, Cloudera Manager, Impala, and Cloudera Navigator users, We are pleased to announce the release of Cloudera Enterprise 5.4.7 (CDH 5.4.7, Cloudera Manager 5.4.7, and Cloudera Navigator 2.3.7).   Cloudera Enterprise 5.4.7 This release fixes key bugs and includes the following. CDH fixes for the following issues: The Spooling directory source dies when encountering zero-byte files. The VolumeScanner thread exits with an exception if there is no block pool to be scanned but there are suspicious blocks. ArrayIndexOutOfBoundsException in CellComparator#getMinimumMidpointArray. Lateral view on top of a view throws a RuntimeException. java.lang.IndexOutOfBoundsException when union all with if function. For a full list of upstream JIRAs fixed in CDH 5.4.7, see the issues fixed section of the Release Notes.   Cloudera Manager fixes for the following issues: The ZooKeeper jute.maxbuffer property is emitted into zoo.cfg instead of in the JVM arguments. Usi

Dear CDH, Cloudera Manager, Impala, and Cloudera Navigator users, We are pleased to announce the release of Cloudera Enterprise 5.4.5 (CDH 5.4.5, Cloudera Manager 5.4.5, and Cloudera Navigator 2.3.5).   Cloudera Enterprise 5.4.5 This release fixes key bugs and includes the following. CDH fixes for the following issues: Predicate push-down does not work with Parquet when partitions are in the expression. Impala DML/DDL operations corrupt table metadata leading to Hive query failures. Reserved RBW space is not released if the client terminates while writing a block. NullPointerException on queries where MapReduce is not involved on tables with partitions. Parallel move task optimization causes a race condition. ResultSerialization and MutationSerialization can throw InvalidProtocolBufferException when serializing a cell larger than 64 MB. For a full list of upstream JIRAs fixed in CDH 5.4.5, see the issues fixed section of the Release Notes. Cloudera Manager fixes

We are pleased to announce the release of Cloudera Director 1.5.0.| Cloudera Director provides a simple, reliable, enterprise-grade way to deploy, scale, and manage Apache Hadoop in the cloud of your choice. Cloudera Director is available as a free download for use with Cloudera Express and is fully supported with Cloudera Enterprise. Cloudera Director 1.5.0 includes the following new features: Cloudera Director now supports multiple cloud providers through an open-source plugin interface: Cloudera Director Service Provider Interface (Cloudera Director SPI). Google Cloud Platform is now supported out-of-the-box through an open-source implementation of the Cloudera Director SPI: Cloudera Director Google Plugin. Advanced configuration settings are now available in the Cloudera Director UI. These include CDH cluster and Cloudera Manager configurations, and management of database servers set up by Cloudera Director. Users can now specify custom scripts to run after cluster creation

Dear CDH, Cloudera Manager, Impala, and Cloudera Navigator users,   We are pleased to announce the release of Cloudera Enterprise 5.3.6 (CDH 5.3.6, Cloudera Manager 5.3.6, and Cloudera Navigator 2.2.6).     This release fixes key bugs and includes the following. CDH fixes for the following issues: NameNode Failover during HA upgrade can cause DataNode to finalize upgrade HBase grant at specific column level does not work for Groups ZooKeeper znodes are bootstrapped with insecure ACLs in a secure configuration Incorrect results for n-way join when join expressions are not in same order across joins Datanode upgrade to BLOCKID_BASED_LAYOUT fails if duplicate block files are present in the same volume For a full list of upstream JIRAs fixed in CDH 5.3.6, see the issues fixed section of the Release Notes. Cloudera Manager fixes for the following issues: Cloudera Manager reports the wrong value for Impala bytes read from cache Cancel Impala Query

Dear CDH Users,     We are pleased to announce the release of Cloudera Distribution of Apache Kafka 1.3.1 for CDH 5.  Apache Kafka is a distributed publish-subscribe messaging system.  This is a maintenance release that fixes key issues, including:   KAFKA-972 - MetadataRequest returns stale list of brokers KAFKA-1367 - Broker topic metadata not kept in sync with ZooKeeper KAFKA-1867 - liveBroker list not updated on a cluster with no topics KAFKA-2308 - New producer + Snappy face un-compression errors after broker restart KAFKA-2317 - De-register isrChangeNotificationListener on controller resignation KAFKA-2337 - Verify that metric names will not collide when creating new topics We look forward to you trying it out, using the information below: Install or upgrade Kafka Review the Documentation Review the Release Notes   As always, we welcome your feedback. Please send your comments and suggestions through our community forums. Y

Dear CDH Users,   We are pleased to announce the release of the Cloudera Connector for Netezza version 1.3. This release has the following new feature:   A new --schema argument is now supported. This argument defines the schema that Sqoop uses for both import and export. The schema is used for metadata queries, and for record extraction and loading (available in Netezza 7.0.3 or later). This connector release is available for CDH 5 only. We look forward to you trying it out, using the information below: Download the Connector Review the Release Notes Review the User Guide As always, we are happy to hear your feedback. Please send your comments and suggestions through our community forums. You can also file bugs through our external JIRA projects on issues.cloudera.org.

Hello CDH and Impala Users,   We are pleased to announce the release of Impala ODBC v2.5.29, Impala JDBC v2.5.24 and Hive JDBC v2.5.15.   Impala ODBC 2.5.29 contains bug fixes and the following enhancements: Support for calling SQLGetData on columns that come before a bound column Updated support for SQL_C_TINYINT Improved error messaging for authentication issues Support for saving passwords as encrypted strings in the Windows Registry Supports the use of "_HOST" as a special value for the Host FQDN option For a full list of fixes in Impala ODBC v2.1.29, see the issues fixed section of the Release Notes.   Impala JDBC 2.5.24 is a bugfix only release. For a full list of fixes in Impala JDBC v2.1.24, see the issues fixed section of the Release Notes.   Hive JDBC v2.5.15 contains numerous bug fixes and the following enhancements: Support for case-insensitive treatment of catalog names, schema names, table names, and column names in catalog fun

Dear CDH, Cloudera Manager, Impala, and Cloudera Navigator users,   We are pleased to announce the release of Cloudera Enterprise 5.2.6 (CDH 5.2.6, Cloudera Manager 5.2.6, and Cloudera Navigator 2.1.6).   Cloudera Enterprise 5.2.6 This release fixes key bugs and includes the following.   CDH fixes for the following issues: YARN rolling upgrade issue ArrayIndexOutOfBoundsException in NN when starting a DN after a storageID change Error that overestimates the amount of space to reserve for open files and can result in storage being incorrectly marked as full. For a full list of upstream JIRAs fixed in CDH 5.2.6, see the issues fixed section of the Release Notes.   Cloudera Manager fixes for the following issues: Cloudera Manager Agent may become slow or get stuck when responding to commands and when sending heartbeats to Cloudera Manager Server. Cloudera Manager reports the wrong value for Impala bytes read from cache. Cloudera Manager use

Dear CDH, Cloudera Manager, Cloudera Impala, and Cloudera Navigator users,   CDH 5.4.4 fixes the following critical bugs:   Hue will not start when using SSL HiveServer2 LDAP Provider May Allow Authentication with Blank Password We look forward to you trying it out, using the information below: Download Cloudera Enterprise View the documentation As always, we are happy to hear your feedback. Please send your comments and suggestions to the user group or through our community forums. You can also file bugs through our external JIRA projects on issues.cloudera.org.

Dear CDH, Cloudera Manager, Impala, and Cloudera Navigator users,   We are pleased to announce the release of Cloudera Enterprise 5.4.3 (CDH 5.4.3, Cloudera Manager 5.4.3, and Cloudera Navigator 2.3.3).   Cloudera Enterprise 5.4.3This release fixes key bugs and includes the following. CDH fixes for the following issues: Multiple YARN rolling upgrade issues  Potential data loss in the HDFS DataNode Incremental block report for HDFS significantly slows down NameNode startup For a full list of upstream JIRAs fixed in CDH 5.4.3, see the Known issues fixed section of the Release Notes. Cloudera Manager fixes for the following issues: Upgrade Wizard fails during CDH 5.4.1/Cloudera Manager 5.4.1 to CDH 5.4.3/Cloudera Manager 5.4.3 upgrade Performance issues when changing configurations on HDFS Cloudera Manager reports the wrong value for Impala bytes read from cache Multiple cross-site scripting vulnerabilities For full list of issues fixed in Cloudera Manager 5.4.3, see t

Dear CDH users,   This release fixes an issue that caused rolling upgrades to CDH 5.3.4 to fail.   We look forward to you trying it out, using the information below:   Download CDH 5.3.5 from the download page View the documentation: CDH 5.3.x Release Notes As always, we are happy to hear your feedback. Please send your comments and suggestions to the user group or through our community forums. You can also file bugs through our external JIRA projects on issues.cloudera.org.

Dear CDH, Cloudera Manager, Impala, and Cloudera Navigator users, We are pleased to announce the release of Cloudera Enterprise 5.3.4 (CDH 5.3.4, Cloudera Manager 5.3.4, and Cloudera Navigator 2.2.4).     Cloudera Enterprise 5.3.4 This release fixes key bugs and includes the following. CDH Multiple fixes for HDFS rolling upgrades Multiple YARN fair scheduler fixes Impala performance and query fixes HS2 no longer leaks open file descriptors when using UDFs For full list of upstream JIRAs fixed in CDH 5.3.4, see the Known issues fixed section of the Release Notes. Cloudera Manager fixes for the following issues: Slowness observed when accessing replication page. Cloudera Manager overwrites the krb5.conf file after disabling management by Cloudera Manager. Header injection vulnerability in internal logging call. Graph for "Total Containers Running Across NodeManagers" displays incorrect high values. We look forward to you trying it out, using the i