Announcements

Hello CDH and Impala Users, We are pleased to announce the release of Hive ODBC v2.5.15 and Impala JDBC v2.5.28. Hive ODBC v2.5.15 contains bug fixes and the following enhancements: Two-way SSL verification Custom HTTP headers SSL and Thrift transport protocol now configured separately from authentication Support for saving passwords as encrypted strings in the Windows Registry Impala ODBC 2.5.28 contains bug fixes and the following enhancements: Driver configuration option for enabling or disabling connections to SSL-enabled servers that use self-signed certificates Ability to configure SSL separately from authentication Option for configuring SASL when using username and password authentication   These drivers work for versions of HiveServer2 in CDH 4.1 or higher and Impala 1.0 or higher. Previous drivers continue to work on the latest versions of HiveServer2 and Impala.   Getting started with the Cloudera drivers: Read the Cloudera ODBC 2.5 driver for

Hello CDH and Impala Users,   We are pleased to announce the release of Hive JDBC v2.5.12 and Impala JDBC v2.5.22. Hive JDBC v2.5.12 allows you to configure SSL separately from authentication and fixes the following issues: The getColumns() function returns an empty result set if it uses both schema and table restrictions, and the table restriction contains an escaped wildcard character. Query translation does not use the database context specified by a USE <database> query. The driver does not report an error when a MapReduce job fails on the server side during query execution.   Impala JDBC 2.5.22 fixes the following issues: The getColumns() function returns an empty result set if it uses both schema and table restrictions, and the table restriction contains an escaped wildcard character. Precision and scale for DECIMAL columns are reported incorrectly.   Query translation does not use the database context specified by a USE <database> query

Dear CDH, Cloudera Manager, Impala, and Cloudera Navigator users,   This release fixes an issue that caused upgrades to CDH 5.4.1 to potentially fail.     We look forward to you trying it out, using the information below: Download Cloudera Enterprise from: http://www.cloudera.com/content/support/en/downloads.html   View the documentation: CDH 5 Release Notes Cloudera Manager Release Notes Cloudera Navigator Release Notes   As always, we are happy to hear your feedback. Please send your comments and suggestions to the user group or through our community forums.  You can also file bugs through our external JIRA projects on issues.cloudera.org.

We are pleased to announce the release of Cloudera Director 1.1.3. Cloudera Director is a simple, reliable, enterprise-grade way to deploy, scale, and manage Hadoop in the cloud, initially for Amazon Web Services (AWS). It is free to download and use, and supported for Cloudera Enterprise customers. This release fixes key bugs and includes the following: Uses lazy_itable_init when preparing ephemeral drives to speed up instance preparation.  This is useful for instances that have many large ephemeral drives, such as AWS D2 instances. Adds support for GUID Partition Table (GPT) root disk partitions. Allows custom AWS Identity and Access Management (IAM) endpoints. Changes the default Cloudera Manager and CDH versions to 5.3.3 instead of the latest version to ensure that compatible Cloudera Manager and CDH versions are used over the lifetime of Cloudera Manager. Corrects a typo for the d2.4xlarge instance type in virtualizationmappings.properties. No longer inadvertently

Dear CDH, Cloudera Manager, Impala, and Cloudera Navigator users,   We are pleased to announce the release of Cloudera Enterprise 5.4.1 (CDH 5.4.1, Cloudera Manager 5.4.1, and Cloudera Navigator 2.3.1).     Cloudera Enterprise 5.4.1 This release fixes key bugs and includes the following. CDH Optimization to avoid opening too many file descriptors during encryption DistCp fix to handle copying to root directory HDFS fixes for: Edit log corruption when append fails with a quota violation. Rolling upgrade restoring blocks from trash multiple times, which could cause. significant and unnecessary block churn. NameNode failover during high availability (HA) upgrade, which can cause the DataNode to finalize the upgrade. Null pointer exception (NPE) when NameNode transitions to active during startup. Incorrectly allowing HA NameNode to start in secure mode with HTTP wildcard address configured. Handling cache checks when encryption is enabled. YARN fi

Hi CDH, Cloudera Manager, and Cloudera Navigator users,   We’re pleased to announce the release of Cloudera Enterprise 5.4 (comprising CDH 5.4, Cloudera Manager 5.4, and Cloudera Navigator 2.3). Cloudera Enterprise 5.4 (Release Notes) reflects critical investments in a production-ready customer experience through  governance, security, performance and deployment flexibility in cloud environments. It also includes support for a significant number of updated open standard components–including Apache Spark 1.3, Impala 2.2, and  Apache HBase 1.0 (as well as unsupported beta releases of Hive-on-Spark data processing and OpenStack deployments). Recently Cloudera made the upgrade process considerably easier via an improved CDH upgrade wizard; see details about that wizard here and best practices here. (Note: Due to metadata format changes in Apache Hadoop 2.6, upgrading to CDH 5.4 and later from any earlier release requires an HDFS metadata upgrade, as well. Note also that for

Dear Cloudera Users,   We are pleased to announce the general availability of the Cloudera Connector Powered by Teradata 1.4. This release has many updates, including: Added support for JDK 8 (CDH 5 only). Added the --error-database option. Added the ability to specify format of Date, Time and Timestamp types when importing into CSV. Import method split.by.amp now supports views. Upgraded Teradata connector for Hadoop to version 1.3.4. The Connector is released in editions compatible with CDH 4 and CDH 5. See the download page for more details. For more details on new features and usage of Cloudera Connector Powered by Teradata, see: Release Notes Cloudera Connector Powered by Teradata version 1.4 Cloudera Connector Powered by Teradata User Guide, version 1.4 As always, we welcome your feedback. Please send your comments and suggestions through our new community forums.  You can also file bugs in the CDH project at issues.cloudera.org.

Dear CDH, Cloudera Manager, Impala, and Cloudera Navigator users,   We are pleased to announce the release of Cloudera Enterprise 5.1.5 (CDH 5.1.5, Cloudera Manager 5.1.5, and Cloudera Navigator 2.0.5) and Cloudera Enterprise 5.2.5 (CDH 5.2.5, Cloudera Manager 5.2.5, and Cloudera Navigator 2.1.5).   Cloudera Enterprise 5.1.5 This release fixes key bugs and includes the following. CDH Replacing DataNode disks or manually changing the Storage IDs of volumes in a cluster may result in data loss. Fixed as part of HDFS-7575, HDFS-7596, HDFS-7960 and HDFS-7208. Fixes to the dfsadmin command-line option and the inclusion of a command to manually trigger full block reports from a DataNode. Improved recovery speed after service or host failure, and fixes to handle race conditions with HDFS integration in Search. Bug fixes in YARN for handling display of clock skew, consistent time zone on the web UI, and ResourceManager high availability. Fix to address LDAP authentication,

We are pleased to announce the release of Cloudera Director 1.1.2.   Cloudera Director is a simple, reliable, enterprise-grade way to deploy, scale, and manage Hadoop in the cloud (initially for AWS). It’s free to download and use, and supported by default for Cloudera Enterprise customers. This release is focused on key bugs fixes including: Added support for d2 and c4 AWS instance types Restored the ability to modify a cluster that had an empty initial list of parcel repositories and was created with Director 1.0 Fixed parcel version validation when using an HTTP proxy We look forward to you trying it out, using the information below: Download Director from: http://www.cloudera.com/content/support/en/downloads.html View the documentation: Cloudera Director Release Notes Getting Started Installing Cloudera Director Client Installing Cloudera Director Server As always, we are happy to hear your feedback. Please send your comments and suggestions to the use

Dear CDH, Cloudera Manager, and Impala users,   We are pleased to announce the release of Cloudera Enterprise 5.0.6 (CDH 5.0.6 and Cloudera Manager 5.0.6)   This release fixes key bugs and includes the following. CDH Replacing DataNode disks or manually changing the Storage IDs of volumes in a cluster may result in data loss. Fixed as part of HDFS-7575, HDFS-7596, HDFS-7960 and HDFS-7208. Improved recovery speed after service or host failure, and fixes to handle race conditions with HDFS integration in Search. Bug fixes in YARN for handling display of clock skew and consistent time zone on the web UI. Bug fixes in Hive, including integration of Impala with HBase through Oozie. For full list of upstream JIRAs fixed in CDH 5.0.6, please see the Known issues fixed section of the Release Notes. Cloudera Manager Starting new ZooKeeper servers shortly after adding them no longer causes ZooKeeper data loss when the number of new servers exceeds the number of old

Dear CDH, Cloudera Manager, Impala, and Cloudera Navigator users, We are pleased to announce the release of Cloudera Enterprise 5.3.3 (CDH 5.3.3, Cloudera Manager 5.3.3, and Cloudera Navigator 2.2.3).   Cloudera Enterprise 5.3.3 This release fixes key bugs and includes the following. CDH Replacing DataNode Disks or Manually changing the Storage IDs of Volumes in a Cluster may result in Data Loss. Fixed as part of HDFS-7575, HDFS-7596, HDFS-7960 and HDFS-7208. Fixes to address issues with load balancing, loading ACLs, and integration with Hive in KMS LDAP-related usability fixes in Hue Bug fixes to handle Kerberos ticket validity, NameNode restarts, white spaces in ACLs, and other issues in Sentry Index corruption during replication and other fixes in Search Fixes for application recovery and ApplicationMaster tracking URL in high availability mode and other issues in YARN Fixes to handle reliability, race conditions, memory leaks, and ACL handling in Impala S

Hello CDH and Impala Users, We are pleased to announce the release of the following new drivers: Impala ODBC v2.5.26 Impala JDBC v2.5.19 Hive ODBC v2.5.14 Hive JDBC v2.5.10 These ODBC drivers include support for Windows 8. Please see the release notes for details on the specific fixes that were added for each driver.   To get started with the Cloudera drivers: Read the Cloudera ODBC 2.5 driver for Impala release notes and installation guide. Read the Cloudera JDBC 2.5 driver for Impala release notes and installation guide. Read the Cloudera ODBC 2.5 Driver for Hive release notes and  installation guide. Read the Cloudera JDBC 2.5 driver for Hive release notes and installation guide. Download the connector from the Cloudera Connectors page. As always, we are happy to hear your feedback. Please send your comments and suggestions to cdh-user@cloudera.org or post to our new Community Forums.

We are pleased to announce the release of Cloudera Director 1.1.1.   Cloudera Director is a simple, reliable, enterprise-grade way to deploy, scale, and manage Hadoop in the cloud (initially for AWS). It’s free to download and use, and supported by default for Cloudera Enterprise customers.   This release is focused on key bugs fixes including:   Restored support for service-level custom configurations Restored customBannerText as a deprecated property Added better progress reporting on failures Updated AWS IAM documentation link Added eu-central-1 to the region dropdown Added automatic assignment of gateway roles for all services in the wizard Allow clusters with Spark on YARN to be modified via the web interface We look forward to you trying it out, using the information below:   Download Director from: http://www.cloudera.com/content/support/en/downloads.html View the documentation: Cloudera Director Release Notes Getting Started Inst

Cloudera is pleased to announce a maintenance release of our supported packaging of Apache Accumulo for use on CDH 5.   This release fixes critical security issues related to the POODLE vulnerability.   Existing users should see a new parcel available for Accumulo 1.6.0-cdh5.1.4.   This release is supported with Cloudera Manager and CDH versions 5.1.0 or later. However, Cloudera Manager and CDH versions 5.1.4 or later are needed for fixes for POODLE in those components.   Cloudera recommends using the latest version of Cloudera Manager.   * Docs: http://tiny.cloudera.com/accumulo-docs * CM 5.3.2 Download: http://tiny.cloudera.com/cm-5.3.2 * Accumulo 1.6.0 on CDH 5 (CDH 5.1.0 or later): http://archive.cloudera.com/accumulo-c5/

Hello CDH Users,   We are pleased to announce the release of the Hive JDBC v2.5.9 driver. This release fixes the following issues: Using Java services to load the driver classes may cause a Hive Server 2 connection failure Driver misinterprets newer version of Hive When using Kerberos authentication, the driver returns an error message To get started with the Cloudera drivers: Read the Cloudera JDBC 2.5 driver for Hive release notes and installation guide. Download the connector from the Cloudera Connectors page. As always, we are happy to hear your feedback. Please send your comments and suggestions to cdh-user@cloudera.org or post to our Community Forums.   Kind regards, The Cloudera Team

Dear CDH and Cloudera Manager Users,     We are pleased to announce the release of Cloudera Director 1.1.   Cloudera Director is a simple and reliable way to deploy, scale, and manage Hadoop in the cloud (initially for AWS) in an enterprise-grade fashion. It’s free to download and use, and supported by default for Cloudera Enterprise customers. This release is focused on the following enhancements:     Support for demand-based shrinking of clusters Integration with Amazon RDS to enable end-to-end setup of clusters as well as related databases Native client bindings for Director API in Java and Python Overall improvements to Director User Interface, usability, and documentation Improved performance We look forward to you trying it out using the information below:   Download Director from: http://www.cloudera.com/content/support/en/downloads.html View the documentation: Cloudera Director Release Notes Getting Started Installing Clouder

Dear CDH and Cloudera Manager Users, We are pleased to announce the General Availability of Apache Kafka for CDH 5. Apache Kafka is a distributed publish-subscribe messaging system. It provides: High throughput and low latency Scalability Durability  and reliability Fault tolerance High concurrency In addition to replacing traditional message brokers, Kafka is ideal for collecting user activity data, aggregating logs, obtaining operational application metrics, and device instrumentation. Download Apache Kafka from: http://www.cloudera.com/content/support/en/downloads.html View the documentation: Overview Release Notes Installation Administration As always, we welcome your feedback. Please send your comments and suggestions to the user group or through ourcommunity forums.  You can also file bugs through our external JIRA projects on issues.cloudera.org.

Dear CDH, Cloudera Manager, and Impala users,   We are pleased to announce the release of CDH 5.2.3 and CDH 5.3.1.   CDH 5.2.3 This release includes updates and fixes in several components including Avro, Crunch, Hadoop, HBase, Hive, Hue, Impala, Pig, Parquet, and Solr. Some of the highlights are:   The data file corruption recovery tool in Avro Fixes in NFS support, short-circuit read, and decommissioning report in HDFS Replication fix in HBase Fixes for Kerberos and LDAP support in Hive Timestamp fix in Impala Fix to issue that could cause a Hive metastore corruption when upgrading to CDH 5.2.0, CDH 5.2.1, or CDH 5.3.0 CDH 5.3.1 This release includes fixes in Impala, Hive, and YARN. Some of the highlights are:   Fix to issue that could cause a Hive metastore corruption when upgrading to CDH 5.2.0, CDH 5.2.1, or CDH 5.3.0 Fix to memory leak when Impala is deployed with secure connections Fixes for YARN HA We look forward to you trying out th

Hello CDH and Impala Users,   We are pleased to announce the release of the Impala ODBC v2.5.23 and JDBC v2.5.16 drivers.   The Impala ODBC driver now supports authentication using user credentials without SASL implemented and fixes the following issues: SQLDescribeCol returns incorrect column lengths Windows DSN Setup dialog loads and saves the password from/to a DSN The driver may hang when running concurrent operations using the same connection from different threads The Impala JDBC driver fixes the following issues: Driver misinterprets a newer version of Impala Executing a query after PreparedStatement.setObject(1, null) in Native Query Mode causes a null pointer issue to occur Driver does not return an error when a table or column in a query is not found These drivers work for previous versions of HiveServer2 in CDH 4.1 or higher and Impala 1.0 or higher.   To get started with the Cloudera drivers: Read the Cloudera ODBC 2.5 driver for Impala r

Dear CDH, Cloudera Manager, Impala, and Cloudera Navigator users,   We are pleased to announce the release of Cloudera Manager 5.2.2 (including Cloudera Navigator 2.1.2) and Cloudera Manager 5.3.1 (including Cloudera Navigator 2.2.1).   Cloudera Manager 5.2.2 and Cloudera Navigator 2.1.2 This release fixes key bugs and includes the following: Cloudera Manager impalad memory limit units error in EnableLlamaRMCommand has been fixed. Fixed MapReduce Usage by User Reports when using an Oracle database backend. HiveServer2 keystore and LDAP group mapping passwords are no longer exposed in client configuration. Running MapReduce v2 jobs are visible using the Application Master view. Deleting services no longer results in foreign key constraint exceptions. Cloudera Navigator Search results in Navigator now have links to Hue. Browser autocomplete is no longer enabled before authentication. Navigator Web UI no longer exposes paths to directory listing/forc

Dear Cloudera users,    We are pleased to announce the general availability of the Cloudera Connector Powered by Teradata 1.3. This release has many updates including:   New features such as: Upgraded Teradata Connector for Hadoop to version 1.3.3 Parcel distribution now contains Teradata JDBC driver and one don't have to download one manually Added support for query import into Avro file format Other notable changes: Import method multiple.fastload has been removed. Connector is released in editions compatible with CDH 4 and CDH 5. See download page for further details. For more details on new features and usage of Cloudera Connector Powered by Teradata, see: Release Notes Cloudera Connector Powered by Teradata version 1.3 Cloudera Connector Powered by Teradata User Guide, version 1.3 As always, we welcome your feedback. Please send your comments and suggestions through our new community forums.  You can also file bugs in the CDH proj

Hi Cloudera users,   We're pleased to announce the release of Cloudera Enterprise 5.3 (comprising CDH 5.3, Cloudera Manager 5.3, and Cloudera Navigator 2.2).   This release continues the drumbeat for security functionality in particular, with HDFS encryption (jointly developed with Intel under Project Rhino) now recommended for production use. This feature alone should justify upgrades for security-minded users (and an improved CDH upgrade wizard makes that process easier).   Here are some of the highlights (incomplete; see the respective Release Notes for CDH, Cloudera Manager, and Cloudera Navigator for full lists of features and fixes): Security Folder-level HDFS encryption (in addition to storage, management, and access to encryption zone keys) is now a production-ready feature (HDFS-6134). This feature integrates with Navigator Key Trustee so that encryption keys can be securely stored separately from the data, with all the enterprise access and audit controls req

Hi Cloudera Director users,   Cloudera Director 1.0.2 was released today as a maintenance release. This is in line with our goal to quickly address bugs and enable our users to deploy production ready clusters in cloud environments such as AWS.   You can download the latest artifact here. Also, AWS QuickStart is a great way to get started with Director if you have an AWS account.   Release notes: Increased the number of inodes per partition for ephemeral drives. Director previously optimized for a small number of large files, which wasn't suitable for smaller sized instance types. The new defaults allow for a large number of files with any sized instance type.  Added support for the new AWS Frankfurt region.  Granular status updates while terminating deployments and clusters. We welcome your feedback!    - The Cloudera Director team

Hello CDH and Impala Users,   We are pleased to announce the release of the following new versions of our drivers: Impala ODBC v2.5.22 Hive ODBC v2.5.13 Impala JDBC v2.5.14 These drivers contain updates that make them compatible with CDH 5.2 and include the following features: Hive 0.13 Support Impala 2.0 Support VARCHAR, CHAR support Impala and Hive protocol update for greater performance (HIVE-3746) Mac installer improvements These drivers work for previous versions of HiveServer2 in CDH 4.1 or higher and Impala 1.0 or higher. Previous drivers continue to work on latest versions as well.   Getting started with the Cloudera Drivers: Read the Cloudera ODBC 2.5 Driver for Impala release notes and installation guide Read the Cloudera ODBC 2.5 Driver for Apache Hive release notes and  installation guide Read the Cloudera JDBC 2.5 for Impala release notes and installation guide Download the connector from the Cloudera Connectors page As always,

Dear CDH, Cloudera Manager, Impala and Cloudera Navigator users, We are pleased to announce the release of Cloudera Enterprise 5.1.4, Cloudera Enterprise 5.0.5, Cloudera Navigator 2.0.3,  CDH 4.7.1, Cloudera Manager 4.8.5 and Impala 1.4.3 and 2.0.1 for CDH 4. The focus of these releases is to fix the POODLE vulnerability in SSL that was discovered in September. In addition, Cloudera Enterprise 5.1.4 contains some critical bug fixes including: Fix for duplicate actions when using the CRON syntax in Apache Oozie Kerberos ticket renewal fixes in Apache Sentry Fix for Spark to work with YARN HA Fixes in Hive to handle white spaces, delimiters, escape sequences, and delegation token cancellation Cloudera Navigator 2.0.3 includes Fix an issue with MR and HDFS extractions where solr query OR clause has too many boolean clauses. We encourage you to try it out using the information below: Download Cloudera Enterprise from: http://www.cloudera.com/content/support/en/downlo