What's New @ Cloudera

Dear CDH, Cloudera Manager, Impala, and Cloudera Navigator users, We are pleased to announce the release of Cloudera Enterprise 5.3.3 (CDH 5.3.3, Cloudera Manager 5.3.3, and Cloudera Navigator 2.2.3).   Cloudera Enterprise 5.3.3 This release fixes key bugs and includes the following. CDH Replacing DataNode Disks or Manually changing the Storage IDs of Volumes in a Cluster may result in Data Loss. Fixed as part of HDFS-7575, HDFS-7596, HDFS-7960 and HDFS-7208. Fixes to address issues with load balancing, loading ACLs, and integration with Hive in KMS LDAP-related usability fixes in Hue Bug fixes to handle Kerberos ticket validity, NameNode restarts, white spaces in ACLs, and other issues in Sentry Index corruption during replication and other fixes in Search Fixes for application recovery and ApplicationMaster tracking URL in high availability mode and other issues in YARN Fixes to handle reliability, race conditions, memory leaks, and ACL handling in Impala S

Hello CDH and Impala Users, We are pleased to announce the release of the following new drivers: Impala ODBC v2.5.26 Impala JDBC v2.5.19 Hive ODBC v2.5.14 Hive JDBC v2.5.10 These ODBC drivers include support for Windows 8. Please see the release notes for details on the specific fixes that were added for each driver.   To get started with the Cloudera drivers: Read the Cloudera ODBC 2.5 driver for Impala release notes and installation guide. Read the Cloudera JDBC 2.5 driver for Impala release notes and installation guide. Read the Cloudera ODBC 2.5 Driver for Hive release notes and  installation guide. Read the Cloudera JDBC 2.5 driver for Hive release notes and installation guide. Download the connector from the Cloudera Connectors page. As always, we are happy to hear your feedback. Please send your comments and suggestions to cdh-user@cloudera.org or post to our new Community Forums.

We are pleased to announce the release of Cloudera Director 1.1.1.   Cloudera Director is a simple, reliable, enterprise-grade way to deploy, scale, and manage Hadoop in the cloud (initially for AWS). It’s free to download and use, and supported by default for Cloudera Enterprise customers.   This release is focused on key bugs fixes including:   Restored support for service-level custom configurations Restored customBannerText as a deprecated property Added better progress reporting on failures Updated AWS IAM documentation link Added eu-central-1 to the region dropdown Added automatic assignment of gateway roles for all services in the wizard Allow clusters with Spark on YARN to be modified via the web interface We look forward to you trying it out, using the information below:   Download Director from: http://www.cloudera.com/content/support/en/downloads.html View the documentation: Cloudera Director Release Notes Getting Started Inst

Cloudera is pleased to announce a maintenance release of our supported packaging of Apache Accumulo for use on CDH 5.   This release fixes critical security issues related to the POODLE vulnerability.   Existing users should see a new parcel available for Accumulo 1.6.0-cdh5.1.4.   This release is supported with Cloudera Manager and CDH versions 5.1.0 or later. However, Cloudera Manager and CDH versions 5.1.4 or later are needed for fixes for POODLE in those components.   Cloudera recommends using the latest version of Cloudera Manager.   * Docs: http://tiny.cloudera.com/accumulo-docs * CM 5.3.2 Download: http://tiny.cloudera.com/cm-5.3.2 * Accumulo 1.6.0 on CDH 5 (CDH 5.1.0 or later): http://archive.cloudera.com/accumulo-c5/

Hello CDH Users,   We are pleased to announce the release of the Hive JDBC v2.5.9 driver. This release fixes the following issues: Using Java services to load the driver classes may cause a Hive Server 2 connection failure Driver misinterprets newer version of Hive When using Kerberos authentication, the driver returns an error message To get started with the Cloudera drivers: Read the Cloudera JDBC 2.5 driver for Hive release notes and installation guide. Download the connector from the Cloudera Connectors page. As always, we are happy to hear your feedback. Please send your comments and suggestions to cdh-user@cloudera.org or post to our Community Forums.   Kind regards, The Cloudera Team

Dear CDH and Cloudera Manager Users,     We are pleased to announce the release of Cloudera Director 1.1.   Cloudera Director is a simple and reliable way to deploy, scale, and manage Hadoop in the cloud (initially for AWS) in an enterprise-grade fashion. It’s free to download and use, and supported by default for Cloudera Enterprise customers. This release is focused on the following enhancements:     Support for demand-based shrinking of clusters Integration with Amazon RDS to enable end-to-end setup of clusters as well as related databases Native client bindings for Director API in Java and Python Overall improvements to Director User Interface, usability, and documentation Improved performance We look forward to you trying it out using the information below:   Download Director from: http://www.cloudera.com/content/support/en/downloads.html View the documentation: Cloudera Director Release Notes Getting Started Installing Clouder

Dear CDH and Cloudera Manager Users, We are pleased to announce the General Availability of Apache Kafka for CDH 5. Apache Kafka is a distributed publish-subscribe messaging system. It provides: High throughput and low latency Scalability Durability  and reliability Fault tolerance High concurrency In addition to replacing traditional message brokers, Kafka is ideal for collecting user activity data, aggregating logs, obtaining operational application metrics, and device instrumentation. Download Apache Kafka from: http://www.cloudera.com/content/support/en/downloads.html View the documentation: Overview Release Notes Installation Administration As always, we welcome your feedback. Please send your comments and suggestions to the user group or through ourcommunity forums.  You can also file bugs through our external JIRA projects on issues.cloudera.org.

Dear CDH, Cloudera Manager, and Impala users,   We are pleased to announce the release of CDH 5.2.3 and CDH 5.3.1.   CDH 5.2.3 This release includes updates and fixes in several components including Avro, Crunch, Hadoop, HBase, Hive, Hue, Impala, Pig, Parquet, and Solr. Some of the highlights are:   The data file corruption recovery tool in Avro Fixes in NFS support, short-circuit read, and decommissioning report in HDFS Replication fix in HBase Fixes for Kerberos and LDAP support in Hive Timestamp fix in Impala Fix to issue that could cause a Hive metastore corruption when upgrading to CDH 5.2.0, CDH 5.2.1, or CDH 5.3.0 CDH 5.3.1 This release includes fixes in Impala, Hive, and YARN. Some of the highlights are:   Fix to issue that could cause a Hive metastore corruption when upgrading to CDH 5.2.0, CDH 5.2.1, or CDH 5.3.0 Fix to memory leak when Impala is deployed with secure connections Fixes for YARN HA We look forward to you trying out th

Hello CDH and Impala Users,   We are pleased to announce the release of the Impala ODBC v2.5.23 and JDBC v2.5.16 drivers.   The Impala ODBC driver now supports authentication using user credentials without SASL implemented and fixes the following issues: SQLDescribeCol returns incorrect column lengths Windows DSN Setup dialog loads and saves the password from/to a DSN The driver may hang when running concurrent operations using the same connection from different threads The Impala JDBC driver fixes the following issues: Driver misinterprets a newer version of Impala Executing a query after PreparedStatement.setObject(1, null) in Native Query Mode causes a null pointer issue to occur Driver does not return an error when a table or column in a query is not found These drivers work for previous versions of HiveServer2 in CDH 4.1 or higher and Impala 1.0 or higher.   To get started with the Cloudera drivers: Read the Cloudera ODBC 2.5 driver for Impala r

Dear CDH, Cloudera Manager, Impala, and Cloudera Navigator users,   We are pleased to announce the release of Cloudera Manager 5.2.2 (including Cloudera Navigator 2.1.2) and Cloudera Manager 5.3.1 (including Cloudera Navigator 2.2.1).   Cloudera Manager 5.2.2 and Cloudera Navigator 2.1.2 This release fixes key bugs and includes the following: Cloudera Manager impalad memory limit units error in EnableLlamaRMCommand has been fixed. Fixed MapReduce Usage by User Reports when using an Oracle database backend. HiveServer2 keystore and LDAP group mapping passwords are no longer exposed in client configuration. Running MapReduce v2 jobs are visible using the Application Master view. Deleting services no longer results in foreign key constraint exceptions. Cloudera Navigator Search results in Navigator now have links to Hue. Browser autocomplete is no longer enabled before authentication. Navigator Web UI no longer exposes paths to directory listing/forc

Dear Cloudera users,    We are pleased to announce the general availability of the Cloudera Connector Powered by Teradata 1.3. This release has many updates including:   New features such as: Upgraded Teradata Connector for Hadoop to version 1.3.3 Parcel distribution now contains Teradata JDBC driver and one don't have to download one manually Added support for query import into Avro file format Other notable changes: Import method multiple.fastload has been removed. Connector is released in editions compatible with CDH 4 and CDH 5. See download page for further details. For more details on new features and usage of Cloudera Connector Powered by Teradata, see: Release Notes Cloudera Connector Powered by Teradata version 1.3 Cloudera Connector Powered by Teradata User Guide, version 1.3 As always, we welcome your feedback. Please send your comments and suggestions through our new community forums.  You can also file bugs in the CDH proj

Hi Cloudera users,   We're pleased to announce the release of Cloudera Enterprise 5.3 (comprising CDH 5.3, Cloudera Manager 5.3, and Cloudera Navigator 2.2).   This release continues the drumbeat for security functionality in particular, with HDFS encryption (jointly developed with Intel under Project Rhino) now recommended for production use. This feature alone should justify upgrades for security-minded users (and an improved CDH upgrade wizard makes that process easier).   Here are some of the highlights (incomplete; see the respective Release Notes for CDH, Cloudera Manager, and Cloudera Navigator for full lists of features and fixes): Security Folder-level HDFS encryption (in addition to storage, management, and access to encryption zone keys) is now a production-ready feature (HDFS-6134). This feature integrates with Navigator Key Trustee so that encryption keys can be securely stored separately from the data, with all the enterprise access and audit controls req

Hi Cloudera Director users,   Cloudera Director 1.0.2 was released today as a maintenance release. This is in line with our goal to quickly address bugs and enable our users to deploy production ready clusters in cloud environments such as AWS.   You can download the latest artifact here. Also, AWS QuickStart is a great way to get started with Director if you have an AWS account.   Release notes: Increased the number of inodes per partition for ephemeral drives. Director previously optimized for a small number of large files, which wasn't suitable for smaller sized instance types. The new defaults allow for a large number of files with any sized instance type.  Added support for the new AWS Frankfurt region.  Granular status updates while terminating deployments and clusters. We welcome your feedback!    - The Cloudera Director team

Hello CDH and Impala Users,   We are pleased to announce the release of the following new versions of our drivers: Impala ODBC v2.5.22 Hive ODBC v2.5.13 Impala JDBC v2.5.14 These drivers contain updates that make them compatible with CDH 5.2 and include the following features: Hive 0.13 Support Impala 2.0 Support VARCHAR, CHAR support Impala and Hive protocol update for greater performance (HIVE-3746) Mac installer improvements These drivers work for previous versions of HiveServer2 in CDH 4.1 or higher and Impala 1.0 or higher. Previous drivers continue to work on latest versions as well.   Getting started with the Cloudera Drivers: Read the Cloudera ODBC 2.5 Driver for Impala release notes and installation guide Read the Cloudera ODBC 2.5 Driver for Apache Hive release notes and  installation guide Read the Cloudera JDBC 2.5 for Impala release notes and installation guide Download the connector from the Cloudera Connectors page As always,

Dear CDH, Cloudera Manager, Impala and Cloudera Navigator users, We are pleased to announce the release of Cloudera Enterprise 5.1.4, Cloudera Enterprise 5.0.5, Cloudera Navigator 2.0.3,  CDH 4.7.1, Cloudera Manager 4.8.5 and Impala 1.4.3 and 2.0.1 for CDH 4. The focus of these releases is to fix the POODLE vulnerability in SSL that was discovered in September. In addition, Cloudera Enterprise 5.1.4 contains some critical bug fixes including: Fix for duplicate actions when using the CRON syntax in Apache Oozie Kerberos ticket renewal fixes in Apache Sentry Fix for Spark to work with YARN HA Fixes in Hive to handle white spaces, delimiters, escape sequences, and delegation token cancellation Cloudera Navigator 2.0.3 includes Fix an issue with MR and HDFS extractions where solr query OR clause has too many boolean clauses. We encourage you to try it out using the information below: Download Cloudera Enterprise from: http://www.cloudera.com/content/support/en/downlo

Dear CDH, Cloudera Manager, Impala and Cloudera Navigator users,   We are pleased to announce the release of Cloudera Enterprise 5.2.1 (CDH 5.2.1, Cloudera Manager 5.2.1, and Cloudera Navigator 2.1.1)   This release is focused on fixing key bugs and includes the following:   CDH Fixes Oozie: Using cron-like syntax for Coordinator frequencies could result in duplicate actions in certain cases; this is now fixed (OOZIE-2063) YARN: Handle app-recovery failures gracefully (YARN-2010) Impala: Memory leak with string functions (IMPALA-1397) Impala: IllegalStateException when inserting results of a window function (IMPALA-1400) Impala: Read errors with Parquet files (IMPALA-1401) Impala: Regex functions don’t accept shorthand such as \d (IMPALA-1410) Impala: Queries fail with metastore exception after upgrade and compute stats (IMPALA-1416) Impala: Crashes due to bug in ClientCacheHelper (IMPALA-1445) Cloudera Manager Fixed metric collection for CDH 5.

We're pleased to announce the release of Cloudera Enterprise 5.2 (comprising CDH 5.2, Cloudera Manager 5.2, Cloudera Director 1.0, and Cloudera Navigator 2.1).   This release reflects our continuing investments in Cloudera Enterprise's main focus areas, including security, integration with the partner ecosystem, and support for the latest innovations in the open source platform (including Impala 2.0, its most significant release yet, and Apache Hive 0.13.1). It also includes a new product, Cloudera Director, that streamlines deployment and management of enterprise-grade Hadoop clusters in cloud environments; new component releases for building real-time applications; and new support for significant partner technologies like EMC Isilon. Furthermore, this release ships the first results of joint engineering with Intel, including WITH GRANT OPTION for Hive and Impala and performance optimizations for MapReduce.   Here are some of the highlights (incomplete; see the respective Re

We're pleased to announce the release of Kite SDK 0.17.0. This release updates the examples to CDH 5, defaults Parquet to the non-durable mode from 0.14 and prior, adds support for namespaces, and adds a kite-minicluster for easier development and integration testing against single-node Hadoop deployments. For more details see the release notes and the documentation.

Hello CDH and Impala Users,   We are pleased to announce the release of version 2.5.12 of the ODBC Driver for Apache Hive and version 2.5.20 of the ODBC driver for Impala.  These versions contain bug fixes including one that affected the decimal data type. These drivers work for previous versions of HiveServer2 in CDH 4.1 or higher and Impala 1.0 or higher.   Getting started with the Cloudera ODBC Drivers:   Read the Cloudera ODBC 2.5 Driver for Impala release notes and installation guide Read the Cloudera ODBC 2.5 Driver for Apache Hive release notes and  installation guide Download the connector from the Cloudera Connectors page As always, we are happy to hear your feedback. Please send your comments and suggestions to cdh-user@cloudera.org or post to our new Community Forums.   Kind regards, The Cloudera Team

Dear CDH and Cloudera Manager users,   We are pleased to announce the release of Cloudera Enterprise 5.1.3.   Cloudera Enterprise 5.1.3 This release is focused on fixing key bugs and includes the following. CDH Fixes HADOOP-11035 - distcp on mr1(branch-1) fails with NPE using a short relative source path. HBASE-11349 - [Thrift] support authentication/impersonation HBASE-11446 - Reduce the frequency of RNG calls in SecureWALCellCodec#EncryptedKvEncoder HBASE-11457 - Increment HFile block encoding IVs accounting for ciper's internal use HBASE-11474 - [Thrift2] support authentication/impersonation HBASE-11565 - Stale connection could stay for a while HBASE-11627 - RegionSplitter's rollingSplit terminated with "/ by zero", and the _balancedSplit file was not deleted properly HBASE-11788 - hbase is not deleting the cell when a Put with a KeyValue, KeyValue.Type.Delete is submitted HBASE-11828 - callers of SeverName.valueOf should use equals and not == HDFS-4257 - The ReplaceData

Dear CDH and Cloudera Manager users,   We are pleased to announce the release of Cloudera Enterprise 5.1.2 (CDH 5.1.2, Cloudera Manager 5.1.2, Cloudera Navigator 2.0.1) and CDH 5.0.4.   Cloudera Enterprise 5.1.2 This release is focused on fixing key bugs and includes the following.   CDH Fixes FLUME-2438 - Make Syslog source message body configurable HBASE-11052 - Sending random data crashes thrift service HBASE-11143 - Improve replication metrics HBASE-11609 - LoadIncrementalHFiles fails if the namespace is specified HDFS-6114 - Block Scan log rolling will never happen if blocks written continuously leading to huge size of dncp_block_verification.log.curr HDFS-6640 - [ Web HDFS ] Syntax for MKDIRS, CREATESYMLINK, and SETXATTR are given wrongly(missed webhdfs/v1).). HDFS-6703 - NFS: Files can be deleted from a read-only mount HDFS-6788 - Improve synchronization in BPOfferService with read write lock HDFS-6825 - Edit log corruption due to delayed block removal HUE-221

We're pleased to announce the release of Kite SDK 0.16.0.This release adds support for Apache Spark, adds a CLI transform command for dataset-to-dataset ETL, and adds a CDH 5 parent POM for building Kite applications targeting CDH 5.   For more details see the release notes and the documentation.

Dear Cloudera Manager users,   We are pleased to announce the release of Cloudera Manager 5.1.1 and 4.8.4.  These are maintenance releases and have a number of bug fixes.   Cloudera Manager 4.8.4 Bug Fixes:   Directory quota in Cloudera Manager shows incorrect values. Activity Monitor in Cloudera Manager doesn't request new http service ticket. Many Hive replications running at the same time can cause some of them to fail with "Read timed out" errors. Multiple Hive replications running at the same time can cause some of them to fail with "command succeeded, but unable to fetch results" errors. This has been noted to occur with as few as 20 replications. Multiple Hive replications started at exactly the same time (typically triggered by replication schedules) can cause one or more of them to complete successfully without actually replicating the desired metadata. Replications can be affected by other replications or commands running at the same time.&nb

Cloudera is pleased to announce support for Accumulo 1.6.0 on both CDH 4 and CDH 5.   As of version 5.1.0, Cloudera Manager now ships with support to deploy and manage Accumulo 1.6.0 on CDH 4.6.0 or later and CDH 5.1.0 or later.   * Docs: http://tiny.cloudera.com/accumulo-docs * CM 5.1.0 Download: http://tiny.cloudera.com/cm-5.1.0 * Accumulo 1.6.0 on CDH 5 (CDH5.1.0 or later): http://archive.cloudera.com/accumulo-c5/ * Accumulo 1.6.0 on CDH 4 (CDH4.6.0 or later): http://archive.cloudera.com/accumulo/

Dear CDH, Cloudera Manager, Impala and Search Users,     We are thrilled to announce the GA release of Cloudera Enterprise 5.1 (CDH 5.1 and Cloudera Manager 5.1),  Cloudera Navigator 2.0, Impala 1.4 for CDH 4, Impala ODBC v2.5.17 and Hive ODBC v2.5.10.   Cloudera Enterprise 5.1 Cloudera Enterprise 5.1 contains a number of new features and component versions including the ones below: Apache Hadoop HDFS Extended ACL Support NFS Enhancements HTTPS support YARN YARN + Impala GA: CDH 5.1 now supports three modes of Resource Management: Static Partitioning (CDH 4.3+) Admission Control (CDH 5.0+) Dynamic Prioritization (CDH 5.1+) As part of Dynamic Prioritization, Llama now supports HA Configuration similar to other HA elements (Active-Passive) Apache HBase HBase 0.98.1 rebase Improved WAL write performance Reverse scans MapReduce over snapshots Apache Spark Rebase to Spark 1.0 Spark Streaming integration with Kerber