Announcements

Dear Cloudera Impala users,   We would like to announce the general availability of Cloudera Impala 1.2.3. This release fixes a bug where Impala couldn’t read Parquet files written by MapReduce.   Note that Impala 1.2.3 does not work with Cloudera Manager 4.7 or earlier. If your environment is managed by Cloudera Manager, you should upgrade to Impala 1.2.3 and Cloudera Manager 4.8 together.   For more details on new Impala features, please see “New Features in Impala”: http://www.cloudera.com/content/cloudera-content/cloudera-docs/Impala/latest/Cloudera-Impala-Release-Notes/cirn_new_features.html   “Installing and Using Cloudera Impala” guide: http://www.cloudera.com/content/cloudera-content/cloudera-docs/Impala/latest/Installing-and-Using-Impala/Installing-and-Using-Impala.html   As always, we are happy to hear your feedback. Please send your comments and suggestions to impalala-user@cloudera.org or through our new community forums.  You can also file bu

Dear CDH, Cloudera Manager, and Cloudera Impala users,   We are pleased to announce the general availability of Cloudera Impala 1.2.2 and version 2.5.13 of the Cloudera ODBC Driver for Cloudera Impala.      Impala 1.2.2 provides key enhancements including a number of the most requested features: Cost-based join order optimizations Compute statistics for tables and columns directly from Impala Cross join Preliminary support for clients to securely and more easily authenticate with their username and password via LDAP or Active Directory Cloudera ODBC Driver for Impala version 2.5.13 includes: Ability to authenticate with a username and password Ability to secure client traffic via encrypted SSL Ability for multi-tiered applications to proxy via delegation IDs Note that Impala 1.2.2 does not work with Cloudera Manager 4.7 or earlier. If your environment is managed by Cloudera Manager, you should upgrade to Impala 1.2.2 and Cloudera Manager 4.8 toge

We are pleased to announce a new name for the CDK: Kite. We've just released Kite version 0.10.0, which is purely a rename of CDK 0.9.0.The new repository and documentation are: Kite repository: https://github.com/kite-sdk/kite Kite documentation: http://kitesdk.org/ Kite examples: https://github.com/kite-sdk/kite-examples Why rename?The goal of Kite, and CDK, is to increase the accessibility of the platform. That isn't Cloudera-specific, and we want the name to correctly represent the project as an open, community-driven set of tools.What will this break?The rename mainly affects dependencies and package names. Once imports and dependencies are updated, almost everything should work the same. However, there are a couple of configuration changes to make for anyone using flume or morphlines. The changes are detailed on our migration page.Again, this 0.10.0 release is a rename only. There are no feature changes, and 0.9.0 will be supported as long as 0.10.0, so that

We are pleased to announce version 0.9.0 of the Cloudera Development Kit.The major highlights of 0.9.0 include a new experimental API for working with random access datasets stored in HBase, Crunch Parquet integration, improved support for existing datasets (including those in CSV format), and several new Morphlines commands.Further details are available in the release notes.To get started with the CDK please consult the documentation, source, and the examples.

Hello CDH Users,   We are pleased to announce the release of version 2.5.5 of the Cloudera ODBC Driver for Apache Hive.  This version adds: Ability for clients to securely and more easily authenticate with their username and password Ability to secure client traffic via encrypted SSL Ability for multi-tiered applications to proxy via delegation IDs These drivers work for previous versions of HiveServer2 in CDH 4.1 or higher but the new functionality above is only available in CDH 4.5.   Getting started with the Cloudera ODBC Drivers: Read the the Hive installation guide Download the connector from the Cloudera Components and Connectors page As always, we are happy to hear your feedback. Please send your comments and suggestions to cdh-user@cloudera.org or post to our new Community Forums.   Kind regards, The Cloudera Team

Dear CDH, Cloudera Manager, Cloudera Impala, and Cloudera Search users,   We are pleased to announce the general availability of CDH 4.5, Cloudera Manager 4.8, Cloudera Impala 1.2.1, and Cloudera Search 1.1. Details on each release are below. Please note that if you use Impala and plan to upgrade to either Cloudera Manager 4.8 or Impala 1.2.1, you should plan on upgrading to both versions together as they have a mutual dependency.   CDH 4.5This is an update to the CDH 4 platform and provides a considerable amount of bug-fixes and stability enhancements. Along with these fixes, we have also included some new features, most notable of which are: Hive - ability for clients to securely and more easily authenticate with their username and password Hive - improved security for the metastore with metastore authentication Hue - secure fine-grained, Sentry authorization for end-users of Hue with Impala Parquet 1.x integrated into CDH 4.5 and ready for use across MapReduce, Pig, Impal

We are pleased to announce the beta release of Cloudera Enterprise 5 (CDH 5 and Cloudera Manager 5).  This release has both Impala and Search integrated into CDH. It also includes many new features and updated component versions including the ones below: Hadoop Rebase on Hadoop 2.2 GA HDFS HDFS Snapshots HDFS Caching Preview MR MR2 is production ready MR2 Management by Cloudera Manager MR1 and MR2 are both supported Resource Management/YARN Ability to run MR and Impala with resource sharing Resource Management High Availability Cloudera Manager Platform coverage/support for CDH 5 Resource/Workload management Extensibility support for Partner applications Advanced Impala monitoring HBase Significant reductions to Mean time to Recovery (MTTR) Rebase on HBase 0.95.2+ Impala Language extensibility with native UDFs and UDAF plus support for existing Hive UDFs Automatic and coordinated metadata refresh Preview of YARN-integrated resource management Support for HDFS cachi

We are pleased to announce version 0.8.0 of the Cloudera Development Kit.The major highlights of 0.8.0 include Dataset Repository URIs, Dataset API improvements, support for Parquet 1.2.0, and new metrics commands in Morphlines.Further details are available in the release notes.To get started with the CDK have a look at the documentation, source, and the examples.

To receive email notifications about new releases, simply register and then "Subscribe" to this forum. You'll get all release notices by email.

Dear CDH Users,   We are pleased to announce the general availability of CDH 4.3.2. This is a maintenance update to the CDH4 platform that includes the following fix: HADOOP-9150 - Unnecessary DNS resolution attempts for logical URIs For more information on this release, please see the Release Notes.   Refer to the CDH4 Quick Start Guide or CDH4 Installation Guide for more information on how to install this update release.   As always, we are happy to hear your feedback. Please send your comments and suggestions to cdh-user@cloudera.org or through our new community forums http://community.cloudera.com/.   Thanks,   The Cloudera Team

Version 0.7.0 has the following notable changes: Dataset API. Changes to make the API more consistent and better integrated with standard Java APIs like Iterator, Iterable, Flushable, and Closeable. Java 7. CDK now works with Java 7. Upgrade to Avro 1.7.5. Morphlines Library Added commands splitKeyValue, extractURIComponent and toByteArray Added outputFields parameter to the split command to support a list of column names similar to the readCSV command Added tika-xmp maven module as a dependency to cdk-morphline-solr-cell module Added several performance enhancements Upgraded cdk-morphlines-saxon module from saxon-HE-9.5.1-1 to saxon-HE-9.5.1-2 The full change log is available from JIRA.

Dear Search, Cloudera Manager, and CDH users,   We are pleased to announce the general availability of Cloudera Search 1.0 along with the Cloudera Manager 4.7, Cloudera Navigator 1.1, and CDH4.4.0 releases.   Cloudera Search 1.0 After three months of public beta, and months of private beta before that, we are proud to present the general availability of Cloudera Search. We have now contributed back our innovation and IP around integration of Apache Solr and Apache Lucene with Cloudera’s Distribution including Apache Hadoop (CDH) back into the various projects, and completed a lot of hardening, integration, simplification, and packaging work.   Our Cloudera team has impressively delivered a number of highly attractive and valuable platform integrations:   Batch indexing via Apache MapReduce Near real time indexing at ingest via Apache Flume and Apache HBase Cloudera Manager integration for better production visibility and monitoring SolrCloud deployment capa

Hello CDH and Impala Users,   We are pleased to announce the version 2.5 release of the Cloudera ODBC Driver for Apache Hive and Cloudera Impala. This version adds: Significantly enhanced ODBC API support to enable even more BI tool integrations Support for additional platforms including Windows XP and Mac 32-bit and 64-bit drivers Increased performance The driver has also been certified with Tableau 8.0.5 to connect to HiveServer2 with CDH 4.2 and above.   Getting started with the Cloudera ODBC 2.5: Read the Impala installation guide and the Hive installation guide Download the connector from the Cloudera Components and Connectors page   As always, we are happy to hear your feedback. Please send your comments and suggestions to cdh-user@cloudera.org or impala-user@cloudera.org or post to our new Community Forums.   Kind regards, The Cloudera Team

Hello CDH, Impala and Cloudera Manager Users, We are pleased to announce the release of Cloudera Impala version: 1.1.1. This is a maintenance release that contains defect fixes and improvements including the following: Additional security feature: auditing events. New startup options for impalad let you capture information about Impala queries that succeed or are blocked due to insufficient privileges. These events will also be integrated into an upcoming release of Cloudera Navigator. For details, see Impala Security. Parquet data files generated by Impala 1.1.1 are now compatible with the Parquet support in Hive. See Incompatible Changes on page 11 for the procedure to update older Impala-created Parquet files to be compatible with the Hive Parquet support. Additional improvements to stability and resource utilization for Impala queries. Additional enhancements for compatibility with existing file formats. For a full list of features and fixes, see the Impala Re

Dear CDH Users,   We are pleased to announce the general availability of CDH4.3.1. This is a maintenance update to the CDH4 platform that includes a security fix for a Apache Hadoop and Apache HBase "Man-in-the-Middle" vulnerability and provides a number of bug fixes and stability enhancements. Some of the key fixes include: Hadoop HADOOP-9439 - JniBasedUnixGroupsMapping crashes HADOOP-8151 - Error handling in snappy decompressor throws invalid exceptions HDFS HDFS-4621 - Additional logging to help diagnose slow QJM logSync HBase HBASE-8446 - Allow parallel snapshot of different tables HBASE-8690 - Reduce unnecessary getFileStatus hdfs calls in TTL hfile and hlog cleaners HBASE-8706 - Some improvement in snapshot HBASE-8712 - HFileLinkCleaner (FSUtils.listStatus) logs too much if links do not exists HBASE-8742 - HTableDescriptor Properties not preserved when cloning HBASE-8783 - RSSnapshotManager.ZKProcedureMemberRp

We are pleased to announce the release of Cloudera Manager 4.6.3. This is a critical bug fix release. Please refer to the fixed issue. We strongly encourage anyone using CM 4.6.x to upgrade.   You can download CM 4.6.3 or upgrade to CM 4.6.3. For more questions, email us at scm-users@cloudera.org, or checkout our new community forum.

Hello CDH, Search, and Cloudera Manager Users,   We are pleased to announce the release of Cloudera Search Beta version 0.9.3. This is the fourth drop of the Cloudera Search public Beta.   This version has bug fixes and adds the following features: Support for Kerberos authentication. Search continues to use simple authentication with the anonymous user as the default configuration, but Search now supports changing the authentication scheme to Kerberos. All required packages are installed during the installation or upgrade process. Additional configuration is required before Kerberos is available in your environment. Extended the morphlines library: Added commands xquery, xslt, convertHTML for reading, extracting and transforming XML and HTML with XPath, XQuery and XSLT. Added tokenizeText command that uses the embedded Solr/Lucene Analyzer library to generate tokens from a text string, without sending data to a Solr server. Added translate command that examines each value

Hello CDH, Impala and Cloudera Manager Users,   Impala 1.1:We are pleased to announce the release of Cloudera Impala version: 1.1. This release includes the following new features: Sentry support: Fine-grained authorization Role-based authorization Support for views Performance improvements Parquet columnar performance More efficient metadata refresh for larger installations Additional SQL SQL-89 joins (in addition to existing SQL-92) LOAD function REFRESH command for JDBC/ODBC Improved Hbase support: Binary types Caching configuration For a full list of features and fixes please see the Release Notes.   Cloudera Manager 4.6.2:We are also announcing the Cloudera Manager 4.6.2 release, which contains support for Impala 1.1 and several key bug fixes. Please see the full Cloudera Manager release notes. You can finddownload information, installation and upgrade documentation from our website. If you are using Cloudera Manager to manage Impala, we