Dear CDH, Cloudera Manager, and Cloudera Impala users, We are pleased to announce the general availability of Cloudera Impala 1.3.1 for use with CDH 4.   Impala 1.3.1 contains stability enhancements and the following new features: Improved memory usage under contention including higher concurrency, high numbers of Parquet columns, or low memory limits Additional SQL built-in functions Note that Impala 1.3.1 does not work with Cloudera Manager 4.7 or earlier. If your environment is managed by Cloudera Manager 4.7 or before, you should upgrade to Impala 1.3.1 and Cloudera Manager 4.8 together. For more details on new Impala features, please see “New Features in Impala”: http://www.cloudera.com/content/cloudera-content/cloudera-docs/Impala/latest/Cloudera-Impala-Release-Notes/cirn_new_features.html “Installing and Using Cloudera Impala” guide: http://www.cloudera.com/content/cloudera-content/cloudera-docs/Impala/latest/Installing-and-Using-Impala/Installing-and-Using-Impala.html As always, we are happy to hear your feedback. Please send your comments and suggestions to impala-user@cloudera.org or through our new community forums.  You can also file bugs in the Impala project at issues.cloudera.org   ... View more

We are thrilled to announce the GA release of Cloudera Enterprise 5 (comprising CDH 5.0 and Cloudera Manager 5.0).    When it became generally available 18 months ago, Cloudera Enterprise 4 was widely recognized to be more flexible, more scalable, and less expensive than traditional data management platforms; with Cloudera Enterprise 5, we can also say it is faster (HDFS caching FTW!), more functional (includes new components such as Apache Spark and Parquet), and better integrated (for example, Cloudera Impala and Cloudera Search are now both inside CDH). Furthermore, in an impressive demonstration of ecosystem growth, 100 Cloudera partners invested technical resources to certify on Cloudera Enterprise 5 before its release.   Cloudera Enterprise contains many new components and features, with the major ones listed below. (See CDH 5 Release Notes and Cloudera Manager 5 Release Notes for full details.) Thanks to everyone who participated in the beta process to help make this release as good as it could be!   New components Apache Spark 0.9.0 Apache Crunch 0.9.0 Parquet 1.2.5 Kite SDK 0.10.0 Apache Avro 1.7.5 Apache Hadoop Rebase on Hadoop 2.3.0+ HDFS HDFS Caching NFS gateway YARN & MapReduce MR2 is production ready MR2 Management by Cloudera Manager MR1 and MR2 are both supported Resource Management/YARN HA support for Resource Manager Cloudera Manager Platform support for CDH 5 Resource management and scheduler configuration Extensibility support for third party applications Advanced Impala monitoring Support for Spark Enhancements to monitoring and charts Single sign-on support Apache HBase Rebase on HBase 0.96.1.1 Significant reductions to Mean time to Recovery (MTTR) Impala Rebase on Impala 1.3 Language extensibility with native UDFs and UDAF, plus support for existing Hive UDFs Automatic and coordinated metadata refresh Concurrency controls via admission controls Beta of YARN-integrated resource management Apache Flume New Kite Dataset Sink Apache Hive Rebase on Apache Hive 0.12.0 Improved JDBC spec coverage SSL encryption support on non-kerberos authentication Native Parquet support Search Support for CDH 5 Apache Sqoop Rebase to Sqoop 1.99.3 Apache Oozie Support for CRON-like scheduling Oozie HA Rebase on Oozie 4.0 Hue Single sign-on support Graphical facets in Search application SQL editors re-vamp: richer GUI for Impala and Hive, result graphing, and more Apache ZooKeeper application Hue 3.5 Apache Pig Rebase to Pig 0.12.0 Rebase to Apache DataFu (incubating) 1.1.0 Back-up and Disaster Recovery (BDR) HDFS Snapshots HBase Snapshots Support for MR2 Global replication page Apache Mahout Rebase on Mahout 0.8.0 In the case of existing clusters, Cloudera fully supports upgrades from Cloudera Manager 4.x and CDH 4.x to Cloudera Enterprise 5. If you were a participant in the beta, we recommend that you start with a new cluster with Cloudera Enterprise 5. If you have a particular need to upgrade a cluster running Cloudera Enterprise 5 Beta or CDH 5 Beta to Cloudera Enterprise 5, customers can contact Cloudera Support for further instructions. If you are not a customer, please ask for assistance on the Cloudera Manager forum.    Please note that Cloudera Manager 5.0 does not support CDH 5.0 Beta 1 or Beta 2.   As always, we are happy to hear your feedback; please send your comments and suggestions through ourcommunity forums. You can also file bugs through our external JIRA system at issues.cloudera.org. ... View more

Dear Cloudera users,  We are pleased to announce the general availability of the Cloudera Connector Powered by Teradata and the Cloudera Connector for Netezza version 1.2. This release has many updates including: For Cloudera Connector Powered by Teradata: Upgraded TDCH to version 1.2.1 Added support for Avro file format Added support for Incremental import Added support for --where argument Added support for Hive import Added support for Importing all tables using import-all-tables Added support for Query Bands Added new import method split.by.amp (supported only on Teradata 14.10 and higher) For Cloudera Connector for Netezza: Added --nz-uploaddir for uploading logs to HDFS directory Added --nz-ctrlchars to enable CTRLCHARS option for the Netezza external table Both connectors are released in editions compatible with CDH 4 and CDH 5. See download page for further details.   Please note that the Cloudera Connector for Teradata is not supported on CDH 5.  You will need to upgrade to the Cloudera Connector powered by Teradata.  For help on moving to the new connector, please see Upgrading to Cloudera Connector Powered by Teradata page.   For more details on new features and usage of Cloudera Connector Powered by Teradata, see: Release Notes Cloudera Connector Powered by Teradata version 1.2 Cloudera Connector Powered by Teradata User Guide, version 1.2 For more details on new features and usage of Cloudera Connector for Netezza, see: Release Notes Cloudera Connector for Netezza version 1.2 Cloudera Connector for Netezza User Guide, version 1.2 As always, we welcome your feedback. Please send your comments and suggestions through our new community forums.  You can also file bugs in the CDH project at issues.cloudera.org. ... View more

We're happy to announce the release of Kite 0.12.0. This release includes a new MapReduce InputFormat and OutputFormat for reading from and writing to Kite Datasets. There are also several Morphlines updates including a new set of examples, and bug fixes and minor improvements. For more details, see the release notes, and the documentation. ... View more

Dear Cloudera Impala and CDH users,     We are pleased to announce the general availability of Cloudera Impala 1.2.4. This maintenance release fixes issues with the Catalog Service as well as a few other bugs, and enables metadata refreshes without full server permissions.   Note that Impala 1.2.4 does not work with Cloudera Manager 4.7 or earlier. If your environment is managed by Cloudera Manager, you should upgrade to Impala 1.2.4 and Cloudera Manager 4.8 together.   For more details on new Impala features, please see “New Features in Impala”.   “Installing and Using Cloudera Impala” guide: http://www.cloudera.com/content/cloudera-content/cloudera-docs/Impala/latest/Installing-and-Using-Impala/Installing-and-Using-Impala.html   As always, we welcome your feedback. Please send your comments and suggestions through our new community forums.  You can also file bugs in the Impala project at issues.cloudera.org.   ... View more

We are pleased to announce the general availability of CDH 4.6, Cloudera Manager 4.8.2 and Cloudera Search 1.2.  Details on each release are below.   CDH 4.6 This is an update to the CDH 4 platform and provides a considerable amount of bug-fixes and stability enhancements. Along with these fixes, we have also included some new features, most notable of which are: Rebase to HBase .94.15 HUE-1664 - URL Redirection Whitelist For more details on new features, see “New Features in CDH 4”.   Refer to the “CDH 4 Quick Start Guide” or the “CDH 4 Installation Guide” for more information on how to install this update release.   As always, we are happy to hear your feedback. Please send your comments and suggestions through our new community forums. You can also file bugs through the Distro project on issues.cloudera.org.     Cloudera Manager 4.8.2 Cloudera Manager 4.8.2 is a maintenance release and has a number of bug-fixes and usability improvements. For more details, see the release notes.   All of the Cloudera Manager documentation can be found here.   You can download this latest Cloudera Manager here or you can upgrade from an existing installation of Cloudera Manager. Installation and upgrade documentation can be found here.   As always, we are happy to hear your feedback. Please send your comments and suggestions through our new community forums.   Cloudera Search 1.2.0 Cloudera Search 1.2.0 is an update to the Cloudera Search product.  This release contains a number of bug fixes and the following features: YARN support for MR indexing (in addition to MR1) Search 1.2.0 requires CDH 4.5.   For more details on new features, please see “New Features in Cloudera Search Version 1.2.0”. Cloudera Search Documentation is here.    As always, we are happy to hear your feedback. Please send your comments and suggestions through our new community forums.  You can also file a bug using the Search component in the Distro project on issues.cloudera.org ... View more

Cloudera has released the Beta 2 version of Cloudera Enterprise 5 (comprises CDH 5.0.0 and Cloudera Manager 5.0.0).  This release (download) contains a number of new features and component versions including the ones below: New Components Apache Spark 0.9 Apache Crunch 0.9 Parquet 1.2.5 Kite SDK  0.10 Apace Avro 1.7.5 Apache Hadoop Rebase to Hadoop 2.2.0+ HDFS HDFS Caching NFS gateway Cloudera Manager Support for Apache Spark Oozie and YARN Resource Manager High Availability Extensibility to support add-on services Enhancements to Monitoring & Charts Apache HBase Rebase to HBase 0.96.1.1 Impala Rebase to Impala 1.2.3 Apache Flume New Kite Dataset Sink Apache Hive Hive 0.12 Rebase Improved JDBC spec coverage SSL encryption support on non-kerberos authentication Native Parquet support Apache Sqoop Rebase to Sqoop 1.99.3 Apache Oozie Support for CRON like scheduling Hue Single Sign On (SSO) support Graphical facets in Search application Result graphing for Hive and Impala Apache Pig Rebase to Pig 0.12.0 Rebase to DataFu 1.1.0 Cloudera strongly recommends that you install Cloudera Enterprise 5.0 Beta 2 and CDH 5 Beta 2 on test clusters or new clusters only. In the case of existing clusters, Cloudera fully supports upgrade from Cloudera Enterprise 4.x and CDH 4.x to Cloudera Enterprise 5.0 Beta 2 and CDH 5 Beta 2. If you have a particular need to upgrade a cluster running Cloudera Enterprise 5.0 Beta 1 or CDH 5 Beta 1 to Beta 2, customers can contact Cloudera Support for further instructions. If you are not a customer, ask for assistance in the Cloudera Manager forum. Please note that Cloudera Manager 5.0 beta 2 does not support CDH 5.0 beta 1. As part of the open Beta, we encourage the community to try it out. Here is how you can get started: Download Cloudera Enterprise from: cloudera.com/downloads install and try it out.  View the documentation: CDH 5 Beta 2 Documentation Cloudera Manager 5 Beta 2 Documentation Impala Beta 2 Documentation Search Beta 2 Documentation  Once you get started, we encourage you to provide feedback using any of the following methods: Ask questions and provide comments on our Beta community forum. Click here to join.  File a bug through our public Jira at: https://issues.cloudera.org/browse/DISTRO https://issues.cloudera.org/browse/CM We look forward to hearing about your experiences of Cloudera Enterprise 5 Beta 2. ... View more

We are pleased to announce the release of Kite 0.11.0. The main new feature in this release is the views API for working with a subset of a dataset using logical constraints such as field matching or ranges. There are also assorted Morphlines updates, and several bug fixes and minor improvements. For more information, see the release notes, and the documentation. ... View more

Dear CDH and Cloudera Manager users,     We are pleased to announce the general availability of Cloudera Manager 4.8.1.   Cloudera Manager 4.8.1 is a maintenance release and has a number of bug-fixes and usability improvements.   For more details, see the release notes: http://www.cloudera.com/content/cloudera-content/cloudera-docs/Cloudera Manager4Ent/latest/Cloudera-Manager-Release-Notes/Cloudera-Manager-Release-Notes.html   All of the Cloudera Manager documentation can be found here: http://www.cloudera.com/content/support/en/documentation/manager/cloudera-manager-v4-latest.html   You can download this latest Cloudera Manager here or you can upgrade from an existing installation of Cloudera Manager.   Installation and upgrade documentation can be found here. ... View more