Cloudera is pleased to announce the immediate availability of its first release of Apache Spark for Cloudera Enterprise (comprising CDH and Cloudera Manager).   Spark was created and contributed to the Apache Software Foundation by UC Berkeley, and it has quickly gained adoption for machine learning, interactive analytics, and streaming analytics over large datasets. It features a general programming model for writing applications by composing arbitrary operators, such as mappers, reducers, joins, group-bys, and filters. Spark keeps track of the data that each of the operators produces, enabling applications to reliably store this data in memory, which makes it ideal for low-latency computations and efficient iterative algorithms. Spark applications can be up to 100x faster and require writing 2x to 10x less code than equivalent MapReduce applications.    Cloudera provides enterprise support for Spark through Cloudera Enterprise Flex Edition (as an optional component) and Data Hub Edition (as an included component) subscriptions. This release provides Spark 0.9.0 tested for use with Spark Standalone Mode on CDH 4, from 4.4.0 forward. Expect releases for Cloudera Enterprise 5 (comprising CDH 5 and Cloudera Manager 5) and Spark on YARN in the near future.   To get started now, you can follow these instructions to install Spark using parcels with Cloudera Manager. The instructions will also walk you through the basic configuration, and a simple WordCount example on Spark.   Once you get going, we would love to hear your feedback:   You can ask questions, get help, and share your growing expertise on our community forum for questions about Spark. You can file a bug through our public Jira instances. For issues with Spark please use https://issues.cloudera.org/browse/DISTRO. For issues with the beta integration with Cloudera Manager, please usehttps://issues.cloudera.org/browse/CM. ... View more

Dear Cloudera Impala users,   We would like to announce the general availability of Cloudera Impala 1.2.3. This release fixes a bug where Impala couldn’t read Parquet files written by MapReduce.   Note that Impala 1.2.3 does not work with Cloudera Manager 4.7 or earlier. If your environment is managed by Cloudera Manager, you should upgrade to Impala 1.2.3 and Cloudera Manager 4.8 together.   For more details on new Impala features, please see “New Features in Impala”: http://www.cloudera.com/content/cloudera-content/cloudera-docs/Impala/latest/Cloudera-Impala-Release-Notes/cirn_new_features.html   “Installing and Using Cloudera Impala” guide: http://www.cloudera.com/content/cloudera-content/cloudera-docs/Impala/latest/Installing-and-Using-Impala/Installing-and-Using-Impala.html   As always, we are happy to hear your feedback. Please send your comments and suggestions to impalala-user@cloudera.org or through our new community forums.  You can also file bugs in the Impala project at issues.cloudera.org     ... View more

Dear CDH, Cloudera Manager, and Cloudera Impala users,   We are pleased to announce the general availability of Cloudera Impala 1.2.2 and version 2.5.13 of the Cloudera ODBC Driver for Cloudera Impala.      Impala 1.2.2 provides key enhancements including a number of the most requested features: Cost-based join order optimizations Compute statistics for tables and columns directly from Impala Cross join Preliminary support for clients to securely and more easily authenticate with their username and password via LDAP or Active Directory Cloudera ODBC Driver for Impala version 2.5.13 includes: Ability to authenticate with a username and password Ability to secure client traffic via encrypted SSL Ability for multi-tiered applications to proxy via delegation IDs Note that Impala 1.2.2 does not work with Cloudera Manager 4.7 or earlier. If your environment is managed by Cloudera Manager, you should upgrade to Impala 1.2.2 and Cloudera Manager 4.8 together.   For more details on new Impala features, please see “New Features in Impala”: http://www.cloudera.com/content/cloudera-content/cloudera-docs/Impala/latest/Cloudera-Impala-Release-Notes/cirn_new_features.html   “Installing and Using Cloudera Impala” guide: http://www.cloudera.com/content/cloudera-content/cloudera-docs/Impala/latest/Installing-and-Using-Impala/Installing-and-Using-Impala.html   As always, we are happy to hear your feedback. Please send your comments and suggestions to impala-user@cloudera.org or through our new community forums .  You can also file bugs in the Impala project at issues.cloudera.org.  ... View more

We are pleased to announce a new name for the CDK: Kite. We've just released Kite version 0.10.0, which is purely a rename of CDK 0.9.0. The new repository and documentation are: Kite repository: https://github.com/kite-sdk/kite Kite documentation: http://kitesdk.org/ Kite examples: https://github.com/kite-sdk/kite-examples Why rename? The goal of Kite, and CDK, is to increase the accessibility of the platform. That isn't Cloudera-specific, and we want the name to correctly represent the project as an open, community-driven set of tools. What will this break? The rename mainly affects dependencies and package names. Once imports and dependencies are updated, almost everything should work the same. However, there are a couple of configuration changes to make for anyone using flume or morphlines. The changes are detailed on our migration page. Again, this 0.10.0 release is a rename only. There are no feature changes, and 0.9.0 will be supported as long as 0.10.0, so that there is plenty of time to make a smooth transition. For more information, see the release notes.   Cheers,   The Kite/CDK team ... View more

We are pleased to announce version 0.9.0 of the Cloudera Development Kit. The major highlights of 0.9.0 include a new experimental API for working with random access datasets stored in HBase, Crunch Parquet integration, improved support for existing datasets (including those in CSV format), and several new Morphlines commands. Further details are available in the release notes. To get started with the CDK please consult the documentation, source, and the examples. ... View more

Hello CDH Users,   We are pleased to announce the release of version 2.5.5 of the Cloudera ODBC Driver for Apache Hive.  This version adds: Ability for clients to securely and more easily authenticate with their username and password Ability to secure client traffic via encrypted SSL Ability for multi-tiered applications to proxy via delegation IDs These drivers work for previous versions of HiveServer2 in CDH 4.1 or higher but the new functionality above is only available in CDH 4.5.   Getting started with the Cloudera ODBC Drivers: Read the the Hive installation guide Download the connector from the Cloudera Components and Connectors page As always, we are happy to hear your feedback. Please send your comments and suggestions to cdh-user@cloudera.org or post to our new Community Forums.   Kind regards, The Cloudera Team ... View more

Dear CDH, Cloudera Manager, Cloudera Impala, and Cloudera Search users,   We are pleased to announce the general availability of CDH 4.5, Cloudera Manager 4.8, Cloudera Impala 1.2.1, and Cloudera Search 1.1. Details on each release are below. Please note that if you use Impala and plan to upgrade to either Cloudera Manager 4.8 or Impala 1.2.1, you should plan on upgrading to both versions together as they have a mutual dependency.   CDH 4.5 This is an update to the CDH 4 platform and provides a considerable amount of bug-fixes and stability enhancements. Along with these fixes, we have also included some new features, most notable of which are: Hive - ability for clients to securely and more easily authenticate with their username and password Hive - improved security for the metastore with metastore authentication Hue - secure fine-grained, Sentry authorization for end-users of Hue with Impala Parquet 1.x integrated into CDH 4.5 and ready for use across MapReduce, Pig, Impala, Hive For more details on new features, see New Features in CDH 4. Refer to the CDH 4 Quick Start Guide or the CDH 4 Installation Guide for more information on how to install this update release.   As always, we are happy to hear your feedback. Please send your comments and suggestions to cdh-user@cloudera.org or through our new community forums. You can also file bugs through the Distro project on issues.cloudera.org.   Cloudera Manager 4.8 Cloudera Manager 4.8 is an update to Cloudera Manager 4 and has a number of bug-fixes and usability improvements. In addition to that, we have also introduced some new features, such as: SSO/SAML Support Support for Impala 1.2.1 and Search 1.1 Support for Impala Catalog Server Note that Cloudera Manager 4.8 only supports Impala 1.2.1 or later. If you plan to upgrade Cloudera Manager to 4.8, you should also upgrade Impala to 1.2.1.   For more details, see the release notes. All of the Cloudera Manager documentation can be found here.   You can download this latest Cloudera Manager here or you can upgrade from an existing installation of Cloudera Manager. Installation and upgrade documentation can be found here.   As always, we are happy to hear your feedback. Please send your comments and suggestions to scm-user@cloudera.org or through our community forums. Cloudera Impala 1.2.1 Cloudera Impala 1.2.1 provides significant enhancements including a number of the most requested features: UDFs and UDAFs for extensibility Automatic metadata refresh for Impala created metadata and centralized refresh for external data Secure fine-grained, Sentry authorization for end-users of Hue with Impala Additional SQL support (Create table as select, table properties) Note that Impala 1.2.1 does not work with Cloudera Manager 4.7 or earlier. If your environment is managed by Cloudera Manager, you should upgrade to Impala 1.2.1 and Cloudera Manager 4.8 together.   For more details on new features, please see New Features in Impala. See the Installing and Using Cloudera Impala guide here.   As always, we are happy to hear your feedback. Please send your comments and suggestions to impala-user@cloudera.org or through our community forums. You can also file bugs on in the Impala project at issues.cloudera.org. Cloudera Search 1.1.0 Cloudera Search 1.1.0 is the first release following the GA release in September 2013. This release adds major security enhancements, bugs fixes, and features such as: Index level authorization via Apache (incubating) Sentry HBase batch indexer tool Support for authenticated access to the Lily HBase Indexer Search 1.1.0 requires CDH4.5 For more details on new features, please see New Features in Cloudera Search Version 1.1.0. For access to the Cloudera Search Documentation, click here. As always, we are happy to hear your feedback. Please send your comments and suggestions to search-user@cloudera.org or through our community forums. You can also file a bug using the Search component in the Distro project on issues.cloudera.org. ... View more

We are pleased to announce the beta release of Cloudera Enterprise 5 (CDH 5 and Cloudera Manager 5).  This release has both Impala and Search integrated into CDH. It also includes many new features and updated component versions including the ones below: Hadoop Rebase on Hadoop 2.2 GA HDFS HDFS Snapshots HDFS Caching Preview MR MR2 is production ready MR2 Management by Cloudera Manager MR1 and MR2 are both supported Resource Management/YARN Ability to run MR and Impala with resource sharing Resource Management High Availability Cloudera Manager Platform coverage/support for CDH 5 Resource/Workload management Extensibility support for Partner applications Advanced Impala monitoring HBase Significant reductions to Mean time to Recovery (MTTR) Rebase on HBase 0.95.2+ Impala Language extensibility with native UDFs and UDAF plus support for existing Hive UDFs Automatic and coordinated metadata refresh Preview of YARN-integrated resource management Support for HDFS caching Hive Rebase to Hive 0.11 plus most of Hive 0.12 Hive Support for MR2 Search Support for CDH5 (MR1, MR2, HBase 0.95.2) Back-up and Disaster Recovery (BDR) HDFS Snapshots HBase Snapshots Support for MR2 Global replication page Oozie Oozie HA Rebase on Oozie 4.0 Hue Sqoop App Zookeeper App Hue 3.0 Mahout Rebase on 0.8 As part of the open beta, we encourage the community to try it out. Here is how you can get started: Download Cloudera Enterprise from: cloudera.com/downloads install and try it out.  View the documentation: CDH 5 Beta 1 Documentation Cloudera Manager 5 Beta 1 Documentation Once you get started, we encourage you to provide feedback. We have the following mechanisms set up to do this: A beta specific community forum has been set up. Click here to join. Please use this to ask questions and provide feedback. File a bug through our public Jira.  You can reach it at: https://issues.cloudera.org/browse/DISTRO https://issues.cloudera.org/browse/CM We look forward to hearing about your experiences of Cloudera Enterprise 5 beta. ... View more