Dear CDH, Cloudera Manager, and Search Users,   We are pleased to announce the release of CDH 4.7 and Search 1.3.  These are both minor releases that contain multiple bug fixes.   CDH 4.7 Bug fixes in CDH 4.7 include: HBase HBASE-10514  - Forward port HBASE-10466, possible data loss when failed flushes HBASE-10257 - Master aborts due to assignment race HBASE-8912 - AssignmentManager throws IllegalStateException from PENDING_OPEN to OFFLINE HDFS HDFS-6289 - HA failover can fail if there are pending DataNode messages for DataNodes which no longer exist HDFS-5944 - LeaseManager:findLeaseWithPrefixPath can't handle path like /a/b/ right and cause SecondaryNameNode failed do checkpoint HDFS-6191 - Disable quota checks when replaying edit log HDFS-4943 - WebHdfsFileSystem does not work when original file path has encoded chars HDFS-5064 - Standby checkpoints should not block concurrent readers HDFS-6160 - TestSafeMode occasionally fails HDFS-5496 - Make replication queue initialization asynchronous HDFS-5438  - Flaws in block report processing can cause data loss HDFS-5255  - Distcp job fails with hsftp when https is enabled in insecure cluster HDFS-5074 - Allow starting up from an fsimage checkpoint in the middle of a segment HDFS-4879  - Add "blocked ArrayList" collection to avoid CMS full GCs Hadoop HADOOP-9454 - Support multipart uploads for s3native MapReduce MAPREDUCE-5877 - Inconsistency between JobTracker/TaskTracker for tasks taking a long time to launch Hue HUE-1962 - Support int row key from Hive table HUE-2060 - LDAP import commands carry incorrect import statements HUE-1992 - Username to lowercase switch for RemoteUserDjangoBackend HUE-1873  - Result data not HTML encoded HUE-1897 -  workflow IDs have double trailing slashes Hive HIVE-6005 - BETWEEN is broken after using KRYO HIVE-4222 - Timestamp type constants cannot be deserialized in JDK 1.6 or earlier HIVE-5380 - Non-default OI constructors should be supported for backwards compatibility HIVE-5263 - Query Plan cloning time could be improved by using Kryo Oozie OOZIE-1699  - Some of the commands submitted to Oozie internal queue are never executed Flume FLUME-2357 - HDFS sink should retry closing files that previously had close errors   For more details on new features, see the release notes: http://www.cloudera.com/content/cloudera-content/cloudera-docs/CDH4/latest/CDH4-Release-Notes/CDH4-Release-Notes.html Refer to the “CDH4 Quick Start Guide” or the “CDH4 Installation Guide” for more information on how to install this update release. CDH4 Quick Start Guide: http://www.cloudera.com/content/cloudera-content/cloudera-docs/CDH4/latest/CDH4-Quick-Start/CDH4-Quick-Start.html CDH4 Installation Guide: http://www.cloudera.com/content/cloudera-content/cloudera-docs/CDH4/latest/CDH4-Installation-Guide/CDH4-Installation-Guide.html As always, we welcome your feedback. Please send your comments and suggestions to cdh-user@cloudera.org or through our community forums.  You can also file bugs through the Distro project on issues.cloudera.org.       Search 1.3 Cloudera Search 1.3.0 is an update to the Cloudera Search product.  This release contains several bug fixes.  Note that Search 1.3.0 requires CDH4.7. For more details on new features, see “New Features in Cloudera Search Version 1.3.0”:  http://www.cloudera.com/content/cloudera-content/cloudera-docs/Search/latest/Cloudera-Search-Release-Notes/Cloudera-Search-Release-Notes.html For access to the Cloudera Search Documentation:  http://www.cloudera.com/content/support/en/documentation/cloudera-search/cloudera-search-documentation-v1-latest.html     As always, we welcome your feedback. Please send your comments and suggestions to search-user@cloudera.org or through our new community forums.  You can also file a bug using the Search component in the Distro project on issues.cloudera.org ... View more

Dear CDH, Cloudera Manager, and Cloudera Impala users,   We are pleased to announce the release of Cloudera Enterprise 5.0.1 (CDH 5.0.1 and Cloudera Manager 5.0.1) and Cloudera Manager 4.8.3.   Cloudera Enterprise 5.0.1 This release is focused on fixing key bugs and includes the following:   Component updates Impala 1.3.1 Cloudera Manager HDFS NFS gateway does not work on all Cloudera-supported platforms Replace YARN_HOME with HADOOP_YARN_HOME during upgrade Insufficient password hashing in Cloudera Manager Upgrade to Cloudera Manager 5.0.0 from SLES older than Service Pack 3 with PostgreSQL older than 8.4 fails MR1 to MR2 import fails on a secure cluster After upgrade from CDH 4 to CDH 5, Oozie is missing workflow extension schemas CDH Fixes SOLR-5608 - Frequently reproducible failures in CollectionsAPIDistributedZkTest#testDistribSearch HIVE-6648 - Fixed permission inheritance for multi-partitioned tables HIVE-6740 - Fixed addition of Avro jars to the classpath HIVE-6575 - select * fails on parquet table with map datatype OOZIE-1794 - java-opts and java-opt in the Java action don't always work properly in YARN HADOOP-10456 - Bug in Configuration.java exposed by Spark (ConcurrentModificationException) HUE-2061 - Task logs are not retrieved if containers not on the same host HADOOP-10442 - Group look-up can cause segmentation fault when certain JNI-based mapping module is used. HDFS-5064 - Standby checkpoints should not block concurrent readers HDFS-6094 - The same block can be counted twice towards safe mode threshold HDFS-6231 - DFSClient hangs infinitely if using hedged reads and all eligible datanodes die   We look forward to you trying it out using the information below: Download Cloudera Enterprise from: cloudera.com/downloads View the documentation: CDH5 Release Notes CDH 5 Documentation Cloudera Manager Release Notes Cloudera Manager 5 Documentation   As always, we are happy to hear your feedback. Please send your comments and suggestions to the user group or through our community forums.  You can also file bugs through our external jira projects on issues.cloudera.org.     Cloudera Manager 4.8.3 Cloudera Manager 4.8.3 is a maintenance release and has a number of bug-fixes and usability improvements.   For more details, see the release notes: http://www.cloudera.com/content/cloudera-content/cloudera-docs/Cloudera Manager4Ent/latest/Cloudera-Manager-Release-Notes/Cloudera-Manager-Release-Notes.html   All of the Cloudera Manager documentation can be found here: http://www.cloudera.com/content/support/en/documentation/manager/cloudera-manager-v4-latest.html   You can download this latest Cloudera Manager here or you can upgrade from an existing installation of Cloudera Manager. Installation and upgrade documentation can be found here.   As always, we are happy to hear your feedback. Please send your comments and suggestions to scm-user@cloudera.org or through our new community forums. ... View more

Dear CDH, Cloudera Manager, and Cloudera Impala users, We are pleased to announce the general availability of Cloudera Impala 1.3.1 for use with CDH 4.   Impala 1.3.1 contains stability enhancements and the following new features: Improved memory usage under contention including higher concurrency, high numbers of Parquet columns, or low memory limits Additional SQL built-in functions Note that Impala 1.3.1 does not work with Cloudera Manager 4.7 or earlier. If your environment is managed by Cloudera Manager 4.7 or before, you should upgrade to Impala 1.3.1 and Cloudera Manager 4.8 together. For more details on new Impala features, please see “New Features in Impala”: http://www.cloudera.com/content/cloudera-content/cloudera-docs/Impala/latest/Cloudera-Impala-Release-Notes/cirn_new_features.html “Installing and Using Cloudera Impala” guide: http://www.cloudera.com/content/cloudera-content/cloudera-docs/Impala/latest/Installing-and-Using-Impala/Installing-and-Using-Impala.html As always, we are happy to hear your feedback. Please send your comments and suggestions to impala-user@cloudera.org or through our new community forums.  You can also file bugs in the Impala project at issues.cloudera.org   ... View more

We are thrilled to announce the GA release of Cloudera Enterprise 5 (comprising CDH 5.0 and Cloudera Manager 5.0).    When it became generally available 18 months ago, Cloudera Enterprise 4 was widely recognized to be more flexible, more scalable, and less expensive than traditional data management platforms; with Cloudera Enterprise 5, we can also say it is faster (HDFS caching FTW!), more functional (includes new components such as Apache Spark and Parquet), and better integrated (for example, Cloudera Impala and Cloudera Search are now both inside CDH). Furthermore, in an impressive demonstration of ecosystem growth, 100 Cloudera partners invested technical resources to certify on Cloudera Enterprise 5 before its release.   Cloudera Enterprise contains many new components and features, with the major ones listed below. (See CDH 5 Release Notes and Cloudera Manager 5 Release Notes for full details.) Thanks to everyone who participated in the beta process to help make this release as good as it could be!   New components Apache Spark 0.9.0 Apache Crunch 0.9.0 Parquet 1.2.5 Kite SDK 0.10.0 Apache Avro 1.7.5 Apache Hadoop Rebase on Hadoop 2.3.0+ HDFS HDFS Caching NFS gateway YARN & MapReduce MR2 is production ready MR2 Management by Cloudera Manager MR1 and MR2 are both supported Resource Management/YARN HA support for Resource Manager Cloudera Manager Platform support for CDH 5 Resource management and scheduler configuration Extensibility support for third party applications Advanced Impala monitoring Support for Spark Enhancements to monitoring and charts Single sign-on support Apache HBase Rebase on HBase 0.96.1.1 Significant reductions to Mean time to Recovery (MTTR) Impala Rebase on Impala 1.3 Language extensibility with native UDFs and UDAF, plus support for existing Hive UDFs Automatic and coordinated metadata refresh Concurrency controls via admission controls Beta of YARN-integrated resource management Apache Flume New Kite Dataset Sink Apache Hive Rebase on Apache Hive 0.12.0 Improved JDBC spec coverage SSL encryption support on non-kerberos authentication Native Parquet support Search Support for CDH 5 Apache Sqoop Rebase to Sqoop 1.99.3 Apache Oozie Support for CRON-like scheduling Oozie HA Rebase on Oozie 4.0 Hue Single sign-on support Graphical facets in Search application SQL editors re-vamp: richer GUI for Impala and Hive, result graphing, and more Apache ZooKeeper application Hue 3.5 Apache Pig Rebase to Pig 0.12.0 Rebase to Apache DataFu (incubating) 1.1.0 Back-up and Disaster Recovery (BDR) HDFS Snapshots HBase Snapshots Support for MR2 Global replication page Apache Mahout Rebase on Mahout 0.8.0 In the case of existing clusters, Cloudera fully supports upgrades from Cloudera Manager 4.x and CDH 4.x to Cloudera Enterprise 5. If you were a participant in the beta, we recommend that you start with a new cluster with Cloudera Enterprise 5. If you have a particular need to upgrade a cluster running Cloudera Enterprise 5 Beta or CDH 5 Beta to Cloudera Enterprise 5, customers can contact Cloudera Support for further instructions. If you are not a customer, please ask for assistance on the Cloudera Manager forum.    Please note that Cloudera Manager 5.0 does not support CDH 5.0 Beta 1 or Beta 2.   As always, we are happy to hear your feedback; please send your comments and suggestions through ourcommunity forums. You can also file bugs through our external JIRA system at issues.cloudera.org. ... View more

Dear Cloudera users,  We are pleased to announce the general availability of the Cloudera Connector Powered by Teradata and the Cloudera Connector for Netezza version 1.2. This release has many updates including: For Cloudera Connector Powered by Teradata: Upgraded TDCH to version 1.2.1 Added support for Avro file format Added support for Incremental import Added support for --where argument Added support for Hive import Added support for Importing all tables using import-all-tables Added support for Query Bands Added new import method split.by.amp (supported only on Teradata 14.10 and higher) For Cloudera Connector for Netezza: Added --nz-uploaddir for uploading logs to HDFS directory Added --nz-ctrlchars to enable CTRLCHARS option for the Netezza external table Both connectors are released in editions compatible with CDH 4 and CDH 5. See download page for further details.   Please note that the Cloudera Connector for Teradata is not supported on CDH 5.  You will need to upgrade to the Cloudera Connector powered by Teradata.  For help on moving to the new connector, please see Upgrading to Cloudera Connector Powered by Teradata page.   For more details on new features and usage of Cloudera Connector Powered by Teradata, see: Release Notes Cloudera Connector Powered by Teradata version 1.2 Cloudera Connector Powered by Teradata User Guide, version 1.2 For more details on new features and usage of Cloudera Connector for Netezza, see: Release Notes Cloudera Connector for Netezza version 1.2 Cloudera Connector for Netezza User Guide, version 1.2 As always, we welcome your feedback. Please send your comments and suggestions through our new community forums.  You can also file bugs in the CDH project at issues.cloudera.org. ... View more

We're happy to announce the release of Kite 0.12.0. This release includes a new MapReduce InputFormat and OutputFormat for reading from and writing to Kite Datasets. There are also several Morphlines updates including a new set of examples, and bug fixes and minor improvements. For more details, see the release notes, and the documentation. ... View more