Dear CDH, Cloudera Manager, Impala, and Cloudera Navigator users,   This release fixes an issue that caused upgrades to CDH 5.4.1 to potentially fail.     We look forward to you trying it out, using the information below: Download Cloudera Enterprise from: http://www.cloudera.com/ content/support/en/downloads. html   View the documentation: CDH 5 Release Notes Cloudera Manager Release Notes Cloudera Navigator Release Notes   As always, we are happy to hear your feedback. Please send your comments and suggestions to the user group or through our community forums.  You can also file bugs through our external JIRA projects on issues.cloudera.org. ... View more

We are pleased to announce the release of Cloudera Director 1.1.3. Cloudera Director is a simple, reliable, enterprise-grade way to deploy, scale, and manage Hadoop in the cloud, initially for Amazon Web Services (AWS). It is free to download and use, and supported for Cloudera Enterprise customers. This release fixes key bugs and includes the following: Uses lazy_itable_init when preparing ephemeral drives to speed up instance preparation.  This is useful for instances that have many large ephemeral drives, such as AWS D2 instances. Adds support for GUID Partition Table (GPT) root disk partitions. Allows custom AWS Identity and Access Management (IAM) endpoints. Changes the default Cloudera Manager and CDH versions to 5.3.3 instead of the latest version to ensure that compatible Cloudera Manager and CDH versions are used over the lifetime of Cloudera Manager. Corrects a typo for the d2.4xlarge instance type in virtualizationmappings. properties. No longer inadvertently upgrades Cloudera Manager packages that have been preinstalled on AMIs. Ensures that time is accurately synchronized by Network Time Protocol (NTP) prior to bootstrapping.  This improves cluster reliability and consistency. We look forward to you trying it out, using the information below: Download Director from: http://www.cloudera.com/ content/support/en/downloads. html View the documentation: Cloudera Director Release Notes Getting Started Installing Cloudera Director Client Installing Cloudera Director Server   As always, we are happy to hear your feedback. Please send your comments and suggestions to the user group or through our community forums. ... View more

Dear CDH, Cloudera Manager, Impala, and Cloudera Navigator users,   We are pleased to announce the release of Cloudera Enterprise 5.4.1 (CDH 5.4.1, Cloudera Manager 5.4.1, and Cloudera Navigator 2.3.1).     Cloudera Enterprise 5.4.1 This release fixes key bugs and includes the following. CDH Optimization to avoid opening too many file descriptors during encryption DistCp fix to handle copying to root directory HDFS fixes for: Edit log corruption when append fails with a quota violation. Rolling upgrade restoring blocks from trash multiple times, which could cause. significant and unnecessary block churn. NameNode failover during high availability (HA) upgrade, which can cause the DataNode to finalize the upgrade. Null pointer exception (NPE) when NameNode transitions to active during startup. Incorrectly allowing HA NameNode to start in secure mode with HTTP wildcard address configured. Handling cache checks when encryption is enabled. YARN fixes for handling a race condition in the localizer, headroom calculation in the fair scheduler, and delegation token handling with DistCp. MapReduce fixes to handle heap sizes greater than 2 GB when expressed in bytes, MR2 regression from MR1 for running local jobs with -libjars command options, and hung jobs in certain scenarios. Minor HBase user interface and usability improvements, scanner improvements when not all values are returned, improved resource utilization in scanners, fixes to handle a broken truncate_preserve command in HBase shell, and deletion of HFiles used by a table cloned from a snapshot when that snapshot is deleted. Fixes for HiveServer2 memory leaks, column access for Parquet files, delegation token handling errors, and Hive on Spark bugs in Hive. Hue fixes for handling the correct number of rows with Hive queries returning data not encoded properly, errors during Oozie fork creation in the workflow editor, and Impala explain button. Fixes to handle crashes and errors with analytical functions, crashes due to missing newline at the end of the file and aggregate functions with empty select-project-join would crash Oozie automatically sets configurations so that Spark jobs are shown in the Spark History Server. Fixes for a memory leak with HiveServer2 integration, performance improvement in metastore plugin cache initialization, and other bug fixes in Sentry. Several bug fixes in Solr. Fixes in Spark to make Python support more usable with YARN, and to handle thread leaks and synchronization issues. Valid Avro column name generation and other bug fixes in Sqoop. Fix to handle crashes due to malformed packets and improved client-side logging in ZooKeeper For full list of upstream JIRAs fixed in CDH 5.4.1, see the Known issues fixed section of the Release Notes. Cloudera Manager Oozie HA plugin is now configured by Cloudera Manager. Enabling wildcarding in a secure environment no longer causes the NameNode to fail to start. Support for adding Hue with HA. Clicking the "Revert to default" icon stores the default value as a user-defined value in the new configuration pages. Logging of command unavailable messages is improved. Various HDFS role migration improvements. HDFS/Hive replication no longer fails when replicating to a target cluster that runs CDH 4 and has Kerberos enabled. Cloudera Navigator fixes for the following issues: Link disappears when expanded. Operations on canary files should be filtered out. Hive views have same icon as Hive fields in lineage. Facet count should show (0) instead of (-) when there are no matching entities. Column lineage does not display. Kite dataset extraction fails when HDFS HA is enabled. Sentry auditing does not work if the Python version is lower than 2.5. We look forward to you trying it out, using the information below: Download Cloudera Enterprise from: http://www.cloudera.com/ content/support/en/downloads. html View the documentation: CDH 5 Release Notes Cloudera Manager Release Notes Cloudera Navigator Release Notes As always, we are happy to hear your feedback. Please send your comments and suggestions to the user group or through our community forums. You can also file bugs through our external JIRA projects on issues.cloudera.org. ... View more

Hi CDH, Cloudera Manager, and Cloudera Navigator users,   We’re pleased to announce the release of Cloudera Enterprise 5.4 (comprising CDH 5.4, Cloudera Manager 5.4, and Cloudera Navigator 2.3). Cloudera Enterprise 5.4 (Release Notes) reflects critical investments in a production-ready customer experience through  governance, security, performance and deployment flexibility in cloud environments. It also includes support for a significant number of updated open standard components–including Apache Spark 1.3, Impala 2.2, and  Apache HBase 1.0 (as well as unsupported beta releases of Hive-on-Spark data processing and OpenStack deployments). Recently Cloudera made the upgrade process considerably easier via an improved CDH upgrade wizard; see details about that wizard here and best practices here. (Note: Due to metadata format changes in Apache Hadoop 2.6, upgrading to CDH 5.4 and later from any earlier release requires an HDFS metadata upgrade, as well. Note also that for parcel-based installs of CDH 5.4, Cloudera Manager 5.4 is required.) Here are some of the highlights (incomplete; see the respective Release Notes for CDH, Cloudera Manager, andCloudera Navigator for full lists of features and fixes): Security SSL and Kerberos support in Apache Flume for the Thrift source and sink. SSL support across Cloudera Search (Solr and all integrations with CDH). Cluster-wide redaction of sensitive data in logs is now possible. HBase impersonation in Hue allows your client to authenticate to HBase as any user, and to re-authenticate at any time. Solr metadata stored in ZooKeeper can now be protected by ZooKeeper ACLs. Kerberos is now supported for Apache Sqoop2. Performance Includes beta release of Hive-on-Spark as an option for improved Hive data processing performance (unsupported). MultiWAL support for HBase RegionServers allows you to increase throughput when a region writes to the write-ahead log (WAL). You can now store medium-sized objects (MOBs) up to 10MB in size directly in HBase while maintaining read and write performance. A new Kafka connector for Spark Streaming avoids the need for the HDFS WAL. Hue pages render much faster. Data Management and Governance Expanded coverage in Cloudera Navigator Impala (CDH 5.4 and higher) lineage Cloudera Search (CDH 5.4 and higher) auditing Auditing of Navigator activity, such as audit views, metadata searches, and policy editing Avro and Parquet schema inference Platform enhancements Redesigned metadata search provides autocomplete, faster filtering, and saved searches SAML for single sign-on Cloud Deployments OpenStack deployments are now possible as an unsupported beta. HBase support on Microsoft Azure. Real-Time Architecture Cloudera Distribution of Apache Kafka 1.3 installs by default and is supported for production use. Spark Streaming now has a receiver-less “direct” connector for Kafka. New or Updated Open Source Components Apache Hadoop 2.6 Apache HBase 1.0 Apache Hive 1.1 Apache Oozie 4.1 Apache Solr 4.10.3 Apache Spark 1.3 Cloudera Distribution of Apache Kafka 1.3 Hue 3.7 Impala 2.2 Kite SDK 1.0 New/Updated OS & Java Support RHEL 6.6/CentOS 6.6/OEL 6.6 (UEK3) JDK8u40, JDK7u75 Over the next few weeks, we’ll publish blog posts that cover some of these features in detail. In the meantime: Download Cloudera Enterprise 5.4 Explore documentation As always, we value your feedback; please provide any comments and suggestions through our community forums. You can also file bugs via issues.cloudera.org. ... View more

Dear Cloudera Users,   We are pleased to announce the general availability of the Cloudera Connector Powered by Teradata 1.4. This release has many updates, including: Added support for JDK 8 (CDH 5 only). Added the --error-database option. Added the ability to specify format of Date, Time and Timestamp types when importing into CSV. Import method split.by.amp now supports views. Upgraded Teradata connector for Hadoop to version 1.3.4. The Connector is released in editions compatible with CDH 4 and CDH 5. See the download page for more details. For more details on new features and usage of Cloudera Connector Powered by Teradata, see: Release Notes Cloudera Connector Powered by Teradata version 1.4 Cloudera Connector Powered by Teradata User Guide, version 1.4 As always, we welcome your feedback. Please send your comments and suggestions through our new community forums.  You can also file bugs in the CDH project at issues.cloudera.org. ... View more

Dear CDH, Cloudera Manager, Impala, and Cloudera Navigator users,   We are pleased to announce the release of Cloudera Enterprise 5.1.5 (CDH 5.1.5, Cloudera Manager 5.1.5, and Cloudera Navigator 2.0.5) and Cloudera Enterprise 5.2.5 (CDH 5.2.5, Cloudera Manager 5.2.5, and Cloudera Navigator 2.1.5).   Cloudera Enterprise 5.1.5 This release fixes key bugs and includes the following. CDH Replacing DataNode disks or manually changing the Storage IDs of volumes in a cluster may result in data loss. Fixed as part of HDFS-7575, HDFS-7596, HDFS-7960 and HDFS-7208. Fixes to the dfsadmin command-line option and the inclusion of a command to manually trigger full block reports from a DataNode. Improved recovery speed after service or host failure, and fixes to handle race conditions with HDFS integration in Search. Bug fixes in YARN for handling display of clock skew, consistent time zone on the web UI, and ResourceManager high availability. Fix to address LDAP authentication, integration of Hive with HBase through Oozie, and other bug fixes in Hive. Bug fixes in Hue and Parquet. Fixes in Impala to address memory leaks with secure transport, performance improvements in the Python SASL client, and other issues with SASL transport. For full list of upstream JIRAs fixed in CDH 5.1.5, please see the Known issues fixed section of the Release Notes. Cloudera Manager Starting new ZooKeeper servers shortly after adding them no longer causes ZooKeeper data loss when the number of new servers exceeds the number of old servers. Cloudera Navigator Fixed memory leak in Navigator Audit Server due to an error during batch operations.  Cloudera Enterprise 5.2.5 This release fixes key bugs and includes the following. CDH Replacing DataNode disks or mManually changing the Storage IDs of volumes in a cluster may result in data loss. Fixed as part of HDFS-7575, HDFS-7596, HDFS-7960 and HDFS-7208. Bug fixes in YARN for handling display of clock skew and consistent time zone on the web UI. Performance improvements, fixes to handle race conditions, hanging jobs and other issues in MapReduce. Index corruption during replication and other fixes in Search. Bug fixes in Hive, Hue, Sentry and Sqoop. A compatibility mode for handling timestamps generated by Hive in Parquet, fixes to handle memory leaks amongst other fixes in Impala. For full list of upstream JIRAs fixed in CDH 5.2.5, please see the Known issues fixed section of the Release Notes. Cloudera Manager Starting new ZooKeeper servers shortly after adding them no longer causes ZooKeeper data loss when the number of new servers exceeds the number of old servers. Permissions set incorrectly on YARN Keytab files Cloudera Navigator Navigator Audit Server reports invalid null characters in HBase audit events when using the PostgreSQL database We look forward to you trying it out, using the information below: Download Cloudera Enterprise from: http://www.cloudera.com/ content/support/en/downloads. html View the documentation: CDH 5 Release Notes Cloudera Manager Release Notes Cloudera Navigator Release Notes   As always, we are happy to hear your feedback. Please send your comments and suggestions to the user group or through our community forums.  You can also file bugs through our external JIRA projects on issues.cloudera.org. ... View more

We are pleased to announce the release of Cloudera Director 1.1.2.   Cloudera Director is a simple, reliable, enterprise-grade way to deploy, scale, and manage Hadoop in the cloud (initially for AWS). It’s free to download and use, and supported by default for Cloudera Enterprise customers. This release is focused on key bugs fixes including: Added support for d2 and c4 AWS instance types Restored the ability to modify a cluster that had an empty initial list of parcel repositories and was created with Director 1.0 Fixed parcel version validation when using an HTTP proxy We look forward to you trying it out, using the information below: Download Director from: http://www.cloudera.com/ content/support/en/downloads. html View the documentation: Cloudera Director Release Notes Getting Started Installing Cloudera Director Client Installing Cloudera Director Server As always, we are happy to hear your feedback. Please send your comments and suggestions to the user group or through our community forums. ... View more

Dear CDH, Cloudera Manager, and Impala users,   We are pleased to announce the release of Cloudera Enterprise 5.0.6 (CDH 5.0.6 and Cloudera Manager 5.0.6)   This release fixes key bugs and includes the following. CDH Replacing DataNode disks or manually changing the Storage IDs of volumes in a cluster may result in data loss. Fixed as part of HDFS-7575, HDFS-7596, HDFS-7960 and HDFS-7208. Improved recovery speed after service or host failure, and fixes to handle race conditions with HDFS integration in Search. Bug fixes in YARN for handling display of clock skew and consistent time zone on the web UI. Bug fixes in Hive, including integration of Impala with HBase through Oozie. For full list of upstream JIRAs fixed in CDH 5.0.6, please see the Known issues fixed section of the Release Notes. Cloudera Manager Starting new ZooKeeper servers shortly after adding them no longer causes ZooKeeper data loss when the number of new servers exceeds the number of old servers. We look forward to you trying it out, using the information below: Download Cloudera Enterprise from: http://www.cloudera.com/ content/support/en/downloads. html View the documentation: CDH 5 Release Notes Cloudera Manager Release Notes As always, we are happy to hear your feedback. Please send your comments and suggestions to the user group or through our community forums. You can also file bugs through our external JIRA projects on issues.cloudera.org. ... View more