Hi CDH, Cloudera Manager, and Cloudera Navigator users,   We’re pleased to announce the release of Cloudera Enterprise 5.4 (comprising CDH 5.4, Cloudera Manager 5.4, and Cloudera Navigator 2.3). Cloudera Enterprise 5.4 (Release Notes) reflects critical investments in a production-ready customer experience through  governance, security, performance and deployment flexibility in cloud environments. It also includes support for a significant number of updated open standard components–including Apache Spark 1.3, Impala 2.2, and  Apache HBase 1.0 (as well as unsupported beta releases of Hive-on-Spark data processing and OpenStack deployments). Recently Cloudera made the upgrade process considerably easier via an improved CDH upgrade wizard; see details about that wizard here and best practices here. (Note: Due to metadata format changes in Apache Hadoop 2.6, upgrading to CDH 5.4 and later from any earlier release requires an HDFS metadata upgrade, as well. Note also that for parcel-based installs of CDH 5.4, Cloudera Manager 5.4 is required.) Here are some of the highlights (incomplete; see the respective Release Notes for CDH, Cloudera Manager, andCloudera Navigator for full lists of features and fixes): Security SSL and Kerberos support in Apache Flume for the Thrift source and sink. SSL support across Cloudera Search (Solr and all integrations with CDH). Cluster-wide redaction of sensitive data in logs is now possible. HBase impersonation in Hue allows your client to authenticate to HBase as any user, and to re-authenticate at any time. Solr metadata stored in ZooKeeper can now be protected by ZooKeeper ACLs. Kerberos is now supported for Apache Sqoop2. Performance Includes beta release of Hive-on-Spark as an option for improved Hive data processing performance (unsupported). MultiWAL support for HBase RegionServers allows you to increase throughput when a region writes to the write-ahead log (WAL). You can now store medium-sized objects (MOBs) up to 10MB in size directly in HBase while maintaining read and write performance. A new Kafka connector for Spark Streaming avoids the need for the HDFS WAL. Hue pages render much faster. Data Management and Governance Expanded coverage in Cloudera Navigator Impala (CDH 5.4 and higher) lineage Cloudera Search (CDH 5.4 and higher) auditing Auditing of Navigator activity, such as audit views, metadata searches, and policy editing Avro and Parquet schema inference Platform enhancements Redesigned metadata search provides autocomplete, faster filtering, and saved searches SAML for single sign-on Cloud Deployments OpenStack deployments are now possible as an unsupported beta. HBase support on Microsoft Azure. Real-Time Architecture Cloudera Distribution of Apache Kafka 1.3 installs by default and is supported for production use. Spark Streaming now has a receiver-less “direct” connector for Kafka. New or Updated Open Source Components Apache Hadoop 2.6 Apache HBase 1.0 Apache Hive 1.1 Apache Oozie 4.1 Apache Solr 4.10.3 Apache Spark 1.3 Cloudera Distribution of Apache Kafka 1.3 Hue 3.7 Impala 2.2 Kite SDK 1.0 New/Updated OS & Java Support RHEL 6.6/CentOS 6.6/OEL 6.6 (UEK3) JDK8u40, JDK7u75 Over the next few weeks, we’ll publish blog posts that cover some of these features in detail. In the meantime: Download Cloudera Enterprise 5.4 Explore documentation As always, we value your feedback; please provide any comments and suggestions through our community forums. You can also file bugs via issues.cloudera.org. ... View more

Dear Cloudera Users,   We are pleased to announce the general availability of the Cloudera Connector Powered by Teradata 1.4. This release has many updates, including: Added support for JDK 8 (CDH 5 only). Added the --error-database option. Added the ability to specify format of Date, Time and Timestamp types when importing into CSV. Import method split.by.amp now supports views. Upgraded Teradata connector for Hadoop to version 1.3.4. The Connector is released in editions compatible with CDH 4 and CDH 5. See the download page for more details. For more details on new features and usage of Cloudera Connector Powered by Teradata, see: Release Notes Cloudera Connector Powered by Teradata version 1.4 Cloudera Connector Powered by Teradata User Guide, version 1.4 As always, we welcome your feedback. Please send your comments and suggestions through our new community forums.  You can also file bugs in the CDH project at issues.cloudera.org. ... View more

Dear CDH, Cloudera Manager, Impala, and Cloudera Navigator users,   We are pleased to announce the release of Cloudera Enterprise 5.1.5 (CDH 5.1.5, Cloudera Manager 5.1.5, and Cloudera Navigator 2.0.5) and Cloudera Enterprise 5.2.5 (CDH 5.2.5, Cloudera Manager 5.2.5, and Cloudera Navigator 2.1.5).   Cloudera Enterprise 5.1.5 This release fixes key bugs and includes the following. CDH Replacing DataNode disks or manually changing the Storage IDs of volumes in a cluster may result in data loss. Fixed as part of HDFS-7575, HDFS-7596, HDFS-7960 and HDFS-7208. Fixes to the dfsadmin command-line option and the inclusion of a command to manually trigger full block reports from a DataNode. Improved recovery speed after service or host failure, and fixes to handle race conditions with HDFS integration in Search. Bug fixes in YARN for handling display of clock skew, consistent time zone on the web UI, and ResourceManager high availability. Fix to address LDAP authentication, integration of Hive with HBase through Oozie, and other bug fixes in Hive. Bug fixes in Hue and Parquet. Fixes in Impala to address memory leaks with secure transport, performance improvements in the Python SASL client, and other issues with SASL transport. For full list of upstream JIRAs fixed in CDH 5.1.5, please see the Known issues fixed section of the Release Notes. Cloudera Manager Starting new ZooKeeper servers shortly after adding them no longer causes ZooKeeper data loss when the number of new servers exceeds the number of old servers. Cloudera Navigator Fixed memory leak in Navigator Audit Server due to an error during batch operations.  Cloudera Enterprise 5.2.5 This release fixes key bugs and includes the following. CDH Replacing DataNode disks or mManually changing the Storage IDs of volumes in a cluster may result in data loss. Fixed as part of HDFS-7575, HDFS-7596, HDFS-7960 and HDFS-7208. Bug fixes in YARN for handling display of clock skew and consistent time zone on the web UI. Performance improvements, fixes to handle race conditions, hanging jobs and other issues in MapReduce. Index corruption during replication and other fixes in Search. Bug fixes in Hive, Hue, Sentry and Sqoop. A compatibility mode for handling timestamps generated by Hive in Parquet, fixes to handle memory leaks amongst other fixes in Impala. For full list of upstream JIRAs fixed in CDH 5.2.5, please see the Known issues fixed section of the Release Notes. Cloudera Manager Starting new ZooKeeper servers shortly after adding them no longer causes ZooKeeper data loss when the number of new servers exceeds the number of old servers. Permissions set incorrectly on YARN Keytab files Cloudera Navigator Navigator Audit Server reports invalid null characters in HBase audit events when using the PostgreSQL database We look forward to you trying it out, using the information below: Download Cloudera Enterprise from: http://www.cloudera.com/ content/support/en/downloads. html View the documentation: CDH 5 Release Notes Cloudera Manager Release Notes Cloudera Navigator Release Notes   As always, we are happy to hear your feedback. Please send your comments and suggestions to the user group or through our community forums.  You can also file bugs through our external JIRA projects on issues.cloudera.org. ... View more

We are pleased to announce the release of Cloudera Director 1.1.2.   Cloudera Director is a simple, reliable, enterprise-grade way to deploy, scale, and manage Hadoop in the cloud (initially for AWS). It’s free to download and use, and supported by default for Cloudera Enterprise customers. This release is focused on key bugs fixes including: Added support for d2 and c4 AWS instance types Restored the ability to modify a cluster that had an empty initial list of parcel repositories and was created with Director 1.0 Fixed parcel version validation when using an HTTP proxy We look forward to you trying it out, using the information below: Download Director from: http://www.cloudera.com/ content/support/en/downloads. html View the documentation: Cloudera Director Release Notes Getting Started Installing Cloudera Director Client Installing Cloudera Director Server As always, we are happy to hear your feedback. Please send your comments and suggestions to the user group or through our community forums. ... View more

Dear CDH, Cloudera Manager, and Impala users,   We are pleased to announce the release of Cloudera Enterprise 5.0.6 (CDH 5.0.6 and Cloudera Manager 5.0.6)   This release fixes key bugs and includes the following. CDH Replacing DataNode disks or manually changing the Storage IDs of volumes in a cluster may result in data loss. Fixed as part of HDFS-7575, HDFS-7596, HDFS-7960 and HDFS-7208. Improved recovery speed after service or host failure, and fixes to handle race conditions with HDFS integration in Search. Bug fixes in YARN for handling display of clock skew and consistent time zone on the web UI. Bug fixes in Hive, including integration of Impala with HBase through Oozie. For full list of upstream JIRAs fixed in CDH 5.0.6, please see the Known issues fixed section of the Release Notes. Cloudera Manager Starting new ZooKeeper servers shortly after adding them no longer causes ZooKeeper data loss when the number of new servers exceeds the number of old servers. We look forward to you trying it out, using the information below: Download Cloudera Enterprise from: http://www.cloudera.com/ content/support/en/downloads. html View the documentation: CDH 5 Release Notes Cloudera Manager Release Notes As always, we are happy to hear your feedback. Please send your comments and suggestions to the user group or through our community forums. You can also file bugs through our external JIRA projects on issues.cloudera.org. ... View more

Dear CDH, Cloudera Manager, Impala, and Cloudera Navigator users, We are pleased to announce the release of Cloudera Enterprise 5.3.3 (CDH 5.3.3, Cloudera Manager 5.3.3, and Cloudera Navigator 2.2.3).   Cloudera Enterprise 5.3.3 This release fixes key bugs and includes the following. CDH Replacing DataNode Disks or Manually changing the Storage IDs of Volumes in a Cluster may result in Data Loss. Fixed as part of HDFS-7575, HDFS-7596, HDFS-7960 and HDFS-7208. Fixes to address issues with load balancing, loading ACLs, and integration with Hive in KMS LDAP-related usability fixes in Hue Bug fixes to handle Kerberos ticket validity, NameNode restarts, white spaces in ACLs, and other issues in Sentry Index corruption during replication and other fixes in Search Fixes for application recovery and ApplicationMaster tracking URL in high availability mode and other issues in YARN Fixes to handle reliability, race conditions, memory leaks, and ACL handling in Impala Several bug fixes in Hive to address usability and integration with KMS and YARN Bug fixes in HBase and Sqoop For full list of upstream JIRAs fixed in CDH 5.3.3, please see the Known issues fixed section of the Release Notes. Cloudera Manager The default value of the hive.metastore.client.socket. timeout property has changed to 60 seconds. The property hadoop.ssl.enabled is deprecated. Cloudera Manager has been updated to use either dfs.http.policy or yarn.http.policy properties instead. Cloudera Manager no longer requires you to restart your cluster after changing the Service Monitor Client Config Overrides property for a service. After updating to a new release, Cloudera Manager incorrectly replaced the specified cluster name with cluster. Cloudera Manager now uses the correct cluster name. Migration of client configuration data is now more robust with handling null host_id. The property hive.log.explain.output is known to create instability of Cloudera Manager Agents in some specific circumstances, especially when Hive queries generate extremely large EXPLAIN outputs. Therefore, the property has been hidden from Cloudera Manager configuration screens. You can still configure the property by using advanced configuration snippets. Starting new ZooKeeper Servers shortly after adding them no longer causes ZooKeeper data loss when the number of new servers exceeds the number of old servers. Cloudera Navigator Navigator Audit Server no longer reports invalid null characters in HBase audit events when using the PostgreSQL database. Oozie extractor throwing too many Boolean clauses exceptions has been fixed. We look forward to you trying it out, using the information below: Download Cloudera Enterprise from: http://www.cloudera.com/ content/support/en/downloads. html View the documentation: CDH 5 Release Notes Cloudera Manager Release Notes Cloudera Navigator Release Notes As always, we are happy to hear your feedback. Please send your comments and suggestions to the user group or through our community forums. You can also file bugs through our external JIRA projects on issues.cloudera.org. ... View more

Hello CDH and Impala Users, We are pleased to announce the release of the following new drivers: Impala ODBC v2.5.26 Impala JDBC v2.5.19 Hive ODBC v2.5.14 Hive JDBC v2.5.10 These ODBC drivers include support for Windows 8. Please see the release notes for details on the specific fixes that were added for each driver.   To get started with the Cloudera drivers: Read the Cloudera ODBC 2.5 driver for Impala release notes and installation guide. Read the Cloudera JDBC 2.5 driver for Impala release notes and installation guide. Read the Cloudera ODBC 2.5 Driver for Hive release notes and  installation guide. Read the Cloudera JDBC 2.5 driver for Hive release notes and installation guide. Download the connector from the Cloudera Connectors page. As always, we are happy to hear your feedback. Please send your comments and suggestions to cdh-user@cloudera.org or post to our new Community Forums. ... View more

We are pleased to announce the release of Cloudera Director 1.1.1.   Cloudera Director is a simple, reliable, enterprise-grade way to deploy, scale, and manage Hadoop in the cloud (initially for AWS). It’s free to download and use, and supported by default for Cloudera Enterprise customers.   This release is focused on key bugs fixes including:   Restored support for service-level custom configurations Restored customBannerText as a deprecated property Added better progress reporting on failures Updated AWS IAM documentation link Added eu-central-1 to the region dropdown Added automatic assignment of gateway roles for all services in the wizard Allow clusters with Spark on YARN to be modified via the web interface We look forward to you trying it out, using the information below:   Download Director from: http://www.cloudera.com/ content/support/en/downloads. html View the documentation: Cloudera Director Release Notes Getting Started Installing Cloudera Director Client Installing Cloudera Director Server   As always, we are happy to hear your feedback. Please send your comments and suggestions to the user group or through our community forums. ... View more