On February 9th, 2016,  we announced the release of Cloudera Enterprise 5.5.2. Shortly after that, we discovered a severe bug in Cloudera Manager 5.5.2, so we decided to remove the release. CDH 5.5.2 is not affected by this bug. We will release Cloudera Manager 5.5.3 and CDH 5.5.2 soon.  Cloudera Manager 5.5.3 will include all the improvements, fixes, and changes that were in Cloudera Manager 5.5.2, plus the fix for the severe bug that was discovered. ... View more

We are pleased to announce the release of Cloudera Director 2.0.0. Cloudera Director provides a simple, reliable, enterprise-grade way to deploy, scale, and manage Apache Hadoop in the cloud of your choice. Cloudera Director is available as a free download for use with Cloudera Express and is fully supported with Cloudera Enterprise. Cloudera Director 2.0.0 includes the following new features: Support for AWS Spot Instances and Google Cloud Platform's Preemptible Instances Automated setup of clusters that are highly available and authenticated via Kerberos Ability to automate submission of jobs to clusters with dynamic creation and termination of clusters Ability to run custom scripts after cluster setup and before cluster termination Enhanced user interface with deeper insights into health of clusters Increased reliability of cluster modifications, including rollback in some failure scenarios RHEL 7.1 support   Links to the product and documentation are listed below: Download Cloudera Director from: http://www.cloudera.com/content/support/en/downloads.html View the documentation: Cloudera Director Release Notes Getting Started Installing Cloudera Director Client Installing Cloudera Director Server   As always, we are happy to hear your feedback. Please post your questions and comments on our community forum. ... View more

We are pleased to announce the release of Hive ODBC v2.5.17 and Impala ODBC v2.5.31 drivers. This release has the following fixes and enhancements: Hive ODBC v2.5.17 Support for Debian 6 Data encryption and integrity support for the SASL SSPI plugin Optimized retrieval of result set schemas Support for ODBC 3.80 Improved implementation of SQLCancel Upgraded OpenSSL library Upgraded ICU library Issues resolved: The driver returns incorrect ODBC error code for authentication-related errors. When using the Windows version of the driver, a SideBySide error occurs due to a conflict in the OpenSSL and libcurl libraries being loaded. When attempting to execute a non-parameterized write-back statement multiple times, the driver only executes the statement against Hive once. The driver returns incorrect results for SET <property name> queries. When connected to Hive 0.13 or earlier, the driver cannot insert result sets from queries into tables. The driver does not correctly translate "INSERT OVERWRITE TABLE <table> PARTITION(...)SELECT ..." statements correctly. DSN configurations cannot be saved when you are working as a non-administrator user. When query execution results in a MapReduce error, the driver closes the current connection and opens a new one. The driver terminates unexpectedly when preparing a parameterized INSERT statement. The driver terminates unexpectedly when the application unloads the driver without closing all connections.   Impala ODBC v2.5.31 Automatic configuration of driver manager settings Updated driver logging options See the Release Notes for ODBC for details on all of the fixes. Getting Started with the Cloudera Drivers Read the Cloudera ODBC 2.5.17 Driver for Hive Release Notes and Installation Guide. Read the Cloudera ODBC 2.5.31 Driver for Impala Release Notes and Installation Guide. Download the connector from the Cloudera Connectors page.   As always, we welcome your feedback. Please send your comments and suggestions to the user group or through our community forums.  You can also file bugs through our external JIRA projects on issues.cloudera.org.   ... View more

Dear CDH, Cloudera Manager, and Cloudera Navigator users, We are pleased to announce the release of Cloudera Enterprise 5.3.9 (CDH 5.3.9, Cloudera Manager 5.3.9, Cloudera Navigator 2.2.9).   This release fixes key bugs and includes the following. CDH fixes for the following issues: Apache Commons Collections deserialization vulnerability, described in TSB-98 Improve diagnostics information for HttpPutFailedException Checkpointing failure caused by shared KerberosAuthenticator Copying from the root to a subdirectory should be forbidden Encryption zone on root not loaded from fsimage after NameNode restart Kerberos credentials can expire if the KDC is slow to respond For a full list of upstream JIRAs fixed in CDH 5.3.9, see the issues fixed section of the Release Notes. Cloudera Manager fixes for the following issues: Apache Commons Collections deserialization vulnerability, described in TSB-98 For full list of issues fixed in Cloudera Manager 5.3.9, see the issues fixed section of the Release Notes. Cloudera Navigator 2.2.9 fixes for the following issues: Apache Commons Collections deserialization vulnerability, described in TSB-98 We look forward to you trying it out, using the information below: Download Cloudera Enterprise View the documentation As always, we are happy to hear your feedback. Please send your comments and suggestions to the user group or through our community forums. You can also file bugs through our external JIRA projects on issues.cloudera.org. ... View more

We are pleased to announce the availability of Cloudera Navigator Encrypt 3.8.0.     Navigator Encrypt is a key component of Cloudera's Security and Governance solution.  It complements HDFS encryption to provide encryption at rest for sensitive data in the hadoop cluster in temp/spill files, metadata databases and ingest volumes.      It works together with Navigator Key Trustee, so that encryption keys are managed following security best-practices required by a number of compliance regulations, including PCI and HIPAA.    Navigator Encrypt is available to all Cloudera customers licensed for Navigator use.   Here's what's new in this release: Support for Red Hat Enterprise Linux (RHEL) 7.x - starting with 7.1 Easier deployment on existing server volumes, through automatic mounting of encrypted loop devices on boot (see Block-Level Encryption with a Loop Device for details) The use of loop devices simplifies adding Navigator Encrypt to existing servers, enabling just a portion of a volume to be encrypted, so that entire volumes don't need to be reformatted.   Note that the previously available eCryptFS file encryption option has been deprecated on all OSes and is not available on RHEL 7.1.   Automatic failover for high availability Navigator Key Trustee Servers (see Registering with Key Trustee Server for details) There is a new download location for all of the Navigator encryption products, including Navigator Key Trustee as well as Navigator Encrypt.   Find them at cloudera.com/download .   You will need your Cloudera support portal username and password.      See also the documentation for the Cloudera Navigator Data Encryption products.     Happy holidays!  ... View more

Dear CDH, Cloudera Manager, and Cloudera Navigator users, We are pleased to announce the release of Cloudera Enterprise 5.4.9 (CDH 5.4.9, Cloudera Manager 5.4.9, Cloudera Navigator 2.3.9, and Key Trustee Server 5.4.9).   This release fixes key bugs and includes the following. CDH fixes for the following issues: Apache Commons Collections Deserialization Vulnerability, described in TSB - 98 Enable using a proxy server to connect to S3a Improve diagnostics information for HttpPutFailedException Fix precondition failures from NameNodeEditLogRoller while saving namespace Improve clearing stale state of Java serialization Checkpointing failure caused by shared KerberosAuthenticator Encryption zone on root not loaded from fsimage after NN restart Exception on HBaseSerDe.serialize binary field Analysis exception when a binary operator contains an IN operator with values Connection idle time 1 second is too short and the connection is closed too quickly by the ChoreService Added resource path is sent to cluster as an empty string when externally removed Make MAX_PAGE_HEADER_SIZE configurable For a full list of upstream JIRAs fixed in CDH 5.4.9, see the issues fixed section of the Release Notes. Cloudera Manager fixes for the following issues: Apache Commons Collections Deserialization Vulnerability, described in TSB - 98 Job History Server retaining logs in secure clusters Snapshot policies with names with special characters not handled as expected Updating the Hive NameNode location multiple times could lead to data corruption Kafka MirrorMaker fails to start due to missing settings Cloudera Manager dry-run replication history shows unexpected values For full list of issues fixed in Cloudera Manager 5.4.9, see the issues fixed section of the Release Notes. Cloudera Navigator 2.3.9 fixes for the following issues: Apache Commons Collections Deserialization Vulnerability, described in TSB - 98 Key Trustee Server 5.4.9 fixes the following issues: Cannot register a client with Key Trustee Server after registering GPG public key We look forward to you trying it out, using the information below: Download Cloudera Enterprise View the documentation   As always, we are happy to hear your feedback. Please send your comments and suggestions to the user group or through our community forums. You can also file bugs through our external JIRA projects on issues.cloudera.org.   ... View more

Cloudera Enterprise 5.5.1 and Director 1.5.2 provide fixes for critical issues found in the Apache Commons library. For a description of issues fixed in Cloudera Enterprise 5.5.1, see the issues fixed section of the Release Notes for CDH and Cloudera Manager. For a description of the issues fixed in Director 1.5.2, see the issues fixed section of the Release Notes.   We look forward to you trying it out, using the information below: Download Cloudera Enterprise Download Cloudera Director View the documentation for Cloudera Enterprise and Cloudera Director   As always, we are happy to hear your feedback. Please send your comments and suggestions to the user group or through our community forums. You can also file bugs through our external JIRA projects on issues.cloudera.org. ... View more

We are happy to announce Kudu 0.6.0, the second beta release of Kudu, the industry’s first columnar storage manager developed for the Hadoop ecosystem. This release includes the following fixes and enhancements: The Java client's CreateTableBuilder and AlterTableBuilder classes have been renamed to CreateTableOptions and AlterTableOptions. Their methods now also return these objects, allowing them to be used as builders. The Java client's AbstractKuduScannerBuilder#maxNumBytes() setter is now called batchSizeBytes, as is the corresponding property in AsyncKuduScanner. This makes it consistent with the C++ client. The kudu-admin tool can now list and delete tables: kudu-admin list kudu-admin delete <table_name> OS X is now supported for single-node development For a full list of issues addressed in Kudu 0.6.0, see this JIRA query. For more details on Kudu, see http://getkudu.io/ Kudu already has an extensive set of capabilities, but there’s still work to be done and we’d appreciate your help.  Kudu is fully open-source software, licensed under the Apache Software License 2.0. Additionally, we recently submitted Kudu to the Apache Software Foundation as an Apache Incubator project to help foster its growth and facilitate its usage. As part of the open beta, we encourage the community to try it out. Here is how you can get started: Download and install Kudu. You need CDH 5.4.0 or higher and Cloudera Manager 5.4.3 or higher to try Kudu with CDH.  Cloudera Manager 5.4.7 and higher provides additional administrative and monitoring options. Kudu requires either RHEL/CentOS 6.4 or later, or Ubuntu Trusty. Installation via parcels with Cloudera Manager is simple and provides additional monitoring and administrative functionality. Kudu can also be installed using a Quickstart VM or through the command line using packages. Once you get started, we’d love to hear your feedback: A Kudu-specific user group has been set up to address user questions and feedback. We have set up a community forum. You can track current open tasks and submit new bugs on the Kudu public issue tracking.   Our team is excited about the possibilities that Kudu enables and we look forward to hearing about your experiences with Kudu. ... View more

Cloudera Enterprise 5.5 is now generally available (comprising CDH 5.5, Cloudera Manager 5.5, and Cloudera Navigator 2.4).   Cloudera is excited to bring you news of Cloudera Enterprise 5.5 (Release Notes). Our persistent emphasis on quality is especially pronounced in this release, with more than 500 issues identified and triaged during its development.   Here are some of the highlights (see the Release Notes for full lists of features and fixes): Security Column-level security is now provided in Impala and Apache Hive (via Apache Sentry [incubating]). In Cloudera Manager-managed clusters, cleartext passwords can now be redacted from configuration files. Cloudera Manager includes a new wizard for setting up HDFS encryption, KMS, and Navigator Key Trustee. In Cloudera Navigator Encrypt, dmcrypt+loopfile replaces eCryptfs (deprecated) for file encryption. LDAP/AD auth is now supported for Apache Solr clients. Apache HBase replication is now encrypted. Performance, Scale, and Operations HDFS includes many scalability enhancements, including data-block “flow control” to help optimize DataNode configuration. Navigator Encrypt now supports auto-failover to a secondary Key Trustee Server. Cloudera Manager now offers a new aggregate UI that provides a single, read-only health dashboard across Cloudera Manager instances. HUE HA can now be set up via Cloudera Manager. Performance is significantly improved when replicating millions of files, partitions, and petabytes of data with Cloudera Manager Backup and Disaster Recovery. Improved parcel management: ability to retry upgrade on failure; selective service restart when updating patch parcels.   Kafka now supports rolling restarts. Data Management and Governance Expanded coverage in Cloudera Navigator: Extended Apache Hive lineage attributes Hive-on-Spark lineage HUE audits Extended Cloudera Manager audits Platform enhancements: The new Cloudera Navigator SDK opens up lineage and metadata capabilities for the entire ecosystem. Improved self-service data discovery dashboard provides visibility into metadata, schema, and full drill-down into entities. Navigator can now publish audit events to Apache Kafka. Data stewardship capabilities: Automated policy workflows for retention and archiving. SQL Support & Usability Impala now supports querying nested data on Apache Parquet (with support for other file formats like Apache Avro on the roadmap). Impala’s robustness and memory efficiency have been improved. Spark SQL and the DataFrames API are now supported. The majority of Spark MLlib is now supported. New or Updated Open Source Components Apache Spark 1.5 (including Spark SQL, DataFrames API, and MLlib per above) Apache Flume 1.6 Apache Sqoop 1.4.6 Apache Sentry 1.5.1 HUE 3.9 Impala 2.3 New or Updated Platform Support RHEL 7 MariaDB Amazon S3 storage for Apache Spark and Apache Hive Over the next few weeks, we'll publish blog posts that cover some of these features in detail. In the meantime: Download Cloudera Enterprise 5.5 or the 5.5 VM Explore documentation   As always, we value your feedback; please provide any comments and suggestions through our community forums. You can also file bugs via issues.cloudera.org. ... View more

We are pleased to announce the release of Impala JDBC v2.5.29 driver. This release has the following fixes and enhancements: Issues resolved: When executing a query with parameter in Native query mode,the setObject operation fails. This issue has been resolved executeBatch() operation does not work properly when multiple parameter sets are added to the batch. Only the first insert is working. This issue has been resolved.   Please see Release Notes for JDBC for details on all of the fixes. Getting started with the Cloudera Drivers: Read the Cloudera JDBC 2.5.29  Driver for Impala Release Notes and Installation Guide. Download the connector from the Cloudera Connectors page. As always, we welcome your feedback. Please send your comments and suggestions to the user group or through our community forums.  You can also file bugs through our external JIRA projects on issues.cloudera.org ... View more