We are pleased to announce the release of the Cloudera Distribution of Apache Kafka 1.4.0 for CDH 5.  Apache Kafka is a distributed publish-subscribe messaging system. This release is based on Apache Kafka 0.8.2, adds support for distribution as a package as well as a parcel, and includes fixes for key issues.   New Features:   Cloudera Distribution of Apache Kafka 1.4 is now distributed via native packages as well as a parcel Notable Fixes:   KAFKA-2633: Default logging from tools to Stderr. KAFKA-1664: Kafka does not properly parse multiple ZK nodes with non-root chroot. KAFKA-2477: Fix a race condition between log append and fetch that causes OffsetOutOfRangeException. KAFKA-2024: Cleaner can generate unindexable log segments. KAFKA-2118: Cleaner can not clean after shutdown during replaceSegments. We look forward to you trying it out, using the information below:   Install or upgrade Kafka Review the Documentation Review the Release Notes As always, we welcome your feedback. Please send your comments and suggestions through our community forums.   ... View more

Today, we’re pleased to announce the availability of a Cloudera QuickStart Docker image!   If you or your organization is using Docker, this image may provide the ideal lightweight, disposable environment for learning and exploring new technology, playing with new ideas, and for doing continuous integration before testing at scale. (However, Cloudera recommends using a more realistic test environment before moving to production.)   More details/docs here:   http://blog.cloudera.com/blog/2015/12/docker-is-the-new-quickstart-option-for-apache-hadoop-and-cloudera/ ... View more

Dear CDH, Cloudera Manager, Impala, and Cloudera Navigator users, We are pleased to announce the release of Cloudera Enterprise 5.4.7 (CDH 5.4.7, Cloudera Manager 5.4.7, and Cloudera Navigator 2.3.7).   Cloudera Enterprise 5.4.7 This release fixes key bugs and includes the following. CDH fixes for the following issues: The Spooling directory source dies when encountering zero-byte files. The VolumeScanner thread exits with an exception if there is no block pool to be scanned but there are suspicious blocks. ArrayIndexOutOfBoundsException in CellComparator# getMinimumMidpointArray. Lateral view on top of a view throws a RuntimeException. java.lang. IndexOutOfBoundsException when union all with if function. For a full list of upstream JIRAs fixed in CDH 5.4.7, see the issues fixed section of the Release Notes.   Cloudera Manager fixes for the following issues: The ZooKeeper jute.maxbuffer property is emitted into zoo.cfg instead of in the JVM arguments. Using the "create a user" API call, a user who normally could not create users is able to create a read-only user account. Attempting to set the listening_hostname property in the Agent's config.ini file (which is not normally necessary) changes the Agent's host ID to use this hostname, instead of the normal value. On Kerberized clusters, Cloudera Manager is monitoring the wrong process as the DataNode. For full list of issues fixed in Cloudera Manager 5.4.7, see the issues fixed section of the Release Notes. There are no updates in Cloudera Navigator 2.3.7. We look forward to you trying it out, using the information below: Download Cloudera Enterprise View the documentation As always, we are happy to hear your feedback. Please send your comments and suggestions to the user group or through our community forums. You can also file bugs through our external JIRA projects on issues.cloudera.org. ... View more

Dear CDH, Cloudera Manager, Impala, and Cloudera Navigator users, We are pleased to announce the release of Cloudera Enterprise 5.4.5 (CDH 5.4.5, Cloudera Manager 5.4.5, and Cloudera Navigator 2.3.5).   Cloudera Enterprise 5.4.5 This release fixes key bugs and includes the following. CDH fixes for the following issues: Predicate push-down does not work with Parquet when partitions are in the expression. Impala DML/DDL operations corrupt table metadata leading to Hive query failures. Reserved RBW space is not released if the client terminates while writing a block. NullPointerException on queries where MapReduce is not involved on tables with partitions. Parallel move task optimization causes a race condition. ResultSerialization and MutationSerialization can throw InvalidProtocolBufferException when serializing a cell larger than 64 MB. For a full list of upstream JIRAs fixed in CDH 5.4.5, see the issues fixed section of the Release Notes. Cloudera Manager fixes for the following issues: Cancel Impala Query attempts to connect via SSL despite SSL being disabled. Cloudera Manager incorrectly reports “Not finalized” status for a rolling upgrade. Add Role Instances wizard does not work when initialized using the Cloudera Manager search box. Cloudera Manager displays a spurious validation warning about the Cloudera Management Service truststore. Agent receives no logs if the last log4j event is larger than the max-size specified. For full list of issues fixed in Cloudera Manager 5.4.5, see the issues fixed section of the Release Notes. There are no updates in Cloudera Navigator 2.3.5. We look forward to you trying it out, using the information below: Download Cloudera Enterprise View the documentation As always, we are happy to hear your feedback. Please send your comments and suggestions to the user group or through our community forums. You can also file bugs through our external JIRA projects on issues.cloudera.org.   ... View more

We are pleased to announce the release of Cloudera Director 1.5.0.| Cloudera Director provides a simple, reliable, enterprise-grade way to deploy, scale, and manage Apache Hadoop in the cloud of your choice. Cloudera Director is available as a free download for use with Cloudera Express and is fully supported with Cloudera Enterprise. Cloudera Director 1.5.0 includes the following new features: Cloudera Director now supports multiple cloud providers through an open-source plugin interface: Cloudera Director Service Provider Interface (Cloudera Director SPI). Google Cloud Platform is now supported out-of-the-box through an open-source implementation of the Cloudera Director SPI: Cloudera Director Google Plugin. Advanced configuration settings are now available in the Cloudera Director UI. These include CDH cluster and Cloudera Manager configurations, and management of database servers set up by Cloudera Director. Users can now specify custom scripts to run after cluster creation. Example scripts for enabling HDFS high availability and Kerberos are available at https://github.com/cloudera/ director-scripts. The Cloudera Director database can now be encrypted. Encryption is enabled by default for new installations.   Links to the product and documentation are listed below: Download Cloudera Director from: http://www.cloudera.com/ content/support/en/downloads. html View the documentation: Cloudera Director Release Notes Getting Started Installing Cloudera Director Client Installing Cloudera Director Server Use the sample configuration file to create clusters in Google Cloud Platform. Director’s User Interface also allows creation of clusters in Google Cloud Platform. Refer to the reference architecture document for best practices for running Cloudera on Google Cloud Platform and leveraging different Google Cloud Platform services such as Compute Engine, Cloud Storage, and Cloud Interconnect. To learn more about the Director SPI and plugin implementations: Cloudera Director Service Provider Interface (Cloudera Director SPI) Cloud Provider Technology Compatibility Kit (Cloudera Director SPI TCK) Amazon Web Services (AWS) plugin Google Cloud Platform (GCP) plugin Example: Bring Your Own Nodes (BYON) plugin   As always, we are happy to hear your feedback. Please post your questions and comments on our community forum. ... View more

Dear CDH, Cloudera Manager, Impala, and Cloudera Navigator users,   We are pleased to announce the release of Cloudera Enterprise 5.3.6 (CDH 5.3.6, Cloudera Manager 5.3.6, and Cloudera Navigator 2.2.6).     This release fixes key bugs and includes the following. CDH fixes for the following issues: NameNode Failover during HA upgrade can cause DataNode to finalize upgrade HBase grant at specific column level does not work for Groups ZooKeeper znodes are bootstrapped with insecure ACLs in a secure configuration Incorrect results for n-way join when join expressions are not in same order across joins Datanode upgrade to BLOCKID_BASED_LAYOUT fails if duplicate block files are present in the same volume For a full list of upstream JIRAs fixed in CDH 5.3.6, see the issues fixed section of the Release Notes. Cloudera Manager fixes for the following issues: Cloudera Manager reports the wrong value for Impala bytes read from cache Cancel Impala Query attempts to connect via SSL despite SSL being disabled Cloudera Manager displays a spurious validation warning about the Cloudera Management Service truststore For full list of issues fixed in Cloudera Manager 5.3.6, see the issues fixed section of the Release Notes. There are no updates included in Cloudera Navigator 2.2.6. We look forward to you trying it out, using the information below: Download Cloudera Enterprise View the documentation As always, we are happy to hear your feedback. Please send your comments and suggestions to the user group or through our community forums. You can also file bugs through our external JIRA projects on issues.cloudera.org. ... View more