Today, we’re pleased to announce the availability of a Cloudera QuickStart Docker image!   If you or your organization is using Docker, this image may provide the ideal lightweight, disposable environment for learning and exploring new technology, playing with new ideas, and for doing continuous integration before testing at scale. (However, Cloudera recommends using a more realistic test environment before moving to production.)   More details/docs here:   http://blog.cloudera.com/blog/2015/12/docker-is-the-new-quickstart-option-for-apache-hadoop-and-cloudera/ ... View more

Dear CDH, Cloudera Manager, Impala, and Cloudera Navigator users, We are pleased to announce the release of Cloudera Enterprise 5.4.7 (CDH 5.4.7, Cloudera Manager 5.4.7, and Cloudera Navigator 2.3.7).   Cloudera Enterprise 5.4.7 This release fixes key bugs and includes the following. CDH fixes for the following issues: The Spooling directory source dies when encountering zero-byte files. The VolumeScanner thread exits with an exception if there is no block pool to be scanned but there are suspicious blocks. ArrayIndexOutOfBoundsException in CellComparator# getMinimumMidpointArray. Lateral view on top of a view throws a RuntimeException. java.lang. IndexOutOfBoundsException when union all with if function. For a full list of upstream JIRAs fixed in CDH 5.4.7, see the issues fixed section of the Release Notes.   Cloudera Manager fixes for the following issues: The ZooKeeper jute.maxbuffer property is emitted into zoo.cfg instead of in the JVM arguments. Using the "create a user" API call, a user who normally could not create users is able to create a read-only user account. Attempting to set the listening_hostname property in the Agent's config.ini file (which is not normally necessary) changes the Agent's host ID to use this hostname, instead of the normal value. On Kerberized clusters, Cloudera Manager is monitoring the wrong process as the DataNode. For full list of issues fixed in Cloudera Manager 5.4.7, see the issues fixed section of the Release Notes. There are no updates in Cloudera Navigator 2.3.7. We look forward to you trying it out, using the information below: Download Cloudera Enterprise View the documentation As always, we are happy to hear your feedback. Please send your comments and suggestions to the user group or through our community forums. You can also file bugs through our external JIRA projects on issues.cloudera.org. ... View more

Dear CDH, Cloudera Manager, Impala, and Cloudera Navigator users, We are pleased to announce the release of Cloudera Enterprise 5.4.5 (CDH 5.4.5, Cloudera Manager 5.4.5, and Cloudera Navigator 2.3.5).   Cloudera Enterprise 5.4.5 This release fixes key bugs and includes the following. CDH fixes for the following issues: Predicate push-down does not work with Parquet when partitions are in the expression. Impala DML/DDL operations corrupt table metadata leading to Hive query failures. Reserved RBW space is not released if the client terminates while writing a block. NullPointerException on queries where MapReduce is not involved on tables with partitions. Parallel move task optimization causes a race condition. ResultSerialization and MutationSerialization can throw InvalidProtocolBufferException when serializing a cell larger than 64 MB. For a full list of upstream JIRAs fixed in CDH 5.4.5, see the issues fixed section of the Release Notes. Cloudera Manager fixes for the following issues: Cancel Impala Query attempts to connect via SSL despite SSL being disabled. Cloudera Manager incorrectly reports “Not finalized” status for a rolling upgrade. Add Role Instances wizard does not work when initialized using the Cloudera Manager search box. Cloudera Manager displays a spurious validation warning about the Cloudera Management Service truststore. Agent receives no logs if the last log4j event is larger than the max-size specified. For full list of issues fixed in Cloudera Manager 5.4.5, see the issues fixed section of the Release Notes. There are no updates in Cloudera Navigator 2.3.5. We look forward to you trying it out, using the information below: Download Cloudera Enterprise View the documentation As always, we are happy to hear your feedback. Please send your comments and suggestions to the user group or through our community forums. You can also file bugs through our external JIRA projects on issues.cloudera.org.   ... View more

We are pleased to announce the release of Cloudera Director 1.5.0.| Cloudera Director provides a simple, reliable, enterprise-grade way to deploy, scale, and manage Apache Hadoop in the cloud of your choice. Cloudera Director is available as a free download for use with Cloudera Express and is fully supported with Cloudera Enterprise. Cloudera Director 1.5.0 includes the following new features: Cloudera Director now supports multiple cloud providers through an open-source plugin interface: Cloudera Director Service Provider Interface (Cloudera Director SPI). Google Cloud Platform is now supported out-of-the-box through an open-source implementation of the Cloudera Director SPI: Cloudera Director Google Plugin. Advanced configuration settings are now available in the Cloudera Director UI. These include CDH cluster and Cloudera Manager configurations, and management of database servers set up by Cloudera Director. Users can now specify custom scripts to run after cluster creation. Example scripts for enabling HDFS high availability and Kerberos are available at https://github.com/cloudera/ director-scripts. The Cloudera Director database can now be encrypted. Encryption is enabled by default for new installations.   Links to the product and documentation are listed below: Download Cloudera Director from: http://www.cloudera.com/ content/support/en/downloads. html View the documentation: Cloudera Director Release Notes Getting Started Installing Cloudera Director Client Installing Cloudera Director Server Use the sample configuration file to create clusters in Google Cloud Platform. Director’s User Interface also allows creation of clusters in Google Cloud Platform. Refer to the reference architecture document for best practices for running Cloudera on Google Cloud Platform and leveraging different Google Cloud Platform services such as Compute Engine, Cloud Storage, and Cloud Interconnect. To learn more about the Director SPI and plugin implementations: Cloudera Director Service Provider Interface (Cloudera Director SPI) Cloud Provider Technology Compatibility Kit (Cloudera Director SPI TCK) Amazon Web Services (AWS) plugin Google Cloud Platform (GCP) plugin Example: Bring Your Own Nodes (BYON) plugin   As always, we are happy to hear your feedback. Please post your questions and comments on our community forum. ... View more

Dear CDH, Cloudera Manager, Impala, and Cloudera Navigator users,   We are pleased to announce the release of Cloudera Enterprise 5.3.6 (CDH 5.3.6, Cloudera Manager 5.3.6, and Cloudera Navigator 2.2.6).     This release fixes key bugs and includes the following. CDH fixes for the following issues: NameNode Failover during HA upgrade can cause DataNode to finalize upgrade HBase grant at specific column level does not work for Groups ZooKeeper znodes are bootstrapped with insecure ACLs in a secure configuration Incorrect results for n-way join when join expressions are not in same order across joins Datanode upgrade to BLOCKID_BASED_LAYOUT fails if duplicate block files are present in the same volume For a full list of upstream JIRAs fixed in CDH 5.3.6, see the issues fixed section of the Release Notes. Cloudera Manager fixes for the following issues: Cloudera Manager reports the wrong value for Impala bytes read from cache Cancel Impala Query attempts to connect via SSL despite SSL being disabled Cloudera Manager displays a spurious validation warning about the Cloudera Management Service truststore For full list of issues fixed in Cloudera Manager 5.3.6, see the issues fixed section of the Release Notes. There are no updates included in Cloudera Navigator 2.2.6. We look forward to you trying it out, using the information below: Download Cloudera Enterprise View the documentation As always, we are happy to hear your feedback. Please send your comments and suggestions to the user group or through our community forums. You can also file bugs through our external JIRA projects on issues.cloudera.org. ... View more

Dear CDH Users,     We are pleased to announce the release of Cloudera Distribution of Apache Kafka 1.3.1 for CDH 5.  Apache Kafka is a distributed publish-subscribe messaging system.  This is a maintenance release that fixes key issues, including:   KAFKA-972 - MetadataRequest returns stale list of brokers KAFKA-1367 - Broker topic metadata not kept in sync with ZooKeeper KAFKA-1867 - liveBroker list not updated on a cluster with no topics KAFKA-2308 - New producer + Snappy face un-compression errors after broker restart KAFKA-2317 - De-register isrChangeNotificationListener on controller resignation KAFKA-2337 - Verify that metric names will not collide when creating new topics We look forward to you trying it out, using the information below: Install or upgrade Kafka Review the Documentation Review the Release Notes   As always, we welcome your feedback. Please send your comments and suggestions through our community forums. You can also file bugs through our external JIRA projects on issues.cloudera.org. ... View more

Dear CDH Users,   We are pleased to announce the release of the Cloudera Connector for Netezza version 1.3. This release has the following new feature:   A new --schema argument is now supported. This argument defines the schema that Sqoop uses for both import and export. The schema is used for metadata queries, and for record extraction and loading (available in Netezza 7.0.3 or later). This connector release is available for CDH 5 only. We look forward to you trying it out, using the information below: Download the Connector Review the Release Notes Review the User Guide As always, we are happy to hear your feedback. Please send your comments and suggestions through our community forums. You can also file bugs through our external JIRA projects on issues.cloudera.org. ... View more

Hello CDH and Impala Users,   We are pleased to announce the release of Impala ODBC v2.5.29, Impala JDBC v2.5.24 and Hive JDBC v2.5.15.   Impala ODBC 2.5.29 contains bug fixes and the following enhancements: Support for calling SQLGetData on columns that come before a bound column Updated support for SQL_C_TINYINT Improved error messaging for authentication issues Support for saving passwords as encrypted strings in the Windows Registry Supports the use of "_HOST" as a special value for the Host FQDN option For a full list of fixes in Impala ODBC v2.1.29, see the issues fixed section of the Release Notes.   Impala JDBC 2.5.24 is a bugfix only release. For a full list of fixes in Impala JDBC v2.1.24, see the issues fixed section of the Release Notes.   Hive JDBC v2.5.15 contains numerous bug fixes and the following enhancements: Support for case-insensitive treatment of catalog names, schema names, table names, and column names in catalog function calls Optimized metadata retrieval For a full list of fixes in Hive JDBC v2.1.15, see the issues fixed section of the Release Notes.   These drivers work for versions of HiveServer2 in CDH 4.1 or higher and Impala 1.0 or higher. Previous drivers continue to work on the latest versions of HiveServer2 and Impala as well. Getting started with the Cloudera Drivers: Read the Cloudera JDBC 2.5 driver for Hive release notes and installation guide. Read the Cloudera JDBC 2.5 driver for Impala release notes and installation guide. Read the Cloudera ODBC 2.5 driver for Impala release notes and Installation Guide. Download the connector from the Cloudera Connectors page. As always, we are happy to hear your feedback. Please send your comments and suggestions to cdh-user@cloudera.org or post to our new Community Forums. ... View more