Announcements

 We are pleased to announce the release of Impala JDBC v2.5.32 driver. This release has the following fixes and enhancements: Enhancements and new features:Support added for optimizing driver performance for INSERT statements.You can use the new Optimized Insert connection property to optimize driver performance when executing INSERT statements. This optimization is enabled by default.Support added for configuring the Thrift transport protocol.You can use the new transport Mode connection property to specify the transport protocol that the driver uses in the Thrift layer. The default AuthMech value now depends on the transport Mode setting. For more information, see the Cloudera JDBC Driver for Impala Installation and Configuration Guide.Implemented server version checking for the getTypeInfo() method.When you call the getTypeInfo() method, the driver now checks the version of the Impala server that you are connecting to and only returns data types that are supported by that Impal

Dear CDH, Cloudera Manager, and Cloudera Navigator users,We are pleased to announce the release of Cloudera Enterprise 5.7.1 (CDH 5.7.1, Cloudera Manager 5.7.1, and Cloudera Navigator 2.6.1).  This release fixes key bugs and includes the following:CDH fixes for the following issues:HBASE-15234 - The ReplicationCleaner process can abort if its connection to ZooKeeper is inconsistentHDFS-8211 - DataNode UUID is always null in the JMX counterYARN-4414 - NodeManager connection errors are retried at multiple levelsYARN-4629 - Distributed shell breaks under strong securityHIVE-13401 - Kerberized HS2 with LDAP auth enabled fails Kerberos/delegation token authenticationHIVE-13530 - Hive on Spark throws Kryo exception in some casesIMPALA-3133 - Wrong privileges after a REVOKE ALL ON SERVER statementIMPALA-3139 - Fix drop table statement to not drop views and vice versaSENTRY-1190 - IMPORT TABLE silently fails if Sentry is enabledFor a full list of upstream JIRAs fixed in CDH 5.7.1, see the

We are pleased to announce the release of Cloudera Enterprise 5.5.4 (CDH 5.5.4, Cloudera Manager 5.5.4, and Cloudera Navigator 2.4.4).  This release fixes key bugs and includes the following:CDH fixes for the following issues:FLUME-2886 - Optional Channels can cause OOMsHADOOP-12718 - Incorrect error message by fs -put local dir without permissionHDFS-9406 - FSImage may get corrupted after deleting snapshotHDFS-9514 - TestDistributedFileSystem.testDFSClientPeerWriteTimeout failing; exception being swallowedHDFS-9701 - DN may deadlock when hot-swapping under loadHBASE-15234 The Replication Cleaner process can abort if its connection to ZooKeeper is inconsistentMAPREDUCE-6460 - TestRMContainerAllocator.testAttemptNotFoundCausesRMCommunicatorException failsMAPREDUCE-6528 - Memory leak for HistoryFileManager.getJobSummary()YARN-3446 - FairScheduler headroom calculation should exclude nodes in the blacklistHBASE-15019 - Replication stuck when HDFS is restartedHIVE-10303 - HIVE-9471 bro

We are pleased to announce the release of Cloudera Enterprise 5.6.1 (CDH 5.6.1, Cloudera Manager 5.6.1, and Cloudera Navigator 2.5.1).  This release fixes key bugs and includes the following:CDH fixes for the following issues:FSImage may get corrupted after deleting snapshotThe ReplicationCleaner process can abort if its connection to ZooKeeper is inconsistentFLUME-2886 - Optional Channels can cause OOMsHADOOP-12604 - Exception may be swallowed in KMSClientProviderHADOOP-12718 - Incorrect error message by fs -put local dir without permissionMAPREDUCE-6528 - Memory leak for HistoryFileManager.getJobSummary()HIVE-12790 - Metastore connection leaks in HiveServer2IMPALA-2711 - Fix memory leak in Rand()IMPALA-2820 - Support unquoted keywords as struct-field namesSENTRY-835 - Drop table leaves a connection open when using metastorelistenerFor a full list of upstream JIRAs fixed in CDH 5.6.1, see the issues fixed section of the Release Notes.Cloudera Manager fixes for the following issue

If you happen to be in the Austin area, you should consider participating in our Hackathon this coming Sunday May 15.  Hosted at the Cloudera office and sponsored by Cloudera Cares.   The hackathon will focus on reducing mosquito borne virus infections by analyzing data on water, mapping mosquito travel, and historical virus analysis.   515 Congress Ave., Suite 1212, Austin, TX 10:30am to 8:00pm   RSVP and further details here.

We are pleased to announce the release of Hive ODBC v2.5.19 and Impala ODBC v2.5.33 drivers. This release has the following fixes and enhancements:   Hive ODBC v2.5.19Enhancements and New Features-Support added for Red Hat Enterprise Linux (RHEL) 7 and CentOS 7-Updated authentication support. For consistency with Microsoft Azure HDInsight updates, the Windows Azure -HDInsight Emulator Authentication mechanism (AuthMech=5) is now deprecated. The driver no longer supports connections to Hive server instances that run on Windows Azure HDInsight Emulator.   Resolved Issues-When attempting to connect to the server using a non-Windows version of the driver with Service Discovery Mode enabled, the client stops working.-When executing a parameterized INSERT statement on a DATE, DECIMAL, or TIMESTAMP column, an error occurs.-When executing a query that contains a large number of filters using OR operators, an error occurs.-When executing a query that uses regular expressions in the fi

We are pleased to announce the release of Cloudera Enterprise 5.3.10 (CDH 5.3.10, Cloudera Manager 5.3.10, and Cloudera Navigator 2.2.10).  This release fixes key bugs and includes the following:CDH fixes for the following issues:HDFS-9406 - When deleting a snapshot that contains the last record of a given INode, the fsimage may become corrupt because the create list of the snapshot diff in the previous snapshot and the child list of the parent INodeDirectory are not cleaned.HADOOP-12464 - Interrupted client may try to fail over and retryHADOOP-12604 - Exception may be swallowed in KMSClientProviderHDFS-8211 - DataNode UUID is always null in the JMX counterHDFS-9092 - NFS silently drops overlapping write requests and causes data copying to failHDFS-9358 - TestNodeCount#testNodeCount timed outMAPREDUCE-6302 - Incorrect headroom can lead to a deadlock between map and reduce allocationsYARN-3464 - Race condition in LocalizerRunner kills localizer before localizing all resourcesYARN-4

We are pleased to announce the release of Impala JDBC v2.5.31 driver. This release has the following fixes and enhancements: Issues resolved:When translating a query that contains an implicit join, the driver disables the implicit join by using CROSS JOIN syntax.If an invalid server-side property is specified, the driver fails to connect. The driver now posts a warning for the invalid server-side property and continues the connection process.When handling multiple connections at the same time, in some cases the driver returns a conversion error when attempting to convert INT data into Long data.The driver no longer removes hints from queries. To preserve hints, the driver does not translate queries that contain hints even when it is configured to work in translation mode (UseNativeQuery=0).Driver returns error when casting data to type TIMESTAMP.When the Driver.getPropertyInfo() method is called, the driver returns a null pointer exception.Driver casts NULL values to type STRING regard

All,   Cloudera's docs have a new look and improved performance & usability. Read the details here:   http://blog.cloudera.com/blog/2016/04/check-out-those-new-and-improved-cloudera-docs/ We look forward to your feedback!  

We are pleased to announce the release of Cloudera Enterprise 5.4.10 (CDH 5.4.10, Cloudera Manager 5.4.10, and Cloudera Navigator 2.3.10).  This release fixes key bugs and includes the following:CDH fixes for the following issues:FLUME-2712 - Optional channel errors slows down the Source to Main channel event rateFLUME-2886 - Optional Channels can cause OOMsHDFS-7553 - Fix the TestDFSUpgradeWithHA due to BindExceptionHDFS-9083 - Replication violates block placement policyHDFS-9092 - Nfs silently drops overlapping write requests and causes data copying to failHDFS-9406 - FSImage may get corrupted after deleting snapshotHDFS-9445 - Datanode may deadlock while handling a bad volumeMAPREDUCE-6302 - Incorrect headroom can lead to a deadlock between map and reduce allocationsMAPREDUCE-6460 - TestRMContainerAllocator.testAttemptNotFoundCausesRMCommunicatorException failsYARN-2902 - Killing a container that is localizing can orphan resources in the DOWNLOADING stateYARN-4204 - ConcurrentM

The organizers of HBaseCon, the conference for the Apache HBase community, have published the agenda for the conference (May 24, 2016, in San Francisco)—and once again, the impressive geographical and use-case diversity of HBase are on full display.   See full agenda/register here:   http://hbasecon.com

A new release of the RecordService beta (0.3.0) is now available; see details here:   http://community.cloudera.com/t5/Beta-Releases-Apache-Kudu/ANNOUNCE-RecordService-0-3-0-Released/m-p/39488#M190

Cloudera Enterprise 5.7 is now generally available (comprising CDH 5.7, Cloudera Manager 5.7, and Cloudera Navigator 2.6).   Cloudera is excited to announce the general availability of Cloudera Enterprise 5.7! Main highlights of this release include production-ready Hive-on-Spark functionality, which will help users accelerate their use of Apache Spark as a data processing standard; 2x performance gains for Apache Impala (incubating); easier cluster configuration and utilization reporting; and end-to-end encryption for Apache Spark data.   The release also contains a long list of incremental improvements across the stack, in addition to the usual hundreds of bug fixes (some of which were uncovered during our multi-dimensional hardening/QA process). Here is a partial list of those improvements (see the Release Notes for a full list):   Performance & Scale Hive-on-Spark GA (graduates from Cloudera Labs) 2x performance gains for Impala: Better join ordering and cardina

We are pleased to announce the release of the Cloudera Distribution of Apache Kafka 2.0.1 for CDH 5.  Apache Kafka is a highly scalable, distributed, publish-subscribe messaging system. Apache Kafka 2.0.1 is maintenance release for Kafka 2.0 with bug fixes listed below.Notable Issues Fixed in Cloudera Distribution of Apache Kafka 2.0.1Notable fixes backported into Kafka 2.0.1:KAFKA-3409: MirrorMaker hangs indefinitely due to commit.KAFKA-3378: Client blocks forever if SocketChannel connects instantly.KAFKA-3426: Improve protocol type errors when invalid sizes are received.KAFKA-3330: Truncate log cleaner offset checkpoint if the log is truncated.KAFKA-3463: Change default receive buffer size for consumer to 64K.KAFKA-1148: Delayed fetch/producer requests should be satisfied on a leader change.KAFKA-3352: Avoid DNS reverse lookups.KAFKA-3341: Improve error handling on invalid requests.KAFKA-3310: Fix for NPEs observed when throttling clients.KAFKA-2784: swallow exceptions when Mirr

We are pleased to announce the release of Hive ODBC v2.5.18 and Impala ODBC v2.5.32 drivers. This release has the following fixes and enhancements: Hive ODBC v2.5.18Enhancements & New FeaturesUpdated handling of result set metadataWhen connected to Hive 0.14 or later, the driver now reports result set columns as being updatable, improving compatibility with the DotNet Odbc library and OdbcDataAdapter.Updated default socket timeout thresholdThe default value of the Socket Timeout option (the SocketTimeout key) has been changed from 30 to 60.Resolved IssuesWhen attempting to connect to the server using a non-Windows version of the driver with Service Discovery Mode enabled, the client stops workingWhen executing a parameterized INSERT statement on a DATE, DECIMAL, or TIMESTAMP column, an error occursWhen executing a query that contains a large number of filters using OR operators, an error occurs Impala ODBC v2.5.32Advanced Kerberos authentication mechanism implementedThe driver

Dear Cloudera Users,   We are pleased to announce the general availability of the Cloudera Connector Powered by Teradata 1.5. This release fixes a compatibility issue with CDH 5.5.0 and later. See the download page for more details.   For more details on new features and usage of Cloudera Connector Powered by Teradata, see:   Release Notes Cloudera Connector Powered by Teradata version 1.5 Cloudera Connector Powered by Teradata User Guide, version 1.5 As always, we welcome your feedback. Please send your comments and suggestions through our new community forums.  You can also file bugs in the CDH project at issues.cloudera.org.

The Kudu team is happy to announce the availability of Kudu 0.7.1. Kudu is currently undergoing Incubation at the Apache Software Foundation. Kudu 0.7.1 is a bug fix release only for Kudu 0.7.0. Highlights:Notable bug fixes:KUDU-1325 fixes a tablet server crash that could occur during table deletion. In some cases, while a table was being deleted, other replicas would attempt to re-replicate tablets to servers that had already processed the deletion. This could trigger a race condition that caused a crash.KUDU-1341 fixes a potential data corruption and crash that could happen shortly after tablet server restarts in workloads that repeatedly delete and re-insert rows with the same primary key. In most cases, this corruption affected only a single replica and could be repaired by re-replicating from another.KUDU-1343 fixes a bug in the Java client that occurs when a scanner has to scan multiple batches from one tablet and then start scanning from another. In particular, this would a

The Kudu team is happy to announce the availability of Kudu 0.7.0. Kudu is currently undergoing Incubation at the Apache Software Foundation, with a beta available from Cloudera.   Kudu 0.7.0 includes improvements to client interfaces and metrics, and fixes for several key issues. We’re also releasing a refresh of the Impala Kudu parcel.   Highlights:   New features and improvements: The Python client has been completely rewritten, with a focus on improving code quality and testing. The read path (scanners) has been improved by adding many of the features already supported by the C++ and Java clients. The Python client is no longer considered experimental. KUDU-1321 Spark integration: a new API, kuduRDD,has been added, which wraps newAPIHadoopRDD and includes a default source for Spark SQL. KUDU-1250 The Java client includes new methods countPendingErrors() and getPendingErrors() on KuduSession. These methods allow you to count and retrieve outstanding row errors when

We are pleased to announce the release of Cloudera Enterprise 5.6. This release introduces a pluggable storage interface to allow support and management of data on shared storage appliances instead of on traditional direct attached storage.  EMC's newly released all-flash storage appliance, the DSSD D5, has been fully tested and qualified with this release and is now supported for CDH and Cloudera Manager.   Cloudera Enterprise 5.6.0 is identical to Cloudera Enterprise 5.5.2 except for the support for shared storage as described above. If you do not need DSSD support, you do not need to upgrade if you are already using the latest 5.5.x release (currently 5.5.2).   We look forward to you trying it, using the information below: Download Cloudera Enterprise View the documentation   For more information about the DSSD D5, see this Cloudera VISION Blog post by our Chief Strategy Officer Mike Olson.   As always, we are happy to hear your feedback. Please send y

Dear CDH Users,   We are pleased to announce the release of the Cloudera Distribution of Apache Kafka 2.0 for CDH 5.     Apache Kafka is a highly scalable, distributed, publish-subscribe messaging system. This release is based on Apache Kafka 0.9, and adds security features such as Kerberos authentication, wire encryption, secure mirroring, a new consumer API, per-user throttling, and many other features and bug fixes that solidify Kafka as an enterprise production-grade component of the Hadoop ecosystem. Kafka 2.0 also ships with new management tooling in Cloudera Manager, for point-and-click configuration of each new capability.   New Features in Cloudera Distribution of Apache Kafka 2.0 Kafka is rebased on Apache Kafka 0.9: http://archive.apache.org/dist/kafka/0.9.0.0/RELEASE_NOTES.html. Kerberos authentication of connections from clients and other brokers, including to ZooKeeper. Wire encryption of communications from clients and other brokers using SSL. A new

On February 9th, 2016,  we announced the release of Cloudera Enterprise 5.5.2. Shortly after that, we discovered a severe bug in Cloudera Manager 5.5.2, so we decided to remove the release. CDH 5.5.2 was not affected by this bug.  Today we are releasing CDH 5.5.2, Cloudera Manager 5.5.2 and Cloudera Manager 5.5.3. All improvements, fixes, and changes in Cloudera Manager 5.5.2, as well as a change related to LDAP authentication, are included in Cloudera Manager 5.5.3. If you are upgrading from a previous version of Cloudera Manager, Cloudera recommends that you upgrade to version 5.5.3 or higher.   This release fixes key bugs and includes the following:CDH fixes for the following issues:(HBase) RegionCoprocessorHost System.nanoTime() performance bottleneck.(Hadoop) Exception may be swallowed in KMSClientProvider. (HDFS) Fix the TestDFSUpgradeWithHA due to BindException.(HDFS) Replication violates block placement policy.(HDFS) HttpFS does not parse ACL syntax correctl

On February 9th, 2016,  we announced the release of Cloudera Enterprise 5.5.2. Shortly after that, we discovered a severe bug in Cloudera Manager 5.5.2, so we decided to remove the release. CDH 5.5.2 is not affected by this bug. We will release Cloudera Manager 5.5.3 and CDH 5.5.2 soon.  Cloudera Manager 5.5.3 will include all the improvements, fixes, and changes that were in Cloudera Manager 5.5.2, plus the fix for the severe bug that was discovered.

We are pleased to announce the release of Cloudera Director 2.0.0.Cloudera Director provides a simple, reliable, enterprise-grade way to deploy, scale, and manage Apache Hadoop in the cloud of your choice. Cloudera Director is available as a free download for use with Cloudera Express and is fully supported with Cloudera Enterprise. Cloudera Director 2.0.0 includes the following new features:Support for AWS Spot Instances and Google Cloud Platform's Preemptible InstancesAutomated setup of clusters that are highly available and authenticated via KerberosAbility to automate submission of jobs to clusters with dynamic creation and termination of clustersAbility to run custom scripts after cluster setup and before cluster terminationEnhanced user interface with deeper insights into health of clustersIncreased reliability of cluster modifications, including rollback in some failure scenariosRHEL 7.1 support Links to the product and documentation are listed below:Download Cloudera Direc

We are pleased to announce the release of Hive ODBC v2.5.17 and Impala ODBC v2.5.31 drivers. This release has the following fixes and enhancements: Hive ODBC v2.5.17Support for Debian 6Data encryption and integrity support for the SASL SSPI pluginOptimized retrieval of result set schemasSupport for ODBC 3.80Improved implementation of SQLCancelUpgraded OpenSSL libraryUpgraded ICU libraryIssues resolved:The driver returns incorrect ODBC error code for authentication-related errors.When using the Windows version of the driver, a SideBySide error occurs due to a conflict in the OpenSSL and libcurl libraries being loaded.When attempting to execute a non-parameterized write-back statement multiple times, the driver only executes the statement against Hive once.The driver returns incorrect results for SET <property name> queries.When connected to Hive 0.13 or earlier, the driver cannot insert result sets from queries into tables.The driver does not correctly translate "INSERT OVERWRITE

Dear CDH, Cloudera Manager, and Cloudera Navigator users,We are pleased to announce the release of Cloudera Enterprise 5.3.9 (CDH 5.3.9, Cloudera Manager 5.3.9, Cloudera Navigator 2.2.9).  This release fixes key bugs and includes the following.CDH fixes for the following issues:Apache Commons Collections deserialization vulnerability, described in TSB-98Improve diagnostics information for HttpPutFailedExceptionCheckpointing failure caused by shared KerberosAuthenticatorCopying from the root to a subdirectory should be forbiddenEncryption zone on root not loaded from fsimage after NameNode restartKerberos credentials can expire if the KDC is slow to respondFor a full list of upstream JIRAs fixed in CDH 5.3.9, see the issues fixed section of the Release Notes.Cloudera Manager fixes for the following issues:Apache Commons Collections deserialization vulnerability, described in TSB-98For full list of issues fixed in Cloudera Manager 5.3.9, see the issues fixed section of the Release N