Cloudera is happy to announce the availability of parcels and packages for Apache Kudu 1.3.0- CDH 5.11.1. Apache Kudu 1.3.0- CDH 5.11.1 is a bug fix release, with no new features or backwards incompatible changes.   To upgrade Kudu to 1.3.0- CDH 5.11.1, see Upgrade Parcels or Upgrade Packages.   Issues Fixed in Kudu 1.3.0- CDH 5.11.1   KUDU-1999 - Fixed an issue where the Kudu Spark connector would fail to kinit with the principal and keytab provided to a job. KUDU-1993 - Fixed a validation issue with grouped gflags. KUDU-1981 - Fixed an issue where Kudu server components would fail to start on machines with fully-qualified domain names longer than 64 characters when security was enabled. This was due to hard-coded restrictions in the OpenSSL library. KUDU-1607 - Fixed a case in which a tablet replica on a tablet server could retain blocks of data which prevented it from being fully deleted. KUDU-1933 - Fixed an issue in which a tablet server would crash and fail to restart after a single tablet received more than two billion write operations. For a complete list of changes, bug fixes, and known issues, see the Kudu 1.3.0/ CDH 5.11.1 Release Notes.   As always, your feedback is appreciated. For general Kudu questions, visit the community page. If you have any questions related to the Kudu packages provided by Cloudera, including installation or configuration using Cloudera Manager, visit the Cloudera Community Forum. ... View more

Dear CDH, Cloudera Manager, and Cloudera Navigator users,   We are pleased to announce the release of Cloudera Enterprise 5.8.5 (CDH 5.8.5, Cloudera Manager 5.8.5, and Cloudera Navigator 2.7.5.).   This release fixes key bugs and includes the following:   CDH fixes for the following issues: FLUME-2798 - Malformed Syslog messages can lead to OutOfMemoryException FLUME-2812 - Fix semaphore leak causing java.lang.Error: Maximum permit count exceeded in MemoryChannel HADOOP-13579 - Fix source-level compatibility after HADOOP-11252 HDFS-11229 - HDFS-11056 failed to close meta file HIVE-11487 - Add getNumPartitionsByFilter api in metastore api HIVE-12465 - Hive might produce wrong results when (outer) joins are merged HIVE-12768 - Thread safety: binary sortable serde decimal deserialization HUE-3065 - [oozie] Sub-workflow submitted from coordinator gets parent workflow graph HUE-4147 - [useradmin] Ignore (objectclass=*) filter when searching for LDAP users IMPALA-3018 - Don't return NULL on zero length allocations IMPALA-3159 - impala-shell does not accept wildcard or SAN certificates IMPALA-3167 - Fix assignment of WHERE conjunct through grouping agg + OJ. IMPALA-3861 - Replace BetweenPredicates with their equivalent CompoundPredicate YARN-3251 - Fixed a deadlock in CapacityScheduler when computing absoluteMaxAvailableCapacity in LeafQueue For a full list of upstream JIRAs fixed in CDH 5.8.5, see the issues fixed section of the Release Notes.   Cloudera Manager fixes for the following issues: Placement rules in DRP UI should provide option to not create sub-pools: Nested User Pools (except existingSecondaryGroup) now support create=true|false as a checkbox in the UI. HBase configuration is supplied for Hive when HBase service is not selected: Fixed an issue where Cloudera Manager provided configuration for the hive-site.xml file even if the HBase Service setting in Hive is not selected, which could cause unnecessary errors when Hive-on-Spark attempts to connect to HBase. Cloudera Manager now correctly emits the HBase-related configuration in the hive-site.xml only when Hive is dependent on HBase. For a full list of issues fixed in Cloudera Manager 5.8.5, see the issues fixed section of the Release Notes.   We look forward to you trying it, using the information below: Download Cloudera Enterprise View the documentation   As always, we are happy to hear your feedback. Please send your comments and suggestions to the user group or through our community forums. You can also file bugs through our external JIRA projects on issues.cloudera.org. ... View more

Dear CDH, Cloudera Manager, and Cloudera Navigator users,   We are pleased to announce the release of Cloudera Enterprise 5.9.2 (CDH 5.9.2, and Cloudera Manager 5.9.2.) This release fixes key bugs and includes the following:   CDH fixes for the following issues: FLUME-2812 - Fix semaphore leak causing java.lang.Error: Maximum permit count exceeded in MemoryChannel HBASE-15378 - Scanner cannot handle heartbeat message with no results HBASE-15931 - Add log for long-running tasks in AsyncProcess HBASE-16289 AsyncProcess stuck messages need to print region/server HBASE-16304 - HRegion#RegionScannerImpl#handleFileNotFoundException may lead to deadlock when trying to obtain write lock on updatesLock HDFS-10763 - Open files can leak permanently due to inconsistent lease update HIVE-12465 - Hive might produce wrong results when (outer) joins are merged HIVE-12768 - Thread safety: binary sortable serde decimal deserialization HIVE-13539 - HiveHFileOutputFormat searching the wrong directory for HFiles HUE-3079 - [jb] Display jobs from JHS (YARN and Spark) and their logs when not in RM HUE-4546 - [editor] Cannot execute any Hive query: 'NoneType' object has no attribute 'update_data' IMPALA-1702 - Enforce single-table consistency in query analysis. IMPALA-3167 - Fix assignment of WHERE conjunct through grouping agg + OJ. IMPALA-3552 - Make incremental stats max serialized size configurable IMPALA-3875 - Thrift threaded server hang in some cases SQOOP-2950 - Sqoop trunk has consistent UT failures - need fixing YARN-3251 - Fixed a deadlock in CapacityScheduler when computing absoluteMaxAvailableCapacity in LeafQueue For a full list of upstream JIRAs fixed in CDH 5.9.2, see the issues fixed section of the Release Notes.   Cloudera Manager fixes for the following issues: Dollar sign '$' character in password results in an IllegalArgumentException: Fixed an issue where CSD-based services could not use certain special characters like '$' without getting an exception. This is most frequently an issue for passwords.   Hive Replication fails when Impala is SSL enabled but Hadoop services are not: Fixed an issue where a NullPointerException is thrown when using Hive Replication with SSL enabled on an Impala service but not on other Hadoop services.   For a full list of issues fixed in Cloudera Manager 5.9.2, see the issues fixed section of the Release Notes.   We look forward to you trying it, using the information below: Download Cloudera Enterprise View the documentation   As always, we are happy to hear your feedback. Please send your comments and suggestions to the user group or through our community forums. You can also file bugs through our external JIRA projects on issues.cloudera.org.       ... View more

Cloudera is pleased to announce that Cloudera Enterprise 5.11 is now generally available (GA). The highlights of this release include lineage support for Apache Spark, Apache Kudu security integration, embedded data discovery for self-service BI, and new cloud capabilities for Microsoft ADLS and Amazon S3.   As usual, there are also a number of quality enhancements, bug fixes, and other improvements across the stack. Here is a partial list of what’s included (see the Release Notes for a full list):   Core Platform and Cloud Amazon S3 Consistency: S3Guard ensures that operations on Amazon S3 are immediately visible to other clients, making it easier to migrate workloads from consistent file systems like HDFS to Amazon S3. Support for Azure Data Lake Store (ADLS): Microsoft introduced ADLS to provide a cost-effective, persistent storage layer for big data applications. With  C5.11, Hive, Spark, and MapReduce can all directly operate on data stored in ADLS, enabling separation of compute and storage and transient clusters on the Azure cloud. S3 At-Rest encryption with AWS KMS: This feature enables at-rest, server-side encryption for data stored in S3 with encryption keys managed by Amazon’s Key Management Service (KMS). With this integration, Cloudera engines can leverage the management and control capabilities of AWS KMS to improve S3 data encryption. Director-support for long-lived clusters: Director 2.4 adds advanced synchronization features for long-lived clusters managed by Cloudera Manager.   Users can now upgrade clusters, add services, and assign roles in Cloudera Manager while keeping a healthy connection to Cloudera Director, making it easy for add or remove nodes at any time. This combination is especially powerful for cloud-based Analytic Database use cases. Data Science & Engineering Spark Lineage: Cloudera Navigator lineage support now extends to Apache Spark. With automatic collection and visualization of lineage, users can quickly identify the provenance, usage, and impact of any dataset for regulatory compliance and end user discovery.   Continued Performance Optimizations for Hive-on-S3: Cloud-native batch workloads are up to 5x faster (compared to 5.10) for greater cost-savings in the cloud.   Operational DB Kudu Authentication/Security (also applies to Analytic DB😞 The integration of Apache Kudu with Kerberos enables the authentication of users and servers. Kudu also now features wire encryption with transport layer security and coarse-grained service level authorization. Improved HBase scalability and efficiency: HBase now leverages better medium object store (MOB) compaction policies to improve scalability. Additionally, the default splitting policy has been updated to minimize the number of required region servers. Analytic DB Embedded Data Discovery for Self-Service BI: Hue now leverages metadata from Cloudera Navigator to make it faster and easier for SQL developers to discover and interact with relevant sets of tables, including the ability to search across tags and add tags directly from the UI. Navigator Optimizer Anonymization for Secure Workload Analysis: Cloudera Navigator Optimizer now supports workload anonymization to protect sensitive information in SQL workloads during analysis and comply with data protection regulations.   The full contents of this release include: Cloudera Enterprise 5.11 (comprising CDH 5.11, Cloudera Manager 5.11, and Cloudera Navigator 2.10) Cloudera Director 2.4 Apache Kudu 1.3 Cloudera Distribution of Kafka (CDK) 2.1 Cloudera Navigator Optimizer Updates   Over the next few weeks, we’ll publish blog posts that cover some of these features in detail. In the meantime you can access the following links for additional information: Download Cloudera Enterprise 5.11 Explore documentation   As always, we value your feedback; please provide any comments and suggestions through our community forums. You can also file bugs via issues.cloudera.org. ... View more

Cloudera is happy to announce the availability of parcels and packages for Apache Kudu 1.2.0/ CDH 5.10.1. Apache Kudu 1.2.0/ CDH 5.10.1 is a bug fix release, with no new features or backwards incompatible changes.   To upgrade Kudu to 1.2.0/ CDH 5.10.1, see Upgrade Parcels or Upgrade Packages.   Issues Fixed in Kudu 1.2.0/ CDH 5.10.1   KUDU-1904 - Fixed a bug where RLE columns with only NULL values would crash on scan. KUDU-1899 - Fixed an issue where tablet servers would crash after inserting an empty string primary key (""). KUDU-1851 - Fixed an issue with the Python client which would crash whenever a TableAlterer is instantiated directly. KUDU-1852 - KuduTableAlterer will no longer crash when given nullptr range bound arguments. KUDU-1821 - Improved warnings when the catalog manager starts For a complete list of changes, bug fixes, and known issues, see the Kudu 1.2.0/ CDH 5.10.1 Release Notes.   As always, your feedback is appreciated. For general Kudu questions, visit the community page. If you have any questions related to the Kudu packages provided by Cloudera, including installation or configuration using Cloudera Manager, visit the Cloudera Community Forum. ... View more

We are pleased to announce the release of the Cloudera Distribution of Apache Kafka 2.1.1 for CDH 5.  Apache Kafka is a highly scalable, distributed, publish-subscribe messaging system.   Apache Kafka 2.1.1 is maintenance release for Kafka 2.1.0.   Notable Issues Fixed in Cloudera Distribution of Apache Kafka 2.1.1   KAFKA-3965: MirrorMaker should not commit offset when exception is thrown from producer.send KAFKA-4158: Reset quota to default value if quota override is deleted KAFKA-2720: Expire group metadata when all offsets have expired KAFKA-3810: replication of internal topics should not be limited by replica.fetch.max.bytes All backported fixes can be viewed in the git release notes here or on our website under the Issues fixed section.     We look forward to you trying Kafka 2.1.1. For more information, please use the links below: Install or upgrade Kafka Review the documentation Review the Release Notes   As always, we welcome your feedback. Please send your comments and suggestions through our community forums. ... View more

Dear CDH, Cloudera Manager, and Cloudera Navigator users,   We are pleased to announce the release of Cloudera Enterprise 5.10.1 (CDH 5.10.1, Cloudera Manager 5.10.1, Cloudera Navigator 2.9.1, and Key Trustee Server 5.10.1).   This release fixes key bugs and includes the following:   CDH fixes for the following issues: FLUME-2812 - Fix semaphore leak causing java.lang.Error: Maximum permit count exceeded in MemoryChannel. HBASE-15378 - Scanner cannot handle heartbeat message with no results. HBASE-15931 - Add log for long-running tasks in AsyncProcess HBASE-16289 HDFS-11379 - DFSInputStream may infinite loop requesting block locations. AsyncProcess stuck messages need to print region/server. HIVE-12465 - Hive might produce wrong results when (outer) joins are merged. HIVE-15338 - Wrong result from non-vectorized DATEDIFF with scalar parameter of type DATE/TIMESTAMP. IMPALA-4263 - Fix wrong omission of agg/analytic hash exchanges. IMPALA-4282 - Remove max length check for type strings. IMPALA-4767 - Workaround for HIVE-15653 to preserve table stats. IMPALA-4854 - Fix incremental stats with complex types. SENTRY-1508 - MetastorePlugin.java does not handle properly initialization failure For a full list of upstream JIRAs fixed in CDH 5.10.1, see the issues fixed section of the Release Notes.   Cloudera Manager fixes for the following issues: Placement rules in DRP UI should provide option to not create sub-pools: Nested User Pools now include the Create pool if it does not exist checkbox in the Cloudera Manager Admin Console to select whether to create the sub-pool. Warning about suspicious non-ASCII punctuation character in KMS ACLs: When setting up the KMS ACLs for HDFS encryption, the warning "Suspicious non-ASCII punctuation character "’" at character position 9118". This warning can be safely ignored, and editing any KMS ACL in Cloudera Manager will make the warning disappear. This bug fix removes this warning. For a full list of issues fixed in Cloudera Manager 5.10.1, see the issues fixed section of the Release Notes. Cloudera Navigator fixes for the following issues: Viewing deleted properties in managed metadata shows incorrect search results: Managed Metadata property previously drilled down to incorrect search results. The results are now displayed correctly. Edit Managed Metadata link available for users with insufficient privilege: The Edit Managed Metadata link was available to users who did not have sufficient privilege levels (AUTH_WRITE_MANAGED_METADATA) to view it. The link is now available only to users with the correct privileges. For a full list of issues fixed in Cloudera Navigator 2.9.1, see the issues fixed section of the Release Notes   Key Trustee Server fixes for the following issue: Key Trustee Server logs omit timestamps: The Key Trustee Server log entries do not include timestamps. For a full list of issues fixed in Key Trustee Server 5.10.1, see the issues fixed section of the Release Notes.   We look forward to you trying it, using the information below: Download Cloudera Enterprise View the documentation   As always, we are happy to hear your feedback. Please send your comments and suggestions to the user group or through our community forums. You can also file bugs through our external JIRA projects on issues.cloudera.org. ... View more

We are pleased to announce the general availability of the Cloudera Connector for Netezza 1.5c5.   New Features in Cloudera Connector for Netezza 1.5c5   Fixed import in direct mode with multi-schema by removing unnecessary object owner check. Added fail fast scenario for import with --as-parquetfile in direct mode. Added fail fast scenario for import with --as-avrodatafile in direct mode. For more details on new features and usage of Cloudera Connector for Netezza, see:   Release Notes Cloudera Connector for Netezza Version 1.5c5 Cloudera Connector for Netezza User Guide, version 1.5c5   As always, we welcome your feedback. Please send your comments and suggestions through our new community forums.  You can also file bugs in the CDH project at issues.cloudera.org. ... View more

Dear CDH, Cloudera Manager, and Cloudera Navigator users,   We are pleased to announce the release of Cloudera Enterprise 5.7.6 (CDH 5.7.6, Cloudera Manager 5.7.6, and Cloudera Navigator 2.6.6).   This release fixes key bugs and includes the following:   CDH fixes for the following issues:   HADOOP-13838 - KMSTokenRenewer should close providers HBASE-15430 - Failed taking snapshot - Manifest proto-message too large HDFS-10271 - Extra bytes are getting released from reservedSpace for append HDFS-10763 - Open files can leak permanently due to inconsistent lease update HDFS-11229 - HDFS-11056 failed to close meta file HIVE-12465 - Hive might produce wrong results when (outer) joins are merged HIVE-13539 - HiveHFileOutputFormat searching the wrong directory for HFiles HIVE-15338 - Wrong result from non-vectorized DATEDIFF with scalar parameter of type DATE/TIMESTAMP HUE-4466 - [security] Deliver csrftoken cookie with secure bit set if possible IMPALA-3875 - Thrift threaded server hangs in some cases IMPALA-4363 - Add Parquet timestamp validation IMPALA-4423 - Correct but conservative implementation of Subquery.equals() IMPALA-4488 - HS2 GetOperationStatus() should keep session alive IMPALA-4550 - Fix CastExpr analysis for substituted slots IMPALA-4765 - Avoid using several loading threads on one table SOLR-10031 - Validation of filename params in ReplicationHandler SQOOP-2983 - OraOop export has degraded performance with wide tables   For a full list of upstream JIRAs fixed in CDH 5.7.6, see the issues fixed section of the Release Notes.   Cloudera Manager fixes for the following issues:   Dollar sign ($) char in password results in IllegalArgumentException: Using special characters such as the dollar sign ($) for passwords and other user-supplied values with CSD-based services (those added to Cloudera Manager with custom service descriptors) raised exceptions. This has been resolved. Cloudera Manager server error - JsonMappingException: Fixed an issue where a race condition can happen when getting the log links for unhealthy roles and then cause a null pointer exception for the Cloudera Manager homepage.   For a full list of upstream JIRAs fixed in CM 5.7.6, see the issues fixed section of the Release Notes.   We look forward to you trying it, using the information below:   Download Cloudera Enterprise View the documentation   As always, we are happy to hear your feedback. Please send your comments and suggestions to the user group or through our community forums. You can also file bugs through our external JIRA projects on issues.cloudera.org. ... View more

Dear CDH, Cloudera Manager, and Cloudera Navigator users,   We are pleased to announce the release of Cloudera Enterprise 5.8.4 (CDH 5.8.4 and Cloudera Manager 5.8.4). This release fixes key bugs and includes the following:   CDH fixes for the following issues:   FLUME-2812 - Fix semaphore leak causing java.lang.Error: Maximum permit count exceeded in MemoryChannel HADOOP-12483 - Maintain wrapped SASL ordering for postponed IPC responses HADOOP-13838 - KMSTokenRenewer should close providers HBASE-15430 - Failed taking snapshot - Manifest proto-message too large HBASE-17072 - CPU usage starts to climb up to 90-100% when using G1GC HDFS-6962 - ACLs inheritance conflict with umaskmode HDFS-10763 - Open files can leak permanently due to inconsistent lease update HIVE-12465 - Hive might produce wrong results when (outer) joins are merged HIVE-13539 - HiveHFileOutputFormat searching the wrong directory for HFiles HUE-4546 - Auto-strip invalid characters from name field of converted docs IMPALA-1702 - Enforce single-table consistency in query analysis IMPALA-3167 - Fix assignment of WHERE clause predicate through grouping aggregate and outer join IMPALA-3552 - Make incremental stats max serialized size configurable IMPALA-3875 - Thrift threaded server hang in some cases IMPALA-3964 - Fix crash when a count(*) is performed on a nested collection IMPALA-4037 - ChildQuery::Cancel() appears to violate lock ordering SENTRY-1313 - Database prefix is not honored when executing grant statement SQOOP-2950 - Fix Sqoop trunk consistent UT failures   For a full list of upstream JIRAs fixed in CDH 5.8.4, see the issues fixed section of the Release Notes.   Cloudera Manager fixes for the following issues:   Dollar sign ($) character in password results in IllegalArgumentException: Using special characters such as the dollar sign ($) for passwords and other user-supplied values with CSD-based services (those added to Cloudera Manager with custom service descriptors) raised exceptions. This has been resolved. Hive replication command should update copy the SerDe properties correctly: Hive replication now replicates the SerDe properties and also copies the corresponding HDFS file.   For a full list of issues fixed in Cloudera Manager 5.8.4, see the issues fixed section of the Release Notes.   We look forward to you trying it, using the information below: Download Cloudera Enterprise View the documentation   As always, we are happy to hear your feedback. Please send your comments and suggestions to the user group or through our community forums. You can also file bugs through our external JIRA projects on issues.cloudera.org. ... View more