Dear CDH, Cloudera Manager, and Cloudera Navigator users,   We are pleased to announce the release of Cloudera Enterprise 6.1.1 (CDH 6.1.1, Cloudera Manager 6.1.1, and Cloudera Navigator 6.1.1). This release fixes key bugs and includes the following:   The following upstream issues are fixed in CDH 6.1.1: IMPALA-7777 - Fixed a crash due to arithmetic overflows in the Exchange Node. HBASE-21503 - Replication normal source can get stuck due potential race conditions between source wal reader and wal provider initialization threads. HBASE-21621 - Reversed scan does not return expected number of rows HIVE-14557 - Nullpointer When both SkewJoin and Mapjoin Enabled KUDU-1678 - Fixed a rare crash caused by a race condition when a replica is shutting down while processing an alter table. For a full list of upstream JIRAs fixed in CDH 6.1.1, see the issues fixed section of the Release Notes. Cloudera Manager fixes for the following issues: Backup and disaster recovery (BDR) HDFS and Hive replications will fail on clusters running Cloudera Manager 6.1.0 The Add Hosts link on the Cloudera Director page is broken in the public cloud scenario BDR fails if dfs.nameservices is overridden with multiple nameservice names The diff format is not displayed on the configuration revisions diff page Decommissioning a DataNode during a current decommission (in parallel) never completes For a full list of issues fixed in Cloudera Manager 6.1.1, see the issues fixed section of the Release Notes. Cloudera Navigator fixes for the following issues: Correction to lineage input and output counts Duplicate data flow relations after Sqoop operation Corrected exception produced during S3 extraction   For a full list of issues fixed in Cloudera Navigator 6.1.1, see the issues fixed section of the Release Notes.   We look forward to you trying the new release by using the information below: Download Cloudera Enterprise View the documentation   As always, we are happy to hear your feedback. Please send your comments and suggestions to the user group or through our community forums. You can also file bugs through our external JIRA projects on issues.cloudera.org. ... View more

Dear CDH, Cloudera Manager, and Cloudera Navigator users, We are pleased to announce the release of Cloudera Enterprise 5.15.2 (CDH 5.15.2, Cloudera Manager 5.15.2, and Cloudera Navigator 2.14.2). This release fixes key bugs and includes the following:   The following upstream issues are fixed in CDH 5.15.2: HIVE-12981 - ThriftCLIService uses incompatible getShortName() implementation HUE-8487 - [useradmin] Fix Add Sync LDAP user fails when using DN with special character HUE-8467 - [jobbrowser] Support impala digest auth for queries HDFS-12299 - Fixed a race between update pipeline and DataNode Re-Registration. KUDU-2463 - Fixed an issue in which incorrect results would be returned in scans following a server restart. For a full list of upstream JIRAs fixed in CDH 5.15.2, see the issues fixed section of the Release Notes. Cloudera Manager fixes for the following issues: Restart Warnings are incorrect after starting a role with an outdated configuration Upgrade to CDH 5.15.2 fails with CM 5.15.2 and OpenJDK Kafka JMX connections listen on all interfaces unnecessarily Flume uses default values for Kafka TLS settings For a full list of issues fixed in Cloudera Manager 5.15.2, see the issues fixed section of the Release Notes. Cloudera Navigator fixes for the following issues: Connection timeout increased in Navigator Audit Server to avoid broken pipe errors Navigator Metadata Server failed to start with InvalidClassException, local class incompatible Navigator Metadata Server purge did not run at the scheduled time Support for PostgreSQL 10 Navigator Metadata Server has high CPU usage, linking taking too long after Spark extraction ClassCastException in Navigator Metadata Server log Authentication fails with javax.naming.PartialResultException when using LDAP   For a full list of issues fixed in Cloudera Navigator 2.14.2, see the issues fixed section of the Release Notes.   We look forward to you trying the new release by using the information below: Download Cloudera Enterprise View the documentation   As always, we are happy to hear your feedback. Please send your comments and suggestions to the user group or through our community forums. You can also file bugs through our external JIRA projects on issues.cloudera.org.   ... View more

Dear CDH, Cloudera Manager, and Cloudera Navigator users,   We are pleased to announce the release of Cloudera Enterprise 5.15.1 (CDH 5.15.1, Cloudera Manager 5.15.1, and Cloudera Navigator 2.14.1).   This release fixes key bugs and includes the following:   The following upstream issues are fixed in CDH 5.15.1: FLUME-3222 - Fix for NoSuchFileException thrown when files are being deleted HADOOP-15317 - Improve NetworkTopology chooseRandom's loop HDFS-13281 - Namenode#createFile should be /.reserved/raw/ aware HDFS-12710 - HTTPFS HTTP max header size env variable is not respected in branch-2 HIVE-19231 - Beeline generates garbled output when using UnsupportedTerminal HIVE-16080 - Add parquet to possible values for hive.default.fileformat and hive.default.fileformat.managed HUE-6697 - [jb] Prevent reset of job page tabs when job is running HUE-8344 - [hbase] Hbase old version of data can not display in Hue HUE-8409 - [core] When idle session timeout is enabled it causes issues with Spnego HUE-8159 - [oozie] Unable to create Workflow/Schedule using Java document Action HUE-8159 - [oozie] Unable to create Workflow/Schedule using Java document Action HUE-8217 - [dashboard] Fix HTML resultset widget templating HUE-8170 - [useradmin] Fix LDAP sync (ldap_access.py) certificate validation logic SENTRY-2184 - Performance Issue: MPath is queried for each MAuthzPathsMapping in full snapshot SPARK-13709 - [SQL] Initialize deserializer with both table and partition properties when reading partitioned tables For a full list of upstream JIRAs fixed in CDH 5.15.1, see the issues fixed section of the Release Notes.   Cloudera Manager fixes for the following issues: Flume uses default values for Kafka TLS settings Abort Installation button causes errors Host Inspector reports identical JDK versions as different. Upgrading a license finishes on wrong page Cloudera Manager should not omit LDAP GROUP_MAPPING passwords from NodeManager Do not expose configuration history to non-admin users. Cloudera Manager upgrade page load issues in Internet Explorer Gateway roles and Isilon replication jobs Cloudera Backup and Disaster Recovery cannot import Hive metadata Threshold settings prevent correct configuration Make Instances and Hosts page refresh when a command dialog is closed Null Pointer Exception on Cloudera Manager Upgrade Page Spark cross-realm authentication fails Yarn Application Masters fail when a concurrent Deploy Client Configuration job is executedloy client configuration Cloudera Manager does not list any CDH package options other than "custom” For a full list of issues fixed in Cloudera Manager 5.15.1, see the issues fixed section of the Release Notes.   Cloudera Navigator fixes for the following issues: "GenericEntity cannot be cast" Exception Missing Audit Events Corrected Metadata Extraction from YARN-run Hive Query Too many open files on the Navigator Metadata Server Spark agent Trust Store password encrypted "Lineage Diagram is limited to 3000 entities" Error Navigator Console Handles Increased Property Limits Improved Console Editing for Float and Double Property Types Automated clean-up when Navigator Metadata Server Storage Directory is Cleared Linking fails with NullPointerException Navigator linking failed with errors similar to the following: ERROR org.apache.solr.core.SolrCore [qtp1200906406-61]:            java.lang.NullPointerException ERROR com.cloudera.nav.persist.impl.CompositeLinker [CDHExecutor-0-CDHUrlClassLoader@23e992bf]: Internal error while linking. java.lang.NullPointerException Multiple Cluster Extractor Failure Web Server and Platform Version Disclosure Removed Pre-registration of Hive/Impala Queries Less Secure Credentials Protection Policy could expose Azure credentials in audit logs API Error when Adding an Audit Filter in Navigator Console (Oracle)   For a full list of issues fixed in Cloudera Navigator 2.14.1, see the issues fixed section of the Release Notes.   Key Trustee KMS fixes for the following issues: Validation fails if hostname command returns shortname For a full list of issues fixed in Key Trustee KMS 5.15.1, see the issues fixed section of the Release Notes.   Navigator Encrypt fixes for the following issues: Kernel modules updates to support RHEL 7.5 We look forward to you trying the new release by using the information below: Download Cloudera Enterprise View the documentation   As always, we are happy to hear your feedback. Please send your comments and suggestions to the user group or through our community forums. You can also file bugs through our external JIRA projects on issues.cloudera.org. ... View more

Dear CDH, Cloudera Manager, and Cloudera Navigator users,   We are pleased to announce the release of Cloudera Enterprise 5.14.4 (CDH 5.14.4, Cloudera Manager 5.14.4, and Cloudera Navigator 2.13.4).   This release fixes key bugs and includes the following:   The following upstream issues are fixed in CDH 5.14.4: HADOOP-15317 - Improve NetworkTopology chooseRandom's loop. HDFS-13170 - Port webhdfs unmaskedpermission parameter to HTTPFS HUE-8159 - [oozie] Unable to create Workflow/Schedule using Java document Action HUE-8217 - [dashboard] Fix HTML resultset widget templating HUE-8170 - [useradmin] Fix LDAP sync (ldap_access.py) certificate validation logic HUE-8159 - [oozie] Unable to create Workflow/Schedule using Java document Action HUE-7946 - [jb] Link to subworkflow on workflow dashboard page 404s in Hue 4 KUDU-2331 - The `kudu tablet change_config move_replica` tool no longer fails for an unavailable tablet server if the tablet server is not the source or destination of the move. SENTRY-2184 - Performance Issue: MPath is queried for each MAuthzPathsMapping in full snapshot SPARK-13709 - [SQL] Initialize deserializer with both table and partition properties when reading partitioned tables For a full list of upstream JIRAs fixed in CDH 5.14.4, see the issues fixed section of the Release Notes. Cloudera Manager fixes for the following issues: For running replication jobs, do not exclude the gateway roles for Isilon clusters Save Changes remains enabled after clicking (possibly autocomplete issue) Cloudera Backup and Disaster Recovery cannot import Hive metadata Do not expose configuration history to non-admin users. Cloudera Manager should not omit LDAP GROUP_MAPPING passwords from NodeManager Errors thrown for Hive replications managed by a single Cloudera Manager Agent exception "Could not evaluate resource {u'hard_limit': 500, u'soft_limit': 300}: 'unicode' object has no attribute 'items'" container-executor.cfg and taskcontroller.cfg can get removed by running Deploy Client Configuration Host installation or upgrade using key based authentication where private key is protected by passphrase does not work Cloudera Manager does not list any CDH package options other than "custom For a full list of issues fixed in Cloudera Manager 5.14.4, see the issues fixed section of the Release Notes. Cloudera Navigator fixes for the following issues: "GenericEntity cannot be cast" Exception Missing Audit Events Multiple Cluster Extractor Failure   For a full list of issues fixed in Cloudera Navigator 2.13.4, see the issues fixed section of the Release Notes. We look forward to you trying the new release by using the information below: Download Cloudera Enterprise View the documentation   As always, we are happy to hear your feedback. Please send your comments and suggestions to the user group or through our community forums. You can also file bugs through our external JIRA projects on issues.cloudera.org. ... View more

We are pleased to announce the general availability of the Cloudera Connector Powered by Teradata 1.7c5. New Features in Cloudera Connector Powered by Teradata Version 1.7c5 Support for Teradata 16.x. Support for importing tables without split-by column specified when the number of mappers is set to 1. Support for the internal.fastexport input method. For more details on new features and usage of Cloudera Connector Powered by Teradata, see Download Cloudera Connector Powered by Teradata Release Notes Cloudera Connector Powered by Teradata version 1.7c5 Cloudera Connector Powered by Teradata User Guide, version 1.7c5 As always, we welcome your feedback. Please send your comments and suggestions to the user group or through our community forums. You can also file bugs through our external JIRA projects at issues.cloudera.org. ... View more

  Dear CDH, Cloudera Manager, and Cloudera Navigator users,   On April 11, 2018, we announced the release of Cloudera Enterprise 5.14.2. Shortly after, we discovered a serious bug in Cloudera Manager 5.14.2. This resulted in Backup and Disaster Recovery (BDR) HDFS and Hive Replications potentially failing when replicating from source clusters that use HDFS HA and are managed by Cloudera Manager 5.13.3 or 5.14.2 to destination clusters managed by Cloudera 5.14.2.   Today we released Cloudera Manager 5.14.3 to fix these issues. Please upgrade to this release instead of Cloudera Manager 5.14.2. For more details, see the Fixed Issues section of the Release Notes. Please use the following information to assist in your implementation: Download Cloudera Enterprise View the documentation   As always, we welcome your feedback. Please send your comments and suggestions to the user group or through our community forums. You can also file bugs through our external JIRA projects at issues.cloudera.org. ... View more

Dear CDH, Cloudera Manager, and Cloudera Navigator users,   We are pleased to announce the release of Cloudera Enterprise 5.14.2 (CDH 5.14.2, Cloudera Manager 5.14.2, and Cloudera Navigator 2.12.3). This release fixes key bugs and includes the following:   The following upstream issues are fixed in CDH 5.14.2: HBASE-14252 - RegionServers fail to start when setting hbase.ipc.server.callqueue.scan.ratio to 0 HDFS-13164 - File not closed if streamer fail with DSQuotaExceededException. HDFS-13040 - Kerberized inotify client fails despite kinit properly HIVE-16886 - Hive metastore (HMS) log notifications may have duplicated event IDs if multiple HMSs are running concurrently HIVE-11609 - Capability to add a filter to hbase scan via composite key doesn't work HIVE-18127 - Do not strip '--' comments from shell commands issued from CliDriver HUE-8053 - [useradmin] LDAP authentication with sync_groups_on_login=true fails with KeyError exception HUE-7646 - [sentry] Changing role privileges removes HDFS ACLs HUE-8055 - [desktop] Support multiple LDAP servers in LDAP Test command HUE-7932 - [oozie] Clicking on workflow with several decision nodes hangs Hue HUE-7874 - [oozie] SSH action missing configuration for retry-max and retry-interval HUE-7830 - [core] Non supported feature use_default_configuration doesn't work in Hue 4 HUE-8024 - [indexer] Use old collection API to avoid grant Update privilege HUE-8032 - [core] XSS in Hue Admin Interface IMPALA-6353: Crash in snappy decompressor IMPALA-6435: Codegen crash when UNIONing CHAR(n) literals IMPALA-6388: UnionNode sets the number of nodes incorrectly IMPALA-6295: Inconsistent handling of 'nan' and 'inf' with min/max analytic fns KUDU-2343 - Fixed an issue where the Java client would fail to connect to the leader master after a leadership change. MAPREDUCE-5124 - AM lacks flow control for task events PARQUET-1217 - Incorrect handling of missing values in Statistics PIG-5325 - Schema disambiguation can't be turned off for nested schemas SQOOP-2976 - Introduce a flag to expand decimal values to fit AVRO schema YARN-7622 - Allow fair-scheduler configuration on HDFS YARN-2416 - InvalidStateTransitonException in ResourceManager if AMLauncher does not receive response for startContainers() call in time For a full list of upstream JIRAs fixed in CDH 5.14.2, see the issues fixed section of the Release Notes. Cloudera Manager fixes for the following issues: CGroup Hard Memory resource reports incorrect units of measurement Scheduled snapshot and replication jobs are skipped The Replication performance CSV file header does not match content BDR Cloud (s3) Replication job fail with delegation token creation issue Cloudera Manager upgrade (5.14.0 to 5.14.1) stuck at refreshing package metadata - configurator not found Hive Replication export step fails with StaleObjectStateException Add "sentry" group in "hadoop.proxyuser.hive.groups" on upgrade to CDH 5.13.0 and higher Spark CSD should emit proper environment variables for older CDH version 5.4.x Cloudera Manager Server reports 'Too many open files' error Table statistics are lost when replicating an existing table without partitions For a full list of issues fixed in Cloudera Manager 5.14.2, see the issues fixed section of the Release Notes. Cloudera Navigator fixes for the following issues: Purging Deleted Properties shows "Bad Request" error when viewing Hive entity details Console description improved for Purge cutoff time The flag for disabling purge was ignored in the UI Less Secure Credentials Protection Policy Missing Impala audit events for database-level operations Extracting Spark operation produced error message "Solr Manager can be used by only one thread" For a full list of issues fixed in Cloudera Navigator 2.13.2, see the issues fixed section of the Release Notes. We look forward to you trying the new release, using the information below: Download Cloudera Enterprise View the documentation   As always, we are happy to hear your feedback. Please send your comments and suggestions to the user group or through our community forums. You can also file bugs through our external JIRA projects on issues.cloudera.org.   ... View more

  Dear CDH, Cloudera Manager, and Cloudera Navigator users, We are pleased to announce the release of Cloudera Enterprise 5.13.3 (CDH 5.13.3, Cloudera Manager 5.13.3, and Cloudera Navigator 2.12.3). This release fixes key bugs and includes the following:   The following upstream issues are fixed in CDH 5.13.3: HDFS-13170 - Port webhdfs unmaskedpermission parameter to HTTPFS HDFS-13040 - Kerberized inotify client fails despite kinit properly HIVE-18526 HMS log notifications may have duplicated event IDs if multiple HMS are running concurrently HIVE-10815 causes HMS to generate events with duplicate eventIDs HUE-8053 - [useradmin] LDAP authentication with sync_groups_on_login=true fails with KeyError exception HUE-8055 - [desktop] Support multiple LDAP servers in LDAP Test command HUE-8032 - [core] XSS in Hue Admin Interface HUE-7932 - [oozie] Clicking on workflow with several decision nodes hangs Hue HUE-8024 - [indexer] Use old collection API to avoid grant Update privilege PARQUET-1217 - Incorrect handling of missing values in Statistics KUDU-2343 - java: properly reconnect to new leader master after failover YARN-2416 - InvalidStateTransitonException in ResourceManager if AMLauncher does not receive response for startContainers() call in time For a full list of upstream JIRAs fixed in CDH 5.13.3, see the issues fixed section of the Release Notes. Cloudera Manager fixes for the following issues: Cloudera Manager Server reports 'Too many open files' error For a full list of issues fixed in Cloudera Manager 5.13.3, see the issues fixed section of the Release Notes. Cloudera Navigator fixes for the following issues: Purging Deleted Properties shows "Bad Request" error when viewing Hive entity details Extracting Spark operation produced error message "Solr Manager can be used by only one thread" For a full list of issues fixed in Cloudera Navigator 2.12.3, see the issues fixed section of the Release Notes. We look forward to you trying the new release, using the information below: Download Cloudera Enterprise View the documentation   As always, we are happy to hear your feedback. Please send your comments and suggestions to the user group or through our community forums. You can also file bugs through our external JIRA projects on issues.cloudera.org.   ... View more

  Dear CDH, Cloudera Manager, and Cloudera Navigator users, We are pleased to announce the release of Cloudera Enterprise 5.13.2 (CDH 5.13.2, Cloudera Manager 5.13.2, and Cloudera Navigator 2.12.2). This release fixes key bugs and includes the following:   The following upstream issues are fixed in CDH 5.13.2: FLUME-3046 - Kafka Sink and Source Configuration Improvements HADOOP-14814 - Fix incompatible API change on FsServerDefaults to HADOOP-14104 HBASE-14252 - RegionServers fail to start when setting hbase.ipc.server.callqueue.scan.ratio to 0 HDFS-12052 - Set SWEBHDFS delegation token kind when ssl is enabled in HttpFS HIVE-18127 - Do not strip '--' comments from shell commands issued from CliDriver HIVE-15519 - BitSet not computed properly for ColumnBuffer subset HIVE-14303 - CommonJoinOperator.checkAndGenObject should return directly to avoid NPE if ExecReducer.close is called twice HIVE-11609 - Capability to add a filter to hbase scan via composite key doesn't work HUE-7830 - [core] Non supported feature use_default_configuration doesn't work in Hue 4 HUE-7874 - [oozie] SSH action missing configuration for retry-max and retry-interval HUE-7676 - [core] skip_trash for hue_config_validation HUE-7692 - [editor] Upgrade failure from from CDH <= 5.4 HUE-7739 - [metastore] Fix column context popover in the table browser HUE-7647 - [core] Group sync fails when a non-standard (not uid) user_name_attr is used HUE-7533 - [fb] Wrong error message in UI with 500 error when user tries to edit read_only file in File browser HUE-7564 - Remove one of the get_connection(ldap_config) function in ldap_access.py. HUE-7646 - [sentry] Changing role privileges removes HDFS ACLs HUE-7624 - [core] Support multi-authentication with AllowFirstUserDjangoBackend and LdapBackend HUE-7697 - [core] Allow Kerberos Renewer to retry kinit multiple times MAPREDUCE-5124 - AM lacks flow control for task events OOZIE-1401 - amend PurgeCommand should purge the workflow jobs w/o end_time PIG-5325 - Schema disambiguation can't be turned off for nested schemas SENTRY-2046 - Create a full snapshot if AUTHZ_PATHS_SNAPSHOT_ID is empty, even if HMS and Sentry Notifications are in sync YARN-7622 - Allow fair-scheduler configuration on HDFS For a full list of upstream JIRAs fixed in CDH 5.13.2, see the issues fixed section of the Release Notes. Cloudera Manager fixes for the following issues: Add "sentry" group in "hadoop.proxyuser.hive.groups" on upgrade to CDH 5.13.0 and higher BDR Cloud (s3) Replication job fail with delegation token creation issue Cluster upgrade fails in wizard with "There is already a pending command on this entity." Configuration "diff" throws TypeMismatchException Historical Disk Usage By User download CSV is not adding the metric type customer is choosing Hive Replication export step fails with StaleObjectStateException Hive Replication fails in unsecured clusters when proxy user is not a superuser on replication source Hive Replication jobs fail intermittently Collection of Impala logs should not fail even when some log files are not present Scheduled snapshot and replication jobs are skipped Table statistics are lost when replicating an existing table without partition The Replication performance CSV file header does not match content WebServerMetricCollector breaks Spark CSD should emit proper environment variables for older CDH version 5.4.x lsof output in host statistics can be huge due to duplicate per-thread entries For a full list of issues fixed in Cloudera Manager 5.13.2, see the issues fixed section of the Release Notes. Cloudera Navigator fixes for the following issues: Less Secure Credentials Protection Policy could expose Azure credentials in audit logs Missing Impala audit events for database-level operations The flag for disabling purge was ignored in the UI Console description improved for Purge cutoff time For a full list of issues fixed in Cloudera Navigator 2.12.2, see the issues fixed section of the Release Notes. We look forward to you trying the new release, using the information below: Download Cloudera Enterprise View the documentation   As always, we are happy to hear your feedback. Please send your comments and suggestions to the user group or through our community forums. You can also file bugs through our external JIRA projects on issues.cloudera.org.   ... View more

Dear CDH, Cloudera Manager, and Cloudera Navigator users,   On January 26, 2018, we announced the release of Cloudera Enterprise 5.14. Shortly after, we discovered two serious bugs in Cloudera Manager 5.14.  One results in the Cloudera Manager upgrade workflow incorrectly requiring the deployment of optional management roles.  The other causes Hive and HDFS Replication jobs to run slowly.   Today we released Cloudera Manager 5.14.1 to fix these issues.  Please upgrade to this release instead of Cloudera Manager 5.14.0.  For more details, see the Fixed Issues section of the Release Notes. Please use the following information to assist in your implementation: Download Cloudera Enterprise View the documentation As always, we welcome your feedback. Please send your comments and suggestions to the user group or through our community forums. You can also file bugs through our external JIRA projects at issues.cloudera.org. ... View more