What's New @ Cloudera

We are pleased to announce the release of Cloudera JDBC 2.6.9 driver for Apache Hive  The release has the following fixes and enhancements: Enhancements and New Features[IMP-636] [00144651][HIVEJ-561][00146044][HIVEJ-563][HIVEJ-554][HIVEJ-539] Updated third-party libraries. The driver now uses the following third-party libraries:jackson 2.9.9Jackson-datadbind 2.9.9.3Thrift 0.12.0ZooKeeper 3.4.14[HIVEJ-549] Support for JDBC 4.2. The driver now supports JDBC 4.2. For more details see the Installation and Configuration Guide. [HIVEJ-551] New JDBC class names.  The driver now supports the following class names for Driver and DataSource that are independent of the JDBC version used:   com.cloudera.hive.jdbc.HS1Driver   com.cloudera.hive.jdbc.HS2Driver   com.cloudera.hive.jdbc.HS1DataSource   com.cloudera.hive.jdbc.HS2DataSourceThe previous JDBC-version-specific class names for 4.0 and 4.1 are still supported.&nb

We are happy to announce Cloudera Enterprise new Runtime release, CDH 6.3.2.What's New?It is a patch release, cumulatively includes base 6.3 features, additional to latest single important fix, above existing known limitations from previous.   Cloudera Manager, 6.3.1, the recommended tool for installing Cloudera Enterprise, is compatible and has no updates this time.   Quick overview of Runtime fixes as follows:   Upstream fix/es for Kudu [KUDU-2990] Kudu cannot distribute libnuma (dependency of memkind). In this release the NVM cache implementation in Kudu has been changed to dynamically link memkind at runtime using dlopen().   How You can get it?   Full software download available at Cloudera Homepage, with support and documentation.   To avoid disrupting currently running CDH workloads, and at Your convenience, You can download the parcel(s) and apply it directly to provisioned clusters via latest

We are pleased to announce the release of Cloudera ODBC 2.6.8 driver for Apache Impala.  The release has the following fixes and enhancements: Enhancements and New Features[IMP-636] Updated Impala and CDH support. The driver now supports Impala versions 2.7 through 3.3, and CDH version 5.9 through 5.16 and 6.0 through 6.2[IMP-666] Support for DATE data type. The driver now supports the DATE data type for Impala version 3.3 and later.  For more information, see “Data Types” in the Installation and Configuration Guide.  Resolved Issues[IMP-686] When an AnalysisException error occurs, the driver incorrectly classifies it as a syntax error and returns SQLState 42000.[IMP-687] After SQLFetech returns and error, if you attempt to call SQLFetch again. The driver terminates unexpectedly.  Known IssuesThe following are known issues that you may encounter due to limitations in the data source, the driver, or an application.  Limited Support for BINARY

We are happy to announce Cloudera Enterprise new release, CDH 6.3.1.What's New?It is a regular maintenance release, cumulatively includes base 6.3 features, additionally new Dell EMC Isilon support to latest patches and fixes, above existing known limitations. Cloudera Manager, 6.3.1, the recommended tool for installing Cloudera Enterprise, has its own feature additions, fixes and known limitations updated. Quick overview of Runtime fixes as follows: Cloudera Distribution fix/es for KafkaIdempotent and Transactional Capabilities of Kafka that are Incompatible with Sentry Upstream fix/es forApache AvroHIVE-17829 - Fixed ArrayIndexOutOfBoundsException that occurred when using HBASE-backed tables with Avro schema in Hive2 Apache HadoopHADOOP-16018 - DistCp does not reassemble chunks when the value of blocks per chunk is greater than zero. HDFSHDFS-12828 - OIV ReverseXML Processor fails with escaped characters.HDFS-13101 - An fsimage corrup

We are happy to announce Cloudera Enterprise 6.2.1 !What's New?It is a regular maintenance release, including base release features, additionally latest patches and Upstream fixes packaged. Apache HadoopHADOOP-16011 - OsSecureRandom very slow compared to other SecureRandom implementationsHADOOP-16018 - DistCp won't reassemble chunks when blocks per chunk > 0.HADOOP-16167 - Fixed Hadoop shell script for Ubuntu 18.HADOOP-16238 - Add the possbility to set SO_REUSEADDR in IPC Server ListenerHDFSHDFS-10477 - Stop decommission a rack of DataNodes caused NameNode fail over to standbyHDFS-12781 - After Datanode down, In Namenode UI Datanode tab is throwing warning message.HDFS-13101 - Yet another fsimage corruption related to snapshotHDFS-13244 - Add stack, conf, metrics links to utilities dropdown in NN webUIHDFS-13677 - Dynamic refresh Disk configuration results in overwriting VolumeMapHDFS-14111 - hdfsOpenFile on HDFS causes unnecess

 We are pleased to announce the release of Cloudera ODBC 2.6.7 driver for Apache Impala.  The release has the following fixes and enhancements: Enhancements and New Features[IMPJ-678] Reporting the maximum length of database fields. You can now specify the maximum character length that the driver reports for the names of the catalogs, columns, schemas, and tables. To do this, st the following connection properties:MaxCatalogNameLenMaxColumnNameLenMaxSchemaNameLenMaxTableNameLenFor more information, see the Installation and Configuration Guide.[IMP-634] Thrift transport modes. The driver now enables you to specify the Thrift transport mode used. You can configure the driver to use binary, HTTP, or SASL transport. [00139411][IMP-668] Updated driver version information in Linux library. You can now check the Linux drivers version from the driver binary file. To do this, open the .so file in a text editor, and search for the text "$driver_version_sb$:". The drivers vers

We are pleased to announce the release of Cloudera JDBC 2.6.15 driver for Apache Impala.  The release has the following fixes and enhancements: Enhancements and New Features[IMPJ-489] Default port - If a port is not specified in the connection URL, the driver now uses a default port depending on the specified transport mode:If the transport mode is set to HTTP, the driver uses port 28000 as the default. If the transport mode is est to SASL or binary, or is not specified, the driver uses port 21050 as the default. [IMPJ-487] HTTP header host name - When the driver uses HTTP header, the header now uses the host name instead of the resolved IP address. Resolved Issues[IMPJ-488] If AuthMech is set to 0 and UID and PWD are specified in the connection URL, the username and password are not sent to the server. This has now been resolved. Now, if UID or PWD are specified in the connection URL, the driver always sends them to the server. Workflow ChangesThe followi

We are pleased to announce the release of Cloudera Altus Director 6.3.0. Altus Director provides a simple, reliable, enterprise-grade way to deploy, scale, and manage Apache Hadoop in the cloud of your choice. Altus Director is fully supported with Cloudera Enterprise 5 and Cloudera Enterprise 6. What's New in Altus Director 6.3.0Cloudera Manager 6.3 and CDH6.3 supportJava 11 supportBug fixes For more info on downloading and installing Altus Director, see the links below. Download Altus DirectorAltus Director Release NotesGetting Started with Altus DirectorUpgrading from a previous Altus Director version As always, we are happy to hear your feedback. Please post your questions and comments on our community forum.

We are pleased to announce the general availability of Cloudera Enterprise 6.3.0, the world’s leading data platform for machine learning and analytics, optimized for the cloud.  This release delivers a number of new capabilities, improved usability, better performance, and support for more modern Java and identity management infrastructure software.  New capabilities include:Platform highlights:Support for the OpenJDK 11 runtime: all components and tools in Cloudera Enterprise 6 support both the JDK8 and JDK11 Java Virtual Machine (JVM).Updated versions of platform components, including packaging & upgrade support for the following new Apache project versions: Kafka 2.2.1, HBase 2.1.4, Impala 3.2.0 and Kudu 1.10.0.Support for Free IPA and Red Hat IPA Manager: Cloudera Manager & CDH now supports the use of FeeIPA/RedHat IDM as the Kerberos KDC provider for CDH, and for LDAP authentication to Cloudera EnterpriseSupport for zstd compression with Parquet files,

Cloudera is delighted to announce the release of Cloudera Data Science Workbench 1.6.0. Some major features shipping with this release include: Bring Your Own EditorCloudera Data Science Workbench enables team collaboration on an end-to-end data science workflow, from data exploration and data engineering to model development and deployment in production.  This can involve collaboration among data engineers, data scientists and ML engineers who often have different editor and IDE preferences. With version 1.6, diverse teams can now tap into the benefits of self-service data science for the enterprise with CDSW, all while working within their most familiar or preferred IDE. This feature supports both, third-party IDEs such as PyCharm that run on your local machine, and browser-based IDEs such as Jupyter and RStudio. For details, see Editors. Expanded Support for Distributed Machine LearningCloudera Data Science Workbench 1.6 allows you to run distributed workloads with fr

We are happy to announce Cloudera Enterprise 5.16.2.  You can download the parcel(s) and apply it directly to provisioned clusters without disrupting Your currently running CDH workloads. What's New? Upstream and other faults fixed:Apache Flume FLUME-2973 - Deadlock in hdfs sink.FLUME-3223 - Flume HDFS Sink should retry close prior recover lease.Apache HadoopHADOOP-15442 - ITestS3AMetrics.testMetricsRegister should not know the name of the metrics source.HDFS-11751 - DFSZKFailoverController daemon exits with the wrong status code.HDFS-12683 - DFSZKFailOverController re-order logic for logging exception.HDFS-14111 - hdfsOpenFile on HDFS causes unnecessary IO from file offset 0MAPREDUCE-6382 - HTML links in the Diagnostics in JHS job overview must not be escaped.MAPREDUCE-7125 - JobResourceUploader creates LocalFileSystem when it's not necessary.MAPREDUCE-7131 - Job History Server has race condition where it moves files fro

We are pleased to announce the release of Cloudera JDBC v2.6.12 driver for Apache Impala. The release has the following resolved issues: Resolved Issues[00142091][IMPJ-461] The driver casts empty string to CHAR(0), causing issues on the server. This issue has been resolved. The driver new casts empty strings to CHAR(0). [00141482] [IMPJ-468] The driver executes UPSERT queries incorrectly, causing errors to be shown. Workflow ChangesThe following are breaking changes to driver functionality. These changes may cause some workflows from earlier versions to fail. 2.6.1 - Removed support for JDBC 3 (Java 5)Beginning with this release, the driver no longer supports JDBC 3 (Java 5). Only JDBC 4 (Java 6) and JDBC 4.1 (Java 7) are supported.  Getting Started with the Cloudera DriverRead the Cloudera Impala JDBC 2.6.12 Driver for Impala Release Notes and Installation Guide. Download the connector from the Cloudera Connectors page.  As always, we welcome your feedback. Pl

We are pleased to announce the release of Cloudera JDBC v2.6.11 driver for Apache Impala. The release has the following resolved issues and enhancements: Enhancement and New Features[00141482][IMPJ-458] Improved performance of prepared statements with large numbers of parameters. Preparing statements no longer takes exponentially more time for each parameter. Additionally, DatabaseMetaData.supportsBatchUpdates() now returns true.[00138441][IMPJ-443] Always pass UID parameter to server. If the UID parameter is specified in the connection URL, the driver now passes it to the server even when No Authentication is specified (AuthMech=0). [IMPJ-448] The driver now supports Impala versions 1.0.1 through 3.1, and CDH versions 5.0 through 5.16 and 6.0 through 6.1.[00140157][IMPJ-450] The driver now uses version 0.12.0 of the Thrift library. Resolved Issues[00141235] [IMPH-454] The driver incorrectly treats SSLTrustStore and SSLTrustStorePWD as server-side properties.[IMPJ-444] If a S

We are pleased to announce the release of Cloudera ODBC v2.6.5 driver for Apache Impala.  The release has the following fixes and enhancements: Enhancements & New Features[IMP-573] On macOS, you can now use the driver with version 2.3.1 of unixODBC driver manager.[IMP-628] The driver now uses OpenSSL 1.1.0j.[IMP-609] The driver now supports Impala versions 1.0.1 through 3.1, and CDH versions 5.0 through 5.16 and 6.0 through 6.1. Resolved Issues[00141430][IMP-623] In some cases, queries with a parameterized insert fail.[00141992][IMP-629] The driver does not handle scale and precision of decimal type correctly.[IMP-612] Driver does not pass a UID into the session when connected using No Authentication.[IMP-631] The driver incorrectly translates CHAR and VARCHAR types of INSERT values to CAST(CAST(...)). This issue is resolved. The driver now translates these values to a single CAST. Workflow Changes: The following changes may disrupt workflows from earlier versio

We are pleased to announce the release of Cloudera Director 6.2.1. Cloudera Director 6.2.1 provides bug fixes and and product improvements, as outlined in the Cloudera Director 6.2.1 release notes. For more info on downloading and installing Altus Director, see the links below. Download Altus DirectorAltus Director Release NotesGetting Started with Altus DirectorUpgrading from a previous Altus Director versionAs always, we are happy to hear your feedback. Please post your questions and comments on our community forum.

We are happy to announce CDS 2.4 Release 2 Powered By Apache Spark. You can download the parcel and apply it directly to provisioned clusters without disrupting your currently running Spark workloads. This component is generally available and is supported on CDH 5.10 and higher. What's New in CDS 2.4 release 2?- A new Streamlined API- Performance Improvements- Stream Processing using Dataframes- New machine learning algorithms and model persistenceSee CDS Powered By Apache Spark Fixed Issues for the list of fixed issues and enhancements. See documentation and full download available here. --------------Want to become a pro Spark user?  Sign up for Apache Spark Training.

We are pleased to announce the release of the Cloudera ODBC v2.6.4 Driver for Apache Hive  The release has the following new features and resolved issues.  Enhancements and New Features[00135108][HAR-921] The driver now supports cookie-based authentication as part of the authentication process.[HAR-965] The driver has been updated to use version 1.1.0 of the RapidJSON parser.[HAR-937] To reduce the footprint of the Linux driver, the OpenSSL and ICU libraries are now dynamically linked. Resolved Issues[00138945][HAR-959] When SQLTables is called, the driver does not correctly display views.[HAR-926] The driver fails to parse queries that contain the keyword “LIMIT”.[00136282][HAR-936] The driver fails to parse queries that contain a non-reserved keyword as the column name. Please refer to the Release Notes for a complete list of new features and resolved issues.  For more info on downloading and installing Cloudera ODBC v2.6.4 Driver for Apache Hive, see the lin

We are pleased to announce the release of Cloudera ODBC v2.6.4 driver for Apache Impala.  The release has the following fixes and enhancements: Enhancements & New Features[0013885][IMP-601] The driver now supports the use of SERVER as an alias for the HOST configuration options. The configuration option HOST is still supported. [IMP-607] The driver has been updated to use version 1.1.0 of the RapdJSOn parser. Resolved Issues[00139182][IMP-603] in some queries that include aliases in subqueries, the driver translates the query to a syntax that is not supported by Impala CDH6.  Workflow Changes: The following changes may disrupt workflows from earlier versions. Version 2.6.0:  Minimum TLS version. Beginning with this release, the driver requires a minimum version of TLS for encrypting the data store connection. By default, the driver requires TLS version 1.2. This requirement may cause existing DSNs and connection strings to stop working, if they are use

We are happy to announce CDS 2.4 Release 1 Powered By Apache Spark.  You can download the parcel and apply it directly to provisioned clusters without disrupting your currently running Spark workloads. This component is generally available and is supported on CDH 5.10 and higher. What's New in CDS 2.4 release 1?- A new Streamlined API- Performance Improvements- Stream Processing using Dataframes- New machine learning algorithms and model persistenceSee CDS Powered By Apache Spark Fixed Issues for the list of fixed issues. See documentation and full download available. Want to become a pro Spark user?  Sign up for Apache Spark Training.

We are pleased to announce the release of Cloudera Altus Director 6.2.0. Altus Director provides a simple, reliable, enterprise-grade way to deploy, scale, and manage Apache Hadoop in the cloud of your choice. Altus Director is fully supported with Cloudera Enterprise 5 and Cloudera Enterprise 6. What's New in Altus Director 6.2.0Cloudera Manager6.2 and CDH6.2 supportAzure MySQL supportSupport for provisioning Azure clusters through an HTTP proxyImproved Cloudera Manager synchronization, including licenseUbuntu 18.04 packagingSupport for Azure VM Scale Set (VMSS) and AWS Auto Scaling Group (ASG) For more info on downloading and installing Altus Director, see the links below. Download Altus DirectorAltus Director Release NotesGetting Started with Altus DirectorUpgrading from a previous Altus Director versionAs always, we are happy to hear your feedback. Please post your questions and comments on our community forum.

Visit Cloudera documentation to discover the new Security Overview for Cloudera Data Science Workbench. You can read about the basics of the CDSW security model, the wildcard DNS requirement, and how authentication, authorization, and wire encryption work in CDSW.   You can also get useful information about the Flume Kudu sink, and other important updates for Apache HBase and YARN. Check out What's New in Cloudera Documentation for a full summary. 

Visit Cloudera documentation to discover the new Security Overview for Cloudera Data Science Workbench.Check out What's New in Cloudera Documentation for a full summary. 

 We are pleased to announce the general availability of Cloudera Enterprise 6.2.0, the modern platform for machine learning and analytics optimized for the cloud. This release delivers a number of new capabilities, improved usability, and better performance.  New capabilities include:Management highlights:Support for a Shared Data Experience (SDX) in Cloudera Manager.  Cloudera Manager now supports creating ‘compute clusters’ serving disparate workloads for independent tenants with stronger isolation & reliability, while operating on shared data, catalog, security and governance using a ‘data context’ abstraction. This permits separation of responsibilities in the administration of each tenant, and between the compute and storage tiers of deployment and works seamlessly with private cloud infrastructure & operating models.BDR replication to clusters using cloud object storage. Cloudera BDR now supports replicating Hive & Impala tables stored in HDFS directly

We are pleased to announce the release of Cloudera JDBC v2.6.9 driver for Apache Impala. The release has the following resolved issues:Resolved Issues[00137281][IMPJ-437] After a query fails on the server side, subsequent   queries on driver side also fail.Breaking ChangesThe following are breaking changes to driver functionality. These changes may cause some workflows from earlier versions of the driver to fail.2.6.1 - Removed support for JDBC 3 (Java 5). Beginning with this release, the driver no longer supports JDBC 3 (Java 5). Only JDBC 4 (Java 6) and JDBC 4.1 (Java 7) are supported.Getting Started with the Cloudera Driver for Apache ImpalaRead the Release Notes and Installation Guide for Cloudera JDBC v2.6.9 Driver for Apache ImpalaDownload the connector from the Cloudera Connectors page. As always, we welcome your feedback. Please send your comments and suggestions to the user group of through our community forums. You can also file bugs through our external Jira projec

We are pleased to announce the release of Cloudera ODBC v2.6.2 Driver for Apache Impala.  The release has the following fixes and enhancements: Resolved Issues: [00134149] [IMP-565] The driver reports transport-related errors using the generic error code 10000, instead of reporting them more specifically using error code 08S01 Workflow Changes: The following changes may disrupt workflows from earlier versions. Version 2.6.0:  Minimum TLS version. Beginning with this release, the driver requires a minimum version of TLS for encrypting the data store connection. By default, the driver requires TLS version 1.2. This requirement may cause existing DSNs and connection strings to stop working, if they are used to connect to data stores that use a TLS version earlier than 1.2. To resolve this, in your DSN or connection string, set the Minimum TLS option (the Min_TLS property) to the appropriate version of TLS for your server. For more information, see the Installation and