Announcements

Cloudera Community Members,    In October last year, I informed you about our temporary suspension for the delivery of Cloudera certification exams. This would allow us to re-platform the system used to conduct the tests. Our plan was to recommence exams from February 1, 2020.   Unfortunately, we are unable to keep this promise to you. As of writing, we do not yet have a new go-live date but please be assured that we are urgently working towards a new launch date. As soon as we have more information, we will inform you; our Certification FAQ will also be kept up to date.   We understand this delay impacts individuals who have been preparing for the exam and sincerely regret any further inconvenience this causes.   We appreciate your continued support of Cloudera certification and training programs.   Respectfully,   Mark Morrissey Senior Director, Cloudera Educational Services

Greetings!   We are pleased to announce General Availability of HDP-3.1.5.0 and AMBARI-2.7.5.0!   With this release HDP is supporting single catalog for Hive/Spark and Hive table-level replication. To keep up with the increased customer interest, we delivered HBase 2.1.6 and GCS Connector 1.9.17 as well.   We have also delivered nearly 200 fixes to increase stability, usability, supportability and performance, enhance security and improve the overall customer experience with HDP and Ambari.   A big kudos and a mountain of gratitude to each and every member of the sustaining, development, quality, release engineering, documentation, biz ops and legal team, to deliver this release with such high quality.   Documentation Download   Thank you all again for your continued support and commitment on this journey!   As always, we welcome your feedback. Please send your comments and suggestions to the user group through our community forums. You ca

Greetings All, Cloudera's Mark Schoeni has a video out now giving folks some high level detail about how the Cloudera is "secure by design". Cloudera designed CDP to safeguard your organization's data within the virtual network of your chosen public cloud vendor. Also, they took all of the hard work associated with setting up security tools, such as kerberos, and automated it. This way the platform is secure and ready to start using right away. Here's his short video explaining these concepts, check it out:   Open the video on YouTube here  

On November 22, 2019, we released CDP Data Center, our next-generation on-premises offering, representing the strongest elements of the former Cloudera and Hortonworks platforms accompanied by new innovations for better scalability, performance and private cloud readiness. Relative to Cloudera’s Enterprise Data Hub, CDP Data Center now offers:Better security:  attribute-based, fine-grained access controls featuring dynamic row filtering and column masking with Ranger. Better governance: more scalable data lineage, data discovery, and metadata search with Atlas 2.0.Better performance:  faster Hive queries and support for ACID transactions. Relative to Hortonworks Data Platform, CDP Data Center brings:Better management:  manage multiple clusters from one control plane, one-click wire encryption, and streamlined maintenance operations with Cloudera Manager.Better SQL analytics: low-latency interactive SQL with Impala, Kudu, and Hue.Better encryption: enterpri

We are pleased to announce the release of Cloudera JDBC 2.6.9 driver for Apache Hive  The release has the following fixes and enhancements: Enhancements and New Features[IMP-636] [00144651][HIVEJ-561][00146044][HIVEJ-563][HIVEJ-554][HIVEJ-539] Updated third-party libraries. The driver now uses the following third-party libraries:jackson 2.9.9Jackson-datadbind 2.9.9.3Thrift 0.12.0ZooKeeper 3.4.14[HIVEJ-549] Support for JDBC 4.2. The driver now supports JDBC 4.2. For more details see the Installation and Configuration Guide. [HIVEJ-551] New JDBC class names.  The driver now supports the following class names for Driver and DataSource that are independent of the JDBC version used:   com.cloudera.hive.jdbc.HS1Driver   com.cloudera.hive.jdbc.HS2Driver   com.cloudera.hive.jdbc.HS1DataSource   com.cloudera.hive.jdbc.HS2DataSourceThe previous JDBC-version-specific class names for 4.0 and 4.1 are still supported.&nb

We are happy to announce Cloudera Enterprise new Runtime release, CDH 6.3.2.What's New?It is a patch release, cumulatively includes base 6.3 features, additional to latest single important fix, above existing known limitations from previous.   Cloudera Manager, 6.3.1, the recommended tool for installing Cloudera Enterprise, is compatible and has no updates this time.   Quick overview of Runtime fixes as follows:   Upstream fix/es for Kudu [KUDU-2990] Kudu cannot distribute libnuma (dependency of memkind). In this release the NVM cache implementation in Kudu has been changed to dynamically link memkind at runtime using dlopen().   How You can get it?   Full software download available at Cloudera Homepage, with support and documentation.   To avoid disrupting currently running CDH workloads, and at Your convenience, You can download the parcel(s) and apply it directly to provisioned clusters via latest

We are pleased to announce the release of Cloudera ODBC 2.6.8 driver for Apache Impala.  The release has the following fixes and enhancements: Enhancements and New Features[IMP-636] Updated Impala and CDH support. The driver now supports Impala versions 2.7 through 3.3, and CDH version 5.9 through 5.16 and 6.0 through 6.2[IMP-666] Support for DATE data type. The driver now supports the DATE data type for Impala version 3.3 and later.  For more information, see “Data Types” in the Installation and Configuration Guide.  Resolved Issues[IMP-686] When an AnalysisException error occurs, the driver incorrectly classifies it as a syntax error and returns SQLState 42000.[IMP-687] After SQLFetech returns and error, if you attempt to call SQLFetch again. The driver terminates unexpectedly.  Known IssuesThe following are known issues that you may encounter due to limitations in the data source, the driver, or an application.  Limited Support for BINARY

Greetings All, There is a lot of information in this message.  Please note we’ve updated our Certification FAQ to address the topics covered within this note.   Since Cloudera and Hortonworks merged earlier this year we have been working to define a new set of tools for training and certification based on our long-term goal of delivering a best-in-class experience for our customers reflective of the new Cloudera.  As we transition to a new platform for delivery of our certification exams Cloudera has suspended the delivery of the following exams from October 18th, 2019 through February 1, 2020:   CCA AdministratorCCA Spark and Hadoop DeveloperCCA Data AnalystCCP Data Engineer For customers and partners in possession of CCA or CCP exam vouchers, leading up to February 1, 2019 the following will apply: Customers can access all Cloudera training classes; only Cloudera’s CCA and CCP certification exams are being suspended. &n

We are happy to announce Cloudera Enterprise new release, CDH 6.3.1.What's New?It is a regular maintenance release, cumulatively includes base 6.3 features, additionally new Dell EMC Isilon support to latest patches and fixes, above existing known limitations. Cloudera Manager, 6.3.1, the recommended tool for installing Cloudera Enterprise, has its own feature additions, fixes and known limitations updated. Quick overview of Runtime fixes as follows: Cloudera Distribution fix/es for KafkaIdempotent and Transactional Capabilities of Kafka that are Incompatible with Sentry Upstream fix/es forApache AvroHIVE-17829 - Fixed ArrayIndexOutOfBoundsException that occurred when using HBASE-backed tables with Avro schema in Hive2 Apache HadoopHADOOP-16018 - DistCp does not reassemble chunks when the value of blocks per chunk is greater than zero. HDFSHDFS-12828 - OIV ReverseXML Processor fails with escaped characters.HDFS-13101 - An fsimage corrup

We are happy to announce Cloudera Enterprise 6.2.1 !What's New?It is a regular maintenance release, including base release features, additionally latest patches and Upstream fixes packaged. Apache HadoopHADOOP-16011 - OsSecureRandom very slow compared to other SecureRandom implementationsHADOOP-16018 - DistCp won't reassemble chunks when blocks per chunk > 0.HADOOP-16167 - Fixed Hadoop shell script for Ubuntu 18.HADOOP-16238 - Add the possbility to set SO_REUSEADDR in IPC Server ListenerHDFSHDFS-10477 - Stop decommission a rack of DataNodes caused NameNode fail over to standbyHDFS-12781 - After Datanode down, In Namenode UI Datanode tab is throwing warning message.HDFS-13101 - Yet another fsimage corruption related to snapshotHDFS-13244 - Add stack, conf, metrics links to utilities dropdown in NN webUIHDFS-13677 - Dynamic refresh Disk configuration results in overwriting VolumeMapHDFS-14111 - hdfsOpenFile on HDFS causes unnecess

 We are pleased to announce the release of Cloudera ODBC 2.6.7 driver for Apache Impala.  The release has the following fixes and enhancements: Enhancements and New Features[IMPJ-678] Reporting the maximum length of database fields. You can now specify the maximum character length that the driver reports for the names of the catalogs, columns, schemas, and tables. To do this, st the following connection properties:MaxCatalogNameLenMaxColumnNameLenMaxSchemaNameLenMaxTableNameLenFor more information, see the Installation and Configuration Guide.[IMP-634] Thrift transport modes. The driver now enables you to specify the Thrift transport mode used. You can configure the driver to use binary, HTTP, or SASL transport. [00139411][IMP-668] Updated driver version information in Linux library. You can now check the Linux drivers version from the driver binary file. To do this, open the .so file in a text editor, and search for the text "$driver_version_sb$:". The drivers vers

We are pleased to announce the release of Cloudera JDBC 2.6.15 driver for Apache Impala.  The release has the following fixes and enhancements: Enhancements and New Features[IMPJ-489] Default port - If a port is not specified in the connection URL, the driver now uses a default port depending on the specified transport mode:If the transport mode is set to HTTP, the driver uses port 28000 as the default. If the transport mode is est to SASL or binary, or is not specified, the driver uses port 21050 as the default. [IMPJ-487] HTTP header host name - When the driver uses HTTP header, the header now uses the host name instead of the resolved IP address. Resolved Issues[IMPJ-488] If AuthMech is set to 0 and UID and PWD are specified in the connection URL, the username and password are not sent to the server. This has now been resolved. Now, if UID or PWD are specified in the connection URL, the driver always sends them to the server. Workflow ChangesThe followi

Starting on Saturday, August 17 at 12:00 a.m. PDT, Cloudera Community will be unavailable while we move Hortonworks Community Connection content and users. On August 17 at 12:00 a.m. PDT, the community team will migrate all site content and users from Hortonworks Community Connection (HCC) to the new Cloudera Community (see below for more information). During the migration, the Cloudera Community will be in maintenance mode and content will not be available until after migration is complete; HCC will be in read-only mode (you will not be able to post during this time) and urls will be redirected to Cloudera after the migration.  Our intent is to perform the migration during low-usage hours to reduce impact to your day-to-day community use. The community is expected to be back up no later than Sunday, August 18th midday PDT. We’re working hard to ensure this transition is as smooth as possible; please be patient with us and plan accordingly. If you need assistance during the migrat

We are pleased to announce the release of Cloudera Altus Director 6.3.0. Altus Director provides a simple, reliable, enterprise-grade way to deploy, scale, and manage Apache Hadoop in the cloud of your choice. Altus Director is fully supported with Cloudera Enterprise 5 and Cloudera Enterprise 6. What's New in Altus Director 6.3.0Cloudera Manager 6.3 and CDH6.3 supportJava 11 supportBug fixes For more info on downloading and installing Altus Director, see the links below. Download Altus DirectorAltus Director Release NotesGetting Started with Altus DirectorUpgrading from a previous Altus Director version As always, we are happy to hear your feedback. Please post your questions and comments on our community forum.

We are pleased to announce the general availability of Cloudera Enterprise 6.3.0, the world’s leading data platform for machine learning and analytics, optimized for the cloud.  This release delivers a number of new capabilities, improved usability, better performance, and support for more modern Java and identity management infrastructure software.  New capabilities include:Platform highlights:Support for the OpenJDK 11 runtime: all components and tools in Cloudera Enterprise 6 support both the JDK8 and JDK11 Java Virtual Machine (JVM).Updated versions of platform components, including packaging & upgrade support for the following new Apache project versions: Kafka 2.2.1, HBase 2.1.4, Impala 3.2.0 and Kudu 1.10.0.Support for Free IPA and Red Hat IPA Manager: Cloudera Manager & CDH now supports the use of FeeIPA/RedHat IDM as the Kerberos KDC provider for CDH, and for LDAP authentication to Cloudera EnterpriseSupport for zstd compression with Parquet files,

Cloudera is delighted to announce the release of Cloudera Data Science Workbench 1.6.0. Some major features shipping with this release include: Bring Your Own EditorCloudera Data Science Workbench enables team collaboration on an end-to-end data science workflow, from data exploration and data engineering to model development and deployment in production.  This can involve collaboration among data engineers, data scientists and ML engineers who often have different editor and IDE preferences. With version 1.6, diverse teams can now tap into the benefits of self-service data science for the enterprise with CDSW, all while working within their most familiar or preferred IDE. This feature supports both, third-party IDEs such as PyCharm that run on your local machine, and browser-based IDEs such as Jupyter and RStudio. For details, see Editors. Expanded Support for Distributed Machine LearningCloudera Data Science Workbench 1.6 allows you to run distributed workloads with fr

We are happy to announce Cloudera Enterprise 5.16.2.  You can download the parcel(s) and apply it directly to provisioned clusters without disrupting Your currently running CDH workloads. What's New? Upstream and other faults fixed:Apache Flume FLUME-2973 - Deadlock in hdfs sink.FLUME-3223 - Flume HDFS Sink should retry close prior recover lease.Apache HadoopHADOOP-15442 - ITestS3AMetrics.testMetricsRegister should not know the name of the metrics source.HDFS-11751 - DFSZKFailoverController daemon exits with the wrong status code.HDFS-12683 - DFSZKFailOverController re-order logic for logging exception.HDFS-14111 - hdfsOpenFile on HDFS causes unnecessary IO from file offset 0MAPREDUCE-6382 - HTML links in the Diagnostics in JHS job overview must not be escaped.MAPREDUCE-7125 - JobResourceUploader creates LocalFileSystem when it's not necessary.MAPREDUCE-7131 - Job History Server has race condition where it moves files fro

We are pleased to announce the release of Cloudera JDBC v2.6.12 driver for Apache Impala. The release has the following resolved issues: Resolved Issues[00142091][IMPJ-461] The driver casts empty string to CHAR(0), causing issues on the server. This issue has been resolved. The driver new casts empty strings to CHAR(0). [00141482] [IMPJ-468] The driver executes UPSERT queries incorrectly, causing errors to be shown. Workflow ChangesThe following are breaking changes to driver functionality. These changes may cause some workflows from earlier versions to fail. 2.6.1 - Removed support for JDBC 3 (Java 5)Beginning with this release, the driver no longer supports JDBC 3 (Java 5). Only JDBC 4 (Java 6) and JDBC 4.1 (Java 7) are supported.  Getting Started with the Cloudera DriverRead the Cloudera Impala JDBC 2.6.12 Driver for Impala Release Notes and Installation Guide. Download the connector from the Cloudera Connectors page.  As always, we welcome your feedback. Pl

We are pleased to announce the release of Cloudera JDBC v2.6.11 driver for Apache Impala. The release has the following resolved issues and enhancements: Enhancement and New Features[00141482][IMPJ-458] Improved performance of prepared statements with large numbers of parameters. Preparing statements no longer takes exponentially more time for each parameter. Additionally, DatabaseMetaData.supportsBatchUpdates() now returns true.[00138441][IMPJ-443] Always pass UID parameter to server. If the UID parameter is specified in the connection URL, the driver now passes it to the server even when No Authentication is specified (AuthMech=0). [IMPJ-448] The driver now supports Impala versions 1.0.1 through 3.1, and CDH versions 5.0 through 5.16 and 6.0 through 6.1.[00140157][IMPJ-450] The driver now uses version 0.12.0 of the Thrift library. Resolved Issues[00141235] [IMPH-454] The driver incorrectly treats SSLTrustStore and SSLTrustStorePWD as server-side properties.[IMPJ-444] If a S

We are pleased to announce the release of Cloudera ODBC v2.6.5 driver for Apache Impala.  The release has the following fixes and enhancements: Enhancements & New Features[IMP-573] On macOS, you can now use the driver with version 2.3.1 of unixODBC driver manager.[IMP-628] The driver now uses OpenSSL 1.1.0j.[IMP-609] The driver now supports Impala versions 1.0.1 through 3.1, and CDH versions 5.0 through 5.16 and 6.0 through 6.1. Resolved Issues[00141430][IMP-623] In some cases, queries with a parameterized insert fail.[00141992][IMP-629] The driver does not handle scale and precision of decimal type correctly.[IMP-612] Driver does not pass a UID into the session when connected using No Authentication.[IMP-631] The driver incorrectly translates CHAR and VARCHAR types of INSERT values to CAST(CAST(...)). This issue is resolved. The driver now translates these values to a single CAST. Workflow Changes: The following changes may disrupt workflows from earlier versio

We are pleased to announce the release of Cloudera Director 6.2.1. Cloudera Director 6.2.1 provides bug fixes and and product improvements, as outlined in the Cloudera Director 6.2.1 release notes. For more info on downloading and installing Altus Director, see the links below. Download Altus DirectorAltus Director Release NotesGetting Started with Altus DirectorUpgrading from a previous Altus Director versionAs always, we are happy to hear your feedback. Please post your questions and comments on our community forum.

We are happy to announce CDS 2.4 Release 2 Powered By Apache Spark. You can download the parcel and apply it directly to provisioned clusters without disrupting your currently running Spark workloads. This component is generally available and is supported on CDH 5.10 and higher. What's New in CDS 2.4 release 2?- A new Streamlined API- Performance Improvements- Stream Processing using Dataframes- New machine learning algorithms and model persistenceSee CDS Powered By Apache Spark Fixed Issues for the list of fixed issues and enhancements. See documentation and full download available here. --------------Want to become a pro Spark user?  Sign up for Apache Spark Training.