Cloudera’s Data In Motion Team is pleased to announce the release of the Cloudera Streaming Analytics Operator for Kubernetes v1.5. This release advances our cloud-native streaming capabilities by introducing the Materialized View engine to Kubernetes, optimizing job handling responsiveness, and updating core infrastructure components for better performance and security. Release Highlights Materialized View Engine on Kubernetes  Cloudera SQL Stream Builder now supports the Materialized View (MV) engine within Kubernetes deployments. This allows users to create and maintain mutating snapshots of queried data, which can be seamlessly accessed via REST APIs, bridging the gap between real-time streams and request-response applications. Asynchronous Flink Job Handling  To improve the user experience, SQL Stream Builder now handles Flink jobs asynchronously. This architectural change significantly enhances the responsiveness of the Streaming SQL Console and ensures more stable job status transitions during deployments and state changes. Rebase to Flink Operator 1.13 and Apache Flink 1.20  The embedded Apache Flink Kubernetes Operator has been rebased to version 1.13. Alongside Apache Flink 1.20, this update brings the latest upstream stability improvements, bug fixes, and performance optimizations to your production environment. Modernized Infrastructure & Compatibility PostgreSQL 18.1: The default database deployed with SQL Stream Builder has been updated to version 18.1 for improved data management. Java Runtime Updates: Docker images now utilize an OpenJDK 17 build that supports older cipher suites, ensuring broader compatibility with legacy security configurations while maintaining a modern runtime. Getting the New Release To learn more about the Cloudera Streaming Analytics Operator for Kubernetes and its typical deployment architecture, see the Overview guide. If you are installing this operator for the first time, consult the Installation instructions. Resources Ready to explore Cloudera Streaming Analytics - Kubernetes Operator 1.4? Find out more here: New - Cloudera Streaming Analytics  Operator for Kubernetes 1.5 Release Notes  New - Cloudera Community Announcement Post Flink Operator 1.13 Upstream Documentation Cloudera Streaming Product Page Updated - Cloudera Stream Processing & Analytics Support Lifecycle Policy   ... View more

Release Highlights Rebase to Strimzi 0.49.1 and Kafka 4.1.1 This release of the Operator is now based on Strimzi 0.49.1 (up from 0.47.0) and Apache Kafka 4.1.1 (up from 4.0.1). This rebase brings the latest performance optimizations and feature sets from the upstream community, ensuring your streaming infrastructure remains at the cutting edge. Introduction of Cloudera Schema Registry New in version 1.6, Schema Registry is now available as a standalone application that allows you to efficiently store and manage schemas for your streaming data. It supports Avro and JSON schema formats, and provides schema evolution capabilities with configurable compatibility modes. Schema Registry helps ensure data consistency across your streaming applications by providing a central repository of schemas that applications use to validate their data. It provides a REST API and client libraries for programmatic access. Apache Iceberg Sink Connector Certification To empower modern data lakehouse architectures, the Apache Iceberg Sink Connector is now officially certified for use with the Operator. While the connector is installed from external repositories (such as Maven Central), it is now a validated part of the Cloudera Streams Messaging ecosystem, enabling seamless data ingestion into Iceberg tables. Cloudera Surveyor: Advanced Broker Insights & Simplified Auth We have significantly upgraded Cloudera Surveyor to provide deeper visibility into your cluster’s physical layer: New Broker Monitoring: Dedicated Brokers and Broker Details pages allow you to monitor health, disk usage, and alerts. You can now track topic partitions, manage log directories, and edit broker configurations directly from the UI. Automatic Key Generation: Setting up authentication is now easier than ever. Surveyor now automatically generates cryptographically secure 128-byte keys by default, eliminating manual configuration steps (except when in FIPS mode). Strimzi v1 API Stability Version 1.6 introduces the v1 API version for all Strimzi Custom Resource Definitions (CRDs), providing a stable foundation for managing Kafka resources.   Getting the New Release To upgrade to Cloudera Streams Messaging Operator for Kubernetes v1.6, check out the upgrade guide. If you are installing this operator for the first time, consult the installation overview. Resources Ready to explore Cloudera Streams Messaging Operator? Find out more here: New - Cloudera Streams Messaging - Kubernetes Operator 1.6 Release Notes New - Cloudera Community Announcement Post Strimzi 0.49.1 Release notes Kafka 4.1.1 Release notes New - Schema Registry Documentation Updated - Cloudera Stream Processing & Analytics Support Lifecycle Policy ... View more

Cloudera’s Data In Motion Team is pleased to announce the release of the Cloudera Streaming Analytics - Kubernetes Operator 1.4. This release focuses on modernization through Flink and Flink Operator rebases, enhancing security with FIPS compliance, and improving developer productivity by enabling Python UDFs by default. Release Highlights Rebase to Flink Operator 1.11 and Apache Flink 1.20 This release of the Operator is now based on the Apache Flink Kubernetes Operator 1.11 and Apache Flink 1.20. These rebases bring the latest features, performance optimizations, and stability fixes from the upstream communities, ensuring your streaming workloads benefit from the newest advancements in high-performance stream processing. FIPS Mode Support  To meet the strictest security and compliance requirements, the Cloudera Streaming Analytics - Kubernetes Operator can now be configured and deployed in Federal Information Processing Standards (FIPS) mode. This ensures that your deployment utilizes FIPS-certified cryptographic modules, adhering to standards required for sensitive and regulated environments. Python UDFs Enabled by Default  For improved developer experience and faster time-to-value, the Python User Defined Functions (UDFs) feature is now enabled by default in all deployments using the Cloudera Streaming Analytics - Kubernetes Operator 1.4.0. This makes it easier for data scientists and developers to extend their SQL stream processing jobs using Python code. Getting the New Release To learn more about the Cloudera Streaming Analytics - Kubernetes Operator and its typical deployment architecture, see the Overview guide. If you are installing this operator for the first time, consult the Installation instructions. Resources Ready to explore Cloudera Streaming Analytics - Kubernetes Operator 1.4? Find out more here: New - Cloudera Streaming Analytics - Kubernetes Operator 1.4.0 Release Notes Flink Operator 1.11 Upstream Documentation Flink 1.20 Upstream Documentation Cloudera SQL Stream Builder REST API Reference  Cloudera Streaming Product Page Cloudera Stream Processing & Analytics Support Lifecycle Policy ... View more

Cloudera’s Data In Motion Team is pleased to announce the release of the Cloudera Streams Messaging - Kubernetes Operator 1.5. This release centers on modernization, adopting the latest Kafka standards, enhancing security, and significantly improving the usability of the Cloudera Surveyor management tool. Release Highlights Rebase to Strimzi 0.47.0 and Kafka 4.0.1 This release of the Operator is now based on Strimzi 0.47.0 (up from 0.45.0) and Apache Kafka 4.0.1 (up from 3.9.0). These rebases bring the latest features, performance optimizations, and stability fixes from the upstream communities. FIPS 140-2/3 Compatibility and Compliance To meet the strictest security requirements, Cloudera Streams Messaging - Kubernetes Operator components are now FIPS 140-2/3 compliant. The core Operator and its managed components will automatically enable FIPS mode on FIPS-enabled hosts. Cloudera Surveyor is also FIPS compliant, though it requires you to manually enable FIPS mode through configuration. Surveyor also supports the use of custom security providers. Cloudera Surveyor Enhancements We’ve focused heavily on quality-of-life improvements for Cloudera Surveyor to make managing your streams messaging environment simpler and more efficient. Key updates include enhanced topic filtering options using configuration properties, improved offset management in the Edit Committed Offsets modal, and better handling of unsaved changes on the Topic Details > Configuration tab. Additionally, we've improved overall UI clarity with more consistent status formatting, clearer alerts, better tooltips, and drop-down lists that allow multiple selections without closing. Getting the New Release Please consult the official documentation for the complete list of fixes and improvements. To upgrade to Cloudera Streams Messaging - Kubernetes Operator 1.5, check out the upgrade guide. If you are installing this operator for the first time, consult the installation overview. Resources Ready to explore Cloudera Streams Messaging - Kubernetes Operator 1.5 and Cloudera Surveyor? Find out more here: New - Cloudera Streams Messaging - Kubernetes Operator 1.5 Release Notes Cloudera Surveyor Documentation Cloudera Streaming Product Page Cloudera Stream Processing & Analytics Support Lifecycle Policy ... View more

The Data In Motion team is thrilled to announce the release of Cloudera Streams Messaging - Kubernetes Operator 1.4 and the exciting new Cloudera Surveyor! This release marks a significant step forward in simplifying and enhancing your Apache Kafka management experience on Kubernetes, focusing on intuitive user experience and powerful new capabilities. Release Highlights Introducing Cloudera Surveyor: Your New Go-To for Seamless Kafka Management on Kubernetes  Cloudera Surveyor is a brand-new, intuitive graphical interface built to streamline the monitoring and management of your Apache Kafka clusters running on Kubernetes. As a core component delivered with Cloudera Streams Messaging - Kubernetes Operator 1.4, Surveyor empowers you with: Effortless Management: Move beyond the command line with a modern, easy-to-use UI for all your Kafka operations. Multi-Cluster Visibility: Manage and monitor multiple Kafka clusters from a single, centralized console. Actionable Insights: Get real-time health and performance metrics that help you quickly identify and resolve issues. Enhanced Security: Benefit from built-in TLS, robust LDAP authentication, and enforcement of Kafka ACLs. Enterprise Scalability: Designed to handle large-scale deployments, Surveyor scales to manage hundreds of Kafka clusters, brokers, and topics. Broad Kafka Compatibility: Manage diverse Kafka deployments consistently across on-premises, cloud, or Kubernetes environments. Cloudera Streams Messaging - Kubernetes Operator 1.4: The Foundation for Your Kubernetes-Native Kafka  Cloudera Streams Messaging - Kubernetes Operator 1.4 provides the robust and reliable foundation necessary for deploying and managing Kafka clusters, including the new Cloudera Surveyor. This update brings continued stability and improvements to your containerized Kafka deployments, ensuring a seamless experience for upgrades and operations within your Kubernetes environments. Unified Data In Motion Portfolio: Beyond Kafka This launch further strengthens Cloudera's comprehensive Data In Motion portfolio. While Cloudera Streams Messaging - Kubernetes Operator and Cloudera Surveyor significantly enhance your Kafka experience, our solutions span the entire real-time data lifecycle. Our portfolio also includes powerful offerings for data ingestion and transformation with Apache NiFi, and advanced stream processing and analytics with Apache Flink, providing a complete ecosystem for your event-driven architectures. Who Benefits from Cloudera Surveyor and When? Cloudera Surveyor is designed to bring clarity, control, and efficiency to anyone managing Apache Kafka on Kubernetes, whether you're an administrator, a DevOps engineer, or a developer. For Kafka Administrators & SREs (Site Reliability Engineers): Daily Operations & Health Monitoring: Easily oversee the health of all your Kafka clusters, brokers, and topics from a single dashboard. Quickly spot anomalies, monitor resource utilization, and ensure the continuous availability of your streaming infrastructure. Proactive Troubleshooting: When issues arise, drill down into performance metrics, consumer group lag, and topic details with an intuitive UI. Identify bottlenecks, misconfigurations, or problematic consumers faster, significantly reducing mean time to resolution (MTTR). Scaling & Capacity Planning: Gain insights into topic growth, partition distribution, and broker load to inform your scaling decisions and optimize resource allocation across your Kubernetes environment.   For DevOps & Platform Engineers: Streamlined Deployments & Upgrades: While Cloudera Streams Messaging - Kubernetes Operator handles the heavy lifting, Surveyor provides immediate visual confirmation of your deployed Kafka clusters, enabling quick validation post-deployment or upgrade. Consistent Multi-Cluster Management: For organizations running numerous Kafka clusters (e.g., for different departments, environments, or applications), Surveyor offers a centralized management plane, drastically simplifying oversight and ensuring consistent configurations and security policies.   For Developers working with Kafka: Understanding Topic & Consumer Behavior: Quickly inspect topics, view message counts, and monitor consumer group progress. This is invaluable for debugging applications, verifying data flow, and understanding how new features or changes impact the Kafka ecosystem during development and testing phases. Security & Access Management: Easily review and manage Kafka ACLs directly through the UI, ensuring that applications and users have appropriate access to topics and consumer groups, without resorting to complex command-line operations. Resources Ready to explore Cloudera Streams Messaging - Kubernetes Operator 1.4 and Cloudera Surveyor? Find out more here: New - Cloudera Surveyor Documentation New - Cloudera Streams Messaging - Kubernetes Operator 1.4 Release Notes Cloudera Streaming Product Page Accelerate Streaming Pipeline Deployments with New Kubernetes Operators (webinar recording) We're excited for you to experience these advancements and empower your real-time data initiatives! ... View more