With the launch of Cloudera on cloud 7.2.15, Cloudera Streaming Analytics for Data Hub deployments has gotten some powerful new features with support for Dead Letter Queues.
SQL Stream Builder now has a de-serialization tab that allows users to configure how errors with messages are handled as part of their SQL Queries. Connections using Kafka can setup multiple options for what to do on a failure to process the message rather than causing the job to stop the message can be handled in multiple ways such as: Failing the Job, Ignoring the Message, Ignoring and Logging the Message, ignoring the message and write it to a Dead Letter Queue (another Kafka Topic.)
Read more about the de-serialization capabilities in the Streaming Analytics 7.2.15 Documentation.
