CDSW Monitoring - Operational Data Engineering Process Monitoring

Part of the Visibility and Transparency series this article provides steps for the implementation of Cloudera Data Science Workbench processes or workloads monitoring and alerting system. The framework uses Apache Hive, Apache Airflow, Bash shell scripts, and BI Visualization tools. The framework features include a customized visualization dashboard for insights and alert mechanisms.

The attachment to this article details the implementation steps.