question Cloudera Data Science Workbench - Memory usage in Support Questions

Cloudera Data Science Workbench - Memory usage

gfranco — Tue, 21 Apr 2026 09:02:49 GMT

Hello.

I have to support a cluster with Cloudera Data Science Workbench (v1.6), that is installed across two nodes (each with 60GB of memory).

I need to understand how CDSW use Docker and Kubernetes. I can see that there are a lot of containers and k8s pods running in the background.
Is it possible to automate the removal of idle containers?
How can I monitor the memory consumption of each node and each container?

CDSW v1.9 has a Grafana Dashboard for monitoring. Can I get these metrics by a CLI?

Re: Cloudera Data Science Workbench - Memory usage

GangWar — Sun, 11 Jul 2021 12:33:48 GMT

@gfranco In CDSW almost every POD is serving it's own purpose. The only thing which is possible is scale/de-scale the Web PODs if needed.

Regarding the monitoring this is running K8s in the heart so you can use K8s command to watch the usages.

Here is a good discussion about such commands/utility: https://github.com/kubernetes/kubernetes/issues/17512

From CDSW public doc you can refer this: https://docs.cloudera.com/cdsw/1.9.1/monitoring/topics/cdsw-monitoring.html?