question Re: split GPU for multiple users in Support Questions

split GPU for multiple users

ursash — Fri, 16 Sep 2022 13:41:55 GMT

Hi everyone:

CDSW support using GPU for machine learning jobs, but it seems one GPU can only be used by one user at the same time.

Can we share one GPU with mulitple users or one GPU must be dedicated to one docker and nobody else can use it at the same time?

Thanks！

peter_ableda — Wed, 12 Sep 2018 09:27:17 GMT

Hi,

CDSW relies on Kubernetes to allocate system resources to user workloads and Kubernetes doesn't allow sharing a GPU core like it does for CPUs.

The expectations are set in the Kubernetes documentation:

Containers (and pods) do not share GPUs. There’s no overcommitting of GPUs.
Each container can request one or more GPUs. It is not possible to request a fraction of a GPU.

Regards,

Peter

ursash — Wed, 12 Sep 2018 09:29:19 GMT

Hi, Peter:
Thank you for your reply. That's really helpful.