Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

split GPU for multiple users

Solved Go to solution
Highlighted

split GPU for multiple users

Explorer

Hi everyone:

 

CDSW support using GPU for machine learning jobs, but it seems one GPU can only be used by one user at the same time.

Can we share one GPU with mulitple users or one GPU must be dedicated to one docker and nobody else can use it at the same time?

 

Thanks!

 

 

1 ACCEPTED SOLUTION

Accepted Solutions

Re: split GPU for multiple users

Rising Star

Hi,

 

CDSW relies on Kubernetes to allocate system resources to user workloads and Kubernetes doesn't allow sharing a GPU core like it does for CPUs.

 

The expectations are set in the Kubernetes documentation:

  • Containers (and pods) do not share GPUs. There’s no overcommitting of GPUs.
  • Each container can request one or more GPUs. It is not possible to request a fraction of a GPU.

from: https://kubernetes.io/docs/tasks/manage-gpus/scheduling-gpus/

 

Regards,

Peter

2 REPLIES 2

Re: split GPU for multiple users

Rising Star

Hi,

 

CDSW relies on Kubernetes to allocate system resources to user workloads and Kubernetes doesn't allow sharing a GPU core like it does for CPUs.

 

The expectations are set in the Kubernetes documentation:

  • Containers (and pods) do not share GPUs. There’s no overcommitting of GPUs.
  • Each container can request one or more GPUs. It is not possible to request a fraction of a GPU.

from: https://kubernetes.io/docs/tasks/manage-gpus/scheduling-gpus/

 

Regards,

Peter

Re: split GPU for multiple users

Explorer
Hi, Peter:
Thank you for your reply. That's really helpful.
Don't have an account?
Coming from Hortonworks? Activate your account here