Support Questions
Find answers, ask questions, and share your expertise
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Spark work processes in GPUs

Spark work processes in GPUs


Any pointers for deploying and reconfiguring the Spark work processes in GPUs.


Re: Spark work processes in GPUs

Super Collaborator

Hi @Kiran Jilla,

This may be useful, Create a separate yarn Queue using the GPU nodes(Node Labeling), schedule all the spark executors to that queue. clubbing the GPU nodes with non-GPU nodes have imbalance in computation skew.

hope you have already across CUDA Libraries able to run your code on top of it.

Don't have an account?
Coming from Hortonworks? Activate your account here