Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

How to pick number of executors , cores for each executor and executor memory

avatar

Cluster Information:

10 Node cluster, each machine has 16 cores and 126.04 GB of RAM

My Question how to pick num-executors, executor-memory, executor-core, driver-memory, driver-cores

Job will run using Yarn as resource schdeuler

1 ACCEPTED SOLUTION
5 REPLIES 5

avatar
Contributor

avatar
Cloudera Employee

Hi,

 

Whether those links that was provided helped to solve the issue

 

if it was fine can you please mark this forum as solved.

 

Thanks

AKR

avatar

@Sivaprasanna - cloudera blog share above is not available, the link redirects to https://blog.cloudera.com/ any idea?