Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How to pick number of executors , cores for each executor and executor memory

Solved Go to solution
Highlighted

How to pick number of executors , cores for each executor and executor memory

Cluster Information:

10 Node cluster, each machine has 16 cores and 126.04 GB of RAM

My Question how to pick num-executors, executor-memory, executor-core, driver-memory, driver-cores

Job will run using Yarn as resource schdeuler

1 ACCEPTED SOLUTION

Accepted Solutions

Re: How to pick number of executors , cores for each executor and executor memory

5 REPLIES 5

Re: How to pick number of executors , cores for each executor and executor memory

Highlighted

Re: How to pick number of executors , cores for each executor and executor memory

Cloudera Employee

Hi,

 

Whether those links that was provided helped to solve the issue

 

if it was fine can you please mark this forum as solved.

 

Thanks

AKR

Highlighted

Re: How to pick number of executors , cores for each executor and executor memory

New Contributor

@Sivaprasanna - cloudera blog share above is not available, the link redirects to https://blog.cloudera.com/ any idea?

Highlighted

Re: How to pick number of executors , cores for each executor and executor memory

New Contributor
Highlighted

Re: How to pick number of executors , cores for each executor and executor memory

New Contributor
Don't have an account?
Coming from Hortonworks? Activate your account here