Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How to pick number of executors , cores for each executor and executor memory

SOLVED Go to solution
Highlighted

How to pick number of executors , cores for each executor and executor memory

New Contributor

Cluster Information:

10 Node cluster, each machine has 16 cores and 126.04 GB of RAM

My Question how to pick num-executors, executor-memory, executor-core, driver-memory, driver-cores

Job will run using Yarn as resource schdeuler

1 ACCEPTED SOLUTION

Accepted Solutions

Re: How to pick number of executors , cores for each executor and executor memory

New Contributor
4 REPLIES 4

Re: How to pick number of executors , cores for each executor and executor memory

New Contributor

Re: How to pick number of executors , cores for each executor and executor memory

New Contributor

@Sivaprasanna - cloudera blog share above is not available, the link redirects to https://blog.cloudera.com/ any idea?

Re: How to pick number of executors , cores for each executor and executor memory

New Contributor

Re: How to pick number of executors , cores for each executor and executor memory

New Contributor