@Matt Krueger you should look at spark history server/spark ui to see the correct environment settings being used. Setting executor cores to 3 is actually going to use 3 concurrent threads in each executor. AFAIK this might not be same as yarn v-core concept. HTH *** If you found this answer addressed your question, please take a moment to login and click the "accept" link on the answer.
... View more
