Support Questions
Find answers, ask questions, and share your expertise

WARN spark.yarn.executor.memoryOverhead

WARN spark.yarn.executor.memoryOverhead


When executing the test with stdout, I got this message repeated like hundreds of times: The configuration key 'spark.yarn.executor.memoryOverhead' has been deprecated as of Spark 2.3 and may be removed in the future. Please use the new key 'spark.executor.memoryOverhead' instead.

I'm going to just copy the number of messages I got in 1 second, just for the fun of it:





Don't have an account?