Support Questions
Find answers, ask questions, and share your expertise
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

WARN spark.yarn.executor.memoryOverhead


WARN spark.yarn.executor.memoryOverhead


When executing the test with stdout, I got this message repeated like hundreds of times: The configuration key 'spark.yarn.executor.memoryOverhead' has been deprecated as of Spark 2.3 and may be removed in the future. Please use the new key 'spark.executor.memoryOverhead' instead.

I'm going to just copy the number of messages I got in 1 second, just for the fun of it:





Don't have an account?
Coming from Hortonworks? Activate your account here