Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

WARN spark.yarn.executor.memoryOverhead

Highlighted

WARN spark.yarn.executor.memoryOverhead

 

When executing the test with stdout, I got this message repeated like hundreds of times: The configuration key 'spark.yarn.executor.memoryOverhead' has been deprecated as of Spark 2.3 and may be removed in the future. Please use the new key 'spark.executor.memoryOverhead' instead.

I'm going to just copy the number of messages I got in 1 second, just for the fun of it:

 

dasdasdasd.jpg

 

 

Don't have an account?
Coming from Hortonworks? Activate your account here