Member since
12-20-2023
1
Post
0
Kudos Received
0
Solutions
12-20-2023
01:18 AM
Hi! We’re facing YARN-4714 and Swap memory issues, as shown on the attached printscreens. Increasing ‘spark.yarn.executor.memoryOverhead’ to default ‘0.6’ solved the issue for our spark application on NameNode. Do you think, it would be reasonable to set the value to ‘0.6-0.75’ in the file ‘yarn-site.xml’, cluster-wide for both NameNodes and DataNodes? Thank you for your response, in advance.
... View more