When starting spark R, the Spark Session is already generated. You need to stop the current session and spin up a new one to set the desired settings. I use the following sparkR.stop()
# master="local", # local master
master="yarn", # cluster master
) Verify from the Spark monitoring page that the settings updated correctly.
... View more