I'm trying to start a sparkR session from within an R session; not through spark-submit. However, when i try to set a queue like this, it doesn't work: sparkR.session(queue ="queue_name") The only way I can get it to actually set that queue is to use the old ```init()``` function, which thows a warning: sc <- SparkR::sparkR.init(master = "yarn-client", sparkEnvir = list(spark.yarn.queue="a2_hungry"))
hiveContext <- sparkRHive.init(sc) Warning message:
'SparkR::sparkR.init' is deprecated.
Use 'sparkR.session' instead.
How can I set a queue in the non-deprecated way?
... View more