Support Questions
Find answers, ask questions, and share your expertise

Spark 2.1.1 spark.dynamicAllocation.enabled=true not working

Spark 2.1.1 spark.dynamicAllocation.enabled=true not working

New Contributor

submitted a spark Job using spark-submit with spark.dynamicAllocation.enabled=true is not working.

2 REPLIES 2

Re: Spark 2.1.1 spark.dynamicAllocation.enabled=true not working

@Kuber S, Check if you have enough resources to accommodate spark.dynamicAllocation.initialExecutors if not you can check and reduce the initial executors/executor memory and try.

Re: Spark 2.1.1 spark.dynamicAllocation.enabled=true not working

Contributor

@Kuber S

Can you share the Advanced spark2-thrift-sparkconf configurations?