Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Spark 2.1.1 spark.dynamicAllocation.enabled=true not working

Highlighted

Spark 2.1.1 spark.dynamicAllocation.enabled=true not working

New Contributor

submitted a spark Job using spark-submit with spark.dynamicAllocation.enabled=true is not working.

2 REPLIES 2

Re: Spark 2.1.1 spark.dynamicAllocation.enabled=true not working

@Kuber S, Check if you have enough resources to accommodate spark.dynamicAllocation.initialExecutors if not you can check and reduce the initial executors/executor memory and try.

Re: Spark 2.1.1 spark.dynamicAllocation.enabled=true not working

Contributor

@Kuber S

Can you share the Advanced spark2-thrift-sparkconf configurations?

Don't have an account?
Coming from Hortonworks? Activate your account here