Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

spark.dynamicAllocation.enabled recommendation

spark.dynamicAllocation.enabled recommendation

Contributor

Hi.

 

Does Cloudera recommend to set spark.dynamicAllocation.enabled property to be turned on ? I have a query not completing and i've been trying to figure out the cause.

 

Thanks.

1 REPLY 1
Highlighted

Re: spark.dynamicAllocation.enabled recommendation

Guru
Starting with CDH 5.5, dynamic allocation is enabled by default. Dynamic Allocation Properties describes properties to control dynamic allocation.

Please refer to the following doc:

https://www.cloudera.com/documentation/enterprise/5-6-x/topics/cdh_ig_running_spark_on_yarn.html#spa...