Support Questions
Find answers, ask questions, and share your expertise
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Advanced Search
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Spark 2.1.1 spark.dynamicAllocation.enabled=true not working

Highlighted

Spark 2.1.1 spark.dynamicAllocation.enabled=true not working

Labels:
manypoints
New Contributor

Created ‎01-24-2018 06:34 PM

submitted a spark Job using spark-submit with spark.dynamicAllocation.enabled=true is not working.

Reply
255 Views
0 Kudos
2 REPLIES 2
Highlighted

Re: Spark 2.1.1 spark.dynamicAllocation.enabled=true not working

sandyy006
Guru

Created ‎01-24-2018 07:10 PM

@Kuber S, Check if you have enough resources to accommodate spark.dynamicAllocation.initialExecutors if not you can check and reduce the initial executors/executor memory and try.

Reply
123 Views
0 Kudos

Re: Spark 2.1.1 spark.dynamicAllocation.enabled=true not working

sankar_tumuluru
Contributor

Created ‎01-24-2018 07:23 PM

@Kuber S

Can you share the Advanced spark2-thrift-sparkconf configurations?

Reply
123 Views
0 Kudos
Don't have an account?
Register
Coming from Hortonworks? Activate your account here