Reply
New Contributor
Posts: 3
Registered: ‎07-27-2017

API for heap size

 

Is there a way we can alter heap size using CM API?

Posts: 642
Topics: 3
Kudos: 105
Solutions: 67
Registered: ‎08-16-2016

Re: API for heap size

For which service?
New Contributor
Posts: 3
Registered: ‎07-27-2017

Re: API for heap size

Our developer team are getting below error while running spark job....

Uncaught error from thread [spark-akka.actor.default-dispatcher-3] shutting down JVM since 'akka.jvm-exit-on-fatal-error' is enabled for ActorSystem[spark]
java.lang.OutOfMemoryError: Java heap space

 

I need to automated fix by running API 

Highlighted
Posts: 642
Topics: 3
Kudos: 105
Solutions: 67
Registered: ‎08-16-2016

Re: API for heap size

They should be able to set the executor memory size when launching the job. This will give it more heap. You can also set this globally in the Spark configs so that all Spark apps have the larger container size.

./bin/spark-submit \
--class org.apache.spark.examples.SparkPi \
--executor-memory 20G \ <------this setting
/path/to/examples.jar \
1000

spark.executor.memory
New Contributor
Posts: 3
Registered: ‎07-27-2017

Re: API for heap size

Will ask developer to test. Thanks Appreciated
Announcements