Reply
Highlighted
Expert Contributor
Posts: 143
Registered: ‎08-07-2017

Getting OOM GC overhead limit exceeded error

[ Edited ]

Hello All,

 

We are using spark thrift service to run hive queries. For one of the queries, we are getting OOM error GC overhead limit exceeded.

 

heap size of resurcemanger,nodemanager is 1gb each.

 

Please suggest.

 

Thanks,

Priya

Posts: 57
Topics: 0
Kudos: 8
Solutions: 5
Registered: ‎05-15-2018

Re: Getting OOM GC overhead limit exceeded error

Hello Priya,

 

Thanks for posting your query!

 

Could you please check the spark thrift service's heap configuration ? ( ps -axu | grep <pid_of_sparkthrift ) you should be able to see Xmx options passed as argument

 

Consider increasing the heap of the same

Thanks,
Satz
Expert Contributor
Posts: 143
Registered: ‎08-07-2017

Re: Getting OOM GC overhead limit exceeded error

Hello satz,

Thanks for inputs. Current heap size is 3gb. I will increase that to 5gb and observe for errors.

Thanks,
Priya
Expert Contributor
Posts: 143
Registered: ‎08-07-2017

Re: Getting OOM GC overhead limit exceeded error

Hi satz,

Thanks for inputs. Current value for Xmx heap size is 3gb. I will increase it to 5gb and observe whether we still face same error or not.

Thanks,
Priya