Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Getting OOM GC overhead limit exceeded error

Getting OOM GC overhead limit exceeded error

Contributor

Hello All,

 

We are using spark thrift service to run hive queries. For one of the queries, we are getting OOM error GC overhead limit exceeded.

 

heap size of resurcemanger,nodemanager is 1gb each.

 

Please suggest.

 

Thanks,

Priya

3 REPLIES 3

Re: Getting OOM GC overhead limit exceeded error

Rising Star

Hello Priya,

 

Thanks for posting your query!

 

Could you please check the spark thrift service's heap configuration ? ( ps -axu | grep <pid_of_sparkthrift ) you should be able to see Xmx options passed as argument

 

Consider increasing the heap of the same

Thanks,
Satz

Re: Getting OOM GC overhead limit exceeded error

Contributor
Hello satz,

Thanks for inputs. Current heap size is 3gb. I will increase that to 5gb and observe for errors.

Thanks,
Priya

Re: Getting OOM GC overhead limit exceeded error

Contributor
Hi satz,

Thanks for inputs. Current value for Xmx heap size is 3gb. I will increase it to 5gb and observe whether we still face same error or not.

Thanks,
Priya