Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

impala catalog server JVM

avatar
Contributor

Hi.

I have a problem with outOfMemory error on impala catalog server.

Data in tables about 30TB and about 175k partitiions.

I set Java Heap Size of Catalog Server in Bytes=30gb, but still have out_of_memory error in start.

How can i calculate how much memory needs for catalog server? And is it have any limit to set ?

1 ACCEPTED SOLUTION

avatar

Slide 17 here has some rules of thumb - https://blog.cloudera.com/latest-impala-cookbook/

 

Can you mention what version you're running and whether you have any other non-standard configs set, e.g. load_catalog_in_background. We made some improvements in this area and have added some options in more recent versions.

 

View solution in original post

1 REPLY 1

avatar

Slide 17 here has some rules of thumb - https://blog.cloudera.com/latest-impala-cookbook/

 

Can you mention what version you're running and whether you have any other non-standard configs set, e.g. load_catalog_in_background. We made some improvements in this area and have added some options in more recent versions.