HI, we started having an OOM with the catalog .
E1203 15:00:07.379981 24194 catalog-server.cc:279] OutOfMemoryError: Requested array size exceeds VM limit
We get this every 4 sec.
WE restarted catalog and it works fine for a while and then the error start reoccurring.
Our biggest table has 5k partitions and less than 20k files.
Catalogd is using between 15-18GB of memory and we are on impala 2.2 .
Have we hit a hard limit here?
From the name node:
1037386 files and directories, 752946 blocks = 1790332 total filesystem object(s).
We have plan to grow our data by many folds... hope we are not capped....
Any help would be appreciated.
