And consecutive query performance also decreased. Please suggest it I can tune the reducer's.
I have tried to tune my cluster with following parameter.
MemPerDaemon (Container Size) > LLAP Heapsize (Java process heap) + CacheSize (off heap) +headroom
Multiple of yarn min allocation
Should be less than yarn.nodemanager.resource.memory-mb
Headroom is capped at 6GB
QueueSize (Yarn Queue) >= MemPerDaemon * num daemons + slider + (tez AM size * concurrency)
Cachesize = MemPerDaemon - (hive tez container * num of executors)
Num executors per daemon = (MemPerDaemon - cache_size)/hive tez container size
Our cluster size is 4 datanode and 1 master.