My cluster configuration is as follows:  3 Node cluster 128GB RAM per cluster node. Processor: 16 core HyperThreaded per cluster node. My questions are: 1) If I submit 5 queries how does impala executes them concurrently? (How does Impala distribute the load in the cluster?) 2) If the number of queries is increased above 10 How will the load balancing of query execution happen?   I am observing an unexpected behaviour of impala if I am trying to execute concurrent queries at a time. So just want to understand the distribution of queries and resources in Impala? ... View more

My cluster configuration is as follows: 3 Node cluster 128GB RAM per cluster node. Processor: 16 core HyperThreaded per cluster node. All 3 nodes have Kudu master and T-Server and Impala server, one of the node has Impala catalogue and Impala StateStore.   My issues are as follows:   1) I've a hard time figuring out Dynamic resource pooling in impala while running concurrent queries. I've tried giving mem_limit still no luck. I've also tried static service pool but with that also I couldn't achieve required concurrency. Even with admission control, the required concurrency was not achieved.            I) The time taken for 1 query: 500-800ms.      II) But if 10 concurrent queries are given the time taken grows to 3-6s per query.      III) But if more than 20 concurrent queries are given the time taken is exceeding 10s per query.   2) One of my cluster nodes is not taking the load after submitting the query, I checked this by the summary of the query. I've tried giving the NUM_NODES as 0 and 1 on the node which is not taking the load, still, the summary shows that the node is not taking the load.   ... View more