Hi,   Could you help me understand the meaning of Total, Peak and Exprs in Breakdown section of the impalad memz page? In my understanding, Peak mem is the Peak memory we've seen so far for that component (Query, Frag or Node etc); Total is the current timepoint's total memory consumption of that component on the machine; and what does (total and Peak of) Exprs mean?   Here's a snippet:   Process: Limit=256.00 MB Total=142.79 MB Peak=264.24 MB Free Disk IO Buffers: Total=4.50 MB Peak=102.56 MB RequestPool=root.centos: Total=11.60 MB Peak=187.26 MB Query(e040ae477e9d2aec:87d527e600000000): Total=11.60 MB Peak=13.45 MB Fragment e040ae477e9d2aec:87d527e600000005: Total=10.30 MB Peak=10.98 MB AGGREGATION_NODE (id=3): Total=10.29 MB Peak=10.29 MB Exprs: Total=4.00 KB Peak=4.00 KB EXCHANGE_NODE (id=2): Total=0 Peak=0 DataStreamRecvr: Total=0 Peak=0 HdfsTableSink: Total=0 Peak=0 CodeGen: Total=3.32 KB Peak=696.50 KB Block Manager: Limit=156.00 MB Total=8.50 MB Peak=8.50 MB Fragment e040ae477e9d2aec:87d527e600000002: Total=1.30 MB Peak=2.47 MB AGGREGATION_NODE (id=1): Total=1.29 MB Peak=1.29 MB Exprs: Total=4.00 KB Peak=4.00 KB HDFS_SCAN_NODE (id=0): Total=0 Peak=0 DataStreamSender (dst_id=2): Total=3.14 KB Peak=3.14 KB CodeGen: Total=0 Peak=1.16 MB   Thanks   ... View more

Hello,   I ran an impala query which failed due to memory limit exceeded error. I notice that I can increase the per query memory limitation by setting the "MEM_LIMIT" at the query level (ref: https://www.cloudera.com/documentation/enterprise/5-8-x/topics/impala_mem_limit.html). Also, there's an impalad daemon level memory limit which sets the mem limit for the process and queries that runs by that daemon as coordinator.   I have a couple of questions regarding these 2 limits (the query mem limit and the daemon mem limit): 1) If I "set mem_limit=yyyy;" before I run the query, I can see these lines from the query profile: .... Query Options (non default): MEM_LIMIT=3145728 Plan: ... But if I don't explicitly set that option, it's not in the query profile, then how/where could I get that value? Is there a CM rest api for retrieving that?   2) From CM rest api, is there a way to get the Impala process total memory and what's the max available memory to allocate to the query? I assume I can't allocate more than the impala process total memory, and if I do, it won't help in allocating more memory for running queries on that impalad host.   Thanks in advance, S.       ... View more

Hello,   I'm trying to get some key impalad daemon metrics (mem consumption, CPU cycles etc.) from CM REST api but couldn't find it. I'm following this list but only see Impala query level metrics:   https://cloudera.github.io/cm_api/apidocs/v15/   In the impalad daemon UI, I see lots of such metrics in the /memz and /metrics tab. Are those (or some of them) available from CM REST api as well?   Thanks, S. ... View more