Welcome to the Cloudera Community

Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Who agreed with this topic

impala + llama error:UNKNOWN_RESERVATION_FOR_EXPANSION

avatar
New Contributor
Who can help me solve this problem, thank you! impala + llama on yarn Execute a query : "select count(distinct userid) from bigtable " Error impala-shell is appearing : WARNINGS: Memory limit exceeded Query did not have enough memory to get the minimum required buffers in the block manager. Memory Limit Exceeded Query(6c49ce60d57f0bd4:c233bac905dea99c) Limit: Consumption=20.02 GB Fragment 6c49ce60d57f0bd4:c233bac905dea99e: Consumption=263.51 MB AGGREGATION_NODE (id=2): Consumption=4.00 KB AGGREGATION_NODE (id=4): Consumption=258.57 MB EXCHANGE_NODE (id=3): Consumption=0 DataStreamRecvr: Consumption=4.91 MB DataStreamSender: Consumption=16.00 KB Block Manager: Limit=6871947776.00 GB Consumption=19.96 GB Fragment 6c49ce60d57f0bd4:c233bac905dea9a4: Consumption=19.76 GB AGGREGATION_NODE (id=1): Consumption=19.73 GB HDFS_SCAN_NODE (id=0): Consumption=31.75 MB DataStreamSender: Consumption=31.97 KB -------------------------------------------------------- impalad log is as follows I0606 23:30:16.828152 38379 status.cc:114] com.cloudera.llama.util.LlamaException: UNKNOWN_RESERVATION_FOR_EXPANSION - Unknown reservation 'bd4dcafb4c42db5d:ff888fe803ab4fb1' for expansion, com.cloudera.llama.util.LlamaException: UNKNOWN_RESERVATION_FOR_EXPANSION - Unknown reservation 'bd4dcafb4c42db5d:ff888fe803ab4fb1' for expansion, at com.cloudera.llama.am.impl.ExpansionReservationsLlamaAM.expand(ExpansionReservationsLlamaAM.java:249), at com.cloudera.llama.am.impl.APIContractLlamaAM.expand(APIContractLlamaAM.java:155), at com.cloudera.llama.am.LlamaAMServiceImpl.Expand(LlamaAMServiceImpl.java:205), at com.cloudera.llama.am.MetricLlamaAMService.Expand(MetricLlamaAMService.java:158), at com.cloudera.llama.thrift.LlamaAMService$Processor$Expand.getResult(LlamaAMService.java:532), at com.cloudera.llama.thrift.LlamaAMService$Processor$Expand.getResult(LlamaAMService.java:517), at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39), at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39), at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:206), at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145), at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615), at java.lang.Thread.run(Thread.java:745) @ 0x78b793 (unknown) @ 0xa6b69d (unknown) @ 0xb60edb (unknown) @ 0x949a14 (unknown) @ 0x968603 (unknown) @ 0x964d21 (unknown) @ 0xc56d05 (unknown) @ 0x7f282bbc9519 (unknown) I0606 23:30:16.828224 38379 mem-tracker.cc:310] Failed to expand memory limit by 4.00 MB: com.cloudera.llama.util.LlamaException: UNKNOWN_RESERVATION_FOR_EXPANSION - Unknown reservation 'bd4dcafb4c42db5d:ff888fe803ab4fb1' for expansion, com.cloudera.llama.util.LlamaException: UNKNOWN_RESERVATION_FOR_EXPANSION - Unknown reservation 'bd4dcafb4c42db5d:ff888fe803ab4fb1' for expansion, at com.cloudera.llama.am.impl.ExpansionReservationsLlamaAM.expand(ExpansionReservationsLlamaAM.java:249), at com.cloudera.llama.am.impl.APIContractLlamaAM.expand(APIContractLlamaAM.java:155), at com.cloudera.llama.am.LlamaAMServiceImpl.Expand(LlamaAMServiceImpl.java:205), at com.cloudera.llama.am.MetricLlamaAMService.Expand(MetricLlamaAMService.java:158), at com.cloudera.llama.thrift.LlamaAMService$Processor$Expand.getResult(LlamaAMService.java:532), at com.cloudera.llama.thrift.LlamaAMService$Processor$Expand.getResult(LlamaAMService.java:517), at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39), at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39), at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:206), at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145), at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615), at java.lang.Thread.run(Thread.java:745) I0606 23:30:16.842576 38379 status.cc:114] com.cloudera.llama.util.LlamaException: UNKNOWN_RESERVATION_FOR_EXPANSION - Unknown reservation 'bd4dcafb4c42db5d:ff888fe803ab4fb1' for expansion, com.cloudera.llama.util.LlamaException: UNKNOWN_RESERVATION_FOR_EXPANSION - Unknown reservation 'bd4dcafb4c42db5d:ff888fe803ab4fb1' for expansion, at com.cloudera.llama.am.impl.ExpansionReservationsLlamaAM.expand(ExpansionReservationsLlamaAM.java:249), at com.cloudera.llama.am.impl.APIContractLlamaAM.expand(APIContractLlamaAM.java:155), at com.cloudera.llama.am.LlamaAMServiceImpl.Expand(LlamaAMServiceImpl.java:205), at com.cloudera.llama.am.MetricLlamaAMService.Expand(MetricLlamaAMService.java:158), at com.cloudera.llama.thrift.LlamaAMService$Processor$Expand.getResult(LlamaAMService.java:532), at com.cloudera.llama.thrift.LlamaAMService$Processor$Expand.getResult(LlamaAMService.java:517), at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39), at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39), at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:206), at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145), at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615), at java.lang.Thread.run(Thread.java:745) @ 0x78b793 (unknown) @ 0xa6b69d (unknown) @ 0xb60edb (unknown) @ 0x949a14 (unknown) @ 0x968603 (unknown) @ 0x964a6c (unknown) @ 0xc56d05 (unknown) @ 0x7f282bbc953c (unknown)
Who agreed with this topic