Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

impala + llama can not work

Highlighted

impala + llama can not work

New Contributor

hi:

 I have run Impala with the enviroment of Integrated Resource Management with YARN  (version: CDH-5.3.0-1.cdh5.3.0.p0.30).

Now I run a complex sql query in impala-shell, the query is as below:

"select s.pvcount, count(p.serversessionid) from wd.session s inner join  wd.pageview p on p.serversessionid = s.serversessionid group by s.pvcount;"

 

Once the resource management is disable, this sql can run success .but after run Impala with the enviroment of Integrated Resource Management with YARN,this sql run failed.

I have already set mem_limit=60G in impala-shell, but the query was still failed.

 

Below is the error log.

 

Could you please help me with this? How could I do next? Thanks.

 

/var/log/impala-llama/llama-cmf-impala-LLAMA-gs-server-1001.log.out:

Expand() error: com.cloudera.llama.util.LlamaException: RESERVATION_ASKING_UNKNOWN_NODE - Reservation 'e24f4b3d41aa4077:63191c21778700af', expansion '6e463526c63ef971:e5e6685793b5bfb4' asking for a resource on node 'gs-server-1000' that does not exist.
com.cloudera.llama.util.LlamaException: RESERVATION_ASKING_UNKNOWN_NODE - Reservation 'e24f4b3d41aa4077:63191c21778700af', expansion '6e463526c63ef971:e5e6685793b5bfb4' asking for a resource on node 'gs-server-1000' that does not exist.
	at com.cloudera.llama.am.impl.ExpansionReservationsLlamaAM.checkAndUpdateCapacity(ExpansionReservationsLlamaAM.java:153)
	at com.cloudera.llama.am.impl.ExpansionReservationsLlamaAM.expand(ExpansionReservationsLlamaAM.java:252)
	at com.cloudera.llama.am.impl.APIContractLlamaAM.expand(APIContractLlamaAM.java:155)
	at com.cloudera.llama.am.LlamaAMServiceImpl.Expand(LlamaAMServiceImpl.java:205)
	at com.cloudera.llama.am.MetricLlamaAMService.Expand(MetricLlamaAMService.java:158)
	at com.cloudera.llama.thrift.LlamaAMService$Processor$Expand.getResult(LlamaAMService.java:532)
	at com.cloudera.llama.thrift.LlamaAMService$Processor$Expand.getResult(LlamaAMService.java:517)
	at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
	at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
	at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:206)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)

/var/log/impalad/impalad.INFO

I0524 16:01:05.533982 28403 query-resource-mgr.cc:193] Could not expand CPU resources for query 9d487629f4102225:e0a546c1930ed285, reservation: e24f4b3d41aa4077:63191c21778700af. Error was: com.cloudera.llama.util.LlamaException: RESERVATION_ASKING_UNKNOWN_NODE - Reservation 'e24f4b3d41aa4077:63191c21778700af', expansion '6e463526c63ef971:e5e6685793b5bfb4' asking for a resource on node 'gs-server-1000' that does not exist., com.cloudera.llama.util.LlamaException: RESERVATION_ASKING_UNKNOWN_NODE - Reservation 'e24f4b3d41aa4077:63191c21778700af', expansion '6e463526c63ef971:e5e6685793b5bfb4' asking for a resource on node 'gs-server-1000' that does not exist., at com.cloudera.llama.am.impl.ExpansionReservationsLlamaAM.checkAndUpdateCapacity(ExpansionReservationsLlamaAM.java:153), at com.cloudera.llama.am.impl.ExpansionReservationsLlamaAM.expand(ExpansionReservationsLlamaAM.java:252), at com.cloudera.llama.am.impl.APIContractLlamaAM.expand(APIContractLlamaAM.java:155), at com.cloudera.llama.am.LlamaAMServiceImpl.Expand(LlamaAMServiceImpl.java:205), at com.cloudera.llama.am.MetricLlamaAMService.Expand(MetricLlamaAMService.java:158), at com.cloudera.llama.thrift.LlamaAMService$Processor$Expand.getResult(LlamaAMService.java:532), at com.cloudera.llama.thrift.LlamaAMService$Processor$Expand.getResult(LlamaAMService.java:517), at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39), at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39), at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:206), at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145), at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615), at java.lang.Thread.run(Thread.java:745)

 

 

 

Don't have an account?
Coming from Hortonworks? Activate your account here