<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:taxo="http://purl.org/rss/1.0/modules/taxonomy/" version="2.0">
  <channel>
    <title>question Hive LLAP - configuration - slowness - tasks killed in Support Questions</title>
    <link>https://community.cloudera.com/t5/Support-Questions/Hive-LLAP-configuration-slowness-tasks-killed/m-p/334295#M231704</link>
    <description>&lt;P&gt;Hi,&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;I'm writing to you because I have some trouble or misunderstanding with Hive LLAP.&lt;/P&gt;&lt;P&gt;LLAP is slow when executing queries and I feel like LLAP is not well configured. I checked the jmx metrics of my LLAP daemons and I saw that :&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;LI-CODE lang="python"&gt;"ExecutorTotalRequestsHandled" : 89065,
"ExecutorTotalSuccess" : 22893,
"ExecutorTotalFailed" : 58,
"ExecutorTotalKilled" : 21724,
"ExecutorTotalEvictedFromWaitQueue" : 43678,
"ExecutorTotalRejectedRequests" : 406234,
"ExecutorTotalPreemptionTimeToKill" : 73450159,
"ExecutorTotalPreemptionTimeLost" : 1083694998,&lt;/LI-CODE&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;Each deamon has the same behavior.&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;Most of executed tasks are killed or evicted (only 25% of sucess tasks...) and I think this is one of the reason of the slowness.&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;Below my configuration :&lt;/P&gt;&lt;P&gt;- 75 nodes reserved for LLAP (node labelling).&lt;/P&gt;&lt;P&gt;- 280 GB - 40 CPUs per node.&lt;/P&gt;&lt;P&gt;- 220 GB - 36 CPU per daemon.&lt;/P&gt;&lt;P&gt;- Daemon : 144 GB for the heap, 60 GB for the cache, 16 GB for the headroom.&lt;/P&gt;&lt;P&gt;- hive.tez.container.size = 4 G&lt;/P&gt;&lt;P&gt;- tez.am.resource.memory.mb = 12 G&lt;/P&gt;&lt;P&gt;- hive.llap.io.threadpool.size = 36&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;Does this configuration look well for you ?&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;Also, when I check the execution of some queries, I can see that :&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;LI-CODE lang="markup"&gt;Map 1: 855(+40426,-1167)/41281 Reducer 2: 0/1009&lt;/LI-CODE&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;It means that "Map 1" has 41281 tasks map, 855 are completed and 40426 are running (and 1167 are pending) but how it that possible because I have 75 daemon and 36 CPUs per deamon (75*36 = 2700), So I should have at most 2700 tasks running (1 CPU per task), no ?&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;What do you think ? Any ideas, suggestions or questions would be useful.&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;Thanks a lot for your help.&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;</description>
    <pubDate>Thu, 20 Jan 2022 15:13:47 GMT</pubDate>
    <dc:creator>Simon230</dc:creator>
    <dc:date>2022-01-20T15:13:47Z</dc:date>
  </channel>
</rss>

