<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:taxo="http://purl.org/rss/1.0/modules/taxonomy/" version="2.0">
  <channel>
    <title>question Re: Hive OutOfMemoryError: unable to create new native thread in Support Questions</title>
    <link>https://community.cloudera.com/t5/Support-Questions/Hive-OutOfMemoryError-unable-to-create-new-native-thread/m-p/281115#M209173</link>
    <description>&lt;P&gt;Hi&amp;nbsp;&lt;a href="https://community.cloudera.com/t5/user/viewprofilepage/user-id/57779"&gt;@ssulav&lt;/a&gt;&amp;nbsp;,&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;I see the below error in the HS2 logs shared:&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;PRE&gt;ERROR [HiveServer2-Background-Pool: Thread-886]: SessionState (:()) - Vertex failed, vertexName=Map 1, vertexId=vertex_1571760131080_0019_1_00, diagnostics=[Task failed, taskId=task_1571760131080_0019_1_00_000380, diagnostics=[TaskAttempt 0 failed, info=[Error: Error while running task ( failure ) : java.lang.OutOfMemoryError: unable to create new native thread&lt;/PRE&gt;&lt;P&gt;The above error is reported by the Yarn application.&lt;/P&gt;&lt;P&gt;This error is not related to any Hadoop or Yarn or Hive configuration. Rather this is an error received by the OS for now able to create new threads for the process.&lt;/P&gt;&lt;P&gt;You need to check the ulimits of the Yarn user on the NodeManager and ResourceManager nodes.&lt;/P&gt;&lt;P&gt;Though, it is more likely this error is coming from the NodeManager running the above mentioned Task ID.&lt;/P&gt;&lt;P&gt;You can identify the host where the above Task is running by searching for the vertex or Task ID in the Yarn application logs.&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;The job would be running as Yarn user and check for similar errors in the nodemanager logs for the same host.&lt;/P&gt;&lt;P&gt;You can try increase the ulimit for "ulimit -u" option.&lt;/P&gt;</description>
    <pubDate>Wed, 23 Oct 2019 11:45:13 GMT</pubDate>
    <dc:creator>rohitmalhotra</dc:creator>
    <dc:date>2019-10-23T11:45:13Z</dc:date>
  </channel>
</rss>

