https://community.cloudera.com/t5/Archives-of-Support-Questions/Why-is-Hive-running-out-of-memory-OOM-on-an-Azure-VM-with-4/m-p/143745#M23726 <P><A rel="user" href="https://community.cloudera.com/users/3574/jgarrigan.html" nodeid="3574">@John Garrigan</A> thank you for posting your resolution. Much appreciated!</P> Sat, 26 Mar 2016 19:08:12 GMT SQLShaw 2016-03-26T19:08:12Z https://community.cloudera.com/t5/Archives-of-Support-Questions/Why-is-Hive-running-out-of-memory-OOM-on-an-Azure-VM-with-4/m-p/143742#M23723 <P>Hi, I am trying to run some simple enough queries on my files (250000 records) and I am receiving an out of memory message as follows:</P><PRE>ERROR : Vertex failed, vertexName=Map 1, vertexId=vertex_1458912652919_0002_1_00, diagnostics=[Task failed, taskId=task_1458912652919_0002_1_00_000006, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:java.lang.RuntimeException: java.lang.OutOfMemoryError: Java heap spaceat org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:159)at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:139).........and this continues for many lines. </PRE><P>I have tried researching this issue and I came across this post but I am lost as to how I can modify the settings discussed: <A href="https://azure.microsoft.com/en-us/blog/hive-memory-settings-resolve-out-of-memory-errors-using-azure-hdinsight/" target="_blank">https://azure.microsoft.com/en-us/blog/hive-memory-settings-resolve-out-of-memory-errors-using-azure-hdinsight/</A></P><P>Can anyone shed any light on this for me please? By the way, below is the query I was trying to run on my Hive table:</P><PRE>SELECT * FROM pigoutputhive SORT BY Score DESC LIMIT 10;</PRE><P>Many thanks in advance.</P> Fri, 25 Mar 2016 23:58:54 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/Why-is-Hive-running-out-of-memory-OOM-on-an-Azure-VM-with-4/m-p/143742#M23723 jgarrigan 2016-03-25T23:58:54Z https://community.cloudera.com/t5/Archives-of-Support-Questions/Why-is-Hive-running-out-of-memory-OOM-on-an-Azure-VM-with-4/m-p/143743#M23724 <P>I came across this article and changed the recommended settings but when I now run the above query I receive no errors or results even though the status is completed. Has anyone any other suggestions please?</P> Sat, 26 Mar 2016 04:51:37 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/Why-is-Hive-running-out-of-memory-OOM-on-an-Azure-VM-with-4/m-p/143743#M23724 jgarrigan 2016-03-26T04:51:37Z https://community.cloudera.com/t5/Archives-of-Support-Questions/Why-is-Hive-running-out-of-memory-OOM-on-an-Azure-VM-with-4/m-p/143744#M23725 <P>So I finally figured out my problem, it had to do with my own impatience!</P><P>Although Hive said the query ran successfully and had not returned any results, it was still working away in the background and eventually spat back some results. Although the results were not correct that's for another day. </P><P>I changed the settings as per the linked article above but needed an Admin profile to do so and it eventually worked. </P> Sat, 26 Mar 2016 18:57:27 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/Why-is-Hive-running-out-of-memory-OOM-on-an-Azure-VM-with-4/m-p/143744#M23725 jgarrigan 2016-03-26T18:57:27Z https://community.cloudera.com/t5/Archives-of-Support-Questions/Why-is-Hive-running-out-of-memory-OOM-on-an-Azure-VM-with-4/m-p/143745#M23726 <P><A rel="user" href="https://community.cloudera.com/users/3574/jgarrigan.html" nodeid="3574">@John Garrigan</A> thank you for posting your resolution. Much appreciated!</P> Sat, 26 Mar 2016 19:08:12 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/Why-is-Hive-running-out-of-memory-OOM-on-an-Azure-VM-with-4/m-p/143745#M23726 SQLShaw 2016-03-26T19:08:12Z https://community.cloudera.com/t5/Archives-of-Support-Questions/Why-is-Hive-running-out-of-memory-OOM-on-an-Azure-VM-with-4/m-p/143746#M23727 <P>how do you login as admin profile? I am using the Maria_dev, it is all grey out in config, I could not change anything</P> Sat, 16 Apr 2016 21:15:03 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/Why-is-Hive-running-out-of-memory-OOM-on-an-Azure-VM-with-4/m-p/143746#M23727 chen_zhi 2016-04-16T21:15:03Z