https://community.cloudera.com/t5/Archives-of-Support-Questions/spark-2-jobs-with-OOZIE-on-HDP-2-6-5-hangs/m-p/237603#M85133 <P>Hello All,</P><P>I try to run a spark 2 job with oozie on HDP 2.6.5. </P><P>Oozie starts successful, but my spark 2 job keeps in running state.</P><P>on Resource manager UI, I got </P><TABLE><TBODY><TR> <TH>Application Type: </TH> <TD>SPARK </TD></TR> <TR> <TH>Application Tags: </TH> <TD>oozie-7bf4f1cfb7c848de2db37230975b4450 </TD></TR> <TR> <TH>Application Priority: </TH> <TD>0 (Higher Integer value indicates higher priority) </TD></TR> <TR> <TH>YarnApplicationState: </TH> <TD>ACCEPTED: waiting for AM container to be allocated, launched and register with RM. </TD></TR> <TR> <TH><BR /></TH><TD></TD></TR></TBODY></TABLE><P><BR />Kindly suggest.</P> Thu, 22 Nov 2018 21:59:56 GMT chris_herssens 2018-11-22T21:59:56Z https://community.cloudera.com/t5/Archives-of-Support-Questions/spark-2-jobs-with-OOZIE-on-HDP-2-6-5-hangs/m-p/237603#M85133 <P>Hello All,</P><P>I try to run a spark 2 job with oozie on HDP 2.6.5. </P><P>Oozie starts successful, but my spark 2 job keeps in running state.</P><P>on Resource manager UI, I got </P><TABLE><TBODY><TR> <TH>Application Type: </TH> <TD>SPARK </TD></TR> <TR> <TH>Application Tags: </TH> <TD>oozie-7bf4f1cfb7c848de2db37230975b4450 </TD></TR> <TR> <TH>Application Priority: </TH> <TD>0 (Higher Integer value indicates higher priority) </TD></TR> <TR> <TH>YarnApplicationState: </TH> <TD>ACCEPTED: waiting for AM container to be allocated, launched and register with RM. </TD></TR> <TR> <TH><BR /></TH><TD></TD></TR></TBODY></TABLE><P><BR />Kindly suggest.</P> Thu, 22 Nov 2018 21:59:56 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/spark-2-jobs-with-OOZIE-on-HDP-2-6-5-hangs/m-p/237603#M85133 chris_herssens 2018-11-22T21:59:56Z https://community.cloudera.com/t5/Archives-of-Support-Questions/spark-2-jobs-with-OOZIE-on-HDP-2-6-5-hangs/m-p/237604#M85134 <P> <A rel="user" href="https://community.cloudera.com/users/13723/chrisherssens.html" nodeid="13723">@chris herssens</A>,</P><P>Looks like there is a resource crunch. Can you try adding additional NodeManagers if possible. Check if any applications are running in YARN. You can kill any app if it's not used and see if your spark job goes to running state from accepted.</P> Thu, 22 Nov 2018 23:42:12 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/spark-2-jobs-with-OOZIE-on-HDP-2-6-5-hangs/m-p/237604#M85134 asirna 2018-11-22T23:42:12Z https://community.cloudera.com/t5/Archives-of-Support-Questions/spark-2-jobs-with-OOZIE-on-HDP-2-6-5-hangs/m-p/237605#M85135 <P>I had limited resource on the yarn queue that I used for my spark job.</P> Fri, 23 Nov 2018 22:16:54 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/spark-2-jobs-with-OOZIE-on-HDP-2-6-5-hangs/m-p/237605#M85135 chris_herssens 2018-11-23T22:16:54Z