https://community.cloudera.com/t5/Archives-of-Support-Questions/How-to-choose-the-queue-in-which-you-want-to-submit-the-job/m-p/168039#M29736 <P>I was able to set Livy queue by just setting livy.spark.yarn.queue=mylivyqueue in the Livy interpreter in Zeppelin and after restarting the Interpreter, Livy notebooks start runnin on that queue. By the way, my spark.yarn.queue=default.</P> Fri, 11 May 2018 11:52:50 GMT pminovic 2018-05-11T11:52:50Z https://community.cloudera.com/t5/Archives-of-Support-Questions/How-to-choose-the-queue-in-which-you-want-to-submit-the-job/m-p/168035#M29732 <P>Hi,</P><P>I am using Apache Zeppelin on HDP 2.4 and was wondering how would i choose/change the queue in which my jobs are being submitted? Currently it goes into the default queue but I would like to dedicate a queue for zeppelin alone, and run all jobs submitted from zeppelin there. But I am unable to switch the queue. Can anyone suggest me how to do it?</P><P>Thanks</P> Thu, 26 May 2016 03:19:12 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/How-to-choose-the-queue-in-which-you-want-to-submit-the-job/m-p/168035#M29732 vagrawal 2016-05-26T03:19:12Z https://community.cloudera.com/t5/Archives-of-Support-Questions/How-to-choose-the-queue-in-which-you-want-to-submit-the-job/m-p/168036#M29733 <P>If you are using zeppelin for spark, you can change JAVA_OPTS in zeppelin-env on zepplien configs and add something like </P><PRE>-Dspark.yarn.queue=my_zeppelin_queuename</PRE><P>You can add mapreduce and tez queues as well in JAVA_OPTS </P> Thu, 26 May 2016 03:25:04 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/How-to-choose-the-queue-in-which-you-want-to-submit-the-job/m-p/168036#M29733 ravi1 2016-05-26T03:25:04Z https://community.cloudera.com/t5/Archives-of-Support-Questions/How-to-choose-the-queue-in-which-you-want-to-submit-the-job/m-p/168037#M29734 <A rel="user" href="https://community.cloudera.com/users/512/vagrawal.html" nodeid="512">@vagrawal</A>Setup YARN queue:<UL> <LI>(Optional) You can setup/configure a YARN queue to customize what portion of the cluster the Spark job should use. To do this follow the two steps below:<P>i. Open the Yarn Queue Manager view to setup a queue for Spark with below capacities:</P><UL> <LI>Capacity: 50%</LI><LI>Max Capacity: 90% (on sandbox, do not reduce below this or the Spark jobs will not run)</LI></UL></LI></UL><P><A href="https://community.cloudera.com/legacyfs/online/attachments/4534-screen-shot-2016-05-25-at-92342-pm.png">screen-shot-2016-05-25-at-92342-pm.png</A></P> Thu, 26 May 2016 03:26:48 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/How-to-choose-the-queue-in-which-you-want-to-submit-the-job/m-p/168037#M29734 jyadav 2016-05-26T03:26:48Z https://community.cloudera.com/t5/Archives-of-Support-Questions/How-to-choose-the-queue-in-which-you-want-to-submit-the-job/m-p/168038#M29735 <P>In such case, if we like to define livy.spark.yarn.queue, should it be same as spark.yarn.queue or it could be different queue?</P><P>Thank you!</P><P>Leonid</P>,<P>In such case, can we define livy.spark.yarn.queue to pint to different queue, or it have to be same as spark.yarn.queue?</P> Thu, 10 Aug 2017 03:01:43 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/How-to-choose-the-queue-in-which-you-want-to-submit-the-job/m-p/168038#M29735 leonid_fedotov1 2017-08-10T03:01:43Z https://community.cloudera.com/t5/Archives-of-Support-Questions/How-to-choose-the-queue-in-which-you-want-to-submit-the-job/m-p/168039#M29736 <P>I was able to set Livy queue by just setting livy.spark.yarn.queue=mylivyqueue in the Livy interpreter in Zeppelin and after restarting the Interpreter, Livy notebooks start runnin on that queue. By the way, my spark.yarn.queue=default.</P> Fri, 11 May 2018 11:52:50 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/How-to-choose-the-queue-in-which-you-want-to-submit-the-job/m-p/168039#M29736 pminovic 2018-05-11T11:52:50Z