Member since
01-16-2019
5
Posts
0
Kudos Received
0
Solutions
02-19-2019
03:52 PM
@Jay Kumar SenSharma We have added "export ZEPPELIN_JAVA_OPTS='-Dspark.yarn.queue=zeppelin'" to the zeppelin configs in Ambari as we have done in the past with 2.6.2.2. We have since upgraded to 2.7.3 and this does not seem to be working in 2.7.3. New zeppelin users are using the "default" queue. I would like to know if that has changed in the new version and what can we do to fix it? @scharan Zeppelin by default uses spark's queue but when running, zeppelin uses up all available resources for the container it's in. We need to set a different queue for zeppelin so we can run it while still having available resources for separate spark queries.
... View more
02-15-2019
09:25 PM
@scharan Thank you for your response. Adding this property through Zeppelin seems to apply only to the current user in Zeppelin. Is there a way to set this property globally through Ambari?
... View more
02-15-2019
02:55 AM
in Ambari 2.6.2.2, you can set Zeppelin to use a custom queue by going to Zepplen notebook --> Configs --> zeppelin_env_content and adding ZEPPELIN_JAVA_OPTS="-Dspark.yarn.queue=QUEUE_NAME_OTHER_THAN_DEFAULT" but it doesn't seem to work in Ambari 2.7.3. Zeppelin ends up using the default queue. How can I configure Zeppelin to use a custom queue other than the default in Ambari 2.7.3?
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Zeppelin
01-17-2019
04:02 PM
Yes, the Ambari agent came up and the log reports the 'Adding recovery command' entries for the individual components. This is strange, two days ago, I tried rebooting the server and waited an hour and no components started within that time frame so I assumed it was a failure. I tried again this morning and the components are now starting up within about 20 minutes and nothing related has been changed on the server that I know of in that time frame. I guess my only question then is this a normal amount of time for the system to start all the components? The software is running on a VM using 8 cores of a Xeon E5-2683V3 processor and 64 GB of RAM. Are there any configuration changes I can make to speed up the starting of the components?
... View more
01-17-2019
02:58 AM
I have setup a new server using Ambari 2.6.2.0 on a CentOS 6.10 server. It is essentially the simplest Ambari setup possible with the server also acting as the remote agent and a single hadoop node also running on the same server. I have set all the services on the Ambari web platform to automatically restart upon reboot but rebooting the CentOS server does not result in the services automatically restarting in the Ambari web platform. I have to manually restart them. I have read and implemented the instructions outlined in: https://community.hortonworks.com/articles/71748/how-do-i-enable-automatic-restart-recovery-of-serv.html The services still do not automatically restart after rebooting the server. Any ideas on how to figure out why the services do not automatically restart?
... View more
Labels:
- Labels:
-
Apache Ambari