Support Questions
Find answers, ask questions, and share your expertise

zepelin not starting

zepelin not starting

Explorer

Hi,

we have a new HDP installation and we deployed zepeling a couple of days ago, it was working fine untill I edited the Advanced zeppelin-shiro-ini --> shiro_ini_content and after that zepeling stopped working. I even restored the shiro_ini_content to default but problem persists.

Ambari dashboard looks ok but service check fails giving this output:

stderr:   /var/lib/ambari-agent/data/errors-396.txt
Traceback (most recent call last):
  File "/var/lib/ambari-agent/cache/common-services/ZEPPELIN/0.7.0/package/scripts/service_check.py", line 40, in <module>
    ZeppelinServiceCheck().execute()
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 367, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/common-services/ZEPPELIN/0.7.0/package/scripts/service_check.py", line 37, in service_check
    logoutput=True)
  File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 166, in __init__
    self.env.run()
  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 160, in run
    self.run_action(resource, action)
  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 124, in run_action
    provider_action()
  File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 262, in action_run
    tries=self.resource.tries, try_sleep=self.resource.try_sleep)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 72, in inner
    result = function(command, **kwargs)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 102, in checked_call
    tries=tries, try_sleep=try_sleep, timeout_kill_strategy=timeout_kill_strategy)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 150, in _call_wrapper
    result = _call(command, **kwargs_copy)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 303, in _call
    raise ExecutionFailed(err_msg, code, out, err)
resource_management.core.exceptions.ExecutionFailed: Execution of 'curl -s -o /dev/null -w'%{http_code}' --negotiate -u: -k http://zeppelin-mlx.mlx:9995 | grep 200' returned 1.
stdout:   /var/lib/ambari-agent/data/output-396.txt
2018-03-14 15:33:25,366 - call['ambari-python-wrap /usr/bin/hdp-select status spark-client'] {'timeout': 20}
2018-03-14 15:33:25,390 - call returned (0, 'spark-client - 2.6.3.0-235')
2018-03-14 15:33:25,393 - Using hadoop conf dir: /usr/hdp/2.6.3.0-235/hadoop/conf
2018-03-14 15:33:25,394 - Execute['curl -s -o /dev/null -w'%{http_code}' --negotiate -u: -k http://zeppelin-mlx.mlx:9995 | grep 200'] {'logoutput': True, 'tries': 10, 'try_sleep': 3}
2018-03-14 15:33:25,527 - Retrying after 3 seconds. Reason: Execution of 'curl -s -o /dev/null -w'%{http_code}' --negotiate -u: -k http://zeppelin-mlx.mlx:9995 | grep 200' returned 1. 
2018-03-14 15:33:28,545 - Retrying after 3 seconds. Reason: Execution of 'curl -s -o /dev/null -w'%{http_code}' --negotiate -u: -k http://zeppelin-mlx.mlx:9995 | grep 200' returned 1. 
2018-03-14 15:33:31,564 - Retrying after 3 seconds. Reason: Execution of 'curl -s -o /dev/null -w'%{http_code}' --negotiate -u: -k http://zeppelin-mlx.mlx:9995 | grep 200' returned 1. 
2018-03-14 15:33:34,583 - Retrying after 3 seconds. Reason: Execution of 'curl -s -o /dev/null -w'%{http_code}' --negotiate -u: -k http://zeppelin-mlx.mlx:9995 | grep 200' returned 1. 
2018-03-14 15:33:37,604 - Retrying after 3 seconds. Reason: Execution of 'curl -s -o /dev/null -w'%{http_code}' --negotiate -u: -k http://zeppelin-mlx.mlx:9995 | grep 200' returned 1. 
2018-03-14 15:33:40,621 - Retrying after 3 seconds. Reason: Execution of 'curl -s -o /dev/null -w'%{http_code}' --negotiate -u: -k http://zeppelin-mlx.mlx:9995 | grep 200' returned 1. 
2018-03-14 15:33:43,639 - Retrying after 3 seconds. Reason: Execution of 'curl -s -o /dev/null -w'%{http_code}' --negotiate -u: -k http://zeppelin-mlx.mlx:9995 | grep 200' returned 1. 
2018-03-14 15:33:46,659 - Retrying after 3 seconds. Reason: Execution of 'curl -s -o /dev/null -w'%{http_code}' --negotiate -u: -k http://zeppelin-mlx.mlx:9995 | grep 200' returned 1. 
2018-03-14 15:33:49,678 - Retrying after 3 seconds. Reason: Execution of 'curl -s -o /dev/null -w'%{http_code}' --negotiate -u: -k http://zeppelin-mlx.mlx:9995 | grep 200' returned 1.
Command failed after 1 tries

I can also see this in the /var/log/zeppelin/zeppelin-zeppelin-zeppelin.local.log file:

INFO [2018-03-14 16:11:46,038] ({main} ZeppelinConfiguration.java[create]:102) - Load configuration from file:/etc/zeppelin/2.6.3.0-235/0/zeppelin-site.xml
 INFO [2018-03-14 16:11:46,139] ({main} ZeppelinConfiguration.java[create]:110) - Server Host: 0.0.0.0
 INFO [2018-03-14 16:11:46,139] ({main} ZeppelinConfiguration.java[create]:112) - Server Port: 9995
 INFO [2018-03-14 16:11:46,140] ({main} ZeppelinConfiguration.java[create]:116) - Context Path: /
 INFO [2018-03-14 16:11:46,142] ({main} ZeppelinConfiguration.java[create]:117) - Zeppelin Version: 0.7.3
 INFO [2018-03-14 16:11:46,170] ({main} Log.java[initialized]:186) - Logging initialized @748ms
 INFO [2018-03-14 16:11:46,243] ({main} ZeppelinServer.java[setupWebAppContext]:370) - ZeppelinServer Webapp path: /usr/hdp/current/zeppelin-server/webapps
 INFO [2018-03-14 16:11:46,524] ({main} AuthorizingRealm.java[getAuthorizationCacheLazy]:248) - No cache or cacheManager properties have been set.  Authorization cache cannot be obtained.
 INFO [2018-03-14 16:11:46,572] ({main} ZeppelinServer.java[main]:211) - Starting zeppelin server
 INFO [2018-03-14 16:11:46,574] ({main} Server.java[doStart]:327) - jetty-9.2.15.v20160210
 WARN [2018-03-14 16:11:46,954] ({main} WebAppContext.java[doStart]:514) - Failed startup of context o.e.j.w.WebAppContext@49b0b76{/,null,null}{/usr/hdp/current/zeppelin-server/lib/zeppelin-web-0.7.3.2.6.3.0-235.war}
java.lang.IllegalStateException: Failed to delete temp dir /usr/hdp/2.6.3.0-235/zeppelin/webapps
        at org.eclipse.jetty.webapp.WebInfConfiguration.configureTempDirectory(WebInfConfiguration.java:372)
        at org.eclipse.jetty.webapp.WebInfConfiguration.resolveTempDirectory(WebInfConfiguration.java:260)
        at org.eclipse.jetty.webapp.WebInfConfiguration.preConfigure(WebInfConfiguration.java:69)
        at org.eclipse.jetty.webapp.WebAppContext.preConfigure(WebAppContext.java:468)
        at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:504)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
        at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:132)
        at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:114)
        at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)
        at org.eclipse.jetty.server.handler.ContextHandlerCollection.doStart(ContextHandlerCollection.java:163)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
        at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:132)
        at org.eclipse.jetty.server.Server.start(Server.java:387)
        at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:114)
        at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)
        at org.eclipse.jetty.server.Server.doStart(Server.java:354)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
        at org.apache.zeppelin.server.ZeppelinServer.main(ZeppelinServer.java:213)
 INFO [2018-03-14 16:11:46,978] ({main} AbstractConnector.java[doStart]:266) - Started ServerConnector@3daa422a{HTTP/1.1}{0.0.0.0:9995}
 INFO [2018-03-14 16:11:46,978] ({main} Server.java[doStart]:379) - Started @1558ms
 INFO [2018-03-14 16:11:46,978] ({main} ZeppelinServer.java[main]:221) - Done, zeppelin server started

any thoughts?

thank you very much

1 REPLY 1

Re: zepelin not starting

@Manuel Sopena Ballesteros,

Can you try deleting this folder manually and then restart zeppelin and perform the sevice check

sudo rm -rf /usr/hdp/2.6.3.0-235/zeppelin/webapps

.

-Aditya