Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

HDP Startup on virtualbox not completing

HDP Startup on virtualbox not completing

Explorer
 
7 REPLIES 7

Re: HDP Startup on virtualbox not completing

Explorer

I downloaded HDP 2.6.4 and running it under virtualbox. The VM has been assigned 16GB and changed the hard drive to "is SSD". The startup has been running for 4 hours and still has not completed. At the console it says that the Temporary Directories is being cleared. I am able to log into the webpage at 8888, but the following service have not/will not start - "YARN","Mapreduce2", "Hive","Oozie", "Zookeeper" plus more.

Not sure why the startup is not completing. Any suggestions?

Thanks

Re: HDP Startup on virtualbox not completing

New Contributor

I have the same issue and I can't fix yet if you find the way to fix it please let me know

Re: HDP Startup on virtualbox not completing

Super Mentor

@David Salvador

1. Do you see any error in "ambari-server.log" when you try to start those services from ambari UI?

http://localhost:8080

2. When you try to start those services from command line individually then do you see any error in the individual component logs?

Example: (or use the UI http:localhost:4200) to execute commands

# ssh root@127.0.0.1  -p 2222
Enter Password: hadoop

[root@Sandbox]# su - zookeeper -c "export ZOOCFGDIR=/usr/hdp/current/zookeeper-server/conf ; export ZOOCFG=zoo.cfg; source /usr/hdp/current/zookeeper-server/conf/zookeeper-env.sh ; /usr/hdp/current/zookeeper-server/bin/zkServer.sh start" 

There are some commands mentioned in the following link that you can try to see if the components are starting via command line or not? and if not then they must be logging some error in the logs.

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.4/bk_reference/content/starting_hdp_services....

Re: HDP Startup on virtualbox not completing

Explorer

:sorry very new to the hortonworks and where to find stuff. Found the log at : /var/log/ambari-server/ambari-server.log

I am seeing this error message repeated every 20 mins or so:

28 May 2018 15:11:12,658 ERROR [ambari-metrics-retrieval-service-thread-139] MetricsRetrievalService:492 - Unable to retrieve metrics from http://sandbox-hdp.hortonworks.com:8744/api/v1/cluster/summary. Subsequent failures will be suppressed from the log for 20 minutes.
java.net.ConnectException: Connection refused (Connection refused)
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:589)
at sun.net.NetworkClient.doConnect(NetworkClient.java:175)
at sun.net.www.http.HttpClient.openServer(HttpClient.java:463)
at sun.net.www.http.HttpClient.openServer(HttpClient.java:558)
at sun.net.www.http.HttpClient.<init>(HttpClient.java:242)
at sun.net.www.http.HttpClient.New(HttpClient.java:339)
at sun.net.www.http.HttpClient.New(HttpClient.java:357)
at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1220)
at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1156)
at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:1050)
at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:984)
at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1564)
at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1492)
at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480)
at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:218)
at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:142)
at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:116)
at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:121)
at org.apache.ambari.server.state.services.MetricsRetrievalService$MetricRunnable.run(MetricsRetrievalService.java:438)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)

Also seeing this error more at the begining of the log file:

28 May 2018 14:36:32,689 ERROR [main] ViewRegistry:1047 - Failed to update 'use.hive.interactive.mode' parameter for viewName: HIVE, version: 2.0.0. Exception: org.apache.ambari.server.ServiceComponentNotFoundException: ServiceComponent not found, clusterName=Sandbox, serviceName=HIVE, serviceComponentName=HIVE_SERVER_INTERACTIVE

Re: HDP Startup on virtualbox not completing

Explorer

ranger is showing as not started on the GUI, went to the command line to start it as listed in the "starting_hdp_services.html" webpage to try and start ranger.


[root@sandbox-hdp ~]# service ranger-admin start
ranger-admin: unrecognized service
[root@sandbox-hdp ~]# service ranger-usersync start
ranger-usersync: unrecognized service
[root@sandbox-hdp ~]#

Re: HDP Startup on virtualbox not completing

Explorer

rebuilt the HDP from a new image download, still getting the same issue.


in the log file seeing a new error:

29 May 2018 16:27:34,034 ERROR [ambari-action-scheduler] ServiceComponentHostImpl:1025 - Can't handle ServiceComponentHostEvent event at current state, serviceComponentName=ZOOKEEPER_SERVER, hostName=sandbox-hdp.hortonworks.com, currentState=UNKNOWN, eventType=HOST_SVCCOMP_OP_FAILED, event=EventType: HOST_SVCCOMP_OP_FAILED
29 May 2018 16:27:34,034 WARN [ambari-action-scheduler] ActionScheduler:938 - Unable to transition to failed state.
org.apache.ambari.server.state.fsm.InvalidStateTransitionException: Invalid event: HOST_SVCCOMP_OP_FAILED at UNKNOWN
at org.apache.ambari.server.state.fsm.StateMachineFactory.doTransition(StateMachineFactory.java:297)
at org.apache.ambari.server.state.fsm.StateMachineFactory.access$300(StateMachineFactory.java:39)
at org.apache.ambari.server.state.fsm.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:440)
at org.apache.ambari.server.state.svccomphost.ServiceComponentHostImpl.handleEvent(ServiceComponentHostImpl.java:1019)
at org.apache.ambari.server.orm.AmbariJpaLocalTxnInterceptor.invoke(AmbariJpaLocalTxnInterceptor.java:128)
at org.apache.ambari.server.actionmanager.ActionScheduler.transitionToFailedState(ActionScheduler.java:921)
at org.apache.ambari.server.actionmanager.ActionScheduler.processInProgressStage(ActionScheduler.java:801)
at org.apache.ambari.server.actionmanager.ActionScheduler.doWork(ActionScheduler.java:417)
at org.apache.ambari.server.actionmanager.ActionScheduler.run(ActionScheduler.java:310)
at java.lang.Thread.run(Thread.java:748)

Re: HDP Startup on virtualbox not completing

Explorer

okay was able to finally get the services up and running by following the order listed in

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.4/bk_reference/content/starting_hdp_services....

Thanks

Don't have an account?
Coming from Hortonworks? Activate your account here