HDP Startup on virtualbox not completing

[#1]

I downloaded HDP 2.6.4 and running it under virtualbox. The VM has been assigned 16GB and changed the hard drive to "is SSD". The startup has been running for 4 hours and still has not completed. At the console it says that the Temporary Directories is being cleared. I am able to log into the webpage at 8888, but the following service have not/will not start - "YARN","Mapreduce2", "Hive","Oozie", "Zookeeper" plus more.

Not sure why the startup is not completing. Any suggestions?

Thanks

[#2]

I have the same issue and I can't fix yet if you find the way to fix it please let me know

[#3]

@David Salvador

1. Do you see any error in "ambari-server.log" when you try to start those services from ambari UI?

http://localhost:8080

2. When you try to start those services from command line individually then do you see any error in the individual component logs?

Example: (or use the UI http:localhost:4200) to execute commands

# ssh root@127.0.0.1  -p 2222
Enter Password: hadoop

[root@Sandbox]# su - zookeeper -c "export ZOOCFGDIR=/usr/hdp/current/zookeeper-server/conf ; export ZOOCFG=zoo.cfg; source /usr/hdp/current/zookeeper-server/conf/zookeeper-env.sh ; /usr/hdp/current/zookeeper-server/bin/zkServer.sh start" 

There are some commands mentioned in the following link that you can try to see if the components are starting via command line or not? and if not then they must be logging some error in the logs.

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.4/bk_reference/content/starting_hdp_services....

[#4]

:sorry very new to the hortonworks and where to find stuff. Found the log at : /var/log/ambari-server/ambari-server.log

I am seeing this error message repeated every 20 mins or so:

28 May 2018 15:11:12,658 ERROR [ambari-metrics-retrieval-service-thread-139] MetricsRetrievalService:492 - Unable to retrieve metrics from http://sandbox-hdp.hortonworks.com:8744/api/v1/cluster/summary. Subsequent failures will be suppressed from the log for 20 minutes.
java.net.ConnectException: Connection refused (Connection refused)
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:589)
at sun.net.NetworkClient.doConnect(NetworkClient.java:175)
at sun.net.www.http.HttpClient.openServer(HttpClient.java:463)
at sun.net.www.http.HttpClient.openServer(HttpClient.java:558)
at sun.net.www.http.HttpClient.<init>(HttpClient.java:242)
at sun.net.www.http.HttpClient.New(HttpClient.java:339)
at sun.net.www.http.HttpClient.New(HttpClient.java:357)
at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1220)
at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1156)
at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:1050)
at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:984)
at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1564)
at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1492)
at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480)
at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:218)
at org.apache.ambari.server.controller.internal.URLStreamProvider.processURL(URLStreamProvider.java:142)
at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:116)
at org.apache.ambari.server.controller.internal.URLStreamProvider.readFrom(URLStreamProvider.java:121)
at org.apache.ambari.server.state.services.MetricsRetrievalService$MetricRunnable.run(MetricsRetrievalService.java:438)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)

Also seeing this error more at the begining of the log file:

28 May 2018 14:36:32,689 ERROR [main] ViewRegistry:1047 - Failed to update 'use.hive.interactive.mode' parameter for viewName: HIVE, version: 2.0.0. Exception: org.apache.ambari.server.ServiceComponentNotFoundException: ServiceComponent not found, clusterName=Sandbox, serviceName=HIVE, serviceComponentName=HIVE_SERVER_INTERACTIVE

[#5]

ranger is showing as not started on the GUI, went to the command line to start it as listed in the "starting_hdp_services.html" webpage to try and start ranger.

[root@sandbox-hdp ~]# service ranger-admin start
ranger-admin: unrecognized service
[root@sandbox-hdp ~]# service ranger-usersync start
ranger-usersync: unrecognized service
[root@sandbox-hdp ~]#

[#6]

rebuilt the HDP from a new image download, still getting the same issue.

in the log file seeing a new error:

29 May 2018 16:27:34,034 ERROR [ambari-action-scheduler] ServiceComponentHostImpl:1025 - Can't handle ServiceComponentHostEvent event at current state, serviceComponentName=ZOOKEEPER_SERVER, hostName=sandbox-hdp.hortonworks.com, currentState=UNKNOWN, eventType=HOST_SVCCOMP_OP_FAILED, event=EventType: HOST_SVCCOMP_OP_FAILED
29 May 2018 16:27:34,034 WARN [ambari-action-scheduler] ActionScheduler:938 - Unable to transition to failed state.
org.apache.ambari.server.state.fsm.InvalidStateTransitionException: Invalid event: HOST_SVCCOMP_OP_FAILED at UNKNOWN
at org.apache.ambari.server.state.fsm.StateMachineFactory.doTransition(StateMachineFactory.java:297)
at org.apache.ambari.server.state.fsm.StateMachineFactory.access$300(StateMachineFactory.java:39)
at org.apache.ambari.server.state.fsm.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:440)
at org.apache.ambari.server.state.svccomphost.ServiceComponentHostImpl.handleEvent(ServiceComponentHostImpl.java:1019)
at org.apache.ambari.server.orm.AmbariJpaLocalTxnInterceptor.invoke(AmbariJpaLocalTxnInterceptor.java:128)
at org.apache.ambari.server.actionmanager.ActionScheduler.transitionToFailedState(ActionScheduler.java:921)
at org.apache.ambari.server.actionmanager.ActionScheduler.processInProgressStage(ActionScheduler.java:801)
at org.apache.ambari.server.actionmanager.ActionScheduler.doWork(ActionScheduler.java:417)
at org.apache.ambari.server.actionmanager.ActionScheduler.run(ActionScheduler.java:310)
at java.lang.Thread.run(Thread.java:748)

[#7]

okay was able to finally get the services up and running by following the order listed in

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.4/bk_reference/content/starting_hdp_services....

Thanks