question HDP 2.6.3 doesn't start under Ubuntu with Docker CE 17.11 or 17.12 in Support Questions

HDP 2.6.3 doesn't start under Ubuntu with Docker CE 17.11 or 17.12

andandev67 — Wed, 03 Jan 2018 00:49:04 GMT

The shell script to start the HDP sandbox 2.6.3 Docker image seems to hang using Docker CE version 17.11 or 17.12 on Ubuntu 16.04 and 17.10. Last console message is 'Ambari Server 'start' completed successfully.'

The problem does not occur with Docker 17.09 on Ubuntu 16.04, so I guess the problem is related to the Docker version.

Any idea how to solve the problem as I would like to run the HDP sandbox on Ubuntu 17.10. which requires using Docker CE 17.11+?

Re: HDP 2.6.3 doesn't start under Ubuntu with Docker CE 17.11 or 17.12

malmeidap — Wed, 03 Jan 2018 06:38:09 GMT

I got the same problem. I tried to increase the timeout for Ambari server following this post adjusting-startup-timeout-for-ambari-server-web-ui, but the problem continue.

Re: HDP 2.6.3 doesn't start under Ubuntu with Docker CE 17.11 or 17.12

orendain — Thu, 04 Jan 2018 03:55:26 GMT

@Andreas Danckert @Marco Almeida

I don't have access to my linux box at this very moment but I'll give this a go when I can and report back. In the meantime, the latest version of Docker that we can verify the builds check out for are Docker 17.09 for both Linux and Mac.

Sidenote: If ambari-server and ambari-agent are up, even if the rest of the start script hangs, the Ambari ui (http://localhost:8080) may still be accessible - could you see if that's the case?

Re: HDP 2.6.3 doesn't start under Ubuntu with Docker CE 17.11 or 17.12

malmeidap — Sun, 18 Aug 2019 00:24:04 GMT

@Edgar Orendain @Andreas Danckert

I tested the Docker Sandbox in the following environment as you suggested, but the problem continues:

Figure 1. System info.

Figure 2. Error description.

Re: HDP 2.6.3 doesn't start under Ubuntu with Docker CE 17.11 or 17.12

azhrch — Mon, 08 Jan 2018 15:39:31 GMT

@Andreas Danckert i'am facing the same issue, did you find a solution ?

Re: HDP 2.6.3 doesn't start under Ubuntu with Docker CE 17.11 or 17.12

orendain — Fri, 12 Jan 2018 11:56:08 GMT

@Andreas Danckert

@Aziz Herch

@Marco Almeida

Yup - this issue was triggered by a Docker change. Please use this updated start script for deploying the HDP 2.6.3 sandbox: https://raw.githubusercontent.com/hortonworks/data-tutorials/f88da0da324e252996cf3201fc9b038e9564a665/tutorials/hdp/sandbox-deployment-and-install-guide/assets/start_sandbox-hdp.sh

Note: Please only use this script for the HDP 2.6.3 sandbox. If you find yourself reading this thread in the future, a new process is in place and this script is likely much more simplified/streamlined in the future - so the link above will be obsolete.

Re: HDP 2.6.3 doesn't start under Ubuntu with Docker CE 17.11 or 17.12

andandev67 — Sat, 13 Jan 2018 02:40:02 GMT

@Edgar Orendain

Thanks for this fix which solved the problem for me.

Very much looking forward to the announced new start process.

Re: HDP 2.6.3 doesn't start under Ubuntu with Docker CE 17.11 or 17.12

malmeidap — Sun, 18 Aug 2019 00:23:50 GMT

@Edgar Orendain

Thank you, problem solved. My system info:

Re: HDP 2.6.3 doesn't start under Ubuntu with Docker CE 17.11 or 17.12

aarrieta — Mon, 22 Jan 2018 07:24:16 GMT

The same for Windows Powershell tested on Docker 17.12.0-ce-win47 (15139) + Windows 10 Pro FCU + HDP Sandbox 2.6.3, just change extention to .ps1 start-sandbox-hdpps1.txt

Re: HDP 2.6.3 doesn't start under Ubuntu with Docker CE 17.11 or 17.12

julian_rodrigue — Fri, 26 Jan 2018 20:27:33 GMT

I'm facing the same issue: HDP 2.6.3 sandbox doesn't start on Ubuntu 16.04.03 LTS running Docker CE 17.12. The updated start script referenced by @Edgar Orendain still hangs while starting Ambari services. This is the line, within the script, having the issue:

docker exec -t sandbox-hdp /bin/sh -c 'until /usr/bin/curl --silent --user raj_ops:raj_ops -H "X-Requested-By: ambari" "http://localhost:8080/api/v1/clusters/Sandbox/requests?to=end&page_size=10&fields=Requests" | tail -n 27 | grep COMPLETED | grep COMPLETED > /dev/null; do echo -n .; sleep 1; done;'

Any suggestion?

Regards, @Julián Rodríguez