HDP 2.6.3 doesn't start under Ubuntu with Docker CE 17.11 or 17.12

[#1]

The shell script to start the HDP sandbox 2.6.3 Docker image seems to hang using Docker CE version 17.11 or 17.12 on Ubuntu 16.04 and 17.10. Last console message is 'Ambari Server 'start' completed successfully.'

The problem does not occur with Docker 17.09 on Ubuntu 16.04, so I guess the problem is related to the Docker version.

Any idea how to solve the problem as I would like to run the HDP sandbox on Ubuntu 17.10. which requires using Docker CE 17.11+?

[#2]

I got the same problem. I tried to increase the timeout for Ambari server following this post adjusting-startup-timeout-for-ambari-server-web-ui, but the problem continue.

[#3]

@Andreas Danckert @Marco Almeida

I don't have access to my linux box at this very moment but I'll give this a go when I can and report back. In the meantime, the latest version of Docker that we can verify the builds check out for are Docker 17.09 for both Linux and Mac.

Sidenote: If ambari-server and ambari-agent are up, even if the rest of the start script hangs, the Ambari ui (http://localhost:8080) may still be accessible - could you see if that's the case?

[#4]

@Edgar Orendain @Andreas Danckert

I tested the Docker Sandbox in the following environment as you suggested, but the problem continues:

Figure 1. System info.

Figure 2. Error description.

[#5]

@Andreas Danckert i'am facing the same issue, did you find a solution ?

[#6 · Accepted solution]

@Andreas Danckert

@Aziz Herch

@Marco Almeida

Yup - this issue was triggered by a Docker change. Please use this updated start script for deploying the HDP 2.6.3 sandbox: https://raw.githubusercontent.com/hortonworks/data-tutorials/f88da0da324e252996cf3201fc9b038e9564a66...

Note: Please only use this script for the HDP 2.6.3 sandbox. If you find yourself reading this thread in the future, a new process is in place and this script is likely much more simplified/streamlined in the future - so the link above will be obsolete.

[#7]

The same for Windows Powershell tested on Docker 17.12.0-ce-win47 (15139) + Windows 10 Pro FCU + HDP Sandbox 2.6.3, just change extention to .ps1 start-sandbox-hdpps1.txt

[#8]

@Edgar Orendain

Thanks for this fix which solved the problem for me.

Very much looking forward to the announced new start process.

[#9]

@Edgar Orendain

Thank you, problem solved. My system info:

[#10]

I'm facing the same issue: HDP 2.6.3 sandbox doesn't start on Ubuntu 16.04.03 LTS running Docker CE 17.12. The updated start script referenced by @Edgar Orendain still hangs while starting Ambari services. This is the line, within the script, having the issue:

docker exec -t sandbox-hdp /bin/sh -c 'until /usr/bin/curl --silent --user raj_ops:raj_ops -H "X-Requested-By: ambari" "http://localhost:8080/api/v1/clusters/Sandbox/requests?to=end&page_size=10&fields=Requests" | tail -n 27 | grep COMPLETED | grep COMPLETED > /dev/null; do echo -n .; sleep 1; done;'

Any suggestion?

Regards, @Julián Rodríguez