Created 06-20-2019 09:28 AM
I am trying to get the HDP sandbox running on RHEL7. I am however getting "no such container sandbox-hdp" error message when I try to run docker-deploy-hdp30.sh.
sudo sh docker-deploy-hdp30.sh
+ registry=hortonworks
+ name=sandbox-hdp
+ version=3.0.1
+ proxyName=sandbox-proxy
+ proxyVersion=1.0
+ flavor=hdp
+ echo hdp
+ mkdir -p sandbox/proxy/conf.d
+ mkdir -p sandbox/proxy/conf.stream.d
+ docker pull hortonworks/sandbox-hdp:3.0.1
3.0.1: Pulling from hortonworks/sandbox-hdp
70799bbf2226: Pull complete
40963917cdad: Pull complete
3fe9adbb8d7e: Pull complete
ee3ec4e8cb3d: Pull complete
7ea5917732c0: Pull complete
2d951411620c: Pull complete
f4c5e354e7fd: Pull complete
22ffa6ef360f: Pull complete
2060aa0f3751: Pull complete
ca01ba34744d: Pull complete
83326dded077: Pull complete
eb3d71b90b73: Pull complete
bdd1cab41c81: Pull complete
500cc770c4bd: Pull complete
0cb1decd5474: Pull complete
b9591f4b6855: Pull complete
f28e56086127: Pull complete
e7de4e7d0bca: Pull complete
ec77967d2166: Pull complete
4fdcae170114: Pull complete
6347f5df8ffc: Pull complete
6a6ecc232709: Pull complete
ea845898ff50: Downloading [==================================================>] 2.2GB/2.2GB
02135573b1bf: Download complete
cb0176867cd8: Download complete
3c08321268fd: Download complete
82e82a97c465: Downloading [==================================================>] 6.405GB/6.405GB
8aaaa48ed101: Download complete
74b321ac2ac5: Download complete
569da02c0a66: Download complete
af40820407ef: Downloading [==================================================>] 11.37GB/11.37GB
write /var/lib/docker/tmp/GetImageBlob635285518: no space left on device
+ docker pull hortonworks/sandbox-proxy:1.0
1.0: Pulling from hortonworks/sandbox-proxy
951bdea65c93: Pull complete
4b9047c5fbbb: Pull complete
773156407aae: Pull complete
d8524176841d: Pull complete
Digest: sha256:42e4cfbcbb76af07e5d8f47a183a0d4105e65a1e7ef39fe37ab746e8b2523e9e
Status: Downloaded newer image for hortonworks/sandbox-proxy:1.0
+ '[' hdp == hdf ']'
+ '[' hdp == hdp ']'
+ hostname=sandbox-hdp.hortonworks.com
++ docker images
++ grep hortonworks/sandbox-hdp
++ awk '{print $2}'
+ version=
+ docker network create cda
18f248ed47236cdaca73c1664fdc13b193a8224a714a5e6788481002d7f8e787
+ docker run --privileged --name sandbox-hdp -h sandbox-hdp.hortonworks.com --network=cda --network-alias=sandbox-hdp.hortonworks.com -d hortonworks/sandbox-hdp:
docker: invalid reference format.
See 'docker run --help'.
+ echo ' Remove existing postgres run files. Please wait'
Remove existing postgres run files. Please wait
+ sleep 2
+ docker exec -t sandbox-hdp sh -c 'rm -rf /var/run/postgresql/*; systemctl restart postgresql-9.6.service;'
Error: No such container: sandbox-hdp
+ sed s/sandbox-hdp-security/sandbox-hdp/g assets/generate-proxy-deploy-script.sh
+ mv -f assets/generate-proxy-deploy-script.sh.new assets/generate-proxy-deploy-script.sh
+ chmod +x assets/generate-proxy-deploy-script.sh
+ assets/generate-proxy-deploy-script.sh
+ uname
+ grep MINGW
+ chmod +x sandbox/proxy/proxy-deploy.sh
+ sandbox/proxy/proxy-deploy.sh
9434d4eea27290ea8417b2be653ccf574fe60035f964cddc3eac0a77daf89805
In there is a "docker: invalid reference format." error message. I am running docker CE:
Docker version 18.09.6, build 481bc77156
Created 06-21-2019 06:20 PM
The first error I see is that you ran out of space:
write /var/lib/docker/tmp/GetImageBlob635285518: no space left on device
You will need to refer to Docker documentation on how to free/increase storage.
Created 06-26-2019 12:04 AM
Hi, so I increased the /var/lib/docker space available. And then I got a storage error when the sandbox script tried to create the /hadoop/hdfs folder. So I had a new mountpoint created with 150Gb at /hadoop.
Now my drive space looks like this:
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/vgrp00-Root 12G 9.6G 2.5G 80% /
devtmpfs 7.6G 0 7.6G 0% /dev
tmpfs 7.6G 0 7.6G 0% /dev/shm
tmpfs 7.6G 777M 6.8G 11% /run
tmpfs 7.6G 0 7.6G 0% /sys/fs/cgroup
/dev/mapper/vgrp00-Usr 4.0G 3.5G 521M 88% /usr
/dev/mapper/vgrp00-Tmp 2.0G 88M 2.0G 5% /tmp
/dev/mapper/vgrp00-Var 8.0G 3.1G 5.0G 38% /var
/dev/mapper/vgrp00-home 2.0G 107M 1.9G 6% /home
/dev/mapper/vgrp00-VarLog 4.0G 1013M 3.1G 25% /var/log
/dev/mapper/vgrp00-VarLogAudit 1014M 61M 954M 6% /var/log/audit
/dev/nvme0n1p1 509M 264M 245M 52% /boot
tmpfs 1.6G 0 1.6G 0% /run/user/703
/dev/mapper/vgapp-lvdockerimages 200G 13G 188G 7% /var/lib/docker
/dev/mapper/vgapp-lvhadoop 148G 33M 148G 1% /hadoop
/dev/mapper/vgapp-lvariel 150G 33M 150G 1% /ariel
But I still get this error log:
+ registry=hortonworks
+ name=sandbox-hdp
+ version=3.0.1
+ proxyName=sandbox-proxy
+ proxyVersion=1.0
+ flavor=hdp
+ echo hdp
+ mkdir -p sandbox/proxy/conf.d
+ mkdir -p sandbox/proxy/conf.stream.d
+ docker pull hortonworks/sandbox-hdp:3.0.1
3.0.1: Pulling from hortonworks/sandbox-hdp
70799bbf2226: Pull complete
40963917cdad: Pull complete
3fe9adbb8d7e: Pull complete
ee3ec4e8cb3d: Pull complete
7ea5917732c0: Pull complete
2d951411620c: Pull complete
f4c5e354e7fd: Pull complete
22ffa6ef360f: Pull complete
2060aa0f3751: Pull complete
ca01ba34744d: Pull complete
83326dded077: Pull complete
eb3d71b90b73: Pull complete
bdd1cab41c81: Pull complete
500cc770c4bd: Pull complete
0cb1decd5474: Pull complete
b9591f4b6855: Pull complete
f28e56086127: Pull complete
e7de4e7d0bca: Pull complete
ec77967d2166: Pull complete
4fdcae170114: Pull complete
6347f5df8ffc: Pull complete
6a6ecc232709: Pull complete
ea845898ff50: Pull complete
02135573b1bf: Pull complete
cb0176867cd8: Pull complete
3c08321268fd: Pull complete
82e82a97c465: Pull complete
8aaaa48ed101: Pull complete
74b321ac2ac5: Pull complete
569da02c0a66: Pull complete
af40820407ef: Extracting [==================================================>] 11.37GB/11.37GB
failed to register layer: ApplyLayer exit status 1 stdout: stderr: write /hadoop/hdfs/data/current/BP-1419118625-172.17.0.2-1543512323726/current/finalized/subdir0/subdir1/blk_1073742280: no space left on device
+ docker pull hortonworks/sandbox-proxy:1.0
1.0: Pulling from hortonworks/sandbox-proxy
Digest: sha256:42e4cfbcbb76af07e5d8f47a183a0d4105e65a1e7ef39fe37ab746e8b2523e9e
Status: Image is up to date for hortonworks/sandbox-proxy:1.0
+ '[' hdp == hdf ']'
+ '[' hdp == hdp ']'
+ hostname=sandbox-hdp.hortonworks.com
++ docker images
++ awk '{print $2}'
++ grep hortonworks/sandbox-hdp
+ version=
+ docker network create cda
+ docker run --privileged --name sandbox-hdp -h sandbox-hdp.hortonworks.com --network=cda --network-alias=sandbox-hdp.hortonworks.com -d hortonworks/sandbox-hdp:
docker: invalid reference format.
See 'docker run --help'.
+ echo ' Remove existing postgres run files. Please wait'
Remove existing postgres run files. Please wait
+ sleep 2
+ docker exec -t sandbox-hdp sh -c 'rm -rf /var/run/postgresql/*; systemctl restart postgresql-9.6.service;'
Error: No such container: sandbox-hdp
+ sed s/sandbox-hdp-security/sandbox-hdp/g assets/generate-proxy-deploy-script.sh
+ mv -f assets/generate-proxy-deploy-script.sh.new assets/generate-proxy-deploy-script.sh
+ chmod +x assets/generate-proxy-deploy-script.sh
+ assets/generate-proxy-deploy-script.sh
+ uname
+ grep MINGW
+ chmod +x sandbox/proxy/proxy-deploy.sh
+ sandbox/proxy/proxy-deploy.sh
So why am I now getting this, when /hadoop was mounted with 150Gb.
failed to register layer: ApplyLayer exit status 1 stdout: stderr: write /hadoop/hdfs/data/current/BP-1419118625-172.17.0.2-1543512323726/current/finalized/subdir0/subdir1/blk_1073742280: no space left on device
Regards
Stephen