question Re: Cannot docker load < HDP_2.5_docker.tar on Centos7 virtual machine in Archives of Support Questions (Read Only)

Cannot docker load < HDP_2.5_docker.tar on Centos7 virtual machine

marcia_hon_29 — Fri, 16 Sep 2022 10:46:52 GMT

Hello,

I have looked all over the place and have tried everything I have found.

I cannot get the load to work.

I get the following message:

[user01@docker01 hortonworks_hadoop]$ sudo docker load < HDP_2.5_docker.tar b1b065555b8a: Loading layer 202.2 MB/202.2 MB 3901568415a3: Loading layer 10.37 GB/13.85 GB ApplyLayer exit status 1 stdout: stderr: write /usr/lib/jvm/java-1.7.0-openjdk-1.7.0.111.x86_64/jre/lib/amd64/server/libjvm.so: no space left on device

I tried:

a. @ /etc/sysconfig/docker add : other_args="-g /var/lib/docker"

b. @ /etc/sysconfig/docker-storage add : DOCKER_STORAGE_OPTIONS="--storage-opt dm.basesize=30G"

c. restart the daemons

Nothing works.

Please let me know if there are other solutions that would solve this.

Thanks,

Marcia

Re: Cannot docker load < HDP_2.5_docker.tar on Centos7 virtual machine

marcia_hon_29 — Sat, 05 Nov 2016 00:37:45 GMT

Also, I'm using Centos 7 and docker v1.12.3 ...

Re: Cannot docker load < HDP_2.5_docker.tar on Centos7 virtual machine

guido_vansteen — Tue, 08 Nov 2016 01:29:01 GMT

I encountered the same problem on Debian Jessie (Stable), Docker version 1.12.3, build 6b644ec. There is no file called "docker-storage" to be found on my system. Obviously, there is no "/etc/sysconfig/docker" either. Any help is appreciated.

Re: Cannot docker load < HDP_2.5_docker.tar on Centos7 virtual machine

myoung — Tue, 08 Nov 2016 10:25:47 GMT

@Marcia Hon

For both options a and b, did you remove the /var/lib/docker/* directory where the image file is created? You have to remove that file and then restart the daemons. If you don't remove the file, Docker will not increase the size automatically.

You can run docker info before and after this process to see how much space is available for Docker.

NOTE: You will lose your images and containers when you delete the contents of that directory. So backup any containers or images you want to keep.

Re: Cannot docker load < HDP_2.5_docker.tar on Centos7 virtual machine

glupu — Tue, 08 Nov 2016 22:48:09 GMT

@Marcia Hon

Hello, what storage driver are you using? You can run "sudo docker info" to get that, for example in my case it's : "Storage Driver: aufs"; In case yours says devicemapper you need to change it to overlayfs on centos7 since the image is bigger than 10GB which is the hard limit for the devicemapper.

Re: Cannot docker load < HDP_2.5_docker.tar on Centos7 virtual machine

marcia_hon_29 — Tue, 08 Nov 2016 23:08:03 GMT

I'm not certain how to do this change. Is it at : /etc/sysconfig/docker or /etc/sysconfig/docker-storage or /etc/default/docker ... etc... I understand that the command is supposed to be : DOCKER_OPTS="--storage-driver=overlayfs"

Re: Cannot docker load < HDP_2.5_docker.tar on Centos7 virtual machine

glupu — Tue, 08 Nov 2016 23:17:47 GMT

@Marcia Hon

What I did was change it in the systemd file:

[root@sandbox multi-user.target.wants]# pwd

/etc/systemd/system/multi-user.target.wants

[root@sandbox multi-user.target.wants]# vi docker.service

and changed this line like so:

ExecStart=/usr/bin/dockerd --storage-driver=overlay

Re: Cannot docker load < HDP_2.5_docker.tar on Centos7 virtual machine

marcia_hon_29 — Wed, 09 Nov 2016 00:25:14 GMT

I have changed accordingly.

I restarted the daemon, however, devicemapper is still being used...

Re: Cannot docker load < HDP_2.5_docker.tar on Centos7 virtual machine

marcia_hon_29 — Wed, 09 Nov 2016 00:32:54 GMT

It has changed to overlay by doing the following:

ExecStart=/usr/bin/docker daemon -H fd:// --storage-driver=overlay

sudo systemctl daemon-reload
sudo systemctl restart docker
sudo docker info

Re: Cannot docker load < HDP_2.5_docker.tar on Centos7 virtual machine

marcia_hon_29 — Wed, 09 Nov 2016 00:37:04 GMT

I did the following, and overlay was changed...

ExecStart=/usr/bin/docker daemon -H fd:// --storage-driver=overlay


sudo systemctl daemon-reload
sudo systemctl restart docker
sudo docker info

Re: Cannot docker load < HDP_2.5_docker.tar on Centos7 virtual machine

marcia_hon_29 — Wed, 09 Nov 2016 01:00:16 GMT

Thank you Michael and Glupu!!!

It now is working!!!

I did changes a and b. Plus the overlay changes. And also deleted /var/lib/docker .

Thanks so much!

I have another issue which is with the start_sandbox.sh file. I will create another thread.

Re: Cannot docker load < HDP_2.5_docker.tar on Centos7 virtual machine

guido_vansteen — Wed, 09 Nov 2016 06:30:52 GMT

Things worked after I did "systemctl stop docker; dockerd --storage-opt dm.basesize=50G; docker load < /path/to/HDP_2.5_docker.tar.gz".

Re: Cannot docker load < HDP_2.5_docker.tar on Centos7 virtual machine

myoung — Wed, 09 Nov 2016 11:36:09 GMT

@Marcia Hon

I'm glad you were able to get things working!

Re: Cannot docker load < HDP_2.5_docker.tar on Centos7 virtual machine

avijeetd — Wed, 09 Nov 2016 19:33:30 GMT

Hi All,

I was able to resolve this -

by adding this line in in docker.service in /lib/systemd/system

ExecStart=/usr/bin/dockerd --graph="/datadrive/docker-data" --storage-opt=dm.basesize=50G

[root@docker datadrive]# docker load < HDP_2.5_docker.tar b1b065555b8a: Loading layer [==================================================>] 202.2 MB/202.2 MB 0b547722f59f: Loading layer [==================================================>] 13.84 GB/13.84 GB 99d7327952e0: Loading layer [==================================================>] 234.8 MB/234.8 MB 294b1c0e07bd: Loading layer [==================================================>] 207.5 MB/207.5 MB fd5c10f2f1a1: Loading layer [==================================================>] 387.6 kB/387.6 kB 6852ef70321d: Loading layer [==================================================>] 163 MB/163 MB 517f170bbf7f: Loading layer [==================================================>] 20.98 MB/20.98 MB 665edb80fc91: Loading layer [==================================================>] 337.4 kB/337.4 kB Loaded image: sandbox:latest

Thanks,

Avijeet

Re: Cannot docker load < HDP_2.5_docker.tar on Centos7 virtual machine

myoung — Thu, 10 Nov 2016 21:53:07 GMT

@Marcia Hon

I wrote an HCC article that walks you through the process of increasing the base size of the CentOS 7 docker vm image. This is the preferred method for making these changes.

https://community.hortonworks.com/content/kbentry/65714/how-to-modify-the-default-docker-configuration-on.html