Support Questions
Find answers, ask questions, and share your expertise

No space left on device (RuntimeError) - vagrant

No space left on device (RuntimeError) - vagrant

Vagrant up gives following error:

rendev@BhujangRnD:~/metron-test/incubator-metron/metron-deployment/vagrant/quick-dev-platform$ vagrant up Running with ansible-tags: ["ambari-agent", "hdp-deploy", "metron"] Running with ansible-skip-tags: ["solr", "yaf"] Bringing machine 'node1' up with 'virtualbox' provider... ==> node1: Checking if box 'metron/hdp-base' is up to date... ==> node1: Clearing any previously set forwarded ports... ==> node1: Clearing any previously set network interfaces... ==> node1: Preparing network interfaces based on configuration... node1: Adapter 1: nat node1: Adapter 2: hostonly ==> node1: Forwarding ports... node1: 22 (guest) => 2222 (host) (adapter 1) ==> node1: Running 'pre-boot' VM customizations... ==> node1: Booting VM... ==> node1: Waiting for machine to boot. This may take a few minutes... node1: SSH address: 127.0.0.1:2222 node1: SSH username: vagrant node1: SSH auth method: private key node1: Warning: Remote connection disconnect. Retrying... ==> node1: Machine booted and ready! ==> node1: Checking for guest additions in VM... ==> node1: Setting hostname... ==> node1: Configuring and enabling network interfaces... /opt/vagrant/embedded/gems/gems/net-scp-1.1.2/lib/net/scp.rb:392:in `await_response_state': scp: /tmp/vagrant-network-entry-eth1-1484540326-0: No space left on device (RuntimeError) from /opt/vagrant/embedded/gems/gems/net-scp-1.1.2/lib/net/scp.rb:363:in `block (3 levels) in start_command' from /opt/vagrant/embedded/gems/gems/net-ssh-3.0.2/lib/net/ssh/connection/channel.rb:324:in `call' from /opt/vagrant/embedded/gems/gems/net-ssh-3.0.2/lib/net/ssh/connection/channel.rb:324:in `process' from /opt/vagrant/embedded/gems/gems/net-ssh-3.0.2/lib/net/ssh/connection/session.rb:223:in `block in preprocess' from /opt/vagrant/embedded/gems/gems/net-ssh-3.0.2/lib/net/ssh/connection/session.rb:223:in `each' from /opt/vagrant/embedded/gems/gems/net-ssh-3.0.2/lib/net/ssh/connection/session.rb:223:in `preprocess' from /opt/vagrant/embedded/gems/gems/net-ssh-3.0.2/lib/net/ssh/connection/session.rb:206:in `process' from /opt/vagrant/embedded/gems/gems/net-ssh-3.0.2/lib/net/ssh/connection/session.rb:170:in `block in loop' from /opt/vagrant/embedded/gems/gems/net-ssh-3.0.2/lib/net/ssh/connection/session.rb:170:in `loop' from /opt/vagrant/embedded/gems/gems/net-ssh-3.0.2/lib/net/ssh/connection/session.rb:170:in `loop' from /opt/vagrant/embedded/gems/gems/net-ssh-3.0.2/lib/net/ssh/connection/channel.rb:269:in `wait' from /opt/vagrant/embedded/gems/gems/net-scp-1.1.2/lib/net/scp.rb:279:in `upload!' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/plugins/communicators/ssh/communicator.rb:275:in `block in upload' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/plugins/communicators/ssh/communicator.rb:654:in `block in scp_connect' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/plugins/communicators/ssh/communicator.rb:316:in `connect' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/plugins/communicators/ssh/communicator.rb:652:in `scp_connect' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/plugins/communicators/ssh/communicator.rb:269:in `upload' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/plugins/guests/redhat/cap/configure_networks.rb:34:in `block (2 levels) in configure_networks' from /opt/vagrant/embedded/lib/ruby/2.2.0/tempfile.rb:319:in `open' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/plugins/guests/redhat/cap/configure_networks.rb:29:in `block in configure_networks' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/plugins/guests/redhat/cap/configure_networks.rb:19:in `each' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/plugins/guests/redhat/cap/configure_networks.rb:19:in `with_index' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/plugins/guests/redhat/cap/configure_networks.rb:19:in `configure_networks' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/capability_host.rb:111:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/capability_host.rb:111:in `capability' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/guest.rb:43:in `capability' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/plugins/providers/virtualbox/action/network.rb:133:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/warden.rb:34:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/plugins/providers/virtualbox/action/clear_network_interfaces.rb:26:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/warden.rb:34:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/plugins/providers/virtualbox/action/prepare_nfs_settings.rb:18:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/warden.rb:34:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/builtin/synced_folders.rb:87:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/warden.rb:34:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/builtin/synced_folder_cleanup.rb:28:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/warden.rb:34:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/plugins/synced_folders/nfs/action_cleanup.rb:25:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/warden.rb:34:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/plugins/providers/virtualbox/action/prepare_nfs_valid_ids.rb:12:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/warden.rb:34:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/builtin/handle_forwarded_port_collisions.rb:49:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/warden.rb:34:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/plugins/providers/virtualbox/action/prepare_forwarded_port_collision_params.rb:30:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/warden.rb:34:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/builtin/env_set.rb:19:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/warden.rb:34:in `call' from /home/rendev/.vagrant.d/gems/2.2.5/gems/vagrant-hostmanager-1.8.5/lib/vagrant-hostmanager/action/update_all.rb:27:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/warden.rb:34:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/builtin/config_validate.rb:25:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/warden.rb:34:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/builtin/provision.rb:80:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/warden.rb:34:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/plugins/providers/virtualbox/action/clear_forwarded_ports.rb:15:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/warden.rb:34:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/plugins/providers/virtualbox/action/set_name.rb:19:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/warden.rb:34:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/plugins/providers/virtualbox/action/clean_machine_folder.rb:17:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/warden.rb:34:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/plugins/providers/virtualbox/action/check_accessible.rb:18:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/warden.rb:34:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/warden.rb:95:in `block in finalize_action' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/warden.rb:34:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/warden.rb:34:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/builder.rb:116:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/runner.rb:66:in `block in run' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/util/busy.rb:19:in `busy' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/runner.rb:66:in `run' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/builtin/call.rb:53:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/warden.rb:34:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/warden.rb:95:in `block in finalize_action' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/warden.rb:34:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/warden.rb:34:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/builder.rb:116:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/runner.rb:66:in `block in run' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/util/busy.rb:19:in `busy' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/runner.rb:66:in `run' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/builtin/call.rb:53:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/warden.rb:34:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/warden.rb:95:in `block in finalize_action' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/warden.rb:34:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/warden.rb:34:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/builder.rb:116:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/runner.rb:66:in `block in run' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/util/busy.rb:19:in `busy' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/runner.rb:66:in `run' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/builtin/call.rb:53:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/warden.rb:34:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/builtin/box_check_outdated.rb:78:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/warden.rb:34:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/builtin/config_validate.rb:25:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/warden.rb:34:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/plugins/providers/virtualbox/action/check_virtualbox.rb:17:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/warden.rb:34:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/warden.rb:95:in `block in finalize_action' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/warden.rb:34:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/warden.rb:34:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/warden.rb:95:in `block in finalize_action' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/warden.rb:34:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/warden.rb:34:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/builder.rb:116:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/runner.rb:66:in `block in run' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/util/busy.rb:19:in `busy' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/runner.rb:66:in `run' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/builtin/call.rb:53:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/warden.rb:34:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/builtin/config_validate.rb:25:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/warden.rb:34:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/warden.rb:95:in `block in finalize_action' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/warden.rb:34:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/warden.rb:34:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/warden.rb:95:in `block in finalize_action' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/warden.rb:34:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/warden.rb:34:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/builder.rb:116:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/runner.rb:66:in `block in run' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/util/busy.rb:19:in `busy' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/runner.rb:66:in `run' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/builtin/call.rb:53:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/warden.rb:34:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/plugins/providers/virtualbox/action/check_virtualbox.rb:17:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/warden.rb:34:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/builder.rb:116:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/runner.rb:66:in `block in run' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/util/busy.rb:19:in `busy' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/action/runner.rb:66:in `run' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/machine.rb:225:in `action_raw' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/machine.rb:200:in `block in action' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/environment.rb:567:in `lock' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/machine.rb:186:in `call' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/machine.rb:186:in `action' from /opt/vagrant/embedded/gems/gems/vagrant-1.9.1/lib/vagrant/batch_action.rb:82:in `block (2 levels) in run'

it says no space left on device:

I did following:

[vagrant@node1 ~]$ df -i
Filesystem            Inodes  IUsed   IFree IUse% Mounted on
/dev/mapper/vg_node1-lv_root
                     2330160 391739 1938421   17% /
tmpfs                1007389      1 1007388    1% /dev/shm
/dev/sda1             128016     46  127970    1% /boot
[vagrant@node1 ~]$ df -h
Filesystem            Size  Used Avail Use% Mounted on
/dev/mapper/vg_node1-lv_root
                       35G   34G     0 100% /
tmpfs                 3.9G     0  3.9G   0% /dev/shm
/dev/sda1             477M   63M  389M  14% /boot
[vagrant@node1 ~]$ 


here df -h shows 100% space used by vg_node1-lv_root, how ever there are inodes which are free, can somebody help how to resolve this error? Thanks!

4 REPLIES 4

Re: No space left on device (RuntimeError) - vagrant

Guru

Your virtual disk is full. Inodes are just pointers in the filesystem, if there are no blocks (space) available, then the disk is, as the message says, full.

If this is a new build of the quick-dev machine, it may be that you need to increase the sizes specified in the vagrant file, as we should look at increasing those by default. If however, this is a machine you've bought up before, I suspect it has just filled with the sample data used to test quick-dev. You can try vagrant ssh and clear out some space if you need.

The quick-dev platform is really designed to be short lived for testing, so the best bet is probably to wipe it an start again (vagrant destroy, vagrant up) with a clean install.

Another option would be to increase the size of the disk given to the VM in Virtual Box, then vagrant ssh in to the box and extent the filesystem (there are plenty of guides on the net for expanding ext3 filesystems). This is probably going to be more pain than just starting with a clean slate though.

A common cause of space running out on earlier versions of quick-dev was log rotation settings, so if you're looking for a quick bit of space, there's usually a lot of unnecessary logs under /var/log, particularly /var/log/snort if you have been using the recommended alert on every packet rules from the wiki.

Re: No space left on device (RuntimeError) - vagrant

Cloudera Employee

@Umesh Kaushik disk space and disk inodes are not the same thing. inode is to a file system somewhat like what index is to a notebook (not really a direct analogy). The problem you have is that you have no pages left in your notebook, but the index pages are empty. But you cannot put your notes in index pages. So, what you need to do is using the "du" command figure out what is not required on your /dev/mapper/vg_node1-lv_root and try to clear some space if you can.

https://en.wikipedia.org/wiki/Inode

How inodes work - YouTube

Re: No space left on device (RuntimeError) - vagrant

I have added a new disk to my vm machine as well but still nothing, can somebody suggest something here? However I have added vdi I did not change it back to vmdk, shall I do that too?

Re: No space left on device (RuntimeError) - vagrant

Explorer

Dear All,

Does anyone know how to clear some space in Metron quickdev installation ? The space keeps growing rapidly and even I have increased the hard-disk allocated to vagrant from 40 GB to 80 GB, it seems it is not enough.

So how can we clear the different cached data on the hard-disk ?

Hope to hear your reply soon.

Best regards,

Maziar