[Bug 842856] [NEW] problems terminating lxc instances

[James Page]

Public bug reported:

I was not able to consistently terminate lxc instances using the
following command:

euca-terminate-instance i-XXXXX

I was able to quite rapidly get to a point where I was unable to start
any new instances because I had to many in the 'running' state - non of
which where actually running.

Error from nova-compute log file:

2011-09-06 15:17:01,765 DEBUG nova.utils [-] Running cmd (subprocess): sudo umount /var/lib/nova/instances/instance-00000002/rootfs from (pid=1229) execute /usr/lib/pymodules/python2.7/nova/utils.py:165
2011-09-06 15:17:01,774 INFO nova.virt.libvirt_conn [-] Instance instance-00000002 destroyed successfully.
2011-09-06 15:17:01,929 DEBUG nova.utils [-] Result was 1 from (pid=1229) execute /usr/lib/pymodules/python2.7/nova/utils.py:180
2011-09-06 15:17:01,930 DEBUG nova.utils [-] Running cmd (subprocess): sudo losetup -a from (pid=1229) execute /usr/lib/pymodules/python2.7/nova/utils.py:165
2011-09-06 15:17:02,033 ERROR nova.exception [-] Uncaught exception
(nova.exception): TRACE: Traceback (most recent call last):
(nova.exception): TRACE:   File "/usr/lib/pymodules/python2.7/nova/exception.py", line 98, in wrapped
(nova.exception): TRACE:     return f(*args, **kw)
(nova.exception): TRACE:   File "/usr/lib/pymodules/python2.7/nova/compute/manager.py", line 117, in decorated_function
(nova.exception): TRACE:     function(self, context, instance_id, *args, **kwargs)
(nova.exception): TRACE:   File "/usr/lib/pymodules/python2.7/nova/compute/manager.py", line 492, in terminate_instance
(nova.exception): TRACE:     self._shutdown_instance(context, instance_id, 'Terminating')
(nova.exception): TRACE:   File "/usr/lib/pymodules/python2.7/nova/compute/manager.py", line 483, in _shutdown_instance
(nova.exception): TRACE:     self.driver.destroy(instance, network_info)
(nova.exception): TRACE:   File "/usr/lib/pymodules/python2.7/nova/virt/libvirt/connection.py", line 326, in destroy
(nova.exception): TRACE:     self._cleanup(instance)
(nova.exception): TRACE:   File "/usr/lib/pymodules/python2.7/nova/virt/libvirt/connection.py", line 336, in _cleanup
(nova.exception): TRACE:     disk.destroy_container(target, instance, nbd=FLAGS.use_cow_images)
(nova.exception): TRACE:   File "/usr/lib/pymodules/python2.7/nova/virt/disk.py", line 153, in destroy_container
(nova.exception): TRACE:     utils.execute('umount', container_dir, run_as_root=True)
(nova.exception): TRACE:   File "/usr/lib/pymodules/python2.7/nova/utils.py", line 188, in execute
(nova.exception): TRACE:     cmd=' '.join(cmd))
(nova.exception): TRACE: ProcessExecutionError: Unexpected error while running command.
(nova.exception): TRACE: Command: sudo umount /var/lib/nova/instances/instance-00000002/rootfs
(nova.exception): TRACE: Exit code: 1
(nova.exception): TRACE: Stdout: ''
(nova.exception): TRACE: Stderr: 'umount: /var/lib/nova/instances/instance-00000002/rootfs: not mounted\n'
(nova.exception): TRACE:
2011-09-06 15:17:02,049 ERROR nova.rpc [-] Exception during message handling
(nova.rpc): TRACE: Traceback (most recent call last):
(nova.rpc): TRACE:   File "/usr/lib/pymodules/python2.7/nova/rpc/impl_kombu.py", line 620, in _process_data
(nova.rpc): TRACE:     rval = node_func(context=ctxt, **node_args)
(nova.rpc): TRACE:   File "/usr/lib/pymodules/python2.7/nova/exception.py", line 129, in wrapped
(nova.rpc): TRACE:     raise Error(str(e))
(nova.rpc): TRACE: Error: Unexpected error while running command.
(nova.rpc): TRACE: Command: sudo umount /var/lib/nova/instances/instance-00000002/rootfs
(nova.rpc): TRACE: Exit code: 1
(nova.rpc): TRACE: Stdout: ''

ProblemType: Bug
DistroRelease: Ubuntu 11.10
Package: nova-compute-lxc 2011.3~rc~20110901.1523-0ubuntu1
ProcVersionSignature: Ubuntu 3.0.0-10.16-server 3.0.4
Uname: Linux 3.0.0-10-server x86_64
Architecture: amd64
Date: Tue Sep  6 16:35:53 2011
NovaConf: Error: [Errno 13] Permission denied: '/etc/nova/nova.conf'
PackageArchitecture: all
ProcEnviron:
 LANGUAGE=en_GB:
 LANG=en_GB.UTF-8
 SHELL=/bin/bash
SourcePackage: nova
UpgradeStatus: No upgrade log present (probably fresh install)

** Affects: nova (Ubuntu)
     Importance: Undecided
         Status: New


** Tags: amd64 apport-bug oneiric

-- 
You received this bug notification because you are a member of Ubuntu
Server Team, which is subscribed to nova in Ubuntu.
https://bugs.launchpad.net/bugs/842856

Title:
  problems terminating lxc instances

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/nova/+bug/842856/+subscriptions