[Bug 1855259] Re: apt broken by unattended upgrade in Ubuntu 19.10

[Urop]

My system was installed using the LVM with full-disk encryption option
of the alternative installer, and uses the default ext4 filesystem, so
the filesystem doesn't appear to the problem.

I previously reported that I didn't have the problem on a system with a
very similar software setup, but without the nvidia-driver-435 package
installed. However, I did unexpectedly encounter a very similar error on
that machine yesterday when installing the youtube-dl package. apt
failed during install of the package. Fortunately, this time, it was
fixable. Running the `apt update` and `apt full-upgrade` was sufficient
to sort it out.

This should be marked as important and as a security issue, because I
haven't had any security updates (well, any updates!) in a week now
because of it.

-- 
You received this bug notification because you are a member of Ubuntu
Foundations Bugs, which is subscribed to update-manager in Ubuntu.
https://bugs.launchpad.net/bugs/1855259

Title:
  apt broken by unattended upgrade in Ubuntu 19.10

Status in update-manager package in Ubuntu:
  Confirmed

Bug description:
  I've got this issue on a fresh (last week) Ubuntu-server 19.10
  install, with gnome-session installed on top.

  From history.log:

  Start-Date: 2019-12-04  06:24:37
  Commandline: /usr/bin/unattended-upgrade
  Install: linux-image-5.3.0-24-generic:amd64 (5.3.0-24.26, automatic), linux-headers-5.3.0-24-generic:amd64 (5.3.0-24.26, automatic), linux-modules-extra-5.3.0-24-generic:amd64 (5.3.0-24.26, automatic), linux-headers-5.3.0-24:amd64 (5.3.0-24.26, automatic), linux-modules-5.3.0-24-generic:amd64 (5.3.0-24.26, automatic)
  Upgrade: linux-headers-generic:amd64 (5.3.0.23.27, 5.3.0.24.28), linux-image-generic:amd64 (5.3.0.23.27, 5.3.0.24.28), linux-generic:amd64 (5.3.0.23.27, 5.3.0.24.28)
  Error: Sub-process /usr/bin/dpkg returned an error code (1)
  End-Date: 2019-12-04  06:25:04 get this error

  From term.log:

  Log started: 2019-12-04  06:24:37
  Selecting previously unselected package linux-modules-5.3.0-24-generic.
  (Reading database ... 162957 files and directories currently installed.)
  Preparing to unpack .../0-linux-modules-5.3.0-24-generic_5.3.0-24.26_amd64.deb ...
  Unpacking linux-modules-5.3.0-24-generic (5.3.0-24.26) ...
  dpkg: error processing archive /tmp/apt-dpkg-install-Axvsef/0-linux-modules-5.3.0-24-generic_5.3.0-24.26_amd64.deb (--unpack):
   unable to create new file '/var/lib/dpkg/info/linux-modules-5.3.0-24-generic.list-new': Operation not permitted
  dpkg (subprocess): unable to execute rm command for cleanup (rm): Operation not permitted
  dpkg: error while cleaning up:
   rm command for cleanup subprocess returned error exit status 2
  Selecting previously unselected package linux-image-5.3.0-24-generic.
  Preparing to unpack .../1-linux-image-5.3.0-24-generic_5.3.0-24.26_amd64.deb ...
  Unpacking linux-image-5.3.0-24-generic (5.3.0-24.26) ...
  Selecting previously unselected package linux-modules-extra-5.3.0-24-generic.
  Preparing to unpack .../2-linux-modules-extra-5.3.0-24-generic_5.3.0-24.26_amd64.deb ...
  Unpacking linux-modules-extra-5.3.0-24-generic (5.3.0-24.26) ...
  dpkg: error processing archive /tmp/apt-dpkg-install-Axvsef/2-linux-modules-extra-5.3.0-24-generic_5.3.0-24.26_amd64.deb (--unpack):
   unable to open '/lib/modules/5.3.0-24-generic/kernel/net/wireless/lib80211.ko.dpkg-new': Operation not permitted
  Preparing to unpack .../3-linux-generic_5.3.0.24.28_amd64.deb ...
  Unpacking linux-generic (5.3.0.24.28) over (5.3.0.23.27) ...
  Preparing to unpack .../4-linux-image-generic_5.3.0.24.28_amd64.deb ...
  Unpacking linux-image-generic (5.3.0.24.28) over (5.3.0.23.27) ...
  Selecting previously unselected package linux-headers-5.3.0-24.
  Preparing to unpack .../5-linux-headers-5.3.0-24_5.3.0-24.26_all.deb ...
  Unpacking linux-headers-5.3.0-24 (5.3.0-24.26) ...
  dpkg: error processing archive /tmp/apt-dpkg-install-Axvsef/5-linux-headers-5.3.0-24_5.3.0-24.26_all.deb (--unpack):
   unable to create new file '/var/lib/dpkg/info/linux-headers-5.3.0-24.list-new': Operation not permitted
  Selecting previously unselected package linux-headers-5.3.0-24-generic.
  Preparing to unpack .../6-linux-headers-5.3.0-24-generic_5.3.0-24.26_amd64.deb ...
  Unpacking linux-headers-5.3.0-24-generic (5.3.0-24.26) ...
  Preparing to unpack .../7-linux-headers-generic_5.3.0.24.28_amd64.deb ...
  Unpacking linux-headers-generic (5.3.0.24.28) over (5.3.0.23.27) ...
  Errors were encountered while processing:
   /tmp/apt-dpkg-install-Axvsef/0-linux-modules-5.3.0-24-generic_5.3.0-24.26_amd64.deb
   /tmp/apt-dpkg-install-Axvsef/2-linux-modules-extra-5.3.0-24-generic_5.3.0-24.26_amd64.deb
   /tmp/apt-dpkg-install-Axvsef/5-linux-headers-5.3.0-24_5.3.0-24.26_all.deb
  Log ended: 2019-12-04  06:25:04

  Try to fix it, following apt instructions. From term.log:

  Start-Date: 2019-12-04  23:32:41
  Commandline: apt --fix-broken install
  Requested-By: ### (1000)
  Install: linux-modules-extra-5.3.0-24-generic:amd64 (5.3.0-24.26, automatic)
  Upgrade: linux-headers-5.3.0-24:amd64 (5.3.0-24.26, 5.3.0-24.26), linux-modules-5.3.0-24-generic:amd64 (5.3.0-24.26, 5.3.0-24.26)
  Error: Sub-process /usr/bin/dpkg returned an error code (1)
  End-Date: 2019-12-04  23:33:01

  From history.log:

  Log started: 2019-12-04  23:32:41
  (Reading database ... 174863 files and directories currently installed.)
  Preparing to unpack .../linux-modules-5.3.0-24-generic_5.3.0-24.26_amd64.deb ...
  Unpacking linux-modules-5.3.0-24-generic (5.3.0-24.26) over (5.3.0-24.26) ...
  Preparing to unpack .../linux-modules-extra-5.3.0-24-generic_5.3.0-24.26_amd64.deb ...
  Unpacking linux-modules-extra-5.3.0-24-generic (5.3.0-24.26) ...
  dpkg: error processing archive /var/cache/apt/archives/linux-modules-extra-5.3.0-24-generic_5.3.0-24.26_amd64.deb (--unpack):
   unable to open '/lib/modules/5.3.0-24-generic/kernel/sound/soc/codecs/snd-soc-rt5640.ko.dpkg-new': Operation not permitted
  Preparing to unpack .../linux-headers-5.3.0-24_5.3.0-24.26_all.deb ...
  Unpacking linux-headers-5.3.0-24 (5.3.0-24.26) over (5.3.0-24.26) ...
  Errors were encountered while processing:
   /var/cache/apt/archives/linux-modules-extra-5.3.0-24-generic_5.3.0-24.26_amd64.deb
  Log ended: 2019-12-04  23:33:01

  Fails. Tried apt clean, apt autoclean, to no avail. apt is now broken.

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/update-manager/+bug/1855259/+subscriptions