[Bug 1822886] Re: universe missing after bionic->cosmic do-release-upgrade

[Brian Murray]

I followed the test when upgrading a system from xenial to bionic and it
passed. Here we can see that url_downloadable is called only once with
the version of the release upgrader in -proposed and that the universe
entry is still enabled:

2019-04-15 09:53:30,259 INFO Using config files '['./DistUpgrade.cfg.xenial']'
2019-04-15 09:53:30,260 INFO uname information: 'Linux clean-xenial-amd64 4.15.0-47-generic #50~16.04.1-Ubuntu SMP Fri Mar 15 16:06:21 UTC 2019 x86_64'
2019-04-15 09:53:30,527 INFO apt version: '1.2.31'
2019-04-15 09:53:30,527 INFO python version: '3.5.2 (default, Nov 12 2018, 13:43:14)
[GCC 5.4.0 20160609]'
2019-04-15 09:53:30,530 INFO release-upgrader version '18.04.31' started
...
2019-04-15 09:53:41,478 DEBUG examining: 'deb http://ubuntu.osuosl.org/ubuntu xenial main restricted multiverse'
2019-04-15 09:53:41,478 DEBUG verifySourcesListEntry: deb http://ubuntu.osuosl.org/ubuntu bionic main restricted multiverse
2019-04-15 09:53:41,478 DEBUG url_downloadable: http://ubuntu.osuosl.org/ubuntu/dists/bionic/Release
2019-04-15 09:53:41,478 DEBUG s='http' n='ubuntu.osuosl.org' p='/ubuntu/dists/bionic/Release' q='' f=''
2019-04-15 09:53:41,556 DEBUG entry 'deb http://ubuntu.osuosl.org/ubuntu bionic main restricted multiverse' updated to new dist
2019-04-15 09:53:41,556 DEBUG examining: 'deb http://ubuntu.osuosl.org/ubuntu xenial-updates main restricted multiverse'
2019-04-15 09:53:41,557 DEBUG entry 'deb http://ubuntu.osuosl.org/ubuntu bionic-updates main restricted multiverse' updated to new dist
2019-04-15 09:53:41,557 DEBUG examining: 'deb http://ubuntu.osuosl.org/ubuntu xenial-security main restricted multiverse'
2019-04-15 09:53:41,558 DEBUG entry 'deb http://ubuntu.osuosl.org/ubuntu bionic-security main restricted multiverse' updated to new dist
2019-04-15 09:53:41,558 DEBUG examining: 'deb http://ubuntu.osuosl.org/ubuntu xenial universe'
2019-04-15 09:53:41,558 DEBUG entry 'deb http://ubuntu.osuosl.org/ubuntu bionic universe' updated to new dist

-- 
You received this bug notification because you are a member of Ubuntu
Foundations Bugs, which is subscribed to ubuntu-release-upgrader in
Ubuntu.
https://bugs.launchpad.net/bugs/1822886

Title:
  universe missing after bionic->cosmic do-release-upgrade

Status in ubuntu-release-upgrader package in Ubuntu:
  Fix Released
Status in ubuntu-release-upgrader source package in Bionic:
  Fix Committed
Status in ubuntu-release-upgrader source package in Cosmic:
  Fix Committed

Bug description:
  [Impact]
  If there is a network hiccup at the right moment it's possible that some sources.list entries will be disabled when a release upgrade is calculated and then people could upgrade with surprising results e.g. universe being missing.

  [Test Case]
  This is somewhat convoluted as we need to create the network error only when a specific line is is being tested by the dist-upgrader.

  1) Use a system on xenial or bionic and ensure prompt is set appropriately (lts for xenial, normal for bionic)
  2) Edit your /etc/apt/sources.list file so that universe is a separate line from main, restricted, and multiverse
  3) Run do-release-upgrade
  4) Cancel the release upgrade
  5) cd to /tmp/ubuntu-release-upgrader-$tmpname
  6) edit DistUpgradeController.py with the attached patch which will cause the url check for the universe line to fail
  7) run 'sudo ./$release-upgrading-to'
  8) wait until you receive the message regarding quantities of packages to install, upgrade, etc
  9) look at /etc/apt/sources.list file and notice that the lines with universe are disabled

  With the release-upgrader from -proposed you'll need to follow the
  same steps and you'll notice that the lines with universe are not
  disabled.

  [Regression Potential]
  Because we are checking each unique uri in sources.list only one time its possible that if the first check fails then the upgrade will fail to be calculated. That is better than upgrading and having components disabled though.

  [Original Description]

  I took a bionic system and stepped through bionic->cosmic->disco via
  do-release-upgrade.

  Upon finishing I noticed that universe was "gone" and all packages
  from universe were removed from the system. Based on the files on my
  system, it looks like it happened during the bionic->cosmic upgrade.
  You'll see in the sources.list that cosmic-updates universe pocket is
  that but not cosmic universe.

  ProblemType: BugDistroRelease: Ubuntu 19.04
  Package: ubuntu-release-upgrader-core 1:19.04.13
  ProcVersionSignature: Ubuntu 5.0.0-8.9-generic 5.0.1
  Uname: Linux 5.0.0-8-generic x86_64
  NonfreeKernelModules: zfs zunicode zavl icp zcommon znvpair
  ApportVersion: 2.20.10-0ubuntu23
  Architecture: amd64
  CrashDB: ubuntu
  CurrentDesktop: ubuntu:GNOME
  Date: Tue Apr  2 16:04:34 2019
  InstallationDate: Installed on 2018-07-24 (252 days ago)
  InstallationMedia: Ubuntu 18.04.1 LTS "Bionic Beaver" - Release amd64 (20180724)
  PackageArchitecture: all
  ProcEnviron:
   TERM=xterm
   PATH=(custom, no user)
   XDG_RUNTIME_DIR=<set>
   LANG=en_US.UTF-8
   SHELL=/bin/bashSourcePackage: ubuntu-release-upgrader
  Symptom: ubuntu-release-upgrader
  UpgradeStatus: Upgraded to disco on 2019-04-02 (0 days ago)
  VarLogDistupgradeXorgFixuplog:
   INFO:root:/usr/bin/do-release-upgrade running
   INFO:root:No xorg.conf, exiting
  mtime.conffile..etc.update-manager.release-upgrades: 2019-04-02T08:18:06.798258

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/ubuntu-release-upgrader/+bug/1822886/+subscriptions