[Bug 1967576] Re: systemd: autopkgtest: tests-in-lxd fails because of remaining snap .mount units

Fri Jun 10 16:54:05 UTC 2022

Hello Nick, or anyone else affected,

Accepted systemd into jammy-proposed. The package will build now and be
available at
https://launchpad.net/ubuntu/+source/systemd/249.11-0ubuntu3.3 in a few
hours, and then in the -proposed repository.

Please help us by testing this new package.  See
https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how
to enable and use -proposed.  Your feedback will aid us getting this
update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug,
mentioning the version of the package you tested, what testing has been
performed on the package and change the tag from verification-needed-
jammy to verification-done-jammy. If it does not fix the bug for you,
please add a comment stating that, and change the tag to verification-
failed-jammy. In either case, without details of your testing we will
not be able to proceed.

Further information regarding the verification process can be found at
https://wiki.ubuntu.com/QATeam/PerformingSRUVerification .  Thank you in
advance for helping!

N.B. The updated package will be released to -updates after the bug(s)
fixed by this package have been verified and the package has been in
-proposed for a minimum of 7 days.

** Changed in: systemd (Ubuntu Jammy)
       Status: In Progress => Fix Committed

** Tags removed: verification-done
** Tags added: verification-needed verification-needed-jammy

-- 
You received this bug notification because you are a member of Ubuntu
Foundations Bugs, which is subscribed to systemd in Ubuntu.
https://bugs.launchpad.net/bugs/1967576

Title:
  systemd: autopkgtest: tests-in-lxd fails because of remaining snap
  .mount units

Status in systemd package in Ubuntu:
  In Progress
Status in systemd source package in Impish:
  Fix Released
Status in systemd source package in Jammy:
  Fix Committed

Bug description:
  [Impact]

   * The "tests-in-lxd/boot-and-services/test_no_failed" autopkgtest fails
   * it did not stand out due to LP: #1976607
   * we want to have proper autopkgtest coverage for systemd in Jammy LTS

  [Test Plan]

   * check autopkgtest logs on autopkgtest.ubuntu.com and make sure all
  instances of "boot-and-services" PASS (especially the "test_no_failed"
  test case. This includes running the test natively in autopkgtest and
  inside the "tests-in-lxd" container.

  [Where problems could occur]

   * other/new snapd-*.mount regressions could be hidden.
   * but snapd is being removed during systemd's tests anyway (introducing this failure)

  [Other Info]

   * The issue was not visible up to now, as the whole tests-in-lxd autopkgtests has been skipped: LP: #1976607

  === original description ===
  This build log provides an example of the problem: https://autopkgtest.ubuntu.com/results/autopkgtest-impish/impish/ppc64el/s/systemd/20220331_190433_fdbbe@/log.gz.

  During setup for tests-in-lxd, an attempt is made to purge snapd, but
  this fails:

  [ ... ]
  Purging configuration files for snapd (2.54.3+21.10.1ubuntu0.2) ...
  Stopping snap.lxd.activate.service
  Stopping unit snap.lxd.activate.service
  Waiting until unit snap.lxd.activate.service is stopped [attempt 1]
  snap.lxd.activate.service is stopped.
  Removing snap.lxd.activate.service
  Stopping snap.lxd.daemon.service
  Stopping unit snap.lxd.daemon.service
  Waiting until unit snap.lxd.daemon.service is stopped [attempt 1]
  snap.lxd.daemon.service is stopped.
  Removing snap.lxd.daemon.service
  Stopping snap.lxd.user-daemon.service
  Stopping unit snap.lxd.user-daemon.service
  Waiting until unit snap.lxd.user-daemon.service is stopped [attempt 1]
  snap.lxd.user-daemon.service is stopped.
  Removing snap.lxd.user-daemon.service
  Stopping snap-core20-1378.mount
  Stopping unit snap-core20-1378.mount
  Waiting until unit snap-core20-1378.mount is stopped [attempt 1]
  snap-core20-1378.mount is stopped.
  Removing snap core20 and revision 1378
  Removing snap-core20-1378.mount
  Stopping snap-lxd-22672.mount
  Stopping unit snap-lxd-22672.mount
  Waiting until unit snap-lxd-22672.mount is stopped [attempt 1]
  snap-lxd-22672.mount is stopped.
  Removing snap lxd and revision 22672
  rm: cannot remove '/var/snap/lxd/common/var/lib/lxcfs/proc/cpuinfo': Function not implemented
  rm: cannot remove '/var/snap/lxd/common/var/lib/lxcfs/proc/meminfo': Function not implemented
  rm: cannot remove '/var/snap/lxd/common/var/lib/lxcfs/proc/stat': Function not implemented
  rm: cannot remove '/var/snap/lxd/common/var/lib/lxcfs/proc/uptime': Function not implemented
  rm: cannot remove '/var/snap/lxd/common/var/lib/lxcfs/proc/diskstats': Function not implemented
  rm: cannot remove '/var/snap/lxd/common/var/lib/lxcfs/proc/swaps': Function not implemented
  rm: cannot remove '/var/snap/lxd/common/var/lib/lxcfs/proc/loadavg': Function not implemented
  rm: cannot remove '/var/snap/lxd/common/var/lib/lxcfs/proc/slabinfo': Function not implemented
  rm: cannot remove '/var/snap/lxd/common/var/lib/lxcfs/sys/devices/system/cpu/cpu0': Operation not permitted
  rm: cannot remove '/var/snap/lxd/common/var/lib/lxcfs/sys/devices/system/cpu/cpuidle': Operation not permitted
  rm: cannot remove '/var/snap/lxd/common/var/lib/lxcfs/sys/devices/system/cpu/uevent': Function not implemented
  rm: cannot remove '/var/snap/lxd/common/var/lib/lxcfs/sys/devices/system/cpu/svm': Function not implemented
  rm: cannot remove '/var/snap/lxd/common/var/lib/lxcfs/sys/devices/system/cpu/hotplug': Operation not permitted
  rm: cannot remove '/var/snap/lxd/common/var/lib/lxcfs/sys/devices/system/cpu/offline': Function not implemented
  rm: cannot remove '/var/snap/lxd/common/var/lib/lxcfs/sys/devices/system/cpu/present': Function not implemented
  rm: cannot remove '/var/snap/lxd/common/var/lib/lxcfs/sys/devices/system/cpu/power': Operation not permitted
  rm: cannot remove '/var/snap/lxd/common/var/lib/lxcfs/sys/devices/system/cpu/dscr_default': Function not implemented
  rm: cannot remove '/var/snap/lxd/common/var/lib/lxcfs/sys/devices/system/cpu/probe': Function not implemented
  rm: cannot remove '/var/snap/lxd/common/var/lib/lxcfs/sys/devices/system/cpu/smt': Operation not permitted
  rm: cannot remove '/var/snap/lxd/common/var/lib/lxcfs/sys/devices/system/cpu/vulnerabilities': Operation not permitted
  rm: cannot remove '/var/snap/lxd/common/var/lib/lxcfs/sys/devices/system/cpu/cpufreq': Operation not permitted
  rm: cannot remove '/var/snap/lxd/common/var/lib/lxcfs/sys/devices/system/cpu/isolated': Function not implemented
  rm: cannot remove '/var/snap/lxd/common/var/lib/lxcfs/sys/devices/system/cpu/kernel_max': Function not implemented
  rm: cannot remove '/var/snap/lxd/common/var/lib/lxcfs/sys/devices/system/cpu/modalias': Function not implemented
  rm: cannot remove '/var/snap/lxd/common/var/lib/lxcfs/cgroup': Input/output error
  dpkg: error processing package snapd (--purge):
   installed snapd package post-removal script subprocess returned error exit status 1
  [ ... ]

  This appears to result in some snap .mount units being left over in
  /etc/systemd/system. These leftover mount units will now always fail
  because snapd etc. is no longer installed. Thus, the 'test_no_failed'
  test, which checks for any failed units after boot, will fail:

  [ ... ]
  ======================================================================
  FAIL: test_no_failed (__main__.ServicesTest)
  No failed units
  ----------------------------------------------------------------------
  Traceback (most recent call last):
    File "/tmp/autopkgtest.s5bwuE/build.2Vb/real-tree/debian/tests/boot-and-services", line 69, in test_no_failed
      self.assertEqual(failed, [])
  AssertionError: Lists differ: ['snap-lxd-22672.mount   loaded failed fai[119 chars]180'] != []

  First list contains 2 additional elements.
  First extra element 0:
  'snap-lxd-22672.mount   loaded failed failed Mount unit for lxd, revision 22672'

  + []
  - ['snap-lxd-22672.mount   loaded failed failed Mount unit for lxd, revision '
  -  '22672',
  -  'snap-snapd-15180.mount loaded failed failed Mount unit for snapd, revision '
  -  '15180']

  ----------------------------------------------------------------------
  Ran 23 tests in 3.771s

  FAILED (failures=1, skipped=7)
  autopkgtest [18:16:43]: test boot-and-services: -----------------------]
  autopkgtest [18:16:44]: test boot-and-services:  - - - - - - - - - - results - - - - - - - - - -
  boot-and-services    FAIL non-zero exit status 1
  autopkgtest [18:16:44]: @@@@@@@@@@@@@@@@@@@@ summary
  boot-and-services    FAIL non-zero exit status 1
  autopkgtest [18:16:52]: test tests-in-lxd: -----------------------]
  autopkgtest [18:16:54]: test tests-in-lxd:  - - - - - - - - - - results - - - - - - - - - -
  tests-in-lxd         FAIL non-zero exit status 1
  [ ... ]

  The underlying snapd bug appears to be related to bug 1903967 and bug
  1950864. In the mean time, the test should be fixed so this does not
  block systemd autopktests.

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/systemd/+bug/1967576/+subscriptions