[Bug 1503150] Re: Minimize installed packages from -proposed

[Martin Pitt]

Changes to autopkgtest:
 - Extend --apt-pocket=<pocketname> to also accept --apt-pocket=<pocketname>=binary1,binary2,src:src1,... 
   This would add the additional apt sources as usual, but additionally create an /etc/apt/prefererences.d/01autopkgtest like in comment #1. all "src:src1" entries are expanded to all binary packages of src1 in <pocketname>.
 - An integration test for this requires some work: Add functionality to create a set of fake debs, then create a fake -release and -proposed archive (with apt-ftparchive), and test various combinations.

Changes to autopkgtest-cloud:
 - Replace "--apt-pocket=proposed" with comma separated params['triggers'], prefixed with src:
 - If no test triggers are given (which happens with manual test requests that don't specify a trigger and thus should apply to and run against all -proposed package), continue to use "--apt-pocket=proposed" as before.

Changes to britney:
 - No changes are necessary for installing only the -proposed packages for the trigger for requesting an individual test run.
 - Request individual test runs for every trigger, instead of just one test run for all triggers. This is what we already do for kernels, but now we need to do that for all packages as a test of p for a trigger t1 does not apply to a different trigger t2 any more. (NB that this will cause a lot of additional test runs, particularly in scenarios like "new KDE version mass upload")

** Also affects: autopkgtest (Ubuntu)
   Importance: Undecided
       Status: New

** Also affects: britney
   Importance: Undecided
       Status: New

** Changed in: britney
       Status: New => Confirmed

** Changed in: autopkgtest (Ubuntu)
       Status: New => Triaged

** Changed in: britney
   Importance: Undecided => Wishlist

** Changed in: autopkgtest (Ubuntu)
   Importance: Undecided => Wishlist

** Changed in: autopkgtest (Ubuntu)
     Assignee: (unassigned) => Martin Pitt (pitti)

** Changed in: autopkgtest (Ubuntu)
       Status: Triaged => In Progress

-- 
You received this bug notification because you are a member of Ubuntu
Foundations Bugs, which is subscribed to autopkgtest in Ubuntu.
https://bugs.launchpad.net/bugs/1503150

Title:
  Minimize installed packages from -proposed

Status in Auto Package Testing:
  Triaged
Status in britney:
  Confirmed
Status in autopkgtest package in Ubuntu:
  In Progress

Bug description:
  It sometimes happens that a package P in -proposed gets stuck because
  one of its dependencies D also gets uploaded and is broken. Right now
  we always run all tests against the entirety of -proposed, which will
  cause P's tests to  fail due to the broken D.

  However, in many cases P's dependencies will be satisfiable in
  -release, so if we would run tests only against P's -proposed binaries
  and only use those packages from -proposed which are necessary to
  satisfy the dependencies (to catch library transitions or packages
  with versioned Depends: which need to land in lockstep) we could land
  P and still keep D in -proposed.

  This needs fleshing out, and we need to figure out how to do that with
  apt pinning.

  Once we do that, we need to become strict in britney about always
  respecting the recorded triggering package in the result logs. We must
  then not consider newer test results which were run against a
  different trigger Q as an updated test result for a failing test
  against P. We currently only do this results-per-trigger tracking for
  kernels, but not for normal packages as the triggering package
  currently doesn't influence the test results there.

To manage notifications about this bug go to:
https://bugs.launchpad.net/auto-package-testing/+bug/1503150/+subscriptions