[QA] Release Meeting 2012-08-17

[Gema Gomez]

Hi all,

the update from the Platform QA Team enclosed:

=== Release Testing ===

==== Quantal Testing ====
*Builds*
http://reports.qa.ubuntu.com/reports/isotesting/builds/quantal.html

*Testing*
https://jenkins.qa.ubuntu.com/view/Quantal
* ISO Testing:

  - Desktop:
      - Quantal desktop ISOs were not built for Aug 16 due hardware
maintenance on the build machines
      - No failures on the images prior to 20121508

- Alternate:
      - No new failures found this week.

- Server:
  - New bug on server installation with lvm/raid1:
[bug 1036612]: Quantal Server failed to install with LVM: VFS: Cannot
open root device "mapper/ubuntu-root" or unknown-block(0,0): error -6
  https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1036612
    * Now fixed and tests started passing on 20120815

  - Existing bug:
[bug 1028453]: Quantal Ubuntu Server minimal install oversized
  https://bugs.launchpad.net/ubuntu/+source/ubuntu-meta/+bug/1028453
    * Keeps impacting some server tests and has not yet been fixed.

  - The maintenance work of the build machines are impacting the server
images as well and hence the test on 20120816 build failed due to the
iso being very thin.
    * Waiting for a new image is the suggested solution by the release
team.


* Upgrades:
   - No new failures found this week.
   - Existing bugs:
[Bug 1022927]: Upgrade tests failed: obsolete files left after the upgrade
  https://bugs.launchpad.net/ubuntu/+source/brltty/+bug/1022927
     * still impacting the tests

[Bug 1034889]: Oneiric to Precise and Precise to Quantal upgrade:
debconf prompt to update unmodified
  configuration file: /etc/sudoers
  https://bugs.launchpad.net/ubuntu/+source/sudo/+bug/1034889:
     * still impacting the tests

==== Precise Testing ====
*Builds*
http://reports.qa.ubuntu.com/reports/isotesting/builds/precise.html

*Testing*

https://jenkins.qa.ubuntu.com/view/Precise/
* ISO testing

- Desktop
  - Precise desktop ISOs were not built for Aug 15 & 16 due hardware
maintenance on the build machines
  - Tests on images upto 20120814 had no failures

- Alternate and Server
   - No failures for this week


* Upgrades:
   - No new failures for this week.

   - Existing bugs:
[bug 1022927]:Upgrade tests failed: obsolete files left after the upgrade
  https://bugs.launchpad.net/ubuntu/+source/brltty/+bug/1022927
      * Still impacting the tests

[Bug 1034889]: Oneiric to Precise and Precise to Quantal upgrade:
debconf prompt to update unmodified configuration file: /etc/sudoers
  https://bugs.launchpad.net/ubuntu/+source/sudo/+bug/1034889
      * Still impacting the tests


The following new upgrade tests have been added this week

1.
https://jenkins.qa.ubuntu.com/view/Precise/view/Upgrade%20Testing%20Dashboard/job/precise-upgrade-lucid-server-updates/
2.
https://jenkins.qa.ubuntu.com/view/Precise/view/Upgrade%20Testing%20Dashboard/job/precise-upgrade-lucid-desktop-updates/

These are  Precise Server|Desktop upgrades with -updates enabled.
They'll run until the release of 12.04.1


=== What was done engineering wise? ===

Bootspeed tests are up and running with UTAH. We are re-running all the
old jobs so that we have a clear set of results and are able to see any
bootspeed trends going forward.

Adding user documentation to UTAH as well as making it more stable as we
encounter problems with its testing.

=== What's about to land that might impact the other teams and release
as a whole? ===

The graphs will change to the real values during this week, before we
were seeing test environment related delays:
http://reports.qa.ubuntu.com/reports/boot-speed

=== Summary of bugs working on by team (reasonably reliable) ===

http://reports.qa.ubuntu.com/reports/qa/qa-open-bugs-quantal.html
http://reports.qa.ubuntu.com/reports/qa/qa-open-bugs.html

=== Dependencies on other teams to make deliverables, blocking items,
release wide concerns? ===

None apart from the known issue of builds taking too long and making the
testing cycle at milestones slow.

=== Team Status ===
http://status.ubuntu.com/ubuntu-quantal/canonical-platform-qa.html

Thanks,
Gema
-- 
Gema Gomez-Solano        <gema.gomez-solano at canonical.com>
Ubuntu QA Team           https://launchpad.net/~gema.gomez
Canonical Ltd.           http://www.canonical.com