Upgrade Testing

[Richard Elkins]

Good point.  The category should be "Product (Ubuntu Core)".  Instead,
the same one or two simple test cases (not enough, IMO) are repeated in
every Ubuntu variant.  It looks like they're all clones.  See
http://iso.qa.ubuntu.com/qatracker/milestones/308/builds/.

It looks like nobody is planning to test multi-boot configuration
upgrades as it stands.  I'll do what I can in whatever time I have and
what time (?) is permitted.

Also, as Elfy pointed out, we really should have distinct scenarios for
(1) upgrading from the last long-term release i.e. 12.04 and (2)
upgrading from the last release i.e. 13.10.  Ouch.  This is why IBM etc.
have large QA departments with paid staff!  (-:

Richard


On 01/29/2014 03:39 PM, Eero Tamminen wrote:
> Hi,
>
> On keskiviikko 29 tammikuu 2014, Elfy wrote:
>> You can do as you wish - and the more testing you can do - the happier
>> we will be.
>>
>> However, for the majority of people they don't have the time.
>>
>> The testcases we use are in fact generic ones for Ubuntu and all the
>> flavours who use the tracker.
> IMHO it's better if Xbuntu testing concentrates on things where
> Xubuntu differentiates from Ubuntu.  Isn't all the bootloader
> functionality inherited from Ubuntu as-is (except for themeing)?
>
>
> 	- Eero
>
>> I can almost guarantee that if we made the upgrade testcases anymore
>> complicated with more variants that the numbers reported would drop from
>> the ~12 we'll get to close to zero.
>>
>> There is no way that we can cover ever eventuality.
>>
>> Elfy
>