Buildup to beta2 -- Testcase Revamp

[Nicholas Skaggs]

Thanks to everyone who is stepping forward to help with this. I have put 
together a page so everyone can see what's happening with the testcases 
this week:

https://wiki.ubuntu.com/QATeam/QuantalTestcaseUpdates

Remember, our goal is to finish the items listed for beta2 this week :-) 
You might see your name under some work items. If you put forth interest 
in helping, I've added you ;-)
Please do take a look and get started on what's been assigned. If your 
not on the list, it's not too late. Email me your interest, and I can 
help you get started.

Also, I'd like to let everyone know the changes mentioned in the bug 
reports on my first email are coming along. Thank you stgraber for 
helping to get these out! You can see the changes in action on the 
staging site here:

http://packages.qa.dev.stgraber.org/qatracker/milestones/225/builds/16296/testcases/1303/results
http://packages.qa.dev.stgraber.org/qatracker/milestones/225/builds/16297/testcases/1303/results

Though one is for ubuntu and the other xubuntu, they are using the same 
testcase -- AND the xubuntu testcase reads 'xubuntu' properly instead of 
ubuntu! Now we have better support for re-using the testcase across the 
flavors. In addition, the testcase is now folded by default to make it 
easier to report results without scrolling through the testcase first. 
Finally, here's a preview of knome's work to make our testcases more 
readable in the tool:

http://packages.qa.dev.stgraber.org/qatracker/milestones/225/builds/16296/testcases/1305/results

We'll be doing work to switch over the testcases after beta 2.

Thanks!

Nicholas

On 09/13/2012 11:38 PM, Scott Kitterman wrote:
> On Thursday, September 13, 2012 06:27:40 PM Nicholas Skaggs wrote:
>> Ok, feature freeze and beta1 craziness is now behind us. Some of you may
>> have noticed, but the first phase of our testcase migration is now
>> complete. All the old testcases (including the application testcases!)
>> are now migrated into the tracker. You can see the general application
>> testcases from last cycle in the 'ubuntu global jam' milestone on the
>> package tracker:
>>
>> http://packages.qa.ubuntu.com/qatracker/milestones/235/builds
>>
>> What this means is work can now begin on enhancing and improving the
>> testcases and testsuites we have. The first testcases being targedt are
>> the image testcases. As many of you noticed, they need to be updated to
>> match the new features found in the beta1 installer. To that end there's
>> a few bugs out  there to support rolling out the changes to the testcases:
>>
>> https://bugs.launchpad.net/ubuntu-qa-website/+bug/1039158
>> https://bugs.launchpad.net/ubuntu-qa-website/+bug/1050489
>>
>> The goals to have done for beta2 are:
>>
>>       -Updating testcases for new ubiquity features (webcam take a
>> picture, lvm, encryption, etc)
>>       -Adding alternate-only testcases back to the desktop cd's as needed
>> (need testcases for the livecd, memtest, etc)
>>       -Migration of ubuntu testcases to all flavors (the changes above
>> should allow this to happen)
>>       -Finishing the last ubuntu server testcases for rollout
>>
>> In regards to the flavor testcases, flavor specific pieces will be
>> additional testcases on-top of the default ubuntu testcases. The bugs
>> above will support varying the displaying of
>> 'ubuntu/xubuntu/lubuntu/kubuntu/ubuntu studio/mythbuntu/edubuntu' inside
>> the testcases, allowing us to share all the bulk of maintenance as much
>> as possible. I know some of you have been helpful in wanting to write
>> testcases. There is actually a team of folks
>>
>> https://wiki.ubuntu.com/Testing/TestCaseAdmins/ManagementOverview
>>
>> and a specific format
>>
>> https://wiki.ubuntu.com/Testing/TestCaseFormat
>>
>> that is being followed. If your interested in helping, please get in
>> touch with me. You can help write testcases, verify testcases that have
>> been written, help out with migrating testcases, etc.
> For Kubuntu, it looks like the KDE U/I for the lvm and encryption changes will
> land before beta 2, so we'll need to make sure those test cases appear for
> Kubuntu live images as well.  We're also likely to drop the alternates during
> beta 2 if we get a fully qualified set of desktop images, so we'd also need the
> alternate only cases added to Kubuntu desktop as well.
>
> Scott K
>