Suggestions for ISO tracker

[Steven]

I second this, on both items.

1) There are multiple tests per test case, i.e. the Live Session test case
has three sub-tests, each of which can be passed or failed (Live Session
Start, Live Session Finish, and Live Session Persistence). These sub-tests
should be passable or failable, not the umbrella Live Session test, in case
one is passed and another is failed.

2) "Additional instructions are available for this testcase, click here to
read them." makes it sound like it's optional to read how to perform the
tests. "Additional" should be removed. How can we provide consistent result
reports if people might not be following the same procedures?

Ideally iso.qa.ubuntu.com and testcases.qa.ubuntu.com should be integrated,
such that clicking "Live Session" on iso.qa.ubuntu.com opens another list of
testcases from testcases.qa.ubuntu.com, and clicking on these gives the
instructions from testcases.qa.ubuntu.com along with the Reporter/Last
Update/Bugs/Comments table from iso.qa.ubuntu.com below it, and the user's
report below that.

Basically instead of just having "Ubuntu Desktop i386 -> Live Session", it
should be "Ubuntu Desktop i386 -> Live Session -> Live Session Start".

This seems like an efficient solution to your points, Alex. What do you
think about it? Anyone else have any comments about this structure?

-Steven


On Sun, Jul 25, 2010 at 5:22 AM, Alex Lourie <djay.il at gmail.com> wrote:

> Hello QA crowd
>
> I had a couple suggestions for ISO tracker:
>
> 1. I noticed there are few tests that include multiple different checks.
> For example, within one test in server ISO testing there are 2 KVM
> installations, 1 VMWare ESX installation and 1 VMWare server installation.
> While being similar they are different, and having run one check (VMWARE ESX
> - the only system I have) I still cannot provide my results as not all
> checks are finished, so the test is not completed.
>
> I suggest splitting such complex tests into smaller tests, so each of them
> could be tested on its own.
>
> 2. It is not really convenient to open the test, and see there nothing to
> do. As an experienced user I noticed the link to wiki pages, which, of
> course, have the test steps and the success criteria. But I believe it would
> be more obvious and convenient to have all steps directly available within
> the test page.
>
> This, of course, requires development, and that's why I asked if redesign
> is planned in a near future.
>
> I'll be happy for any comments.
>
> --
> Alex Lourie
>
> --
> Ubuntu-qa mailing list
> Ubuntu-qa at lists.ubuntu.com
> Modify settings or unsubscribe at:
> https://lists.ubuntu.com/mailman/listinfo/ubuntu-qa
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.ubuntu.com/archives/ubuntu-quality/attachments/20100803/606f424e/attachment.html>