<div dir="ltr">As always,<div><br></div><div>wise words..</div><div><br></div><div>Regards,</div><div><br></div><div>Phill.</div></div><div class="gmail_extra"><br><br><div class="gmail_quote">On 4 January 2014 20:38, Elfy <span dir="ltr"><<a href="mailto:ub.untu@btinternet.com" target="_blank">ub.untu@btinternet.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000"><div class="im">
<div>On 04/01/14 20:01, Javier Lopez wrote:<br>
</div>
<blockquote type="cite">
<pre>Hi,
Happy new year to all QA ubuntu members =). Since some time ago, launchpad has
been used to track the progress on manual|automatic tests for Ubuntu and derived
flavours (kubuntu, lubuntu, xubuntu, etc).
<a href="https://bugs.launchpad.net/ubuntu-manual-tests" target="_blank">https://bugs.launchpad.net/ubuntu-manual-tests</a>
<a href="https://launchpad.net/ubuntu-autopilot-tests/" target="_blank">https://launchpad.net/ubuntu-autopilot-tests/</a>
Recently however, Paul White has pointed out that some of the flavours use
other mediums to track progress on this aspect, eg. Kubuntu uses
<a href="https://trello.com/kubuntu" target="_blank">https://trello.com/kubuntu</a>.
<a href="https://bugs.launchpad.net/ubuntu-manual-tests/+bug/1183934" target="_blank">https://bugs.launchpad.net/ubuntu-manual-tests/+bug/1183934</a>
Should keep using launchpad to track manual|automatic test for ubuntu derived
flavours?
Greetings
</pre>
</blockquote></div>
Happy new year to you too :)<br>
<br>
My position is simple enough.<br>
<br>
<b>Manual Testing.</b><br>
<br>
If a flavour team wants to use the trackers then they should.<br>
<br>
If I'd seen this discussion before the bugs for manual testcases
were created, I would at that point have been -1 to a mass creation
of testcases for flavours without any discussion with them.<br>
<br>
It should be up to a team how to deal with their QA infrastructure.
<br>
<br>
Different teams have differing resources - I'm positive that the
only way that we (Xubuntu) managed to get the testcases we did
written, onto the package tracker and actually tested was down to a
lot of work by a very few people at the beginning.<br>
<br>
It was of some concern to find ~50 bugs all tagged Xubuntu - I
didn't see any discussion on any mailing list about this. <br>
<br>
Now that we have the testcases - the tracker itself mostly looks
after itself. Though actually getting tests done and reported is a
different story. <br>
<br>
As far as Kubuntu goes - if they aren't using, and seem to have no
inclination to do so - why shouldn't the Kubuntu testcase bugs be
marked as invalid - as they surely are that ;) [1]<br>
<br>
I see that ubuntu-studio has 53 outstanding testcase bugs - they
have less people than we do.<br>
<br>
Edubuntu has 65 of them - though I've no idea how many people there
are available to do their testcases.<br>
<br>
<b>Autopilot testing</b><br>
<br>
I can see the value in there being testcase bugs raised here - once
the testcase is done then the need for people to get involved
reduces remarkably - I assume.<br>
<br>
I'm surprised to be honest that there isn't a massive list of these.
Perhaps because it would seem that autopilot was set up purely for
Ubuntu - which is understandable - we are having massive problems
even getting anything to run for us in our environment, it would
certainly have been of enormous help for us to have automatic
testing - it is looking increasingly likely that we'll not ever be
in a position to really take advantage of this. <br>
<br>
<br>
<b>Summary</b><br>
<br>
In summary - it seems to me that we're looking at discussing
something now that should have been discussed earlier. <br>
<br>
But the main thing we should look at is whether a flavour has any
intention of using the package tracker. If QA as a team hasn't
touched base with them - then perhaps we should be.<br>
<br>
<br>
<br>
Apologies if I did miss mailings.<br>
<br>
regards<br>
<br>
Elfy<br>
<br>
<br>
[1]
<a href="https://lists.ubuntu.com/archives/kubuntu-devel/2014-January/007653.html" target="_blank">https://lists.ubuntu.com/archives/kubuntu-devel/2014-January/007653.html</a><span class="HOEnZb"><font color="#888888"><br>
<br>
<br>
<br>
<br>
<pre cols="72">--
Ubuntu Forum Council Member
Xubuntu QA Lead</pre>
</font></span></div>
<br>--<br>
Ubuntu-quality mailing list<br>
<a href="mailto:Ubuntu-quality@lists.ubuntu.com">Ubuntu-quality@lists.ubuntu.com</a><br>
Modify settings or unsubscribe at: <a href="https://lists.ubuntu.com/mailman/listinfo/ubuntu-quality" target="_blank">https://lists.ubuntu.com/mailman/listinfo/ubuntu-quality</a><br>
<br></blockquote></div><br><br clear="all"><div><br></div>-- <br><a href="https://wiki.ubuntu.com/phillw" target="_blank">https://wiki.ubuntu.com/phillw</a>
</div>