Automated testing

[Jim Baker]

On 08/23/2011 07:32 AM, Gustavo Niemeyer wrote:
> Jim,
>
> Can you please update us on how the automated run and reporting of
> functional tests is going?
>
> Thanks in advance,
Gustavo,

Work commenced on this yesterday. I'm in the process of setting up the
following:

* Making JUnit XML output available when running tests. (Regardless of
  its merits, JUnit XML is a standard reporting format for CI systems,
  and is rather trivial to support as seen in this code
  http://pypi.python.org/pypi/XmlTestRunner/). However, it is
  necessary to do this through Twisted Trial and its plugin system for
  adding new reporters. This work is nearly complete.

* Deploying Jenkins to run the functional tests against EC2. This will
  use a standard CI process, along with the Jenkins bzr plugin, to
  automatically run the tests after every change to the tip of
  trunk. In the future, other cloud stacks will also be supported
  (OpenStack, Orchestra), as well as the LXC provider for testing, and
  run in parallel.

After we have automated run/reporting in place with Jenkins, we can
start work on improving the quality of the functional tests.

- Jim

-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 554 bytes
Desc: OpenPGP digital signature
URL: <https://lists.ubuntu.com/archives/juju/attachments/20110824/7e4f6f26/attachment-0002.pgp>