About dep-8-tests

[Yolanda Robla]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Hi
In server team we have been working in adding dep-8-tests in several
packages:
https://blueprints.launchpad.net/ubuntu/+spec/servercloud-s-seeded-qa-workflow

That will improve QA because every time a new package version is
pushed, or some dependency changes, tests will be run and will make
sure that packages are still working correctly.

But we are finding some conflicts in that process. For the following
packages:puppet, open-iscsi, solr-tomcat, exim4, mailman, squid,
vsftpd, backuppc, lxc, snmp, freeradius...

it will be useful to reuse the tests that are already in QRT branches:
https://code.launchpad.net/~ubuntu-bugcontrol/qa-regression-testing/master

As they are providing the same functionality that we need. This leads
to the problem of code duplication, because the tests will be
duplicated in QRT branch and package branch, that will make that more
difficult to maintain.

We are also neededing to copy testlib.py file
along all the tests. Packaging testlib.py and using that as a depends
should be the cleanest option, but this code is not thought to be
production code and is not 100% guaranteed. Should we package it or
find another alternatives? - also these tests need to go to Debian, so
in the solution we find we need to consider it -

Also there is the problem with UTAH tests. If security team is working
on some UTAH tests we should discuss the way to integrate them with
dep-8-tests.

Finally there is another issue with older releases. If some package in
saucy has dep-8-tests, and the precise version doesn't have it, how
should we act? How can these tests be run, maybe we should backport them?

So i think we should have a discussion about these topics and find the
best way to deal with them.

Best
Yolanda
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.12 (GNU/Linux)
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/

iQEcBAEBAgAGBQJRm4QzAAoJEHui+4jWFHJLsWIIAIigMEx8DnfYui7doYNsdmVX
A7mJyv3UM7eYC2PIjO96ik5JOc9CmqzlwinHrqEwkhym/m3MptX7qsEJDf2CrJov
PBKNTwUdcljqdBtOCnOkpww7O2/R+7r5Jat34x/ewQNa1xgWAawCtjrwVrWl1Bpc
qf2z7rBtcLf2S9zQpqbfmReBEH4Z3aysz0KlLCgcChr6Z43aGnUSPaIHtffYqrKU
FFzJ88THE0KtWrzqbzUTdY7IoP8syEt8rl+tpCZE/t3LIZ96QBLJ6SewDM7Ar9ny
NK7GGcc3UJ8JmAC098XYRngi+pSM6NqETYdX+v1TAVTqVg7u+BCivjdcyNTJv7Q=
=J4kA
-----END PGP SIGNATURE-----