New Checkbox release available in our Stable PPA! (2016-03-21)

Pierre Equoy pierre.equoy at canonical.com
Mon Mar 21 06:56:38 UTC 2016 

Hello folks!

A new version of the Checkbox stack is available in our Stable PPA:

https://launchpad.net/~hardware-certification/+archive/ubuntu/public

t includes the following components:

   - checkbox-converged 1.2.5
   - checkbox-ng 0.24
   - plainbox-provider-resource-generic 0.24
   - checkbox-support-stable 0.24
   - plainbox-provider-checkbox 0.26
   - plainbox 0.26
   - plainbox-provider-sru 1.1
   - plainbox-provider-certification 0.23


*New Features*

*Migration from local jobs to template units*
This will have an impact on your job if you use a provider or a test plan
that was based on local jobs (which is very likely).
*You need to adapt your test plans.* The plainbox documentation
<http://plainbox.readthedocs.org/en/latest/manpages/plainbox-template-units.html>
will provide more information.

*New launcher system*
A new launcher system has been developed to be compatible with the template
units.
A tutorial
<http://checkbox.readthedocs.org/en/latest/launcher-tutorial.html> is
available to help you writing your new launchers.
*Please update your launchers to use the new system*, as the previous
launchers are incompatible with template units and may cause your test
plans not being executed properly! Again, the Certification team is here to
help so don't hesitate to ask if you have any question.

*Better support for devices with NVMe/eMMC drives*
The heuristics used by Checkbox to discover NVMe and eMMC drives has been
updated. Previously, NVMe or eMMC drives were often recognized as SD cards
which caused problems when testing. This should be resolved now.

*Keyboard shortcut to toggle jobs IDs/summaries in checkbox-cli*
We added a little feature that can be useful for people who are used to job
IDs instead of job summaries.
When using checkbox-cli, you can now switch between job summaries and job
IDs by pressing *“i”* in the job selection screen.
By doing so, this:
    Test that video can be displayed with Advanced Micro Devices, Inc.
[AMD/ATI] Opal PRO [Radeon R7 M260]
will turn into this:
    graphics/2_video_Opal_PRO__Radeon_R7_M260_


We also *fixed* *a lot of issues* (more than 50!) since the previous
release (see below for complete changelog).

Thanks!


*Complete Changelog*

Next Generation Checkbox (CLI)
-------------------------------
* 1543162 - Traceback when finishing a test run on s390x <pad.lv/1543162>
* 1536045 - Unable to run checkbox-cli2 on Trusty <pad.lv/1536045>
* 1528516 - Confusion in hardware-id vs. secure-id <pad.lv/1528516>
* 1423949 - Ugly terminal code "decorations" in
canonical-certification-server <pad.lv/1423949>
* 1392124 - Initially, the tree of available jobs should start collapsed <
pad.lv/1392124>
* 1556337 - canonical-certification-server ignores secure_id set in
canonical-certification.conf; crashes when no entry given <pad.lv/1556337>
* 1558126 - write submission files to a secondary location <pad.lv/1558126>
* 1553872 - Add an extra argument (or a keyboard shortcut) to show job id
instead of summary <pad.lv/1553872>
* 1555578 - Job definition displayed even if dependencies are not met <
pad.lv/1555578>
* 1555233 - Empty rerun screen <pad.lv/1555233>

PlainBox (Toolkit)
-------------------
* 1552748 - KeyError while processing pointing template jobs <pad.lv/1552748
>
* 1439500 - Submission processing failed on C3 with manually exported
submission file <pad.lv/1439500>
* 1402612 - xlsx exporter crashes on non-perfect package resource data <
pad.lv/1402612>

Checkbox Provider for PlainBox
-------------------------------
* 1552503 - Some fwts critical/high errors are not accounted for in
plainbox results <pad.lv/1552503>
* 1548539 - Checkbox Test: Verify KVM VM boots Failed on arm64 <
pad.lv/1548539>
* 1545762 - need more info in ethernet/detect <pad.lv/1545762>
* 1542243 - Touchpad tests are broken since 15.04 <pad.lv/1542243>
* 1503677 - key_test crashed with IndexError in on_key(): list index out of
range <pad.lv/1503677>
* 1536926 - screenshot_validation job will fail with sample picture missing
error <pad.lv/1536926>
* 1536888 - suspend_30_cycles_with_reboots test failed <pad.lv/1536888>
* 1533718 - SMART test doesn't work on RAID devices <pad.lv/1533718>
* 1528426 - Test case 'disk/detect' is always failed for NVMe disk. <
pad.lv/1528426>
* 1527154 - wirelesswireless_connection_* shows errors: extra argument <
pad.lv/1527154>
* 1522128 - Traceback in disk/detect when disk has "Unknown" in it's data <
pad.lv/1522128>
* 1431605 - memory_compare crashed with subprocess.CalledProcessError in
check_output(): Command '['lshw', '-json']' returned non-zero exit status
-6 <pad.lv/1431605>
* 1475539 - screenshot_opencv_validation.jpg won't be attached if the
opencv job failed <pad.lv/1475539>
* 1469979 - Dependency for attachment job seems not working <pad.lv/1469979>
* 1458462 - SD/SDHC storage_test fails  (system with eMMC) <pad.lv/1458462>
* 1441415 - Convert local job into templates to improve readability <
pad.lv/1441415>
* 1333300 - pactl parser chokes on pactl list sinks from phablet (nexus 7) <
pad.lv/1333300>
* 1328481 - duplicate jobs generated for CD/DVD/BD devices <pad.lv/1328481>
* 1078884 - camera_test has missing dependencies <pad.lv/1078884>
* 1543182 - fwts based tests fail to run on s390x as there is no build of
fwts for that arch <pad.lv/1543182>
* 1535506 - Description confusion for miscellanea/remote_dedicated_ipmi <
pad.lv/1535506>
* 1543287 - cpu_toplogy does not run on s390 <pad.lv/1543287>
* 1525009 - memory_compare fails on ARM due to different lshw output <
pad.lv/1525009>

Canonical Certification Provider for PlainBox
----------------------------------------------
* 1554577 - Unable to install canonical-certification-server in Xenial
because of dependency problems <pad.lv/1554577>
* 1543627 - virtualization/kvm_check_vm test fails in Xenial because of
missing genisoimage <pad.lv/1543627>
* 1536560 - Test plans need to be updated with template migration <
pad.lv/1536560>
* 1521939 - To set test case "firmware/no_ACPI_REV_interface" a non-blocker
<pad.lv/1521939>
* 1276832 - installing canonical-certification-server pulls in mysql, 159Mb
of pkgs <pad.lv/1276832>
* 1260468 - canonical-certification-server has a lot of unnecessary
(possibly) dependencies pulled in. <pad.lv/1260468>
* 1555927 - Empty test list in canonical-certification-client of dailybuild
ppa <pad.lv/1555927>
* 1554818 - Empty test list in canonical-certification-server <
pad.lv/1554818>
* 1555776 - Flat test list with missing tests when
canonical-certification-server is run <pad.lv/1555776>
* 1554628 - p-p-c-s missing all the whitelists <pad.lv/1554628>

Checkbox Converged
-------------------
* 1493469 - Mandatory Tests need UI design <pad.lv/1493469>
* 1492234 - Problems in qml-native tests -> Record video <pad.lv/1492234>
* 1397109 - The app never removes old sessions data in ~/.cache/<app-name> <
pad.lv/1397109>

Checkbox Support Library
-------------------------
* 1539041 - [mini-ci] ValidationError and KeyError <pad.lv/1539041>
* 1522768 - disk/detect fails and disk-related tests are skipped on eMMC
unit <pad.lv/1522768>
* 1511254 - audio_settings script will raise "Expected end of text" in
pyparsing.py <pad.lv/1511254>
* 1450113 - SubmissionParser crashes on empty <property> <pad.lv/1450113>
* 1308702 - udev parser could be a bit smarter about known items that lead
to false test failures <pad.lv/1308702>

Resource Provider for PlainBox
-------------------------------
* 1545929 - graphics_card resource job will crash on Precise <pad.lv/1545929
>


Cheers,


-- 
Pierre Equoy
QA & Certification Engineer | Canonical
www.canonical.com | www.ubuntu.com
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.ubuntu.com/archives/checkbox-devel/attachments/20160321/21f9b338/attachment.html>

More information about the Checkbox-devel mailing list