<div dir="ltr"><div class="gmail_quote"><div dir="ltr"><div>Hello folks!<br><br></div>A new version of the Checkbox stack is available in our Stable PPA:<br><br><a href="https://launchpad.net/~hardware-certification/+archive/ubuntu/public" target="_blank">https://launchpad.net/~hardware-certification/+archive/ubuntu/public</a><br><div><div><br></div><div>t includes the following components:<br><ul><li>checkbox-converged 1.2.5</li><li>checkbox-ng 0.24</li><li>plainbox-provider-resource-generic 0.24</li><li>checkbox-support-stable 0.24</li><li>plainbox-provider-checkbox 0.26</li><li>plainbox 0.26</li><li>plainbox-provider-sru 1.1</li><li>plainbox-provider-certification 0.23</li></ul><br><div class="gmail_quote"><b><font size="4">New Features</font></b><br><br></div><div class="gmail_quote"><b>Migration from local jobs to template units</b><br></div><div class="gmail_quote">This will have an impact on your job if you use a provider or a test plan that was based on local jobs (which is very likely).<br></div><div class="gmail_quote"><span style="color:rgb(204,0,0)"><u>You need to adapt your test plans.</u></span> The <a href="http://plainbox.readthedocs.org/en/latest/manpages/plainbox-template-units.html">plainbox documentation</a> will provide more information.<br><br></div><div class="gmail_quote"><b>New launcher system</b><br></div><div class="gmail_quote">A new launcher system has been developed to be compatible with the template units.<br></div><div class="gmail_quote">A <a href="http://checkbox.readthedocs.org/en/latest/launcher-tutorial.html" target="_blank">tutorial</a> is available to help you writing your new launchers.<br></div><div class="gmail_quote"><span style="color:rgb(204,0,0)"><u>Please update your launchers to use the new system</u></span>,
as the previous launchers are incompatible with template units and may
cause your test plans not being executed properly! Again, the
Certification team is here to help so don't hesitate to ask if you have
any question.<br></div><div class="gmail_quote"><br><b>Better support for devices with NVMe/eMMC drives</b><br></div><div>The heuristics used by <span>Checkbox</span>
to discover NVMe and eMMC drives has been updated. Previously, NVMe or
eMMC drives were often recognized as SD cards which caused problems when
testing. This should be resolved now.<br><br><b>Keyboard shortcut to toggle jobs IDs/summaries in checkbox-cli</b><br>We added a
little feature that can be useful for people who are used to job IDs
instead of job summaries.<br></div><div class="gmail_quote"><div>When using <span>checkbox</span>-cli, you can now switch between job summaries and job IDs by pressing <i>“<b>i</b>”</i> in the job selection screen.<br></div><div>By doing so, this:<br><span style="font-family:monospace,monospace"> Test that video can be displayed with Advanced Micro Devices, Inc. [AMD/ATI] Opal PRO [Radeon R7 M260]</span><br></div><div>will turn into this:<br><span style="font-family:monospace,monospace"> graphics/2_video_Opal_PRO__</span><span style="font-family:monospace,monospace">Radeon_R7_M260_</span><br></div><div><br><br>We also <b>fixed</b> <b>a lot of issues</b> (more than 50!) since the previous release (see below for complete changelog).<br><br></div><div>Thanks!<br><br></div><br></div><b><font size="4">Complete Changelog</font></b><br><br>Next Generation <span>Checkbox</span> (CLI)<br>-------------------------------<br>* 1543162 - Traceback when finishing a test run on s390x <<a href="http://pad.lv/1543162" target="_blank">pad.lv/1543162</a>><br>* 1536045 - Unable to run <span>checkbox</span>-cli2 on Trusty <<a href="http://pad.lv/1536045" target="_blank">pad.lv/1536045</a>><br>* 1528516 - Confusion in hardware-id vs. secure-id <<a href="http://pad.lv/1528516" target="_blank">pad.lv/1528516</a>><br>* 1423949 - Ugly terminal code "decorations" in canonical-certification-server <<a href="http://pad.lv/1423949" target="_blank">pad.lv/1423949</a>><br>* 1392124 - Initially, the tree of available jobs should start collapsed <<a href="http://pad.lv/1392124" target="_blank">pad.lv/1392124</a>><br>*
1556337 - canonical-certification-server ignores secure_id set in
canonical-certification.conf; crashes when no entry given <<a href="http://pad.lv/1556337" target="_blank">pad.lv/1556337</a>><br>* 1558126 - write submission files to a secondary location <<a href="http://pad.lv/1558126" target="_blank">pad.lv/1558126</a>><br>* 1553872 - Add an extra argument (or a keyboard shortcut) to show job id instead of summary <<a href="http://pad.lv/1553872" target="_blank">pad.lv/1553872</a>><br>* 1555578 - Job definition displayed even if dependencies are not met <<a href="http://pad.lv/1555578" target="_blank">pad.lv/1555578</a>><br>* 1555233 - Empty rerun screen <<a href="http://pad.lv/1555233" target="_blank">pad.lv/1555233</a>><br><br>PlainBox (Toolkit)<br>-------------------<br>* 1552748 - KeyError while processing pointing template jobs <<a href="http://pad.lv/1552748" target="_blank">pad.lv/1552748</a>><br>* 1439500 - Submission processing failed on C3 with manually exported submission file <<a href="http://pad.lv/1439500" target="_blank">pad.lv/1439500</a>><br>* 1402612 - xlsx exporter crashes on non-perfect package resource data <<a href="http://pad.lv/1402612" target="_blank">pad.lv/1402612</a>><br><br><span>Checkbox</span> Provider for PlainBox<br>-------------------------------<br>* 1552503 - Some fwts critical/high errors are not accounted for in plainbox results <<a href="http://pad.lv/1552503" target="_blank">pad.lv/1552503</a>><br>* 1548539 - <span>Checkbox</span> Test: Verify KVM VM boots Failed on arm64 <<a href="http://pad.lv/1548539" target="_blank">pad.lv/1548539</a>><br>* 1545762 - need more info in ethernet/detect <<a href="http://pad.lv/1545762" target="_blank">pad.lv/1545762</a>><br>* 1542243 - Touchpad tests are broken since 15.04 <<a href="http://pad.lv/1542243" target="_blank">pad.lv/1542243</a>><br>* 1503677 - key_test crashed with IndexError in on_key(): list index out of range <<a href="http://pad.lv/1503677" target="_blank">pad.lv/1503677</a>><br>* 1536926 - screenshot_validation job will fail with sample picture missing error <<a href="http://pad.lv/1536926" target="_blank">pad.lv/1536926</a>><br>* 1536888 - suspend_30_cycles_with_reboots test failed <<a href="http://pad.lv/1536888" target="_blank">pad.lv/1536888</a>><br>* 1533718 - SMART test doesn't work on RAID devices <<a href="http://pad.lv/1533718" target="_blank">pad.lv/1533718</a>><br>* 1528426 - Test case 'disk/detect' is always failed for NVMe disk. <<a href="http://pad.lv/1528426" target="_blank">pad.lv/1528426</a>><br>* 1527154 - wirelesswireless_connection_* shows errors: extra argument <<a href="http://pad.lv/1527154" target="_blank">pad.lv/1527154</a>><br>* 1522128 - Traceback in disk/detect when disk has "Unknown" in it's data <<a href="http://pad.lv/1522128" target="_blank">pad.lv/1522128</a>><br>*
1431605 - memory_compare crashed with subprocess.CalledProcessError in
check_output(): Command '['lshw', '-json']' returned non-zero exit
status -6 <<a href="http://pad.lv/1431605" target="_blank">pad.lv/1431605</a>><br>* 1475539 - screenshot_opencv_validation.jpg won't be attached if the opencv job failed <<a href="http://pad.lv/1475539" target="_blank">pad.lv/1475539</a>><br>* 1469979 - Dependency for attachment job seems not working <<a href="http://pad.lv/1469979" target="_blank">pad.lv/1469979</a>><br>* 1458462 - SD/SDHC storage_test fails (system with eMMC) <<a href="http://pad.lv/1458462" target="_blank">pad.lv/1458462</a>><br>* 1441415 - Convert local job into templates to improve readability <<a href="http://pad.lv/1441415" target="_blank">pad.lv/1441415</a>><br>* 1333300 - pactl parser chokes on pactl list sinks from phablet (nexus 7) <<a href="http://pad.lv/1333300" target="_blank">pad.lv/1333300</a>><br>* 1328481 - duplicate jobs generated for CD/DVD/BD devices <<a href="http://pad.lv/1328481" target="_blank">pad.lv/1328481</a>><br>* 1078884 - camera_test has missing dependencies <<a href="http://pad.lv/1078884" target="_blank">pad.lv/1078884</a>><br>* 1543182 - fwts based tests fail to run on s390x as there is no build of fwts for that arch <<a href="http://pad.lv/1543182" target="_blank">pad.lv/1543182</a>><br>* 1535506 - Description confusion for miscellanea/remote_dedicated_ipmi <<a href="http://pad.lv/1535506" target="_blank">pad.lv/1535506</a>><br>* 1543287 - cpu_toplogy does not run on s390 <<a href="http://pad.lv/1543287" target="_blank">pad.lv/1543287</a>><br>* 1525009 - memory_compare fails on ARM due to different lshw output <<a href="http://pad.lv/1525009" target="_blank">pad.lv/1525009</a>><br><br>Canonical Certification Provider for PlainBox<br>----------------------------------------------<br>* 1554577 - Unable to install canonical-certification-server in Xenial because of dependency problems <<a href="http://pad.lv/1554577" target="_blank">pad.lv/1554577</a>><br>* 1543627 - virtualization/kvm_check_vm test fails in Xenial because of missing genisoimage <<a href="http://pad.lv/1543627" target="_blank">pad.lv/1543627</a>><br>* 1536560 - Test plans need to be updated with template migration <<a href="http://pad.lv/1536560" target="_blank">pad.lv/1536560</a>><br>* 1521939 - To set test case "firmware/no_ACPI_REV_interface" a non-blocker <<a href="http://pad.lv/1521939" target="_blank">pad.lv/1521939</a>><br>* 1276832 - installing canonical-certification-server pulls in mysql, 159Mb of pkgs <<a href="http://pad.lv/1276832" target="_blank">pad.lv/1276832</a>><br>* 1260468 - canonical-certification-server has a lot of unnecessary (possibly) dependencies pulled in. <<a href="http://pad.lv/1260468" target="_blank">pad.lv/1260468</a>><br>* 1555927 - Empty test list in canonical-certification-client of dailybuild ppa <<a href="http://pad.lv/1555927" target="_blank">pad.lv/1555927</a>><br>* 1554818 - Empty test list in canonical-certification-server <<a href="http://pad.lv/1554818" target="_blank">pad.lv/1554818</a>><br>* 1555776 - Flat test list with missing tests when canonical-certification-server is run <<a href="http://pad.lv/1555776" target="_blank">pad.lv/1555776</a>><br>* 1554628 - p-p-c-s missing all the whitelists <<a href="http://pad.lv/1554628" target="_blank">pad.lv/1554628</a>><br><br><span>Checkbox</span> Converged<br>-------------------<br>* 1493469 - Mandatory Tests need UI design <<a href="http://pad.lv/1493469" target="_blank">pad.lv/1493469</a>><br>* 1492234 - Problems in qml-native tests -> Record video <<a href="http://pad.lv/1492234" target="_blank">pad.lv/1492234</a>><br>* 1397109 - The app never removes old sessions data in ~/.cache/<app-name> <<a href="http://pad.lv/1397109" target="_blank">pad.lv/1397109</a>><br><br><span>Checkbox</span> Support Library<br>-------------------------<br>* 1539041 - [mini-ci] ValidationError and KeyError <<a href="http://pad.lv/1539041" target="_blank">pad.lv/1539041</a>><br>* 1522768 - disk/detect fails and disk-related tests are skipped on eMMC unit <<a href="http://pad.lv/1522768" target="_blank">pad.lv/1522768</a>><br>* 1511254 - audio_settings script will raise "Expected end of text" in pyparsing.py <<a href="http://pad.lv/1511254" target="_blank">pad.lv/1511254</a>><br>* 1450113 - SubmissionParser crashes on empty <property> <<a href="http://pad.lv/1450113" target="_blank">pad.lv/1450113</a>><br>* 1308702 - udev parser could be a bit smarter about known items that lead to false test failures <<a href="http://pad.lv/1308702" target="_blank">pad.lv/1308702</a>><br><br>Resource Provider for PlainBox<br>-------------------------------<br>* 1545929 - graphics_card resource job will crash on Precise <<a href="http://pad.lv/1545929" target="_blank">pad.lv/1545929</a>><br>
<br><br>
Cheers,<span class="HOEnZb"><font color="#888888"><br clear="all"><br></font></span></div></div></div>
</div><br>-- <br><div class="gmail_signature"><div dir="ltr"><div><div dir="ltr"><span style="color:rgb(102,102,102)">Pierre Equoy<br>QA & Certification Engineer | Canonical<br><a href="http://www.canonical.com" target="_blank">www.canonical.com</a> | <a href="http://www.ubuntu.com" target="_blank">www.ubuntu.com</a></span></div></div></div></div>
</div>