From sylvain.pineau at canonical.com Thu Sep 20 12:17:22 2018 From: sylvain.pineau at canonical.com (Sylvain Pineau) Date: Thu, 20 Sep 2018 14:17:22 +0200 Subject: New Checkbox release available in our Stable PPA! (2018-09-20) Message-ID: Hello all! A new release of Checkbox is available in the stable PPA: https://launchpad.net/~hardware-certification/+archive/ubuntu/public It includes a new version of the following components: - checkbox-ng 1.2 - checkbox-support 0.39.0 - plainbox-provider-resource 0.38.0 - plainbox-provider-checkbox 0.46.0 - plainbox-provider-sru 1.12.0 - plainbox-provider-tpm2 1.8.0 - plainbox-provider-certification-client 0.35.0 - plainbox-provider-certification-server 0.40.0 *HIGHLIGHTS* - New tpm2-tools for 18.04 based on upstream 3.0.4, bionic certification test   plan now includes the nested part: tpm2.0_3.0.4. Please check your providers   to upgrade from "tpm2.0" nested part (xenial version) to "tpm2.0_3.0.4". - New checkbox-cli tp-export command to help creating test case guides from   project test plans.   See https://checkbox.readthedocs.io/en/latest/using.html#checkbox-cli-tp-export *Bug fixes* https://goo.gl/igoxe8 *Changelog* checkbox-ng: + add an option to input description when submitting + Add numerical progress indicator to remote execution + checkbox-cli: New subcommand to export a test plan as a XLSX document + providers:exporters: New tp-export exporter unit (based on xlsx) + exporter:xlsx: New OPTION_TEST_PLAN_EXPORT to create just one worksheet + docs: add output formatting explanation in the list-bootstrapped section + exporter: add test duration to the json rep. + remote: fix a timeout when doing local exports + remote: fix short timeout for calls from master to the slave + manifests: add optional prompt entry to unit + manifests: remove collection via zenitfy interface + plainbox-manifest-collect: check value of tr_prompt + plainbox-manifest-collect: indent json when dumped + result: strip ANSI color escape codes when reading logs + secure:launcher: remove reference to argparse's private func. + trusted-launcher: Generate after-suspend jobs from template jobs + vendor: update rpyc to 4.0.1 (py3.7 compat) + add clear-cache cli option + add --format to list-bootstrapped + add handling wrapper around SA's select_providers + add json exporter validation + add --version option to checkbox-cli + allow jobs to leave outcome info for auto-resume resolution + assistant: make run_job reentrant + checkbox-ng: autopep8 unused imports on checkbox-ng + checkbox-ng:restart: Don't use the systemd service unit on classic + ctrl: warn if can't access sudoers dir + docs: add chapter about Checkbox Remote + exporters:json: Add session title and job category names (instead of ids) + exporters: make html report snap-aware + fix and improve `list all-jobs` and `list-bootstrapped` subcmds + fix controller exiting after selcting tp + fix crash when resuming a session started with checkbox-cli run + Fix typo in remove-deb-core.txt + get rid of CheckBoxInvocationMixIn + jinja2: ensure <3.6 compatibility in validation + jinja2: make Jinja2SessionStateExporter.__init__ more pythonic + list-bootstrap: fill templates in id field + List test jobs only in the pie chart rather than all jobs + make preserve-locale the default behavior + migrate `checkbox-config` subcmd to checkbox_ng + migrate classes implementing 'run' to checkbox_ng + migrate get_os_release to packaging + migrate `startprovider` subcmd to checkbox_ng + Opportunistic cleanups on remote.py + plainbox: missing shlex import in packaging + plainbox: remove `dev analyze` subcmd + plainbox: remove `dev crash` subcmd + plainbox: remove `device` subcmd + plainbox: remove `dev list` subcmd + plainbox: remove `dev logtest` subcmd + plainbox: remove `dev special` subcmd + plainbox: remove script cmd + plainbox: remove `self-test` subcmd + po: update POTFILES.in + properly handle passwordless sudo from !classic snaps + remote: add option to abandon session from the master + remote: add server import from rpyc + remote: add support for interactive jobs + remote: add support for jobs with simple description (not the P/S/V trio) + remote: add terminate callback to Assistant2 + remote: check if the remote API version match + remote: correct the remote-ends on interrupt screen + remote: exit gracefully when master doesn't select any TP + remote: fix master crashing when TP generated no tests to choose from + remote: fix running sessions with forced selections + remote: handle ctrl+c properly + remote: introduce the bootstrapped state + remote: make sudoprovider survive main loop break + remote: properly unlock session_change_lock + remote: rename SA2 to RemoteSessionAssistant + remote: rename service and controller to slave and master + remote: use TestsSelected state instead of Bootstrapped + remove standalone plainbox-qml-shell command + Seperate regular tests and the others in html report + session: optimize creation of throwaway session managers + subcommands: Load and call the socket module getaddrinfo + units: rename 'neuter-locale' flag to 'reset-locale' + units: rename 'neuter-locale' flag to 'reset-locale' + unit:testplan: Allow all automated jobs in bootstrap_include, not only resources + unit:testplan: Store bootstrap job ids in a list to preserve ordering + Update html report session title description + urwid: add widget for handling ctrl+c interrupt + use try_selecting_providers in subcommands + version: add function reporting components' version + xlsx: fix typo in comment + xlsx: replace fugly magic numbers in write_systeminfo + xlsx: write checkbox version info checkbox-support: + Add new category for SOCKETCAN interfaces + fwts: add securebootcert to the qa whitelist + parsers:pactl: Add support for empty properties (found in bionic pactl 1.11) + parsers:pactl: test update with pactl 1.11 sample + rollback change to get_udev_xhci_devices that was not necessary + Some devices (NVMe) return None for device_file in udev. This causes a traceback. lp: #1770352 plainbox-provider-resource: + Ensure all jobs have a summary for display in gui + resource:fwts: Use executable.name to be snap-friendly + snapd_resource: Add status property to the snap fields + snapd_resource: Ignore KeyError when listing snaps plainbox-provider-checkbox: + add multi-finger tap test for non-unity system + Add test for predictable network names + change detecting of Unity in 3/4 touchscreen tap test + fix skips of nvidia card switch on xenial + graphics: remove an extra 'without' in job def + Increase sleep delays in suspend_30_cycles + make cstates_results.log depend on cstates job + network: make timeout send KILL 1s after the initial timeout + network/predictable_names: Add _summary field + pm_test: add checking for hardware changes + pm_test: Only check fwts logs if suspends_before_reboot option is used + socketcan: add after-suspend flags and test plans + socketcan: ensure bitrate set before small pkt tests + socketcan: FD mode fixes to work with IXXAT driver + use hardware checking in 3 reboots with suspends tests + Add disk encryption test + Added new test to fail if a pre-release kernel or OS is in use. + add monitor tests to the after-suspend bunch + Add secure boot test for Ubuntu Core + Add summaries where missing to common jobs + add type-c -> hdmi and type-c -> vga jobs + add usb type-c to ethernet test + bin:cycle_vts: Add support for gdm virtual terminals + bin:disk_info: Add support for encrypted drives + bin: Enforce versions with gi.require_version in python3 scripts + bin:keyboard_test: Fix import/require order + camera: remove depends on obsolete gst 0.10 + camera: remove legacy test, requires for ubuntucore + Changes to new check-prerelease script to make it less verbose on success, as per Jeff's suggestion. + cpu: split arm vfp test between arch versions + Create socketcan category + Create socketcan tests + disk: import test-plans from p-p-snappy + disk_read_performance_test: Make the threshold configurable + Fixed bug caused by an unassigned variable. Also modified a test failure message to make it a bit clearer. + graphics: Look for Xorg logs in $HOME on systems where X is running as non root + make BT4 a blocker and BT3 non-blocker + Make ethernet hotplug tests cert blockers in networking-cert-manual test plan + make forwarding xhci info easier + manage_compiz_plugin: Use dconf instead of gsettings + mark TB3 tests as blockers and legacy TB as non-bl. + Migrate ethernet jobs from p-p-s to p-p-c + Modified IPMI test based on discussions in Portland LP: #1775949 + New Bluetooth LE test to check beacon measurement notifications + pm_test: fix crash on SUT with missing lightdm.conf + pm_test: introduce dry-run mode + pm_test: make jobs that use pm_test dry-run aware + pm_test: Unset LD_LIBRARY_PATH, PYTHONPATH and PYTHONHOME to start system terminal + pm_test: verify that fwts suspended appropriate num. of times + Remove argv passing, neater argument check + Remove unnecessary use of regex + socketcan: modify category display name + stop testing for version in dmitest on servers lp: #1760632 + suspend.pxu: fix the iperf test + units:disks: Ensure no bad chars in test summaries + units:mediacard.pxu: Add __on_ubuntucore__ jinja2 condition blocks + units:suspend.pxu: checkbox.ini -> checkbox.conf + units: update some requirements to use executable.name instead of package.name + Use valid machine types in platform tests + wireless: Use executable resource in monitor_wireless_connection.* jobs + xrandr_cycle: fix testing of weird resolutions plainbox-provider-sru: + remove memory/check job from test plans + add 802.11ac test cases to SRU test plan + Add remove-deb-base.txt for mk-env + Align SRU wifi tests by adding 802.11ac test cases to UC16 SRU test plan plainbox-provider-tpm2: + tpm2 resource: s/tpm2.getcap/tpm2_getcap + Add tpm2-tools 3.0.4 integration tests and corresponding jobs/test plans + test_tpm2_getpubak.sh: Use tpm2_getpubak on UC and classic (thanks to aliases) plainbox-provider-certification-client: + Only one suspend test for mono gpu systems + New 18.04 Client Certification test plan + Depends on nux-tools plainbox-provider-certification-server: + Added networking/predictable_names test to testplans + Add check-prerelease test for server test units. + Demoted optical drive tests from blocking to non-blocking in all whitelists LP: #1775077 Cheers, Sylvain Pineau