Fwd: Next Release of Checkbox (Week #35 RC2) available in Testing PPA

Fri Aug 31 08:11:23 UTC 2018

I've just pushed a RC3 for checkbox-ng only (checkbox-ng - 1.2.0~rc3~ppa 
<https://code.launchpad.net/%7Echeckbox-dev/+archive/ubuntu/testing/+sourcepub/9371692/+listing-archive-extra>) 
to fix the following bug:

https://bugs.launchpad.net/checkbox-ng/+bug/1790050

Sylvain

-------- Forwarded Message --------
Subject: 	Next Release of Checkbox (Week #35 RC2) available in Testing PPA
Date: 	Wed, 29 Aug 2018 10:44:32 +0200
From: 	Sylvain Pineau <sylvain.pineau at canonical.com>
To: 	ce-certification-qa <ce-certification-qa at lists.canonical.com>, 
checkbox-devel at lists.ubuntu.com, hwcert-announce at lists.canonical.com

Hello all!

The next release of Checkbox (RC2) is available in the testing PPA:
https://code.launchpad.net/~checkbox-dev/+archive/testing
<https://code.launchpad.net/%7Echeckbox-dev/+archive/testing>

- checkbox-ng 1.2.0rc2
- checkbox-support 0.39.0rc2
- plainbox-provider-resource 0.38.0rc2
- plainbox-provider-checkbox 0.46.0rc2
- plainbox-provider-sru 1.12.0rc2
- plainbox-provider-tpm2 1.8.0rc2
- plainbox-provider-certification-client 0.35.0rc2
- plainbox-provider-certification-server 0.40.0rc2

Please help testing this version.

HIGHLIGHTS
==========

- New tpm2-tools for 18.04 based on upstream 3.0.4, bionic certification
test
   plan now includes the nested part: tpm2.0_3.0.4. Please check your
providers
   to upgrade from "tpm2.0" nested part (xenial version) to "tpm2.0_3.0.4".
- New checkbox-cli tp-export command to help creating test case guides from
   project test plans.
   See
https://checkbox.readthedocs.io/en/latest/using.html#checkbox-cli-tp-export

*Bug fixes*
https://goo.gl/QfHr59

*Changelog*

checkbox-ng:
RC2
+ add an option to input description when submitting
+ Add numerical progress indicator to remote execution
+ checkbox-cli: New subcommand to export a test plan as a XLSX document
+ providers:exporters: New tp-export exporter unit (based on xlsx)
+ exporter:xlsx: New OPTION_TEST_PLAN_EXPORT to create just one worksheet
+ docs: add output formatting explanation in the list-bootstrapped section
+ exporter: add test duration to the json rep.
+ remote: fix a timeout when doing local exports
+ remote: fix short timeout for calls from master to the slave
+ manifests: add optional prompt entry to unit
+ manifests: remove collection via zenitfy interface
+ plainbox-manifest-collect: check value of tr_prompt
+ plainbox-manifest-collect: indent json when dumped
+ result: strip ANSI color escape codes when reading logs
+ secure:launcher: remove reference to argparse's private func.
+ trusted-launcher: Generate after-suspend jobs from template jobs
+ vendor: update rpyc to 4.0.1 (py3.7 compat)
RC1
+ add clear-cache cli option
+ add --format to list-bootstrapped
+ add handling wrapper around SA's select_providers
+ add json exporter validation
+ add --version option to checkbox-cli
+ allow jobs to leave outcome info for auto-resume resolution
+ assistant: make run_job reentrant
+ checkbox-ng: autopep8 unused imports on checkbox-ng
+ checkbox-ng:restart: Don't use the systemd service unit on classic
+ ctrl: warn if can't access sudoers dir
+ docs: add chapter about Checkbox Remote
+ exporters:json: Add session title and job category names (instead of ids)
+ exporters: make html report snap-aware
+ fix and improve `list all-jobs` and `list-bootstrapped` subcmds
+ fix controller exiting after selcting tp
+ fix crash when resuming a session started with checkbox-cli run
+ Fix typo in remove-deb-core.txt
+ get rid of CheckBoxInvocationMixIn
+ jinja2: ensure <3.6 compatibility in validation
+ jinja2: make Jinja2SessionStateExporter.__init__ more pythonic
+ list-bootstrap: fill templates in id field
+ List test jobs only in the pie chart rather than all jobs
+ make preserve-locale the default behavior
+ migrate `checkbox-config` subcmd to checkbox_ng
+ migrate classes implementing 'run' to checkbox_ng
+ migrate get_os_release to packaging
+ migrate `startprovider` subcmd to checkbox_ng
+ Opportunistic cleanups on remote.py
+ plainbox: missing shlex import in packaging
+ plainbox: remove `dev analyze` subcmd
+ plainbox: remove `dev crash` subcmd
+ plainbox: remove `device` subcmd
+ plainbox: remove `dev list` subcmd
+ plainbox: remove `dev logtest` subcmd
+ plainbox: remove `dev special` subcmd
+ plainbox: remove script cmd
+ plainbox: remove `self-test` subcmd
+ po: update POTFILES.in
+ properly handle passwordless sudo from !classic snaps
+ remote: add option to abandon session from the master
+ remote: add server import from rpyc
+ remote: add support for interactive jobs
+ remote: add support for jobs with simple description (not the P/S/V trio)
+ remote: add terminate callback to Assistant2
+ remote: check if the remote API version match
+ remote: correct the remote-ends on interrupt screen
+ remote: exit gracefully when master doesn't select any TP
+ remote: fix master crashing when TP generated no tests to choose from
+ remote: fix running sessions with forced selections
+ remote: handle ctrl+c properly
+ remote: introduce the bootstrapped state
+ remote: make sudoprovider survive main loop break
+ remote: properly unlock session_change_lock
+ remote: rename SA2 to RemoteSessionAssistant
+ remote: rename service and controller to slave and master
+ remote: use TestsSelected state instead of Bootstrapped
+ remove standalone plainbox-qml-shell command
+ Seperate regular tests and the others in html report
+ session: optimize creation of throwaway session managers
+ subcommands: Load and call the socket module getaddrinfo
+ units: rename 'neuter-locale' flag to 'reset-locale'
+ units: rename 'neuter-locale' flag to 'reset-locale'
+ unit:testplan: Allow all automated jobs in bootstrap_include, not only
resources
+ unit:testplan: Store bootstrap job ids in a list to preserve ordering
+ Update html report session title description
+ urwid: add widget for handling ctrl+c interrupt
+ use try_selecting_providers in subcommands
+ version: add function reporting components' version
+ xlsx: fix typo in comment
+ xlsx: replace fugly magic numbers in write_systeminfo
+ xlsx: write checkbox version info

checkbox-support:
+ Add new category for SOCKETCAN interfaces
+ fwts: add securebootcert to the qa whitelist
+ parsers:pactl: Add support for empty properties (found in bionic pactl
1.11)
+ parsers:pactl: test update with pactl 1.11 sample
+ rollback change to get_udev_xhci_devices that was not necessary
+ Some devices (NVMe) return None for device_file in udev. This causes a
traceback. lp: #1770352

plainbox-provider-resource:
+ Ensure all jobs have a summary for display in gui
+ resource:fwts: Use executable.name to be snap-friendly
+ snapd_resource: Add status property to the snap fields
+ snapd_resource: Ignore KeyError when listing snaps

plainbox-provider-checkbox:
RC2
+ add multi-finger tap test for non-unity system
+ Add test for predictable network names
+ change detecting of Unity in 3/4 touchscreen tap test
+ fix skips of nvidia card switch on xenial
+ graphics: remove an extra 'without' in job def
+ Increase sleep delays in suspend_30_cycles
+ make cstates_results.log depend on cstates job
+ network: make timeout send KILL 1s after the initial timeout
+ network/predictable_names: Add _summary field
+ pm_test: add checking for hardware changes
+ pm_test: Only check fwts logs if suspends_before_reboot option is used
+ socketcan: add after-suspend flags and test plans
+ socketcan: ensure bitrate set before small pkt tests
+ socketcan: FD mode fixes to work with IXXAT driver
+ use hardware checking in 3 reboots with suspends tests
RC1
+ Add disk encryption test
+ Added new test to fail if a pre-release kernel or OS is in use.
+ add monitor tests to the after-suspend bunch
+ Add secure boot test for Ubuntu Core
+ Add summaries where missing to common jobs
+ add type-c -> hdmi and type-c -> vga jobs
+ add usb type-c to ethernet test
+ bin:cycle_vts: Add support for gdm virtual terminals
+ bin:disk_info: Add support for encrypted drives
+ bin: Enforce versions with gi.require_version in python3 scripts
+ bin:keyboard_test: Fix import/require order
+ camera: remove depends on obsolete gst 0.10
+ camera: remove legacy test, requires for ubuntucore
+ Changes to new check-prerelease script to make it less verbose on
success, as per Jeff's suggestion.
+ cpu: split arm vfp test between arch versions
+ Create socketcan category
+ Create socketcan tests
+ disk: import test-plans from p-p-snappy
+ disk_read_performance_test: Make the threshold configurable
+ Fixed bug caused by an unassigned variable. Also modified a test
failure message to make it a bit clearer.
+ graphics: Look for Xorg logs in $HOME on systems where X is running as
non root
+ make BT4 a blocker and BT3 non-blocker
+ Make ethernet hotplug tests cert blockers in networking-cert-manual
test plan
+ make forwarding xhci info easier
+ manage_compiz_plugin: Use dconf instead of gsettings
+ mark TB3 tests as blockers and legacy TB as non-bl.
+ Migrate ethernet jobs from p-p-s to p-p-c
+ Modified IPMI test based on discussions in Portland LP: #1775949
+ New Bluetooth LE test to check beacon measurement notifications
+ pm_test: fix crash on SUT with missing lightdm.conf
+ pm_test: introduce dry-run mode
+ pm_test: make jobs that use pm_test dry-run aware
+ pm_test: Unset LD_LIBRARY_PATH, PYTHONPATH and PYTHONHOME to start
system terminal
+ pm_test: verify that fwts suspended appropriate num. of times
+ Remove argv passing, neater argument check
+ Remove unnecessary use of regex
+ socketcan: modify category display name
+ stop testing for version in dmitest on servers lp: #1760632
+ suspend.pxu: fix the iperf test
+ units:disks: Ensure no bad chars in test summaries
+ units:mediacard.pxu: Add __on_ubuntucore__ jinja2 condition blocks
+ units:suspend.pxu: checkbox.ini -> checkbox.conf
+ units: update some requirements to use executable.name instead of
package.name
+ Use valid machine types in platform tests
+ wireless: Use executable resource in monitor_wireless_connection.* jobs
+ xrandr_cycle: fix testing of weird resolutions

plainbox-provider-sru:
RC2
+ remove memory/check job from test plans
RC1
+ add 802.11ac test cases to SRU test plan
+ Add remove-deb-base.txt for mk-env
+ Align SRU wifi tests by adding 802.11ac test cases to UC16 SRU test plan

plainbox-provider-tpm2:
RC2
+ tpm2 resource: s/tpm2.getcap/tpm2_getcap
RC1
+ Add tpm2-tools 3.0.4 integration tests and corresponding jobs/test plans
+ test_tpm2_getpubak.sh: Use tpm2_getpubak on UC and classic (thanks to
aliases)

plainbox-provider-certification-client:
+ New 18.04 Client Certification test plan
+ Depends on nux-tools

plainbox-provider-certification-server:
RC2
+ Added networking/predictable_names test to testplans
RC1
+ Add check-prerelease test for server test units.
+ Demoted optical drive tests from blocking to non-blocking in all
whitelists LP: #1775077

Cheers,

Sylvain Pineau