[Bug 1872863] Re: QEMU/KVM display is garbled when booting from kernel EFI stub due to missing bochs-drm module
Matthew Ruffell
1872863 at bugs.launchpad.net
Wed Apr 22 03:21:04 UTC 2020
I have verified that enabling the bochs-drm kernel module on bionic does
not cause any regressions for PowerKVM machines when the video device is
VGA=std.
TLDR: See Screenshot:
https://launchpadlibrarian.net/475658598/Screenshot%20from%202020-04-22%2015-14-13.png
This is in response to the main cause of regression concern, LP
#1378648, which got bochs-drm disabled in the first place, on yakkety.
On Christian's advice, I created a ppc64el instance on Canonistack, with
the m1.medium flavor and c8c120bd-3d55-4e2d-8cc5-93039a62524f image
(ubuntu/ubuntu-bionic-18.04-ppc64el-server-20200407-disk1.img).
>From there, I installed the KVM packages and a xfce4 desktop, and got
xrdp working. I then installed virt-manager.
I modprobed the kvm_pr kernel module on my instance to enable nested kvm
on ppc64el.
>From there, I installed Ubuntu 18.04.4 Server ppc64el, using virt-
manager. The "Machine Type" was pseries-2.12, and the Video Model was
set to "VGA" [1].
[1]:
https://launchpadlibrarian.net/475658622/Screenshot%20from%202020-04-22%2015-14-04.png
Upon booting, the system was using the Open Firmware frame buffer:
[ 0.888072] Using unsupported 800x600 vga at 200081000000, depth=32, pitch=3200
[ 0.890480] Console: switching to colour frame buffer device 100x37
[ 0.892181] fb0: Open Firmware frame buffer device on /pci at 800000020000000/vga at 6
$ cat /proc/fb
0 OFfb vga
Which is what LP #1378648 wanted.
I then enabled my ppa where my test packages were built:
https://launchpad.net/~mruffell/+archive/ubuntu/sf272653-test
and installed new kmod and 4.15.0-96-generic test builds with bochs-drm
enabled in the kernel config, and removed from the kmod blacklist.
I then rebooted, and found that system boots successfully, and does not
get hung up at the bug in LP #1378648, indicating that it has been fixed
before 4.15.
I checked "lsmod" and bochs-drm has been loaded, and looking at dmesg,
initially the Open Firmware frame buffer device is used, and later in
the boot, bochs-drm is loaded, and takes over the frame buffer.
See screenshot [2] for proof that bochs-drm is running and functions
correctly in virt-manager.
[2]:
https://launchpadlibrarian.net/475658598/Screenshot%20from%202020-04-22%2015-14-13.png
A complete dmesg from this boot can be found here [3].
[3] https://paste.ubuntu.com/p/Q8V7fKnRzz/
Interesting parts:
[ 0.893046] Using unsupported 800x600 vga at 200081000000, depth=32, pitch=3200
[ 0.895482] Console: switching to colour frame buffer device 100x37
[ 0.897270] fb0: Open Firmware frame buffer device on /pci at 800000020000000/vga at 6
...
[ 2.041835] checking generic (200081000000 1d4c00) vs hw (200081000000 1000000)
[ 2.041836] fb: switching to bochsdrmfb from OFfb vga
[ 2.042568] Console: switching to colour dummy device 80x25
[ 2.045581] [drm] Found bochs VGA, ID 0xb0c5.
[ 2.046100] [drm] Framebuffer size 16384 kB @ 0x200081000000, mmio @ 0x200082000000.
[ 2.058141] [TTM] Zone kernel: Available graphics memory: 504512 kiB
[ 2.058883] [TTM] Initializing pool allocator
[ 2.059372] [TTM] Initializing DMA pool allocator
[ 2.074890] Console: switching to colour frame buffer device 128x48
[ 2.089805] bochs-drm 0000:00:06.0: fb0: bochsdrmfb frame buffer device
[ 2.090549] [drm] Initialized bochs-drm 1.0.0 20130925 for 0000:00:06.0 on minor 0
$ cat /proc/fb
0 bochsdrmfb
With good dmesg outputs, and positive test results in virt-manager, I am
happy to say that enabling bochs-drm will not cause any regressions on
ppc64el, and with that, I hope it satisfies your request for testing.
--
You received this bug notification because you are a member of Ubuntu
Foundations Bugs, which is subscribed to kmod in Ubuntu.
https://bugs.launchpad.net/bugs/1872863
Title:
QEMU/KVM display is garbled when booting from kernel EFI stub due to
missing bochs-drm module
Status in kmod package in Ubuntu:
Fix Released
Status in linux package in Ubuntu:
Fix Released
Status in kmod source package in Bionic:
In Progress
Status in linux source package in Bionic:
In Progress
Bug description:
BugLink: https://bugs.launchpad.net/bugs/1872863
[Impact]
A recent grub2 SRU, LP #1864533, now forces the kernel to boot via the
kernel EFI stub whenever EFI is enabled. This causes problems for
QEMU/KVM virtual machines which use the VGA=std video device, as the
efifb driver yields an unreadable garbled screen. See the attached
image.
The correct framebuffer driver to use in this situation is bochs-drm,
and modprobing it from a HWE kernel fixes the issues.
bochs-drm is missing from Bionic since CONFIG_DRM_BOCHS was disabled
in LP #1378648 due to bochs-drm causing problems in a PowerKVM
machine. This problem appears to be fixed now, and bochs-drm has been
re-enabled for Disco and up, in LP #1795857 and has been proven safe.
This has also come up again in LP #1823152, as well as chatter on LP
#1795857 to get this enabled on Bionic.
The customer which is experiencing this issue cannot switch to VGA=qxl
as a workaround, and must use VGA=std, hence I suggest we re-enable
bochs-drm for Bionic.
[Fix]
I noticed on Focal, if you boot, the framebuffer is initially efifb:
[ 0.603716] efifb: probing for efifb
[ 0.603733] efifb: framebuffer at 0xc0000000, using 1876k, total 1875k
[ 0.603735] efifb: mode is 800x600x32, linelength=3200, pages=1
[ 0.603736] efifb: scrolling: redraw
[ 0.603738] efifb: Truecolor: size=8:8:8:8, shift=24:16:8:0
[ 0.604462] Console: switching to colour frame buffer device 100x37
[ 0.605829] fb0: EFI VGA frame buffer device
This soon changes to bochs-drm about a second later:
[ 0.935988] bochs-drm 0000:00:01.0: remove_conflicting_pci_framebuffers: bar 0: 0xc0000000 -> 0xc0ffffff
[ 0.937023] bochs-drm 0000:00:01.0: remove_conflicting_pci_framebuffers: bar 2: 0xc1c8c000 -> 0xc1c8cfff
[ 0.937776] checking generic (c0000000 1d5000) vs hw (c0000000 1000000)
[ 0.937776] fb0: switching to bochsdrmfb from EFI VGA
[ 0.939085] Console: switching to colour dummy device 80x25
[ 0.939117] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console
[ 0.939210] [drm] Found bochs VGA, ID 0xb0c5.
[ 0.939212] [drm] Framebuffer size 16384 kB @ 0xc0000000, mmio @ 0xc1c8c000.
[ 0.941955] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized
[ 0.942069] [TTM] Zone kernel: Available graphics memory: 2006780 KiB
[ 0.942081] [TTM] Initializing pool allocator
[ 0.942089] [TTM] Initializing DMA pool allocator
[ 0.943026] virtio_blk virtio2: [vda] 20971520 512-byte logical blocks (10.7 GB/10.0 GiB)
[ 0.944019] [drm] Found EDID data blob.
[ 0.944162] [drm] Initialized bochs-drm 1.0.0 20130925 for 0000:00:01.0 on minor 0
[ 0.944979] fbcon: bochs-drmdrmfb (fb0) is primary device
[ 0.947712] Console: switching to colour frame buffer device 128x48
On bionic, the framebuffer never changes from efifb, since the bochs-
drm kernel module is not built, and it is also present on the module
banlist in /etc/modprobe.d/blacklist-framebuffer.conf
bochs-drm needs to be enabled to be built in the kernel config, and
removed from the module blacklist in kmod.
[Testcase]
Create a new QEMU/KVM virtual machine, I used virt-manager. Before you
install the OS, check the box to modify settings before install. In
the "Overview" tab, enable EFI by setting the firmware to "UEFI
x86_64: /usr/share/OVMF/OVMF_CODE.secboot.fd".
Set the video device to qxl while you install Bionic. Once the install
is done, reboot, do a "apt update" and "apt upgrade", to ensure you
have grub2 2.02-2ubuntu8.15 installed.
Shut the VM down, and set the video device to VGA. Or VGA=std if you
use the QEMU command line.
Start the VM up, and the screen will be garbled. See attached picture.
If you install my test packages, which are available here:
https://launchpad.net/~mruffell/+archive/ubuntu/sf272653-test
Instructions to install (on a bionic system):
1) sudo add-apt-repository ppa:mruffell/sf272653-test
2) sudo apt-get update
3) sudo apt install linux-image-unsigned-4.15.0-96-generic linux-modules-4.15.0-96-generic linux-modules-extra-4.15.0-96-generic linux-headers-4.15.0-96-generic linux-headers-4.15.0-96 libkmod2 kmod
4) sudo reboot
5) uname -rv
4.15.0-96-generic #97+TEST272653v20200409b1-Ubuntu SMP Thu Apr 9 04:09:18 UTC 2020
If you reboot, the screen will be perfectly readable, since the bochs-
drm driver will be in use.
[Regression Potential]
We are enabling a display driver on Bionic which was previously
disabled, so there will be some virtual machines making the jump to
using bochs-drm since it would now be available.
I don't think that this is a bad thing, and in many ways will probably
end up improving some user's experience. Although there are two
scenarios where a regression could happen:
1 - frequently gamers use GPU passthrough to their kvm based virtual
machines, and I have seen them expect, or hardcode their kernel
command lines to use the efifb driver. I actually find this strange,
as if you read the kernel documentation, the efifb driver is meant for
Apple Macintosh computers only:
https://www.kernel.org/doc/html/latest/fb/efifb.html Since most gamers
have to jump through a lot of hoops to get GPU passthrough working,
and most have moved on from Bionic, I don't expect this to be a
problem.
2 - if the bug with PowerKVM machines isn't actually fixed in Bionic,
it will cause a regression on POWER. We just need to test this on
POWER and ensure that the bug in LP #1378648 was fixed. If not, then
we could just disable bochs-drm on POWER, leaving it enabled for all
other archs.
To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/kmod/+bug/1872863/+subscriptions
More information about the foundations-bugs
mailing list