[Bug 1455268] Re: update-grub (grub-probe) during package installation on Cisco UCS B260 servers - Precise deployment fails with hwe-t kernel

Wed Jul 1 17:30:15 UTC 2015

Thanks.  From the fs log (fs/process_dump.12751):

16:17:43 open("/dev/sdb", O_RDONLY|O_SYNC) = 4
16:17:43 lseek(4, 0, SEEK_SET)          = 0
16:17:43 read(4, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 512) = 512
16:17:43 read(4, "LABELONE\1\0\0\0\0\0\0\0]V\332\353 \0\0\0LVM2 001"..., 32256) = 32256
16:17:43 brk(0x20d2000)                 = 0x20d2000
16:17:43 mmap(NULL, 8589926400, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f3f857c0000
16:17:43 lseek(4, 32768, SEEK_SET)      = 32768
16:17:43 read(4, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 4294901760) = 2147479552
16:17:54 read(4, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 2147422208) = 2147422208
16:18:05 brk(0x20fa000)                 = 0x20fa000

[...]

grub-probe spends 22 seconds reading 4GB from the disk.  Then this
pattern repeats:

16:18:08 open("/dev/sdb", O_RDONLY|O_SYNC) = 4
16:18:08 lseek(4, 32768, SEEK_SET)      = 32768
16:18:08 read(4, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 4294901760) = 2147479552
16:18:19 read(4, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 2147422208) = 2147422208
16:18:30 brk(0x2153000)                 = 0x2153000

And the same thing happens in the fs_uuid calls.

16:19:35 open("/dev/sdb", O_RDONLY|O_SYNC) = 4
16:19:35 lseek(4, 0, SEEK_SET)          = 0
16:19:35 read(4, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 512) = 512
16:19:35 read(4, "LABELONE\1\0\0\0\0\0\0\0]V\332\353 \0\0\0LVM2 001"..., 32256) = 32256
16:19:35 brk(0x1707000)                 = 0x1707000
16:19:35 mmap(NULL, 8589926400, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7faca2289000
16:19:35 lseek(4, 32768, SEEK_SET)      = 32768
16:19:35 read(4, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 4294901760) = 2147479552
16:19:46 read(4, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 2147422208) = 2147422208
16:19:56 brk(0x172f000)                 = 0x172f000

I have no idea why grub-probe thinks it needs to read 4GB of disk, but
that does explain why it's slow, and does point to a grub problem rather
than a kernel problem.

-- 
You received this bug notification because you are a member of Ubuntu
Foundations Bugs, which is subscribed to grub2 in Ubuntu.
https://bugs.launchpad.net/bugs/1455268

Title:
  update-grub (grub-probe) during package installation on Cisco UCS B260
  servers - Precise deployment fails with hwe-t kernel

Status in grub2 package in Ubuntu:
  New
Status in linux package in Ubuntu:
  Incomplete

Bug description:
  In bug 1437475, deploying Precise with maas was failing with curtin
  error with generic ephemeral image.

  With hwe-t kernel it gets passed the curtin error.. However, grub
  looks to be stuck. Looking at the diff for install log minutes apart
  right before deployment gets marked as failed by maas, it looks to be
  retrying the last step:

  Last lines of curtin install log:
  ===========================================================================
  Unpacking linux-generic-lts-trusty (from .../linux-generic-lts-trusty_3.13.0.52.45_amd64.deb) ...
  Setting up linux-image-3.13.0-52-generic (3.13.0-52.86~precise1) ...
  Running depmod.
  update-initramfs: deferring update (hook will be called later)
  Examining /etc/kernel/postinst.d.
  run-parts: executing /etc/kernel/postinst.d/apt-auto-removal 3.13.0-52-generic /boot/vmlinuz-3.13.0-52-generic
  run-parts: executing /etc/kernel/postinst.d/initramfs-tools 3.13.0-52-generic /boot/vmlinuz-3.13.0-52-generic
  update-initramfs: Generating /boot/initrd.img-3.13.0-52-generic
  df: Warning: cannot read table of mounted file systems: No such file or directory
  run-parts: executing /etc/kernel/postinst.d/update-notifier 3.13.0-52-generic /boot/vmlinuz-3.13.0-52-generic
  run-parts: executing /etc/kernel/postinst.d/x-grub-legacy-ec2 3.13.0-52-generic /boot/vmlinuz-3.13.0-52-generic
  Searching for GRUB installation directory ... found: /boot/grub
  Searching for default file ... found: /boot/grub/default
  Testing for an existing GRUB menu.lst file ... found: /boot/grub/menu.lst
  Searching for splash image ... none found, skipping ...
  Ignoring non-Xen Kernel on Xen domU host: vmlinuz-3.2.0-80-generic
  Found kernel: /boot/vmlinuz-3.13.0-52-generic
  Found kernel: /boot/memtest86+.bin
  Updating /boot/grub/menu.lst ... done

  run-parts: executing /etc/kernel/postinst.d/zz-update-grub 3.13.0-52-generic /boot/vmlinuz-3.13.0-52-generic
  Generating grub.cfg ...
  Found linux image: /boot/vmlinuz-3.13.0-52-generic
  Found initrd image: /boot/initrd.img-3.13.0-52-generic
  Found linux image: /boot/vmlinuz-3.2.0-80-generic
  Found initrd image: /boot/initrd.img-3.2.0-80-generic
  Found memtest86+ image: /boot/memtest86+.bin
  done
  Setting up linux-image-generic-lts-trusty (3.13.0.52.45) ...
  Setting up linux-headers-3.13.0-52 (3.13.0-52.86~precise1) ...
  Setting up linux-headers-3.13.0-52-generic (3.13.0-52.86~precise1) ...
  Setting up linux-headers-generic-lts-trusty (3.13.0.52.45) ...
  Setting up linux-generic-lts-trusty (3.13.0.52.45) ...
  Leaving 'diversion of /etc/init/ureadahead.conf to /etc/init/ureadahead.conf.disabled by cloud-init'
  8192+0 records in
  8192+0 records out
  8589934592 bytes (8.6 GB) copied, 6.10194 s, 1.4 GB/s
  Setting up swapspace version 1, size = 8388604 KiB
  no label, UUID=56f58ad7-bd54-4c17-be2f-893d3c70cd7e
  Generating grub.cfg ...
  Found linux image: /boot/vmlinuz-3.13.0-52-generic
  Found initrd image: /boot/initrd.img-3.13.0-52-generic
  Found linux image: /boot/vmlinuz-3.2.0-80-generic
  Found initrd image: /boot/initrd.img-3.2.0-80-generic
  Found memtest86+ image: /boot/memtest86+.bin
  done
  Generating grub.cfg ...
  Found linux image: /boot/vmlinuz-3.13.0-52-generic
  Found initrd image: /boot/initrd.img-3.13.0-52-generic
  ===========================================================================

  Diff output:
  ===========================================================================
  ubuntu at pullman-01:~$ diff install.log var/log/curtin/install.log 
  219,221d218
  < Generating grub.cfg ...
  < Found linux image: /boot/vmlinuz-3.13.0-52-generic
  < Found initrd image: /boot/initrd.img-3.13.0-52-generic
  ubuntu at pullman-01:~$ 
  ===========================================================================

  I am attaching some logs I collected including content of /var/log

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/grub2/+bug/1455268/+subscriptions