[Bug 1914479] Re: OSDs do not start after reboot

[Launchpad Bug Tracker]

[Expired for ceph (Ubuntu) because there has been no activity for 60
days.]

** Changed in: ceph (Ubuntu)
       Status: Incomplete => Expired

-- 
You received this bug notification because you are a member of Ubuntu
OpenStack, which is subscribed to ceph in Ubuntu.
https://bugs.launchpad.net/bugs/1914479

Title:
  OSDs do not start after reboot

Status in Ceph OSD Charm:
  Invalid
Status in ceph package in Ubuntu:
  Expired

Bug description:
  Charm cs:ceph-osd-304, bionic-ussuri

  After rebooting the host, Ceph OSDs do not start again.  The tmpfs
  mounts are not created.

  Workaround - once the host has completed boot, run the following:

  ceph-volume lvm activate --all

  Journal logs at the time, showing the failure:

  -- Reboot --
  Feb 03 21:29:24 cloud1 systemd[1]: Starting Ceph object storage daemon osd.21...
  -- Subject: Unit ceph-osd at 21.service has begun start-up
  -- Defined-By: systemd
  -- Support: http://www.ubuntu.com/support
  -- 
  -- Unit ceph-osd at 21.service has begun starting up.
  Feb 03 21:29:24 cloud1 systemd[1]: Started Ceph object storage daemon osd.21.
  -- Subject: Unit ceph-osd at 21.service has finished start-up
  -- Defined-By: systemd
  -- Support: http://www.ubuntu.com/support
  -- 
  -- Unit ceph-osd at 21.service has finished starting up.
  -- 
  -- The start-up result is RESULT.
  Feb 03 21:29:24 cloud1 ceph-osd[368748]: 2021-02-03T21:29:24.753+0000 7f96087d3d80 -1 auth: unable to find a keyring on /var/lib/ceph/osd/ceph-21/keyring: (2) No such file or directory
  Feb 03 21:29:24 cloud1 ceph-osd[368748]: 2021-02-03T21:29:24.753+0000 7f96087d3d80 -1 AuthRegistry(0x560082b42938) no keyring found at /var/lib/ceph/osd/ceph-21/keyring, disabling cephx
  Feb 03 21:29:24 cloud1 ceph-osd[368748]: 2021-02-03T21:29:24.753+0000 7f96087d3d80 -1 auth: unable to find a keyring on /var/lib/ceph/osd/ceph-21/keyring: (2) No such file or directory
  Feb 03 21:29:24 cloud1 ceph-osd[368748]: 2021-02-03T21:29:24.753+0000 7f96087d3d80 -1 AuthRegistry(0x7ffe4ef93c60) no keyring found at /var/lib/ceph/osd/ceph-21/keyring, disabling cephx
  Feb 03 21:29:24 cloud1 ceph-osd[368748]: failed to fetch mon config (--no-mon-config to skip)
  Feb 03 21:29:24 cloud1 systemd[1]: ceph-osd at 21.service: Main process exited, code=exited, status=1/FAILURE
  Feb 03 21:29:24 cloud1 systemd[1]: ceph-osd at 21.service: Failed with result 'exit-code'.
  Feb 03 21:29:34 cloud1 systemd[1]: ceph-osd at 21.service: Service hold-off time over, scheduling restart.
  Feb 03 21:29:34 cloud1 systemd[1]: ceph-osd at 21.service: Scheduled restart job, restart counter is at 1.

  
  There's nothing in the OSD logs in /var/log/ceph/ceph-osd.21.log for that time.

To manage notifications about this bug go to:
https://bugs.launchpad.net/charm-ceph-osd/+bug/1914479/+subscriptions