[Bug 1604501] Re: ceph-osd fails to initialize when encrypt is enabled

Fri Jul 27 14:28:09 UTC 2018

Later ceph releases (and charms) do support native ceph block device
encryption.

** Changed in: charm-ceph-osd
       Status: Triaged => Won't Fix

-- 
You received this bug notification because you are a member of Ubuntu
OpenStack, which is subscribed to ceph in Ubuntu.
https://bugs.launchpad.net/bugs/1604501

Title:
  ceph-osd fails to initialize when encrypt is enabled

Status in OpenStack ceph charm:
  Won't Fix
Status in OpenStack ceph-osd charm:
  Won't Fix
Status in ceph package in Ubuntu:
  Fix Released
Status in ceph source package in Xenial:
  Triaged
Status in ceph source package in Yakkety:
  Won't Fix
Status in ceph source package in Zesty:
  Triaged
Status in ceph source package in Artful:
  Fix Released
Status in ceph source package in Bionic:
  Fix Released
Status in ceph package in Juju Charms Collection:
  Invalid
Status in ceph-osd package in Juju Charms Collection:
  Invalid

Bug description:
  The config-key put command is called without a cephx user which causes the command to fail.  Error log information is:
  2016-07-16 05:07:14 INFO mon-relation-changed 2016-07-16 05:07:14.918436 7f67d2797700 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring: (2) No such file or directory
  2016-07-16 05:07:14 INFO mon-relation-changed 2016-07-16 05:07:14.919173 7f67d2797700 -1 monclient(hunting): ERROR: missing keyring, cannot use cephx for authentication
  2016-07-16 05:07:14 INFO mon-relation-changed 2016-07-16 05:07:14.919315 7f67d2797700  0 librados: client.admin initialization error (2) No such file or directory
  2016-07-16 05:07:14 INFO mon-relation-changed Error connecting to cluster: ObjectNotFound
  2016-07-16 05:07:14 INFO mon-relation-changed Traceback (most recent call last):
  2016-07-16 05:07:14 INFO mon-relation-changed   File "/usr/sbin/ceph-disk", line 9, in <module>
  2016-07-16 05:07:14 INFO mon-relation-changed     load_entry_point('ceph-disk==1.0.0', 'console_scripts', 'ceph-disk')()
  2016-07-16 05:07:14 INFO mon-relation-changed   File "/usr/lib/python2.7/dist-packages/ceph_disk/main.py", line 4965, in run
  2016-07-16 05:07:14 INFO mon-relation-changed     main(sys.argv[1:])
  2016-07-16 05:07:14 INFO mon-relation-changed   File "/usr/lib/python2.7/dist-packages/ceph_disk/main.py", line 4918, in main
  2016-07-16 05:07:14 INFO mon-relation-changed     main_catch(args.func, args)
  2016-07-16 05:07:14 INFO mon-relation-changed   File "/usr/lib/python2.7/dist-packages/ceph_disk/main.py", line 4943, in main_catch
  2016-07-16 05:07:14 INFO mon-relation-changed     func(args)
  2016-07-16 05:07:14 INFO mon-relation-changed   File "/usr/lib/python2.7/dist-packages/ceph_disk/main.py", line 1774, in main
  2016-07-16 05:07:14 INFO mon-relation-changed     Prepare.factory(args).prepare()
  2016-07-16 05:07:14 INFO mon-relation-changed   File "/usr/lib/python2.7/dist-packages/ceph_disk/main.py", line 1762, in prepare
  2016-07-16 05:07:14 INFO mon-relation-changed     self.prepare_locked()
  2016-07-16 05:07:14 INFO mon-relation-changed   File "/usr/lib/python2.7/dist-packages/ceph_disk/main.py", line 1793, in prepare_locked
  2016-07-16 05:07:14 INFO mon-relation-changed     self.lockbox.prepare()
  2016-07-16 05:07:14 INFO mon-relation-changed   File "/usr/lib/python2.7/dist-packages/ceph_disk/main.py", line 2360, in prepare
  2016-07-16 05:07:14 INFO mon-relation-changed     self.populate()
  2016-07-16 05:07:14 INFO mon-relation-changed   File "/usr/lib/python2.7/dist-packages/ceph_disk/main.py", line 2305, in populate
  2016-07-16 05:07:14 INFO mon-relation-changed     self.create_key()
  2016-07-16 05:07:14 INFO mon-relation-changed   File "/usr/lib/python2.7/dist-packages/ceph_disk/main.py", line 2264, in create_key
  2016-07-16 05:07:14 INFO mon-relation-changed     base64_key,
  2016-07-16 05:07:14 INFO mon-relation-changed   File "/usr/lib/python2.7/dist-packages/ceph_disk/main.py", line 439, in command_check_call
  2016-07-16 05:07:14 INFO mon-relation-changed     return subprocess.check_call(arguments)
  2016-07-16 05:07:14 INFO mon-relation-changed   File "/usr/lib/python2.7/subprocess.py", line 540, in check_call
  2016-07-16 05:07:14 INFO mon-relation-changed     raise CalledProcessError(retcode, cmd)
  2016-07-16 05:07:14 INFO mon-relation-changed subprocess.CalledProcessError: Command '['/usr/bin/ceph', 'config-key', 'put', 'dm-crypt/osd/e4d2604d-1e38-4563-88ae-c447ffba95e9/luks', '61H4+6InRku1kvSqg23ckK0EsoFL1csn18ONWL8a+1s7r8wLzPUTrRRmuq4D1o1/GZ9UvFVxytPq4pZeA73ZtCeNPWlbIoKeAhZ/gbK6g1YXPjpICOmxx7aSckIO212faMiHG+jLbIAzeekhK7AKT+rxGWXYh2wYVX3rxn4dKik=']' returned non-zero exit status 1
  2016-07-16 05:07:14 INFO worker.uniter.jujuc server.go:172 running hook tool "juju-log" ["-l" "ERROR" "Unable to initialize device: /dev/vdb"]
  2016-07-16 05:07:14 DEBUG worker.uniter.jujuc server.go:173 hook context id "ceph-osd/0-mon-relation-changed-4972863589887456037"; dir "/var/lib/juju/agents/unit-ceph-osd-0/charm"
  2016-07-16 05:07:14 ERROR juju-log mon:1: Unable to initialize device: /dev/vdb
  2016-07-16 05:07:14 INFO mon-relation-changed Traceback (most recent call last):
  2016-07-16 05:07:14 INFO mon-relation-changed   File "/var/lib/juju/agents/unit-ceph-osd-0/charm/hooks/mon-relation-changed", line 614, in <module>
  2016-07-16 05:07:14 INFO mon-relation-changed     hooks.execute(sys.argv)
  2016-07-16 05:07:14 INFO mon-relation-changed   File "/var/lib/juju/agents/unit-ceph-osd-0/charm/hooks/charmhelpers/core/hookenv.py", line 715, in execute
  2016-07-16 05:07:14 INFO mon-relation-changed     self._hooks[hook_name]()
  2016-07-16 05:07:14 INFO mon-relation-changed   File "/var/lib/juju/agents/unit-ceph-osd-0/charm/hooks/mon-relation-changed", line 545, in mon_relation
  2016-07-16 05:07:14 INFO mon-relation-changed     prepare_disks_and_activate()
  2016-07-16 05:07:14 INFO mon-relation-changed   File "/var/lib/juju/agents/unit-ceph-osd-0/charm/hooks/mon-relation-changed", line 454, in prepare_disks_and_activate
  2016-07-16 05:07:14 INFO mon-relation-changed     config('osd-encrypt'))
  2016-07-16 05:07:14 INFO mon-relation-changed   File "/var/lib/juju/agents/unit-ceph-osd-0/charm/hooks/ceph.py", line 997, in osdize
  2016-07-16 05:07:14 INFO mon-relation-changed     reformat_osd, ignore_errors, encrypt)
  2016-07-16 05:07:14 INFO mon-relation-changed   File "/var/lib/juju/agents/unit-ceph-osd-0/charm/hooks/ceph.py", line 1052, in osdize_dev
  2016-07-16 05:07:14 INFO mon-relation-changed     raise e
  2016-07-16 05:07:14 INFO mon-relation-changed subprocess.CalledProcessError: Command '['ceph-disk', 'prepare', '--dmcrypt', '--fs-type', u'xfs', u'/dev/vdb']' returned non-zero exit status 1

To manage notifications about this bug go to:
https://bugs.launchpad.net/charm-ceph/+bug/1604501/+subscriptions