[Bug 1261501] Re: ceph osds unbalanced

[James Page]

As this bug relates to an older, unsupported version of Ceph, marking
'Won't Fix'.

** Changed in: ceph (Ubuntu)
       Status: Triaged => Won't Fix

-- 
You received this bug notification because you are a member of Ubuntu
OpenStack, which is subscribed to ceph in Ubuntu.
https://bugs.launchpad.net/bugs/1261501

Title:
  ceph osds unbalanced

Status in ceph package in Ubuntu:
  Won't Fix

Bug description:
  Our ceph ring has some osds that are not balanced

  We are using the 0.48.3-0ubuntu1~cloud0 version of ceph on precise
  Full settings:
  "full_ratio": "0.950000",
  "near_full_ratio": "0.850000",

  ceph osd tree
         weight
  12      1                       osd.12  up      1
  11      1                       osd.11  up      1
  13      1                       osd.13  up      1
  23      2                       osd.23  up      1
  27      2                       osd.27  up      1
  24      2                       osd.24  up      1
  25      2                       osd.25  up      1
  26      2                       osd.26  up      1
  48      2                       osd.48  up      1
  51      2                       osd.51  up      1
  55      2                       osd.55  up      1

  df of ceph-osd node:
  /dev/sdc1       917G  716G  202G  79% /var/lib/ceph/osd/ceph-11
  /dev/sdd1       917G  347G  571G  38% /var/lib/ceph/osd/ceph-12
  /dev/sdb1       917G  791G  127G  87% /var/lib/ceph/osd/ceph-13
  /dev/sdf1       1.8T  1.1T  729G  61% /var/lib/ceph/osd/ceph-23
  /dev/sdh1       1.8T  1.1T  727G  61% /var/lib/ceph/osd/ceph-24
  /dev/sde1       1.8T  1.2T  610G  67% /var/lib/ceph/osd/ceph-25
  /dev/sdi1       1.8T  1.1T  731G  61% /var/lib/ceph/osd/ceph-26
  /dev/sdg1       1.8T  1.1T  756G  59% /var/lib/ceph/osd/ceph-27
  /dev/sdj1       1.9T  989G  874G  54% /var/lib/ceph/osd/ceph-48
  /dev/sdk1       1.9T 1007G  856G  55% /var/lib/ceph/osd/ceph-51
  /dev/sdl1       1.9T  960G  903G  52% /var/lib/ceph/osd/ceph-55

  Notice ceph-13 is at 87% and ceph-11 is at 79% while ceph-12 which has
  the same size and weight is only at 38%

  What is causing this imbalance?

  Manual re-balancing causes downtime in our environment, what can we do
  to solve this?

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/ceph/+bug/1261501/+subscriptions