[Bug 1261501] [NEW] ceph osds unbalanced

[David Ames]

Public bug reported:

Our ceph ring has some osds that are not balanced

We are using the 0.48.3-0ubuntu1~cloud0 version of ceph on precise
Full settings:
"full_ratio": "0.950000",
"near_full_ratio": "0.850000",

ceph osd tree
       weight
12      1                       osd.12  up      1
11      1                       osd.11  up      1
13      1                       osd.13  up      1
23      2                       osd.23  up      1
27      2                       osd.27  up      1
24      2                       osd.24  up      1
25      2                       osd.25  up      1
26      2                       osd.26  up      1
48      2                       osd.48  up      1
51      2                       osd.51  up      1
55      2                       osd.55  up      1

df of ceph-osd node:
/dev/sdc1       917G  716G  202G  79% /var/lib/ceph/osd/ceph-11
/dev/sdd1       917G  347G  571G  38% /var/lib/ceph/osd/ceph-12
/dev/sdb1       917G  791G  127G  87% /var/lib/ceph/osd/ceph-13
/dev/sdf1       1.8T  1.1T  729G  61% /var/lib/ceph/osd/ceph-23
/dev/sdh1       1.8T  1.1T  727G  61% /var/lib/ceph/osd/ceph-24
/dev/sde1       1.8T  1.2T  610G  67% /var/lib/ceph/osd/ceph-25
/dev/sdi1       1.8T  1.1T  731G  61% /var/lib/ceph/osd/ceph-26
/dev/sdg1       1.8T  1.1T  756G  59% /var/lib/ceph/osd/ceph-27
/dev/sdj1       1.9T  989G  874G  54% /var/lib/ceph/osd/ceph-48
/dev/sdk1       1.9T 1007G  856G  55% /var/lib/ceph/osd/ceph-51
/dev/sdl1       1.9T  960G  903G  52% /var/lib/ceph/osd/ceph-55

Notice ceph-13 is at 87% and ceph-11 is at 79% while ceph-12 which has
the same size and weight is only at 38%

What is causing this imbalance?

Manual re-balancing causes downtime in our environment, what can we do
to solve this?

** Affects: ceph (Ubuntu)
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Ubuntu
Server Team, which is subscribed to ceph in Ubuntu.
https://bugs.launchpad.net/bugs/1261501

Title:
  ceph osds unbalanced

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/ceph/+bug/1261501/+subscriptions