Ceph-Radosgw Account Quotas

[James Beedy]

Billy,

I'm thinking the radosgw and swift object-store apis must be similar to
some degree because we use the same clients to access either one with
consistent functionality despite the underlying object-store implementation.

Concerning swift support, I feel radosgw supports both s3 and swift to the
same degree, see the radosgw docs here:
http://docs.ceph.com/docs/master/install/install-ceph-gateway/#using-the-gateway

As far as I can see per ^, radosgw supports s3, and swift .... am I missing
something here?

I have ensured all possible quotas on at the lower ceph/radosgw level are
non-existent, so I can be assured the quota is not coming from the lower
level. It seems the account quota (in this case) is set at the openstack
level, not the ceph level. I'm thinking this account quota data might be
stored in the .users.swift bucket ..?..?..?.

To easily replicate this:

Preform a pg_basebackup of a database > 30GB, using wal-e, pointed at your
swift/radosgw container. Your backup will fail once the swift container
reaches 30GB.

The current object-storage account quotas render object storage useless for
anything > 30GB.

This feels like a solid bug to me. Thoughts?

Thanks,

~James

On Wed, Mar 30, 2016 at 9:50 AM, Billy Olsen <billy.olsen at canonical.com>
wrote:

> James,
>
> You can manage ceph radosgw quotas via the radosgw-admin command -
> http://docs.ceph.com/docs/hammer/radosgw/admin/
>
> I'm not sure if the general object storage APIs apply from OpenStack, but
> in general Ceph is S3 compatible and not Swift compatible. If there's an
> API difference, Ceph will lean the way of S3. If there are Swift specific
> APIs, its possible that Ceph does not yet honor those APIs.
>
>
> On Tue, Mar 29, 2016 at 10:19 AM, James Beedy <jamesbeedy at gmail.com>
> wrote:
>
>> Liam,
>>
>> The capability to modify account quotas for object storage is a must
>> have. Can you aid me in finding out how this might be accomplished using
>> ceph-radosgw?
>>
>> Thanks,
>>
>> ~James
>>
>> On Tue, Mar 29, 2016 at 3:48 AM, Liam Young <liam.young at canonical.com>
>> wrote:
>>
>>> Hi James,
>>>
>>> The ceph-radosgw  charm does register endpoints with keystone. The
>>> catalog query below was against the deployment done by
>>> the 018-basic-trusty-liberty ceph-radosgw amulet test:
>>>
>>> $ keystone catalog --service object-store
>>>
>>> Service: object-store
>>> +-------------+----------------------------------+
>>> |   Property  |              Value               |
>>> +-------------+----------------------------------+
>>> |   adminURL  |    http://10.5.5.41:80/swift     |
>>> |      id     | 5369a3e7cdc846af8c6a1cda90a6bd7a |
>>> | internalURL |   http://10.5.5.41:80/swift/v1   |
>>> |  publicURL  |   http://10.5.5.41:80/swift/v1   |
>>> |    region   |            RegionOne             |
>>> +-------------+----------------------------------+
>>>
>>> Having said that I don't know whether ceph-radosgw supports managing
>>> qutoas via that api, I suspect not.
>>>
>>> Liam
>>>
>>> On Fri, Mar 25, 2016 at 9:56 PM, James Beedy <jamesbeedy at gmail.com>
>>> wrote:
>>>
>>>> Team,
>>>>
>>>> I have a need to increase the account quotas of my ceph-radosgw object
>>>> storage. To the extent of my knowledge, I need to preform api calls similar
>>>> to those found here:
>>>> http://docs.openstack.org/liberty/config-reference/content/object-storage-account-quotas.html
>>>>
>>>> Is this functionality currently supported by the object-store api?
>>>>
>>>> I feel like ceph-radosgw may not be passing the relational data on
>>>> identity joined hook to facilitate the creation of my needed endpoint.
>>>>
>>>> Has anyone else hit this yet? I feel like this is a legitimate bug with
>>>> either ceph-radosgw or keystone, although I could just be missing something.
>>>>
>>>> I feel like I need the public and internal endpoints created here:
>>>> http://docs.openstack.org/liberty/install-guide-ubuntu/swift-controller-install.html
>>>>
>>>> Any insight would be greatly appreciated!
>>>>
>>>> Thanks!
>>>>
>>>> James
>>>>
>>>> --
>>>> Juju mailing list
>>>> Juju at lists.ubuntu.com
>>>> Modify settings or unsubscribe at:
>>>> https://lists.ubuntu.com/mailman/listinfo/juju
>>>>
>>>>
>>>
>>
>> --
>> Juju mailing list
>> Juju at lists.ubuntu.com
>> Modify settings or unsubscribe at:
>> https://lists.ubuntu.com/mailman/listinfo/juju
>>
>>
>
>
> --
> Billy Olsen
>
> billy.olsen at canonical.com
> Software Engineer
> Canonical USA
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.ubuntu.com/archives/juju/attachments/20160330/f0fc0a7c/attachment.html>