Ceph-Radosgw Account Quotas

[James Beedy]

Notice the `user_quota` and `bucket_quota` here:
http://paste.ubuntu.com/15563242/.

I am still limited by the default account quota using both juju-dev, and
juju-common users. I feel this helps verify that the quota is not being set
at the radosgw level.



On Wed, Mar 30, 2016 at 2:43 PM, James Beedy <jamesbeedy at gmail.com> wrote:

>
> Billy,
>
> I'm thinking the radosgw and swift object-store apis must be similar to
> some degree because we use the same clients to access either one with
> consistent functionality despite the underlying object-store implementation.
>
> Concerning swift support, I feel radosgw supports both s3 and swift to the
> same degree, see the radosgw docs here:
> http://docs.ceph.com/docs/master/install/install-ceph-gateway/#using-the-gateway
>
> As far as I can see per ^, radosgw supports s3, and swift .... am I
> missing something here?
>
> I have ensured all possible quotas on at the lower ceph/radosgw level are
> non-existent, so I can be assured the quota is not coming from the lower
> level. It seems the account quota (in this case) is set at the openstack
> level, not the ceph level. I'm thinking this account quota data might be
> stored in the .users.swift bucket ..?..?..?.
>
> To easily replicate this:
>
> Preform a pg_basebackup of a database > 30GB, using wal-e, pointed at your
> swift/radosgw container. Your backup will fail once the swift container
> reaches 30GB.
>
> The current object-storage account quotas render object storage useless
> for anything > 30GB.
>
> This feels like a solid bug to me. Thoughts?
>
> Thanks,
>
> ~James
>
> On Wed, Mar 30, 2016 at 9:50 AM, Billy Olsen <billy.olsen at canonical.com>
> wrote:
>
>> James,
>>
>> You can manage ceph radosgw quotas via the radosgw-admin command -
>> http://docs.ceph.com/docs/hammer/radosgw/admin/
>>
>> I'm not sure if the general object storage APIs apply from OpenStack, but
>> in general Ceph is S3 compatible and not Swift compatible. If there's an
>> API difference, Ceph will lean the way of S3. If there are Swift specific
>> APIs, its possible that Ceph does not yet honor those APIs.
>>
>>
>> On Tue, Mar 29, 2016 at 10:19 AM, James Beedy <jamesbeedy at gmail.com>
>> wrote:
>>
>>> Liam,
>>>
>>> The capability to modify account quotas for object storage is a must
>>> have. Can you aid me in finding out how this might be accomplished using
>>> ceph-radosgw?
>>>
>>> Thanks,
>>>
>>> ~James
>>>
>>> On Tue, Mar 29, 2016 at 3:48 AM, Liam Young <liam.young at canonical.com>
>>> wrote:
>>>
>>>> Hi James,
>>>>
>>>> The ceph-radosgw  charm does register endpoints with keystone. The
>>>> catalog query below was against the deployment done by
>>>> the 018-basic-trusty-liberty ceph-radosgw amulet test:
>>>>
>>>> $ keystone catalog --service object-store
>>>>
>>>> Service: object-store
>>>> +-------------+----------------------------------+
>>>> |   Property  |              Value               |
>>>> +-------------+----------------------------------+
>>>> |   adminURL  |    http://10.5.5.41:80/swift     |
>>>> |      id     | 5369a3e7cdc846af8c6a1cda90a6bd7a |
>>>> | internalURL |   http://10.5.5.41:80/swift/v1   |
>>>> |  publicURL  |   http://10.5.5.41:80/swift/v1   |
>>>> |    region   |            RegionOne             |
>>>> +-------------+----------------------------------+
>>>>
>>>> Having said that I don't know whether ceph-radosgw supports managing
>>>> qutoas via that api, I suspect not.
>>>>
>>>> Liam
>>>>
>>>> On Fri, Mar 25, 2016 at 9:56 PM, James Beedy <jamesbeedy at gmail.com>
>>>> wrote:
>>>>
>>>>> Team,
>>>>>
>>>>> I have a need to increase the account quotas of my ceph-radosgw object
>>>>> storage. To the extent of my knowledge, I need to preform api calls similar
>>>>> to those found here:
>>>>> http://docs.openstack.org/liberty/config-reference/content/object-storage-account-quotas.html
>>>>>
>>>>> Is this functionality currently supported by the object-store api?
>>>>>
>>>>> I feel like ceph-radosgw may not be passing the relational data on
>>>>> identity joined hook to facilitate the creation of my needed endpoint.
>>>>>
>>>>> Has anyone else hit this yet? I feel like this is a legitimate bug
>>>>> with either ceph-radosgw or keystone, although I could just be missing
>>>>> something.
>>>>>
>>>>> I feel like I need the public and internal endpoints created here:
>>>>> http://docs.openstack.org/liberty/install-guide-ubuntu/swift-controller-install.html
>>>>>
>>>>> Any insight would be greatly appreciated!
>>>>>
>>>>> Thanks!
>>>>>
>>>>> James
>>>>>
>>>>> --
>>>>> Juju mailing list
>>>>> Juju at lists.ubuntu.com
>>>>> Modify settings or unsubscribe at:
>>>>> https://lists.ubuntu.com/mailman/listinfo/juju
>>>>>
>>>>>
>>>>
>>>
>>> --
>>> Juju mailing list
>>> Juju at lists.ubuntu.com
>>> Modify settings or unsubscribe at:
>>> https://lists.ubuntu.com/mailman/listinfo/juju
>>>
>>>
>>
>>
>> --
>> Billy Olsen
>>
>> billy.olsen at canonical.com
>> Software Engineer
>> Canonical USA
>>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.ubuntu.com/archives/juju/attachments/20160330/09ad79a0/attachment.html>