openstack ephemeral storage and ceph
ed bond
celpa.firl at gmail.com
Thu Nov 5 14:35:43 UTC 2015
James,
Thanks for the insight. I will wait for the ceph backed ephemeral until I get the mellanox up and running.
I just tried a live migration:
maasadmin at restonMaas:~$ nova live-migration b71f57c3-f083-4f11-b1d0-eaf8ebf70f35 sniveling-father
ERROR (BadRequest): petty-fact is not on shared storage: Live migration can not be used without shared storage. (HTTP 400) (Request-ID: req-c4f42d5c-f457-4365-bf12-d25637904b4d)
That’s why I thought I had to do the ceph backed ephemeral. Is there something I have to do to enable the live migration for kilo?
- Ed
> On Nov 5, 2015, at 8:31 AM, James Page <james.page at canonical.com> wrote:
>
> Hi Ed
>
> You can switch to the Ceph RBD image backend by setting:
>
> libvirt-image-backend=rbd
>
> on the nova-compute charm; note that this applies to all instance root and ephemeral disks, and unless you're using low latency >10G networking or have extremely light disk IO requirements, its not going to be a fantastic experience from a performance perspective.
>
> Live migration is possible without the Ceph backend; there is a restriction in Kilo if you also have Ceph disks attached to an instance via Cinder which means Nova won't try to perform the migration, but I think that's fixed in Liberty.
>
> Nice to see the deploy from source option being used for the openstack-dashboard!
>
> On Thu, Nov 5, 2015 at 2:22 PM, ed bond <celpa.firl at gmail.com <mailto:celpa.firl at gmail.com>> wrote:
> Does anyone know how to configure the juju openstack charms to have ephemeral storage use ceph instead of the local disk so that I can do live migrations?
>
> - Ed
>
>
> My sample bundle that I used:
>
> machines:
> '0':
> constraints: "arch=amd64 cpu-cores=4 root-disk=2072"
> series: trusty
> '1':
> series: trusty
> '2':
> series: trusty
> '3':
> series: trusty
> '4':
> series: trusty
> '5':
> series: trusty
> relations:
> - - nova-compute:amqp
> - rabbitmq-server:amqp
> - - neutron-gateway:amqp
> - rabbitmq-server:amqp
> - - keystone:shared-db
> - mysql:shared-db
> - - nova-cloud-controller:identity-service
> - keystone:identity-service
> - - glance:identity-service
> - keystone:identity-service
> - - neutron-api:identity-service
> - keystone:identity-service
> - - neutron-openvswitch:neutron-plugin-api
> - neutron-api:neutron-plugin-api
> - - neutron-api:shared-db
> - mysql:shared-db
> - - neutron-api:amqp
> - rabbitmq-server:amqp
> - - neutron-gateway:neutron-plugin-api
> - neutron-api:neutron-plugin-api
> - - glance:shared-db
> - mysql:shared-db
> - - glance:amqp
> - rabbitmq-server:amqp
> - - nova-cloud-controller:image-service
> - glance:image-service
> - - nova-compute:image-service
> - glance:image-service
> - - nova-cloud-controller:cloud-compute
> - nova-compute:cloud-compute
> - - nova-cloud-controller:amqp
> - rabbitmq-server:amqp
> - - nova-cloud-controller:quantum-network-service
> - neutron-gateway:quantum-network-service
> - - nova-compute:neutron-plugin
> - neutron-openvswitch:neutron-plugin
> - - neutron-openvswitch:amqp
> - rabbitmq-server:amqp
> - - openstack-dashboard:identity-service
> - keystone:identity-service
> - - nova-cloud-controller:shared-db
> - mysql:shared-db
> - - nova-cloud-controller:neutron-api
> - neutron-api:neutron-api
> - - cinder:image-service
> - glance:image-service
> - - cinder:amqp
> - rabbitmq-server:amqp
> - - cinder:identity-service
> - keystone:identity-service
> - - cinder:cinder-volume-service
> - nova-cloud-controller:cinder-volume-service
> - - cinder-ceph:storage-backend
> - cinder:storage-backend
> - - ceph:client
> - nova-compute:ceph
> - - cinder:shared-db
> - mysql:shared-db
> - - ceph:client
> - cinder-ceph:ceph
> - - ceph:client
> - glance:ceph
> - - ceph-osd:mon
> - ceph:osd
> - - ntp:juju-info
> - nova-compute:juju-info
> - - ntp:juju-info
> - neutron-gateway:juju-info
> - - ceph-radosgw:mon
> - ceph:radosgw
> - - ceph-radosgw:identity-service
> - keystone:identity-service
> series: trusty
> services:
> ceph:
> annotations:
> gui-x: '750'
> gui-y: '500'
> charm: cs:trusty/ceph-38
> num_units: 3
> options:
> fsid: 5a791d94-980b-11e4-b6f6-3c970e8b1cf7
> monitor-secret: AQAi5a9UeJXUExAA+By9u+GPhl8/XiUQ4nwI3A==
> osd-devices: /dev/sdb /dev/sdc /dev/sdd /dev/sde /dev/sdf /dev/sdg /dev/sdh /dev/sdi /dev/sdj /dev/sdk /dev/sdl /dev/sdm /dev/sdn /dev/sdo /dev/sdp /dev/sdq /dev/sdr
> osd-reformat: 'yes'
> source: cloud:trusty-kilo
> to:
> - '0'
> - '1'
> - '2'
> ceph-osd:
> annotations:
> gui-x: '1000'
> gui-y: '500'
> charm: cs:trusty/ceph-osd-12
> num_units: 3
> options:
> osd-devices: /dev/sdb /dev/sdc /dev/sdd /dev/sde /dev/sdf /dev/sdg /dev/sdh /dev/sdi /dev/sdj /dev/sdk /dev/sdl /dev/sdm /dev/sdn /dev/sdo /dev/sdp /dev/sdq /dev/sdr
> osd-reformat: 'yes'
> source: cloud:trusty-kilo
> to:
> - '3'
> - '4'
> - '5'
> ceph-radosgw:
> num_units: 1
> annotations:
> gui-x: '1000'
> gui-y: '250'
> charm: cs:trusty/ceph-radosgw-15
> options:
> source: cloud:trusty-kilo
> use-embedded-webserver: true
> to:
> - lxc:0
> cinder:
> num_units: 2
> annotations:
> gui-x: '750'
> gui-y: '0'
> charm: cs:trusty/cinder-26
> options:
> block-device: None
> glance-api-version: 2
> ha-mcastport: 5401
> openstack-origin: cloud:trusty-kilo
> to:
> - lxc:0
> - lxc:1
> cinder-ceph:
> annotations:
> gui-x: '750'
> gui-y: '250'
> charm: cs:trusty/cinder-ceph-9
> options:
> ceph-osd-replication-count: 2
> num_units: 0
> glance:
> annotations:
> gui-x: '250'
> gui-y: '0'
> charm: cs:trusty/glance-24
> num_units: 2
> options:
> ha-mcastport: 5402
> openstack-origin: cloud:trusty-kilo
> to:
> - lxc:1
> - lxc:2
> keystone:
> annotations:
> gui-x: '500'
> gui-y: '0'
> charm: cs:trusty/keystone-28
> options:
> admin-password: openstack
> ha-mcastport: 5403
> openstack-origin: cloud:trusty-kilo
> num_units: 2
> to:
> - lxc:2
> - lxc:3
> mysql:
> annotations:
> gui-x: '0'
> gui-y: '250'
> charm: cs:trusty/percona-cluster-26
> options:
> max-connections: 20000
> num_units: 2
> to:
> - lxc:3
> - lxc:4
> neutron-api:
> annotations:
> gui-x: '500'
> gui-y: '500'
> charm: cs:trusty/neutron-api-17
> options:
> neutron-security-groups: true
> openstack-origin: cloud:trusty-kilo
> num_units: 2
> to:
> - lxc:4
> - lxc:5
> neutron-gateway:
> annotations:
> gui-x: '0'
> gui-y: '0'
> charm: cs:trusty/neutron-gateway-5
> options:
> ext-port: eth1
> openstack-origin: cloud:trusty-kilo
> num_units: 1
> to:
> - '0'
> neutron-openvswitch:
> annotations:
> gui-x: '250'
> gui-y: '500'
> charm: cs:trusty/neutron-openvswitch-9
> num_units: 0
> nova-cloud-controller:
> annotations:
> gui-x: '0'
> gui-y: '500'
> charm: cs:trusty/nova-cloud-controller-60
> options:
> network-manager: Neutron
> openstack-origin: cloud:trusty-kilo
> quantum-security-groups: 'yes'
> num_units: 2
> to:
> - lxc:2
> - lxc:3
> nova-compute:
> annotations:
> gui-x: '250'
> gui-y: '250'
> charm: cs:trusty/nova-compute-26
> options:
> enable-live-migration: true
> enable-resize: true
> migration-auth-type: ssh
> openstack-origin: cloud:trusty-kilo
> num_units: 6
> to:
> - '0'
> - '1'
> - '2'
> - '3'
> - '4'
> - '5'
> ntp:
> annotations:
> gui-x: '1000'
> gui-y: '0'
> charm: cs:trusty/ntp-11
> num_units: 0
> openstack-dashboard:
> charm: cs:trusty/openstack-dashboard-16
> openstack-origin: cloud:trusty-kilo
> debug: 'no'
> default-role: Member
> neutron-network-firewall: 'true'
> neutron-network-lb: 'true'
> neutron-network-vpn: 'true'
> offline-compression: 'yes'
> prefer-ipv6: 'false'
> ubuntu-theme: 'yes'
> use-syslog: 'true'
> webroot: /horizon
> openstack-origin-git: |
> {repositories:[
> {name: requirements,
> repository: 'git://github.com/openstack/requirements <http://github.com/openstack/requirements>',
> branch: master},
> {name: muranodashboard,
> repository: 'git://github.com/openstack/murano-dashboard <http://github.com/openstack/murano-dashboard>',
> branch: master},
> {name: horizon,
> repository: 'git://github.com/openstack/horizon <http://github.com/openstack/horizon>',
> branch: master}]}
> num_units: 2
> to:
> - lxc:3
> - lxc:4
> rabbitmq-server:
> annotations:
> gui-x: '500'
> gui-y: '250'
> charm: cs:trusty/rabbitmq-server-33
> num_units: 2
> to:
> - lxc:4
> - lxc:5
>
>
> --
> Juju mailing list
> Juju at lists.ubuntu.com <mailto:Juju at lists.ubuntu.com>
> Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/juju <https://lists.ubuntu.com/mailman/listinfo/juju>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.ubuntu.com/archives/juju/attachments/20151105/449238f3/attachment.html>
More information about the Juju
mailing list