We need to set up cinder apis and attach them to ceph on the backend and horizon on the front.
Description
Details
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | Andrew | T269511 Attachable block storage in cloud-vps | |||
| Resolved | Andrew | T272113 Cinder default quotas? | |||
| Resolved | Andrew | T272114 Replace all disk-usage flavor variants with Cinder use (was: Cinder storage vs. ephemeral storage vs. flavor) | |||
| Resolved | • Bstorm | T277078 Support Cinder for CI docker workers |
Event Timeline
Change 645722 merged by Andrew Bogott:
[operations/puppet@production] Initial cinder class and templates
Change 647043 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Cinder: add some shared config settings to hiera
Change 647043 merged by Andrew Bogott:
[operations/puppet@production] Cinder: add some shared config settings to hiera
Change 647044 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Pass ceph_pool name to deployment-specific cinder profiles
Change 647044 merged by Andrew Bogott:
[operations/puppet@production] Pass ceph_pool name to deployment-specific cinder profiles
Change 647045 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Pass ceph_pool name from profile to module
Change 647045 merged by Andrew Bogott:
[operations/puppet@production] Pass ceph_pool name from profile to module
Change 647047 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Cinder: create cinder system user before package install
Change 647047 merged by Andrew Bogott:
[operations/puppet@production] Cinder: create cinder system user before package install
Change 647048 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Cinder: create cinder group as well as user
Change 647048 merged by Andrew Bogott:
[operations/puppet@production] Cinder: create cinder group as well as user
Change 647049 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Added rsyslog config for cinder
Change 647049 merged by Andrew Bogott:
[operations/puppet@production] Added rsyslog config for cinder
Change 647060 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[labs/private@master] Add dummy passwords for cinder service user
Steps for standing up cinder post-puppet:
create database
apply grants
# cinder-manage db sync
create service user:
dn: uid=cinder,ou=people,dc=wikimedia,dc=org givenName: cinder uid: cinder cn: cinder loginShell: /bin/bash sn: cinder homeDirectory: /home/cinder mail: ops@wikimedia.org uidNumber: XXX gidNumber: 500 isNovaAdmin: FALSE objectClass: person objectClass: organizationalPerson objectClass: inetOrgPerson objectClass: ldapPublicKey objectClass: novaUser objectClass: shadowAccount objectClass: posixAccount objectClass: top
ldapadd -x -W -D uid=novaadmin,ou=people,dc=wikimedia,dc=org -f ./cinder.ldif
ldappasswd -x -W -D uid=novaadmin,ou=people,dc=wikimedia,dc=org uid=cinder,ou=people,dc=wikimedia,dc=org
<note password in private puppet>
openstack project create service
openstack role add --project service --user cinder admin
openstack service create --name cinderv3 \ --description "OpenStack Block Storage" volumev3 openstack service create --name cinderv2 \ --description "OpenStack Block Storage" volumev2
openstack endpoint create --region codfw1dev volumev3 admin http://openstack.codfw1dev.wikimediacloud.org:8776/v3/%\(project_id\)s openstack endpoint create --region codfw1dev volumev3 internal http://openstack.codfw1dev.wikimediacloud.org:8776/v3/%\(project_id\)s openstack endpoint create --region codfw1dev volumev3 public http://openstack.codfw1dev.wikimediacloud.org:8776/v3/%\(project_id\)s openstack endpoint create --region codfw1dev-r volumev2 admin http://openstack.codfw1dev.wikimediacloud.org:8776/v2/%\(project_id\)s openstack endpoint create --region codfw1dev-r volumev2 public http://openstack.codfw1dev.wikimediacloud.org:8776/v2/%\(project_id\)s openstack endpoint create --region codfw1dev-r volumev2 internal http://openstack.codfw1dev.wikimediacloud.org:8776/v2/%\(project_id\)s
ceph osd pool create codfw1dev-cinder <pgcount>
ceph auth get-or-create client.codfw1dev-cinder mon 'allow r' osd 'allow class-read object_prefix rbd_children, allow rwx pool=codfw1dev-cinder, allow rx pool=codfw1dev-cinder'
^ done already for eqiad1
add resulting keyring to puppet
^ done already for eqiad1
Check default quotas; if necessary, adjust them by hand in the database (hard limit on quota classes)
default qos things:
openstack volume qos create --property iops_sec=5000 --property total_bytes_sec=200000000 --property write_iops_sec=500 standard-iops openstack volume type create standard openstack volume qos associate (those two)
Change 647061 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Cinder: correct some config settings
Change 647060 merged by Andrew Bogott:
[labs/private@master] Add dummy passwords for cinder service user
Change 647061 merged by Andrew Bogott:
[operations/puppet@production] Cinder: correct some config settings
Change 647099 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Cinder: add rabbit hostname/password to config
Change 647099 merged by Andrew Bogott:
[operations/puppet@production] Cinder: add rabbit hostname/password to config
Change 647323 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Cinder: install ceph client keyring
Change 647329 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Cinder: use the deployment-wide libvirt_rbd_uuid for cinder
Change 647323 merged by Andrew Bogott:
[operations/puppet@production] Cinder: install ceph client keyring
Change 647329 merged by Andrew Bogott:
[operations/puppet@production] Cinder: use the deployment-wide libvirt_rbd_uuid for cinder
Change 647330 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Cinder: no need to restart apache2 when config changes
Change 647330 merged by Andrew Bogott:
[operations/puppet@production] Cinder: no need to restart apache2 when config changes
Change 647335 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Cinder: fix keystone auth for the cinder service user
Change 647335 merged by Andrew Bogott:
[operations/puppet@production] Cinder: fix keystone auth for the cinder service user
Change 647344 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Cinder: more config fixes
Change 647345 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Cinder: include cinder-volume service on control nodes
Change 647344 merged by Andrew Bogott:
[operations/puppet@production] Cinder: more config fixes
Change 647345 merged by Andrew Bogott:
[operations/puppet@production] Cinder: include cinder-volume service on control nodes
Change 647764 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] nova-compute/cinder/ceph: add a cinder-specific ceph uuid
Change 647764 merged by Andrew Bogott:
[operations/puppet@production] nova-compute/cinder/ceph: add a cinder-specific ceph uuid
Change 647786 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] rbd_libvirt: fix installation of the cinder ceph secret
Change 647786 merged by Andrew Bogott:
[operations/puppet@production] rbd_libvirt: fix installation of the cinder ceph secret
Change 647795 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Cinder: set default quotas to be very low
Change 647795 merged by Andrew Bogott:
[operations/puppet@production] Cinder: set default quotas to be very low
Change 647810 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Cinder: update policy.yaml
Change 647810 merged by Andrew Bogott:
[operations/puppet@production] Cinder: update policy.yaml
Change 647850 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Add cinder logs to central logging
Change 647850 merged by Andrew Bogott:
[operations/puppet@production] Add cinder logs to central logging
Change 648296 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Cinder: Fix syslog filter of health checks
Change 648296 merged by Andrew Bogott:
[operations/puppet@production] Cinder: Fix syslog filter of health checks
Change 648302 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Cinder policy.yaml: fix typo that broke policy parsing
Change 648302 merged by Andrew Bogott:
[operations/puppet@production] Cinder policy.yaml: fix typo that broke policy parsing
Change 648303 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Cinder: a few tweaks to quiet log warnings
Change 648303 merged by Andrew Bogott:
[operations/puppet@production] Cinder: a few tweaks to quiet log warnings
At least some of the horizon errors seem to be related to https://bugs.launchpad.net/cinder/+bug/1753885, maybe fixed in Stein.
Change 648770 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Cinder: include custon resource_filters.json file
Change 648770 merged by Andrew Bogott:
[operations/puppet@production] Cinder: include custon resource_filters.json file
Nope! Those errors were a result of a weird default filter policy. After https://gerrit.wikimedia.org/r/c/operations/puppet/+/648770 I don't see any failures in Horizon.
Change 648840 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Cinder: allow api filtering on 'bootable'
Change 648840 merged by Andrew Bogott:
[operations/puppet@production] Cinder: allow api filtering on 'bootable'
Change 648847 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Horizon: update LAUNCH_INSTANCE_DEFAULTS to prepare for Cinder
Change 648847 merged by Andrew Bogott:
[operations/puppet@production] Horizon: update LAUNCH_INSTANCE_DEFAULTS to prepare for Cinder
Change 649422 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Cinder: use a default volume type named 'standard'
Change 649422 merged by Andrew Bogott:
[operations/puppet@production] Cinder: use a default volume type named 'standard'
Change 649891 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Cinder: allow query filtering by volume_id
Change 649891 merged by Andrew Bogott:
[operations/puppet@production] Cinder: allow query filtering by volume_id
Change 649895 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Cinder: allow even more query filtering by volume_id
Change 649895 merged by Andrew Bogott:
[operations/puppet@production] Cinder: allow even more query filtering by volume_id
Change 656250 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Enable cinder in eqiad1
Change 656250 merged by Andrew Bogott:
[operations/puppet@production] Enable cinder in eqiad1
Change 656252 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] cinder: enable haproxy frontend in eqiad1
Change 656252 merged by Andrew Bogott:
[operations/puppet@production] cinder: enable haproxy frontend in eqiad1
Change 656255 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Cinder: set default quotas to 0 so I can deploy in eqiad1
Change 656255 merged by Andrew Bogott:
[operations/puppet@production] Cinder: set default quotas to 0 so I can deploy in eqiad1
Change 656260 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Horizon: install real Cinder policies
Change 656260 merged by Andrew Bogott:
[operations/puppet@production] Horizon: install real Cinder policies
Change 668757 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] cloud-vps: Add a new class to detect and format available cinder volumes
Change 669958 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Add role::labs::cindermount::srv
Change 670278 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Update prepare_cinder_volume.py to support mounting formatted volumes
Change 670278 merged by Andrew Bogott:
[operations/puppet@production] Update prepare_cinder_volume.py to support mounting formatted volumes
Change 668757 merged by Andrew Bogott:
[operations/puppet@production] cloud-vps: Add a new resource to detect and format available cinder volumes
Change 669958 merged by Andrew Bogott:
[operations/puppet@production] Add role::labs::cindermount::srv
Change 670553 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] cinderutils::ensure: Add a 'mount' resource
Change 670553 merged by Andrew Bogott:
[operations/puppet@production] cinderutils::ensure: Refactor and add a 'mount' resource
Change 673098 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[openstack/horizon/horizon@train-buster] Revert "WMF Hack: remove volume quota charts"
Change 673098 merged by Andrew Bogott:
[openstack/horizon/horizon@train-buster] Revert "WMF Hack: remove volume quota charts"
Change 673100 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[openstack/horizon/deploy@train-buster] Update horizon submodule: show volume summary
Change 673100 merged by Andrew Bogott:
[openstack/horizon/deploy@train-buster] Update horizon submodule: show volume summary