Page MenuHomePhabricator

Attachable block storage in cloud-vps
Closed, ResolvedPublic

Description

We need to set up cinder apis and attach them to ceph on the backend and horizon on the front.

Details

ProjectBranchLines +/-Subject
openstack/horizon/deploytrain-buster+1 -1
openstack/horizon/horizontrain-buster+9 -0
operations/puppetproduction+47 -26
operations/puppetproduction+21 -0
operations/puppetproduction+24 -11
operations/puppetproduction+73 -0
operations/puppetproduction+8 -1
operations/puppetproduction+4 -4
operations/puppetproduction+9 -0
operations/puppetproduction+1 -0
operations/puppetproduction+2 -2
operations/puppetproduction+1 -1
operations/puppetproduction+9 -0
operations/puppetproduction+6 -1
operations/puppetproduction+3 -3
operations/puppetproduction+14 -3
operations/puppetproduction+3 -2
operations/puppetproduction+1 -1
operations/puppetproduction+4 -2
operations/puppetproduction+3 -0
operations/puppetproduction+30 -0
operations/puppetproduction+7 -7
operations/puppetproduction+1 -1
operations/puppetproduction+87 -43
operations/puppetproduction+25 -3
operations/puppetproduction+2 -2
operations/puppetproduction+12 -8
operations/puppetproduction+1 -1
operations/puppetproduction+10 -1
operations/puppetproduction+29 -0
operations/puppetproduction+15 -2
operations/puppetproduction+12 -3
labs/privatemaster+6 -1
operations/puppetproduction+5 -0
operations/puppetproduction+7 -1
operations/puppetproduction+13 -1
operations/puppetproduction+1 -0
operations/puppetproduction+2 -0
operations/puppetproduction+2 -0
operations/puppetproduction+490 -0
Show related patches Customize query in gerrit

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
Andrew triaged this task as High priority.Dec 8 2020, 5:10 PM
Andrew moved this task from Inbox to Doing on the cloud-services-team (Kanban) board.

Change 645722 merged by Andrew Bogott:
[operations/puppet@production] Initial cinder class and templates

https://gerrit.wikimedia.org/r/645722

Change 647043 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Cinder: add some shared config settings to hiera

https://gerrit.wikimedia.org/r/647043

Change 647043 merged by Andrew Bogott:
[operations/puppet@production] Cinder: add some shared config settings to hiera

https://gerrit.wikimedia.org/r/647043

Change 647044 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Pass ceph_pool name to deployment-specific cinder profiles

https://gerrit.wikimedia.org/r/647044

Change 647044 merged by Andrew Bogott:
[operations/puppet@production] Pass ceph_pool name to deployment-specific cinder profiles

https://gerrit.wikimedia.org/r/647044

Change 647045 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Pass ceph_pool name from profile to module

https://gerrit.wikimedia.org/r/647045

Change 647045 merged by Andrew Bogott:
[operations/puppet@production] Pass ceph_pool name from profile to module

https://gerrit.wikimedia.org/r/647045

Change 647047 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Cinder: create cinder system user before package install

https://gerrit.wikimedia.org/r/647047

Change 647047 merged by Andrew Bogott:
[operations/puppet@production] Cinder: create cinder system user before package install

https://gerrit.wikimedia.org/r/647047

Change 647048 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Cinder: create cinder group as well as user

https://gerrit.wikimedia.org/r/647048

Change 647048 merged by Andrew Bogott:
[operations/puppet@production] Cinder: create cinder group as well as user

https://gerrit.wikimedia.org/r/647048

Change 647049 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Added rsyslog config for cinder

https://gerrit.wikimedia.org/r/647049

Change 647049 merged by Andrew Bogott:
[operations/puppet@production] Added rsyslog config for cinder

https://gerrit.wikimedia.org/r/647049

Change 647060 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[labs/private@master] Add dummy passwords for cinder service user

https://gerrit.wikimedia.org/r/647060

Steps for standing up cinder post-puppet:

create database

apply grants

# cinder-manage  db sync

create service user:

dn: uid=cinder,ou=people,dc=wikimedia,dc=org
givenName: cinder
uid: cinder
cn: cinder
loginShell: /bin/bash
sn: cinder
homeDirectory: /home/cinder
mail: ops@wikimedia.org
uidNumber: XXX
gidNumber: 500
isNovaAdmin: FALSE
objectClass: person
objectClass: organizationalPerson
objectClass: inetOrgPerson
objectClass: ldapPublicKey
objectClass: novaUser
objectClass: shadowAccount
objectClass: posixAccount
objectClass: top
ldapadd -x -W -D uid=novaadmin,ou=people,dc=wikimedia,dc=org -f ./cinder.ldif
ldappasswd -x -W -D uid=novaadmin,ou=people,dc=wikimedia,dc=org uid=cinder,ou=people,dc=wikimedia,dc=org

<note password in private puppet>

openstack project create service
openstack role add --project service --user cinder admin
openstack service create --name cinderv3 \
  --description "OpenStack Block Storage" volumev3
openstack service create --name cinderv2 \
  --description "OpenStack Block Storage" volumev2
openstack endpoint create --region codfw1dev volumev3 admin http://openstack.codfw1dev.wikimediacloud.org:8776/v3/%\(project_id\)s
openstack endpoint create --region codfw1dev volumev3 internal http://openstack.codfw1dev.wikimediacloud.org:8776/v3/%\(project_id\)s
openstack endpoint create --region codfw1dev volumev3 public http://openstack.codfw1dev.wikimediacloud.org:8776/v3/%\(project_id\)s

openstack endpoint create --region codfw1dev-r volumev2 admin http://openstack.codfw1dev.wikimediacloud.org:8776/v2/%\(project_id\)s
openstack endpoint create --region codfw1dev-r volumev2 public http://openstack.codfw1dev.wikimediacloud.org:8776/v2/%\(project_id\)s
openstack endpoint create --region codfw1dev-r volumev2 internal http://openstack.codfw1dev.wikimediacloud.org:8776/v2/%\(project_id\)s
ceph osd pool create codfw1dev-cinder <pgcount>
ceph auth get-or-create client.codfw1dev-cinder mon 'allow r' osd 'allow class-read object_prefix rbd_children, allow rwx pool=codfw1dev-cinder, allow rx pool=codfw1dev-cinder'

^ done already for eqiad1

add resulting keyring to puppet
^ done already for eqiad1

Check default quotas; if necessary, adjust them by hand in the database (hard limit on quota classes)

default qos things:

openstack volume qos create --property iops_sec=5000 --property total_bytes_sec=200000000 --property write_iops_sec=500 standard-iops
openstack volume type create standard
openstack volume qos associate (those two)

Change 647061 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Cinder: correct some config settings

https://gerrit.wikimedia.org/r/647061

Change 647060 merged by Andrew Bogott:
[labs/private@master] Add dummy passwords for cinder service user

https://gerrit.wikimedia.org/r/647060

Change 647061 merged by Andrew Bogott:
[operations/puppet@production] Cinder: correct some config settings

https://gerrit.wikimedia.org/r/647061

Change 647099 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Cinder: add rabbit hostname/password to config

https://gerrit.wikimedia.org/r/647099

Change 647099 merged by Andrew Bogott:
[operations/puppet@production] Cinder: add rabbit hostname/password to config

https://gerrit.wikimedia.org/r/647099

Change 647323 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Cinder: install ceph client keyring

https://gerrit.wikimedia.org/r/647323

Change 647329 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Cinder: use the deployment-wide libvirt_rbd_uuid for cinder

https://gerrit.wikimedia.org/r/647329

Change 647323 merged by Andrew Bogott:
[operations/puppet@production] Cinder: install ceph client keyring

https://gerrit.wikimedia.org/r/647323

Change 647329 merged by Andrew Bogott:
[operations/puppet@production] Cinder: use the deployment-wide libvirt_rbd_uuid for cinder

https://gerrit.wikimedia.org/r/647329

Change 647330 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Cinder: no need to restart apache2 when config changes

https://gerrit.wikimedia.org/r/647330

Change 647330 merged by Andrew Bogott:
[operations/puppet@production] Cinder: no need to restart apache2 when config changes

https://gerrit.wikimedia.org/r/647330

Change 647335 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Cinder: fix keystone auth for the cinder service user

https://gerrit.wikimedia.org/r/647335

Change 647335 merged by Andrew Bogott:
[operations/puppet@production] Cinder: fix keystone auth for the cinder service user

https://gerrit.wikimedia.org/r/647335

Change 647344 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Cinder: more config fixes

https://gerrit.wikimedia.org/r/647344

Change 647345 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Cinder: include cinder-volume service on control nodes

https://gerrit.wikimedia.org/r/647345

Change 647344 merged by Andrew Bogott:
[operations/puppet@production] Cinder: more config fixes

https://gerrit.wikimedia.org/r/647344

Change 647345 merged by Andrew Bogott:
[operations/puppet@production] Cinder: include cinder-volume service on control nodes

https://gerrit.wikimedia.org/r/647345

Change 647764 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] nova-compute/cinder/ceph: add a cinder-specific ceph uuid

https://gerrit.wikimedia.org/r/647764

Change 647764 merged by Andrew Bogott:
[operations/puppet@production] nova-compute/cinder/ceph: add a cinder-specific ceph uuid

https://gerrit.wikimedia.org/r/647764

Change 647786 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] rbd_libvirt: fix installation of the cinder ceph secret

https://gerrit.wikimedia.org/r/647786

Change 647786 merged by Andrew Bogott:
[operations/puppet@production] rbd_libvirt: fix installation of the cinder ceph secret

https://gerrit.wikimedia.org/r/647786

Change 647795 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Cinder: set default quotas to be very low

https://gerrit.wikimedia.org/r/647795

Change 647795 merged by Andrew Bogott:
[operations/puppet@production] Cinder: set default quotas to be very low

https://gerrit.wikimedia.org/r/647795

Change 647810 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Cinder: update policy.yaml

https://gerrit.wikimedia.org/r/647810

Change 647810 merged by Andrew Bogott:
[operations/puppet@production] Cinder: update policy.yaml

https://gerrit.wikimedia.org/r/647810

Change 647850 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Add cinder logs to central logging

https://gerrit.wikimedia.org/r/647850

Change 647850 merged by Andrew Bogott:
[operations/puppet@production] Add cinder logs to central logging

https://gerrit.wikimedia.org/r/647850

Change 648296 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Cinder: Fix syslog filter of health checks

https://gerrit.wikimedia.org/r/648296

Change 648296 merged by Andrew Bogott:
[operations/puppet@production] Cinder: Fix syslog filter of health checks

https://gerrit.wikimedia.org/r/648296

Change 648302 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Cinder policy.yaml: fix typo that broke policy parsing

https://gerrit.wikimedia.org/r/648302

Change 648302 merged by Andrew Bogott:
[operations/puppet@production] Cinder policy.yaml: fix typo that broke policy parsing

https://gerrit.wikimedia.org/r/648302

Change 648303 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Cinder: a few tweaks to quiet log warnings

https://gerrit.wikimedia.org/r/648303

Change 648303 merged by Andrew Bogott:
[operations/puppet@production] Cinder: a few tweaks to quiet log warnings

https://gerrit.wikimedia.org/r/648303

At least some of the horizon errors seem to be related to https://bugs.launchpad.net/cinder/+bug/1753885, maybe fixed in Stein.

Change 648770 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Cinder: include custon resource_filters.json file

https://gerrit.wikimedia.org/r/648770

Change 648770 merged by Andrew Bogott:
[operations/puppet@production] Cinder: include custon resource_filters.json file

https://gerrit.wikimedia.org/r/648770

At least some of the horizon errors seem to be related to https://bugs.launchpad.net/cinder/+bug/1753885, maybe fixed in Stein.

Nope! Those errors were a result of a weird default filter policy. After https://gerrit.wikimedia.org/r/c/operations/puppet/+/648770 I don't see any failures in Horizon.

Change 648840 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Cinder: allow api filtering on 'bootable'

https://gerrit.wikimedia.org/r/648840

Change 648840 merged by Andrew Bogott:
[operations/puppet@production] Cinder: allow api filtering on 'bootable'

https://gerrit.wikimedia.org/r/648840

Change 648847 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Horizon: update LAUNCH_INSTANCE_DEFAULTS to prepare for Cinder

https://gerrit.wikimedia.org/r/648847

Change 648847 merged by Andrew Bogott:
[operations/puppet@production] Horizon: update LAUNCH_INSTANCE_DEFAULTS to prepare for Cinder

https://gerrit.wikimedia.org/r/648847

Change 649422 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Cinder: use a default volume type named 'standard'

https://gerrit.wikimedia.org/r/649422

Change 649422 merged by Andrew Bogott:
[operations/puppet@production] Cinder: use a default volume type named 'standard'

https://gerrit.wikimedia.org/r/649422

Change 649891 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Cinder: allow query filtering by volume_id

https://gerrit.wikimedia.org/r/649891

Change 649891 merged by Andrew Bogott:
[operations/puppet@production] Cinder: allow query filtering by volume_id

https://gerrit.wikimedia.org/r/649891

Change 649895 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Cinder: allow even more query filtering by volume_id

https://gerrit.wikimedia.org/r/649895

Change 649895 merged by Andrew Bogott:
[operations/puppet@production] Cinder: allow even more query filtering by volume_id

https://gerrit.wikimedia.org/r/649895

Change 656250 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Enable cinder in eqiad1

https://gerrit.wikimedia.org/r/656250

Change 656250 merged by Andrew Bogott:
[operations/puppet@production] Enable cinder in eqiad1

https://gerrit.wikimedia.org/r/656250

Change 656252 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] cinder: enable haproxy frontend in eqiad1

https://gerrit.wikimedia.org/r/656252

Change 656252 merged by Andrew Bogott:
[operations/puppet@production] cinder: enable haproxy frontend in eqiad1

https://gerrit.wikimedia.org/r/656252

Change 656255 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Cinder: set default quotas to 0 so I can deploy in eqiad1

https://gerrit.wikimedia.org/r/656255

Change 656255 merged by Andrew Bogott:
[operations/puppet@production] Cinder: set default quotas to 0 so I can deploy in eqiad1

https://gerrit.wikimedia.org/r/656255

Change 656260 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Horizon: install real Cinder policies

https://gerrit.wikimedia.org/r/656260

Change 656260 merged by Andrew Bogott:
[operations/puppet@production] Horizon: install real Cinder policies

https://gerrit.wikimedia.org/r/656260

Change 668757 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] cloud-vps: Add a new class to detect and format available cinder volumes

https://gerrit.wikimedia.org/r/668757

Change 669958 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Add role::labs::cindermount::srv

https://gerrit.wikimedia.org/r/669958

Change 670278 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Update prepare_cinder_volume.py to support mounting formatted volumes

https://gerrit.wikimedia.org/r/670278

Change 670278 merged by Andrew Bogott:
[operations/puppet@production] Update prepare_cinder_volume.py to support mounting formatted volumes

https://gerrit.wikimedia.org/r/670278

Change 668757 merged by Andrew Bogott:
[operations/puppet@production] cloud-vps: Add a new resource to detect and format available cinder volumes

https://gerrit.wikimedia.org/r/668757

Change 669958 merged by Andrew Bogott:
[operations/puppet@production] Add role::labs::cindermount::srv

https://gerrit.wikimedia.org/r/669958

Change 670553 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] cinderutils::ensure: Add a 'mount' resource

https://gerrit.wikimedia.org/r/670553

Change 670553 merged by Andrew Bogott:
[operations/puppet@production] cinderutils::ensure: Refactor and add a 'mount' resource

https://gerrit.wikimedia.org/r/670553

Change 673098 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[openstack/horizon/horizon@train-buster] Revert "WMF Hack: remove volume quota charts"

https://gerrit.wikimedia.org/r/673098

Change 673098 merged by Andrew Bogott:
[openstack/horizon/horizon@train-buster] Revert "WMF Hack: remove volume quota charts"

https://gerrit.wikimedia.org/r/673098

Change 673100 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[openstack/horizon/deploy@train-buster] Update horizon submodule: show volume summary

https://gerrit.wikimedia.org/r/673100

Change 673100 merged by Andrew Bogott:
[openstack/horizon/deploy@train-buster] Update horizon submodule: show volume summary

https://gerrit.wikimedia.org/r/673100