cloudvps: eqiad1 deployment
Open, NormalPublic

Description

Tracking task for the eqiad1 openstack deployment for the Cloud VPS service.

This deployment implements neutron and will co-exists with the main deployment (nova-network) until the final migration.

More info:

There are a very large number of changes, so older changes are hidden. Show Older Changes

Mentioned in SAL (#wikimedia-operations) [2018-06-13T12:16:29Z] <arturo> T196633 extend downtime for labcontrol1003

Change 440102 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] openstack: eqiad1: enable keystone local database

https://gerrit.wikimedia.org/r/440102

Change 440144 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] openstack: eqiad1: disable keystone hourly cron

https://gerrit.wikimedia.org/r/440144

Change 440144 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] openstack: eqiad1: disable keystone hourly cron

https://gerrit.wikimedia.org/r/440144

Change 440109 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] openstack: eqiad1: bootstrap keystone

https://gerrit.wikimedia.org/r/440109

Change 442063 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[labs/private@master] hieradata: add eqiad1 keystone admin_token

https://gerrit.wikimedia.org/r/442063

Change 442063 merged by Arturo Borrero Gonzalez:
[labs/private@master] hieradata: add eqiad1 keystone admin_token

https://gerrit.wikimedia.org/r/442063

Change 440109 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] openstack: eqiad1: bootstrap keystone

https://gerrit.wikimedia.org/r/440109

Change 442316 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] openstack: keystone bootstrap: make seed script more c&p friendly

https://gerrit.wikimedia.org/r/442316

Change 442316 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] openstack: keystone bootstrap: make seed script more c&p friendly

https://gerrit.wikimedia.org/r/442316

Change 442328 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] openstack: eqiad1: allow mysql connection for keystone

https://gerrit.wikimedia.org/r/442328

Change 442328 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] openstack: eqiad1: allow mysql connection for keystone

https://gerrit.wikimedia.org/r/442328

Change 442332 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] openstack: eqiad1: fix keystone local db ferm rul

https://gerrit.wikimedia.org/r/442332

Change 442332 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] openstack: eqiad1: fix keystone local db ferm rul

https://gerrit.wikimedia.org/r/442332

Change 442340 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] hieradata: openstack: eqiad1: fix value of nova_controller_standby

https://gerrit.wikimedia.org/r/442340

Change 442340 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] hieradata: openstack: eqiad1: fix value of nova_controller_standby

https://gerrit.wikimedia.org/r/442340

keystone has been deployed to labcontrol1003.wikimedia.org and labcontrol1004.wikimedia.org.

I talked with @chasemp about next steps and the status of things, and they are:

  • use a local database for keystone & glance at labcontrol1003. Then moving to m5 when eqiad1 is put into prod.
  • issue token for keystone to start doing basic operations and tests (openstack token issue).
  • bootstrap keystone. From puppet, there are command examples.
  • new labnet boxes are then blocked by all steps above.

this is now done, keystone is running and can be used from both labcontrol1003.wikimedia.org and labcontrol1004.wikimedia.org

Change 442737 had a related patch set uploaded (by Rush; owner: cpettet):
[operations/puppet@production] openstack: basic net role to labnet100[34]

https://gerrit.wikimedia.org/r/442737

Change 442737 merged by Rush:
[operations/puppet@production] openstack: basic net role to labnet100[34]

https://gerrit.wikimedia.org/r/442737

Change 442807 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] openstack: eqiad1: keystone bootstrap done

https://gerrit.wikimedia.org/r/442807

Change 442807 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] openstack: eqiad1: keystone bootstrap done

https://gerrit.wikimedia.org/r/442807

Change 442814 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[labs/private@master] hieradata: add profile::openstack::eqiad1::neutron::db_pass

https://gerrit.wikimedia.org/r/442814

Change 442814 merged by Arturo Borrero Gonzalez:
[labs/private@master] hieradata: add profile::openstack::eqiad1::neutron::db_pass

https://gerrit.wikimedia.org/r/442814

Change 442815 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] openstack: eqiad1: enable neutron in control boxes

https://gerrit.wikimedia.org/r/442815

Change 442836 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] openstack: eqiad1: enable glance in control boxes

https://gerrit.wikimedia.org/r/442836

Change 442837 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[labs/private@master] hieradata: add profile::openstack::eqiad1::glance::db_pass

https://gerrit.wikimedia.org/r/442837

Change 442837 merged by Arturo Borrero Gonzalez:
[labs/private@master] hieradata: add profile::openstack::eqiad1::glance::db_pass

https://gerrit.wikimedia.org/r/442837

Change 442815 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] openstack: eqiad1: enable neutron in control boxes

https://gerrit.wikimedia.org/r/442815

Change 442839 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] openstack: neutron-common: install from jessie-backports if running mitaka

https://gerrit.wikimedia.org/r/442839

Change 442839 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] openstack: neutron-common: install from jessie-backports if running mitaka

https://gerrit.wikimedia.org/r/442839

Change 442836 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] openstack: eqiad1: enable glance in control boxes

https://gerrit.wikimedia.org/r/442836

Change 442841 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] openstack: glance: install from jessie-backports if running mitaka

https://gerrit.wikimedia.org/r/442841

Change 442841 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] openstack: glance: install from jessie-backports if running mitaka

https://gerrit.wikimedia.org/r/442841

Change 443197 had a related patch set uploaded (by Rush; owner: cpettet):
[operations/puppet@production] openstack: eqiad1 initial neutron l3-agent manifest

https://gerrit.wikimedia.org/r/443197

Change 443197 merged by Rush:
[operations/puppet@production] openstack: eqiad1 initial neutron l3-agent manifest

https://gerrit.wikimedia.org/r/443197

Vvjjkkii renamed this task from cloudvps: eqiad1 deployment to ahbaaaaaaa.Sun, Jul 1, 1:06 AM
Vvjjkkii raised the priority of this task from Normal to High.
Vvjjkkii removed aborrero as the assignee of this task.
Vvjjkkii updated the task description. (Show Details)
Vvjjkkii removed subscribers: Aklapper, gerritbot.

Change 443414 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] openstack: glance: update bootstrap seed script

https://gerrit.wikimedia.org/r/443414

Change 443414 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] openstack: glance: update bootstrap seed script

https://gerrit.wikimedia.org/r/443414

CommunityTechBot edited projects, added Cloud-Services; removed Hashtags.
CommunityTechBot assigned this task to aborrero.
CommunityTechBot lowered the priority of this task from High to Normal.
CommunityTechBot renamed this task from ahbaaaaaaa to cloudvps: eqiad1 deployment.
CommunityTechBot added subscribers: Aklapper, gerritbot.

Glance should be bootstrapped now.

Change 443796 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[labs/private@master] hieradata: profile::openstack::eqiad1::neutron::metadata_proxy_shared_secret

https://gerrit.wikimedia.org/r/443796

Change 443796 merged by Arturo Borrero Gonzalez:
[labs/private@master] hieradata: profile::openstack::eqiad1::neutron::metadata_proxy_shared_secret

https://gerrit.wikimedia.org/r/443796

Change 443802 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] openstack: eqiad1: add nova common profile

https://gerrit.wikimedia.org/r/443802

Change 443802 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] openstack: eqiad1: add nova common profile

https://gerrit.wikimedia.org/r/443802

Change 443811 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] openstack: eqiad1: add nova conductor profile

https://gerrit.wikimedia.org/r/443811

Change 443811 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] openstack: eqiad1: add nova conductor profile

https://gerrit.wikimedia.org/r/443811

Change 443819 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] openstack: eqiad1: add nova scheduler profile

https://gerrit.wikimedia.org/r/443819

Change 443819 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] openstack: eqiad1: add nova scheduler profile

https://gerrit.wikimedia.org/r/443819

Change 443824 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] openstack: eqiad1: enable nova-api

https://gerrit.wikimedia.org/r/443824

Change 443824 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] openstack: eqiad1: enable nova-api

https://gerrit.wikimedia.org/r/443824

status of nova in eqiad1:

  • I've bootstrapped the local database in labcontrol1003.wikimedia.org
  • the nova-api service has some issue. Puppet has it disabled. This is probably because the hiera key nova_api_host is pointing to an unconfigured machine?
 git grep nova_api_host hieradata/
hieradata/common/profile/openstack/eqiad1.yaml:profile::openstack::eqiad1::nova_api_host: 'labnet1003.eqiad.wmnet'
hieradata/common/profile/openstack/labtest.yaml:profile::openstack::labtest::nova_api_host: 'labtestnet2001.codfw.wmnet'
hieradata/common/profile/openstack/labtestn.yaml:profile::openstack::labtestn::nova_api_host: 'labtestcontrol2003.wikimedia.org'
hieradata/common/profile/openstack/main.yaml:profile::openstack::main::nova_api_host: 'labnet1001.eqiad.wmnet'

status of neutron in eqiad1:

  • I've done the initial DB bootstrap in labcontrol1003.wikimedia.org
  • I stopped at the point of creating networks and subnets, since I'm not sure I have all the required data yet (do we have all the net allocations?) and I would like to discuss this first with @chasemp

Change 443922 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] openstack: eqiad1: nova-api runs on control boxes

https://gerrit.wikimedia.org/r/443922

Change 443922 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] openstack: eqiad1: nova-api runs on control boxes

https://gerrit.wikimedia.org/r/443922

Change 443925 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] openstack: bootstrap: nova: fix endpoints

https://gerrit.wikimedia.org/r/443925

Change 443925 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] openstack: bootstrap: nova: fix endpoints

https://gerrit.wikimedia.org/r/443925

Change 443953 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] openstack: add openstack-cvps wrapper script

https://gerrit.wikimedia.org/r/443953

Change 443953 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] openstack: add openstack-cvps wrapper script

https://gerrit.wikimedia.org/r/443953

aborrero moved this task from Triage to OpenStack on the Cloud-Services board.Thu, Jul 5, 3:27 PM

Change 444204 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] openstack: eqiad1: enable neutron-l3-agent

https://gerrit.wikimedia.org/r/444204

Change 444204 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] openstack: eqiad1: enable neutron-l3-agent

https://gerrit.wikimedia.org/r/444204

Change 444222 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] openstack: bootstrap: neutron: add more hints about l3agents

https://gerrit.wikimedia.org/r/444222

Change 444224 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] openstack: eqiad1: add dhcp agents configuration

https://gerrit.wikimedia.org/r/444224

Change 444224 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] openstack: eqiad1: add dhcp agents configuration

https://gerrit.wikimedia.org/r/444224

Change 444855 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] openstack: eqiad1: enable nova-compute service

https://gerrit.wikimedia.org/r/444855

Change 444855 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] openstack: eqiad1: enable nova-compute service

https://gerrit.wikimedia.org/r/444855

Change 445020 had a related patch set uploaded (by Rush; owner: cpettet):
[operations/puppet@production] openstack: eqiad1-r metadata agent for net role

https://gerrit.wikimedia.org/r/445020

Change 445020 merged by Rush:
[operations/puppet@production] openstack: eqiad1-r metadata agent for net role

https://gerrit.wikimedia.org/r/445020

Change 445023 had a related patch set uploaded (by Rush; owner: cpettet):
[operations/dns@master] openstack: add labnet100[34] VLAN 1120 reservations

https://gerrit.wikimedia.org/r/445023

Change 445192 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] hieradata: openstack: eqiad1: fix typo in dmz_cidr

https://gerrit.wikimedia.org/r/445192

Change 445192 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] hieradata: openstack: eqiad1: fix typo in dmz_cidr

https://gerrit.wikimedia.org/r/445192

Change 445204 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] hieradata: eqiad1: fix public IP address

https://gerrit.wikimedia.org/r/445204

Change 445209 had a related patch set uploaded (by Rush; owner: cpettet):
[operations/puppet@production] openstack: eqiad1 assign neutron::network_public_ip

https://gerrit.wikimedia.org/r/445209

Change 445209 merged by Rush:
[operations/puppet@production] openstack: eqiad1 assign neutron::network_public_ip

https://gerrit.wikimedia.org/r/445209

Change 445211 had a related patch set uploaded (by Rush; owner: cpettet):
[operations/puppet@production] openstack: eqiad1 and labtestn fix and cleanup neutron settings

https://gerrit.wikimedia.org/r/445211

Change 445211 merged by Rush:
[operations/puppet@production] openstack: eqiad1 and labtestn fix and cleanup neutron settings

https://gerrit.wikimedia.org/r/445211

Change 444222 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] openstack: bootstrap: neutron: refresh and add more hints

https://gerrit.wikimedia.org/r/444222

Change 445409 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] openstack: neutron metadata agent: add support for jessie/mitaka

https://gerrit.wikimedia.org/r/445409

Change 445409 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] openstack: neutron metadata agent: add support for jessie/mitaka

https://gerrit.wikimedia.org/r/445409

Change 445422 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] hieradata: openstack: eqiad1: add cloudvirt1022 to the pool

https://gerrit.wikimedia.org/r/445422

Change 445422 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] hieradata: openstack: eqiad1: add cloudvirt1022 to the pool

https://gerrit.wikimedia.org/r/445422

Change 445432 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] cloudvps: eqiad1: extend mysql limits

https://gerrit.wikimedia.org/r/445432

Change 445432 merged by Rush:
[operations/puppet@production] cloudvps: eqiad1: extend mysql limits

https://gerrit.wikimedia.org/r/445432

Change 445457 had a related patch set uploaded (by Rush; owner: cpettet):
[operations/puppet@production] openstack: eqiad1 neutron bootstrap DNS server

https://gerrit.wikimedia.org/r/445457

Change 445457 merged by Rush:
[operations/puppet@production] openstack: eqiad1 neutron bootstrap DNS server

https://gerrit.wikimedia.org/r/445457

Change 445582 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] openstack: neutron: make agents heartbeats configurable

https://gerrit.wikimedia.org/r/445582

Change 445582 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] openstack: neutron: make agents heartbeats configurable

https://gerrit.wikimedia.org/r/445582

ayounsi removed a subscriber: ayounsi.Fri, Jul 13, 11:20 PM