Create Task
Maniphest T196633

cloudvps: eqiad1 deployment
Closed, ResolvedPublic
Actions

Description

Tracking task for the eqiad1 openstack deployment for the Cloud VPS service.

This deployment implements neutron and will co-exists with the main deployment (nova-network) until the final migration.

More info:

Related Objects
Search...

There are a very large number of changes, so older changes are hidden. Show Older Changes
gerritbot added a comment.Jun 27 2018, 2:54 PM

Change 442316 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] openstack: keystone bootstrap: make seed script more c&p friendly

https://gerrit.wikimedia.org/r/442316

gerritbot added a comment.Jun 27 2018, 2:56 PM

Change 442316 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] openstack: keystone bootstrap: make seed script more c&p friendly

https://gerrit.wikimedia.org/r/442316

gerritbot added a comment.Jun 27 2018, 3:31 PM

Change 442328 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] openstack: eqiad1: allow mysql connection for keystone

https://gerrit.wikimedia.org/r/442328

gerritbot added a comment.Jun 27 2018, 3:46 PM

Change 442328 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] openstack: eqiad1: allow mysql connection for keystone

https://gerrit.wikimedia.org/r/442328

gerritbot added a comment.Jun 27 2018, 4:00 PM

Change 442332 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] openstack: eqiad1: fix keystone local db ferm rul

https://gerrit.wikimedia.org/r/442332

gerritbot added a comment.Jun 27 2018, 4:00 PM

Change 442332 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] openstack: eqiad1: fix keystone local db ferm rul

https://gerrit.wikimedia.org/r/442332

gerritbot added a comment.Jun 27 2018, 4:30 PM

Change 442340 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] hieradata: openstack: eqiad1: fix value of nova_controller_standby

https://gerrit.wikimedia.org/r/442340

gerritbot added a comment.Jun 27 2018, 4:33 PM

Change 442340 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] hieradata: openstack: eqiad1: fix value of nova_controller_standby

https://gerrit.wikimedia.org/r/442340

aborrero added a comment.Jun 27 2018, 5:16 PM
In T196633#4275209, @aborrero wrote:

keystone has been deployed to labcontrol1003.wikimedia.org and labcontrol1004.wikimedia.org.

I talked with @chasemp about next steps and the status of things, and they are:

  • use a local database for keystone & glance at labcontrol1003. Then moving to m5 when eqiad1 is put into prod.
  • issue token for keystone to start doing basic operations and tests (openstack token issue).
  • bootstrap keystone. From puppet, there are command examples.
  • new labnet boxes are then blocked by all steps above.

this is now done, keystone is running and can be used from both labcontrol1003.wikimedia.org and labcontrol1004.wikimedia.org

gerritbot added a comment.Jun 27 2018, 8:33 PM

Change 442737 had a related patch set uploaded (by Rush; owner: cpettet):
[operations/puppet@production] openstack: basic net role to labnet100[34]

https://gerrit.wikimedia.org/r/442737

gerritbot added a comment.Jun 27 2018, 8:34 PM

Change 442737 merged by Rush:
[operations/puppet@production] openstack: basic net role to labnet100[34]

https://gerrit.wikimedia.org/r/442737

gerritbot added a comment.Jun 28 2018, 9:25 AM

Change 442807 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] openstack: eqiad1: keystone bootstrap done

https://gerrit.wikimedia.org/r/442807

gerritbot added a comment.Jun 28 2018, 9:25 AM

Change 442807 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] openstack: eqiad1: keystone bootstrap done

https://gerrit.wikimedia.org/r/442807

gerritbot added a comment.Jun 28 2018, 9:46 AM

Change 442814 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[labs/private@master] hieradata: add profile::openstack::eqiad1::neutron::db_pass

https://gerrit.wikimedia.org/r/442814

gerritbot added a comment.Jun 28 2018, 9:46 AM

Change 442814 merged by Arturo Borrero Gonzalez:
[labs/private@master] hieradata: add profile::openstack::eqiad1::neutron::db_pass

https://gerrit.wikimedia.org/r/442814

gerritbot added a comment.Jun 28 2018, 9:49 AM

Change 442815 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] openstack: eqiad1: enable neutron in control boxes

https://gerrit.wikimedia.org/r/442815

gerritbot added a comment.Jun 28 2018, 12:34 PM

Change 442836 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] openstack: eqiad1: enable glance in control boxes

https://gerrit.wikimedia.org/r/442836

gerritbot added a comment.Jun 28 2018, 12:36 PM

Change 442837 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[labs/private@master] hieradata: add profile::openstack::eqiad1::glance::db_pass

https://gerrit.wikimedia.org/r/442837

gerritbot added a comment.Jun 28 2018, 12:38 PM

Change 442837 merged by Arturo Borrero Gonzalez:
[labs/private@master] hieradata: add profile::openstack::eqiad1::glance::db_pass

https://gerrit.wikimedia.org/r/442837

gerritbot added a comment.Jun 28 2018, 12:47 PM

Change 442815 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] openstack: eqiad1: enable neutron in control boxes

https://gerrit.wikimedia.org/r/442815

gerritbot added a comment.Jun 28 2018, 12:53 PM

Change 442839 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] openstack: neutron-common: install from jessie-backports if running mitaka

https://gerrit.wikimedia.org/r/442839

gerritbot added a comment.Jun 28 2018, 12:55 PM

Change 442839 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] openstack: neutron-common: install from jessie-backports if running mitaka

https://gerrit.wikimedia.org/r/442839

gerritbot added a comment.Jun 28 2018, 1:07 PM

Change 442836 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] openstack: eqiad1: enable glance in control boxes

https://gerrit.wikimedia.org/r/442836

gerritbot added a comment.Jun 28 2018, 1:11 PM

Change 442841 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] openstack: glance: install from jessie-backports if running mitaka

https://gerrit.wikimedia.org/r/442841

gerritbot added a comment.Jun 28 2018, 1:13 PM

Change 442841 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] openstack: glance: install from jessie-backports if running mitaka

https://gerrit.wikimedia.org/r/442841

gerritbot added a comment.Jun 29 2018, 9:20 PM

Change 443197 had a related patch set uploaded (by Rush; owner: cpettet):
[operations/puppet@production] openstack: eqiad1 initial neutron l3-agent manifest

https://gerrit.wikimedia.org/r/443197

gerritbot added a comment.Jun 29 2018, 9:32 PM

Change 443197 merged by Rush:
[operations/puppet@production] openstack: eqiad1 initial neutron l3-agent manifest

https://gerrit.wikimedia.org/r/443197

• Vvjjkkii renamed this task from cloudvps: eqiad1 deployment to ahbaaaaaaa.Jul 1 2018, 1:06 AM
• Vvjjkkii raised the priority of this task from Normal to High.
• Vvjjkkii removed aborrero as the assignee of this task.
• Vvjjkkii edited projects, added CheckUser, Connected-Open-Heritage-Batch-uploads (RAÄ-KMB_1_2017-02), Tamil-Sites, Gamepress, Hashtags, JADE, KartoEditor, Language-2018-Apr-June, New-Editor-Experiences, Mail, TCB-Team; removed Cloud-Services.
• Vvjjkkii updated the task description. (Show Details)
• Vvjjkkii removed subscribers: Aklapper, gerritbot.
gerritbot added a comment.Jul 2 2018, 12:29 PM

Change 443414 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] openstack: glance: update bootstrap seed script

https://gerrit.wikimedia.org/r/443414

gerritbot added a comment.Jul 2 2018, 12:36 PM

Change 443414 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] openstack: glance: update bootstrap seed script

https://gerrit.wikimedia.org/r/443414

CommunityTechBot updated the task description. (Show Details)Jul 2 2018, 1:31 PM
CommunityTechBot edited projects, added Cloud-Services; removed Hashtags.
CommunityTechBot removed projects: TCB-Team, Mail, New-Editor-Experiences, Language-2018-Apr-June, KartoEditor, JADE, Gamepress, Tamil-Sites, Connected-Open-Heritage-Batch-uploads (RAÄ-KMB_1_2017-02), CheckUser.
CommunityTechBot assigned this task to aborrero.
CommunityTechBot lowered the priority of this task from High to Normal.
CommunityTechBot renamed this task from ahbaaaaaaa to cloudvps: eqiad1 deployment.
CommunityTechBot added subscribers: Aklapper, gerritbot.
aborrero added a comment.Jul 2 2018, 4:49 PM

Glance should be bootstrapped now.

gerritbot added a comment.Jul 4 2018, 9:27 AM

Change 443796 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[labs/private@master] hieradata: profile::openstack::eqiad1::neutron::metadata_proxy_shared_secret

https://gerrit.wikimedia.org/r/443796

gerritbot added a comment.Jul 4 2018, 9:27 AM

Change 443796 merged by Arturo Borrero Gonzalez:
[labs/private@master] hieradata: profile::openstack::eqiad1::neutron::metadata_proxy_shared_secret

https://gerrit.wikimedia.org/r/443796

gerritbot added a comment.Jul 4 2018, 9:36 AM

Change 443802 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] openstack: eqiad1: add nova common profile

https://gerrit.wikimedia.org/r/443802

gerritbot added a comment.Jul 4 2018, 9:47 AM

Change 443802 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] openstack: eqiad1: add nova common profile

https://gerrit.wikimedia.org/r/443802

gerritbot added a comment.Jul 4 2018, 10:26 AM

Change 443811 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] openstack: eqiad1: add nova conductor profile

https://gerrit.wikimedia.org/r/443811

gerritbot added a comment.Jul 4 2018, 11:00 AM

Change 443811 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] openstack: eqiad1: add nova conductor profile

https://gerrit.wikimedia.org/r/443811

gerritbot added a comment.Jul 4 2018, 11:29 AM

Change 443819 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] openstack: eqiad1: add nova scheduler profile

https://gerrit.wikimedia.org/r/443819

gerritbot added a comment.Jul 4 2018, 11:35 AM

Change 443819 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] openstack: eqiad1: add nova scheduler profile

https://gerrit.wikimedia.org/r/443819

gerritbot added a comment.Jul 4 2018, 12:26 PM

Change 443824 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] openstack: eqiad1: enable nova-api

https://gerrit.wikimedia.org/r/443824

gerritbot added a comment.Jul 4 2018, 12:31 PM

Change 443824 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] openstack: eqiad1: enable nova-api

https://gerrit.wikimedia.org/r/443824

aborrero added a comment.Jul 4 2018, 4:32 PM

status of nova in eqiad1:

  • I've bootstrapped the local database in labcontrol1003.wikimedia.org
  • the nova-api service has some issue. Puppet has it disabled. This is probably because the hiera key nova_api_host is pointing to an unconfigured machine?
 git grep nova_api_host hieradata/
hieradata/common/profile/openstack/eqiad1.yaml:profile::openstack::eqiad1::nova_api_host: 'labnet1003.eqiad.wmnet'
hieradata/common/profile/openstack/labtest.yaml:profile::openstack::labtest::nova_api_host: 'labtestnet2001.codfw.wmnet'
hieradata/common/profile/openstack/labtestn.yaml:profile::openstack::labtestn::nova_api_host: 'labtestcontrol2003.wikimedia.org'
hieradata/common/profile/openstack/main.yaml:profile::openstack::main::nova_api_host: 'labnet1001.eqiad.wmnet'
aborrero added a comment.Jul 4 2018, 4:43 PM

status of neutron in eqiad1:

  • I've done the initial DB bootstrap in labcontrol1003.wikimedia.org
  • I stopped at the point of creating networks and subnets, since I'm not sure I have all the required data yet (do we have all the net allocations?) and I would like to discuss this first with @chasemp
gerritbot added a comment.Jul 5 2018, 9:11 AM

Change 443922 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] openstack: eqiad1: nova-api runs on control boxes

https://gerrit.wikimedia.org/r/443922

gerritbot added a comment.Jul 5 2018, 9:12 AM

Change 443922 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] openstack: eqiad1: nova-api runs on control boxes

https://gerrit.wikimedia.org/r/443922

gerritbot added a comment.Jul 5 2018, 9:29 AM

Change 443925 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] openstack: bootstrap: nova: fix endpoints

https://gerrit.wikimedia.org/r/443925

gerritbot added a comment.Jul 5 2018, 11:34 AM

Change 443925 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] openstack: bootstrap: nova: fix endpoints

https://gerrit.wikimedia.org/r/443925

gerritbot added a comment.Jul 5 2018, 12:08 PM

Change 443953 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] openstack: add openstack-cvps wrapper script

https://gerrit.wikimedia.org/r/443953

gerritbot added a comment.Jul 5 2018, 12:15 PM

Change 443953 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] openstack: add openstack-cvps wrapper script

https://gerrit.wikimedia.org/r/443953

aborrero moved this task from Triage to OpenStack on the Cloud-Services board.Jul 5 2018, 3:27 PM
gerritbot added a comment.Jul 6 2018, 11:36 AM

Change 444204 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] openstack: eqiad1: enable neutron-l3-agent

https://gerrit.wikimedia.org/r/444204

gerritbot added a comment.Jul 6 2018, 11:51 AM

Change 444204 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] openstack: eqiad1: enable neutron-l3-agent

https://gerrit.wikimedia.org/r/444204

gerritbot added a comment.Jul 6 2018, 1:20 PM

Change 444222 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] openstack: bootstrap: neutron: add more hints about l3agents

https://gerrit.wikimedia.org/r/444222

gerritbot added a comment.Jul 6 2018, 1:26 PM

Change 444224 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] openstack: eqiad1: add dhcp agents configuration

https://gerrit.wikimedia.org/r/444224

gerritbot added a comment.Jul 9 2018, 10:35 AM

Change 444224 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] openstack: eqiad1: add dhcp agents configuration

https://gerrit.wikimedia.org/r/444224

gerritbot added a comment.Jul 10 2018, 11:25 AM

Change 444855 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] openstack: eqiad1: enable nova-compute service

https://gerrit.wikimedia.org/r/444855

gerritbot added a comment.Jul 10 2018, 12:01 PM

Change 444855 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] openstack: eqiad1: enable nova-compute service

https://gerrit.wikimedia.org/r/444855

gerritbot added a comment.Jul 10 2018, 9:07 PM

Change 445020 had a related patch set uploaded (by Rush; owner: cpettet):
[operations/puppet@production] openstack: eqiad1-r metadata agent for net role

https://gerrit.wikimedia.org/r/445020

gerritbot added a comment.Jul 10 2018, 9:08 PM

Change 445020 merged by Rush:
[operations/puppet@production] openstack: eqiad1-r metadata agent for net role

https://gerrit.wikimedia.org/r/445020

gerritbot added a comment.Jul 10 2018, 9:18 PM

Change 445023 had a related patch set uploaded (by Rush; owner: cpettet):
[operations/dns@master] openstack: add labnet100[34] VLAN 1120 reservations

https://gerrit.wikimedia.org/r/445023

gerritbot added a comment.Jul 11 2018, 3:44 PM

Change 445192 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] hieradata: openstack: eqiad1: fix typo in dmz_cidr

https://gerrit.wikimedia.org/r/445192

gerritbot added a comment.Jul 11 2018, 5:04 PM

Change 445192 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] hieradata: openstack: eqiad1: fix typo in dmz_cidr

https://gerrit.wikimedia.org/r/445192

gerritbot added a comment.Jul 11 2018, 5:10 PM

Change 445204 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] hieradata: eqiad1: fix public IP address

https://gerrit.wikimedia.org/r/445204

gerritbot added a comment.Jul 11 2018, 5:45 PM

Change 445209 had a related patch set uploaded (by Rush; owner: cpettet):
[operations/puppet@production] openstack: eqiad1 assign neutron::network_public_ip

https://gerrit.wikimedia.org/r/445209

gerritbot added a comment.Jul 11 2018, 5:46 PM

Change 445209 merged by Rush:
[operations/puppet@production] openstack: eqiad1 assign neutron::network_public_ip

https://gerrit.wikimedia.org/r/445209

gerritbot added a comment.Jul 11 2018, 6:01 PM

Change 445211 had a related patch set uploaded (by Rush; owner: cpettet):
[operations/puppet@production] openstack: eqiad1 and labtestn fix and cleanup neutron settings

https://gerrit.wikimedia.org/r/445211

gerritbot added a comment.Jul 11 2018, 6:02 PM

Change 445211 merged by Rush:
[operations/puppet@production] openstack: eqiad1 and labtestn fix and cleanup neutron settings

https://gerrit.wikimedia.org/r/445211

gerritbot added a comment.Jul 12 2018, 12:52 PM

Change 444222 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] openstack: bootstrap: neutron: refresh and add more hints

https://gerrit.wikimedia.org/r/444222

gerritbot added a comment.Jul 12 2018, 1:27 PM

Change 445409 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] openstack: neutron metadata agent: add support for jessie/mitaka

https://gerrit.wikimedia.org/r/445409

gerritbot added a comment.Jul 12 2018, 3:02 PM

Change 445409 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] openstack: neutron metadata agent: add support for jessie/mitaka

https://gerrit.wikimedia.org/r/445409

gerritbot added a comment.Jul 12 2018, 3:05 PM

Change 445422 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] hieradata: openstack: eqiad1: add cloudvirt1022 to the pool

https://gerrit.wikimedia.org/r/445422

gerritbot added a comment.Jul 12 2018, 3:06 PM

Change 445422 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] hieradata: openstack: eqiad1: add cloudvirt1022 to the pool

https://gerrit.wikimedia.org/r/445422

gerritbot added a comment.Jul 12 2018, 4:15 PM

Change 445432 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] cloudvps: eqiad1: extend mysql limits

https://gerrit.wikimedia.org/r/445432

gerritbot added a comment.Jul 12 2018, 5:04 PM

Change 445432 merged by Rush:
[operations/puppet@production] cloudvps: eqiad1: extend mysql limits

https://gerrit.wikimedia.org/r/445432

gerritbot added a comment.Jul 12 2018, 8:07 PM

Change 445457 had a related patch set uploaded (by Rush; owner: cpettet):
[operations/puppet@production] openstack: eqiad1 neutron bootstrap DNS server

https://gerrit.wikimedia.org/r/445457

gerritbot added a comment.Jul 12 2018, 8:08 PM

Change 445457 merged by Rush:
[operations/puppet@production] openstack: eqiad1 neutron bootstrap DNS server

https://gerrit.wikimedia.org/r/445457

gerritbot added a comment.Jul 13 2018, 9:29 AM

Change 445582 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] openstack: neutron: make agents heartbeats configurable

https://gerrit.wikimedia.org/r/445582

gerritbot added a comment.Jul 13 2018, 9:58 AM

Change 445582 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] openstack: neutron: make agents heartbeats configurable

https://gerrit.wikimedia.org/r/445582

ayounsi removed a subscriber: ayounsi.Jul 13 2018, 11:20 PM
gerritbot added a comment.Fri, Aug 24, 11:52 AM

Change 445204 abandoned by Arturo Borrero Gonzalez:
hieradata: eqiad1: fix public IP address

Reason:
see commit dee0f898de668342c9f8f99ec37260dbe6859cd3e

https://gerrit.wikimedia.org/r/445204

Content licensed under Creative Commons Attribution-ShareAlike 3.0 (CC-BY-SA) unless otherwise noted; code licensed under GNU General Public License (GPL) or other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL