Program 1 Outcome 4: VPS hosting
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	• bd808
	May 26 2017, 5:12 PM

Description

Program

Availability, performance, and maintenance

Goal

We will maintain the availability of Wikimedia’s sites and services for our global audiences and ensure they’re running reliably, securely, and with high performance. We will do this while modernizing our infrastructure and improving current levels of service when it comes to testing, deployments, and maintenance of software and hardware.

Outcome

Wikimedia Cloud Services users can leverage a reliable and public Infrastructure as a Service (IaaS) product ecosystem for VPS hosting.

Objectives, Activities, Milestones, and Targets

Objective 1: Maintain existing OpenStack infrastructure and services
Objective 2: Pay down technical debt and allow upgrading of the core OpenStack platform to modern, supported releases by replacing the current network topology layer with OpenStack Neutron, which has become the standard for most OpenStack deployments.
Objective 3: Increase availability of compute resources for the IaaS product by expanding deployment of physical resources beyond the current single broadcast domain

Related Objects
Search...

Status	Subtype	Assigned	Task
Resolved		• bd808	T166396 Program 1 Outcome 4: VPS hosting
Resolved		Andrew	T167556 Define a metric to track OpenStack system availability
Resolved	PRODUCTION ERROR	Andrew	T168470 Setup wikitech, horizon, and striker on new labweb hardware
Resolved		Andrew	T98813 Move wikitech (silver) to HHVM
Resolved		Andrew	T167820 rack/setup/install labweb100[12].wikimedia.org
Resolved		Andrew	T186729 labweb1001 and 1002 need to access labnet1001.eqiad.wmnet:8774 (and labnet1002.eqiad.wmnet:8774)
Resolved		Andrew	T187493 deploy horizon version 'ocata' using scap3
Resolved		Andrew	T187496 horizon puppet prefix tab creation broken
Resolved		Andrew	T187499 puppet tab class apply fails
Resolved		• bd808	T187420 Graphics for wmcs/horizon branding
Resolved		Andrew	T187502 Update graphics and branding for horizon 'material' theme
Resolved		Andrew	T187506 load-balance horizon between labweb1001 and 1002
Resolved		Andrew	T187563 horizon deploy fails at the very end "Port 8080 not up. Waiting 3.00s"
Resolved		Andrew	T187810 horizon 'reverse dns' panel throws lots of errors, probably useless
Resolved		Andrew	T187811 horizon: language selection broken
Resolved		Andrew	T187743 Deploy striker on labweb1001, 1002
Resolved		Andrew	T188029 Move labswiki database to m5
Resolved		Andrew	T188458 Newhorizon errors on sudo policy changes
Resolved		Andrew	T188915 Move wikitech images to swift
Resolved		Andrew	T188926 New wikitech-static sync process for images
Resolved		Andrew	T189168 How to purge misc-web varnishes for wikitech changes?
Resolved		Andrew	T189278 Session issues on labweb horizon ('newhorizon.wikimedia.org')
Resolved	PRODUCTION ERROR	Andrew	T189347 Possible issues with varnish purging on wikitech
Resolved		None	T167293 Nova-network to Neutron migration
Resolved		• chasemp	T153099 Initial OpenStack Neutron PoC deployment in Labtest
Resolved		Andrew	T165211 Disable keystone admin_token usage
			Restricted Task
Declined		None	T167294 use a service role project for openstack components
Duplicate		None	T167295 Discontinue use of admin_token for keystone
Resolved		• chasemp	T167356 Undo trunking to virts for a sane flat networking model
Resolved		• chasemp	T167357 Determine need and replacement for dmz_cidr configuration in nova-network
Resolved		faidon	T122406 Consider renumbering Labs to separate address spaces
Resolved		• chasemp	T167518 update queue_server.pp for user/pass setup or one-time setup instructions
Resolved		• aborrero	T168580 Neutron implementation of routing_source_ip definition
Resolved		• aborrero	T195786 cloudvps: labtestn: neutron issue with vxlan and l2population
Resolved		• chasemp	T167559 Create a detailed migration plan for implementing Neutron as our OpenStack SDN layer
Resolved		• chasemp	T171494 Refactor OpenStack Puppet to account for Neutron
Resolved		• aborrero	T181523 labtest puppetmaster is not working for clients
Resolved		Papaul	T183167 Connect labtestvirt2003 eth1 and eth2 interface(s) to switch fabric
			Restricted Task
Resolved		• chasemp	T186142 labtestservices* cron spam related to designate
Resolved		• chasemp	T187552 connect eth2 for labtestneutron2001 and 2002
Resolved		• chasemp	T187954 Cloud VPS upgrade to Openstack Mitaka release
Resolved		• aborrero	T188266 labtestn to Mitaka on Jessie
Resolved		• aborrero	T188392 package prometheus-rabbitmq-exporter for Debian jessie
Resolved		• aborrero	T189682 reimage labtestmetal2001 with virt compatible partman as Jessie
Resolved		Andrew	T191790 Figure out how to migrate an instance from a nova-network region to a neutron region
Resolved		Andrew	T191791 Make same glance images available to multiple regions
Resolved		Andrew	T202532 After migrating a VM to eqiad1, transfer DNS to point to the new VM
Resolved		Andrew	T202533 During eqiad1 migration, transfer dynamic proxies to point to the post-migrate VM
Resolved		faidon	T193496 Allocate public v4 IPs for Neutron setup in eqiad
Resolved		• aborrero	T193657 integrate nova.conf missing settings into neutron setup
Resolved		• aborrero	T196633 cloudvps: eqiad1 deployment
Resolved		• aborrero	T199521 labnet1003: reimage+rename to cloudnet1003
Resolved		• Cmjohnson	T199524 Relabel labnet1003.eqiad.wmnet as cloudnet1003.eqiad.wmnet
Resolved		• aborrero	T199781 labcontrol1004.wikimedia.org: reimage and rename to cloudcontrol1004.wikimedia.org
Resolved		• Cmjohnson	T199782 Relabel labcontrol1004.wikimedia.org as cloudcontrol1004.wikimedia.org
Resolved		• aborrero	T199906 labnet1004: reimage+rename to cloudnet1004
Resolved		• Cmjohnson	T199921 Relabel labnet1004.eqiad.wmnet as cloudnet1004.eqiad.wmnet
Resolved		• aborrero	T200068 labcontrol1003: reimage+rename to cloudcontrol1003
Resolved		• Cmjohnson	T200080 Relabel labcontrol1003.wikimedia.org as cloudcontrol1003.wikimedia.org
Resolved		Andrew	T197162 real-time service concerns with neutron migration
Resolved		• chasemp	T197169 10G ports seem not to work on new HP hardware
Resolved		• aborrero	T198863 Reallocate labvirt from main to eqiad1
Resolved		• aborrero	T199107 labvirt1021: reallocate from eqiad1 as cloudvirt1021
Resolved		• aborrero	T199202 labvirt1022: reallocate from eqiad1 as cloudvirt1022
Resolved		Andrew	T199374 Delegate public IP range for Eqiad1-r OpenStack deployment to designate (neutron)
			Restricted Task
Resolved		Andrew	T199578 Designate (DNS) integration with Neutron
			Unknown Object (Task)
Resolved		Andrew	T201341 rack/setup/install cloudservices1004.wikimedia.org
			Restricted Task
Resolved		Andrew	T201423 Make labpuppetmaster aware of VMs in eqiad1
Resolved		• aborrero	T201504 cloudvps: main/eqiad1 keystone merge
Resolved		• aborrero	T201674 m5-master: setup for new keystone daemon
Resolved		• aborrero	T210595 cloudvps: keystone extra services
Resolved		• aborrero	T202115 cloudvps: eqiad1: review floating IP mechanisms
			Restricted Task
			Restricted Task
Resolved		• aborrero	T202261 cloudvps: eqiad1: move neutron db to m5-master
Resolved		• aborrero	T202549 cloudvps: eqiad1: move nova db to m5-master
Resolved		• aborrero	T202636 Allow routing between eqiad and eqiad1 regions
Resolved		• aborrero	T202886 cloudvps: eqiad1: create DNS PTR records for cloud addresses
Resolved		Andrew	T203031 eqiad1 private IPs lacking PTRs in DNS
Resolved		• aborrero	T203177 cloudvps: metrics and analytics
Invalid		Andrew	T204349 Migrated VMs (possibly all VMs) don't appear in the project overview page on Horizon
Resolved		Andrew	T204745 cloudvps: migrate projects from main to eqiad1
Resolved		None	T207677 Migrate 'Quarry' project to eqiad1
Resolved		Andrew	T209632 Move 'video' project to eqiad1-r
Declined		None	T209938 CloudVPS: diamond report some metrics with the host IP address instead of host name
Resolved		Andrew	T213085 Delete eqiad region bastion hosts
Resolved		Andrew	T213087 Stray user files on old eqiad bastions
Resolved		Andrew	T213540 Migrate nova proxies to eqiad1
Duplicate		herron	T205158 Mail relays needed for VMs in eqiad1
Resolved		herron	T41785 Create a Cloud VPS SMTP smarthost
Resolved		• bd808	T174618 Request creation of project-smtp VPS project
Resolved		herron	T206261 Routing RFC1918 private IP addresses to/from WMCS floating IPs
Resolved		• JHedden	T205524 cloudvps: neutron: agents failed to communicate with server
Resolved		Krenair	T208101 Migrate deployment-prep to eqiad1
Resolved		• mmodell	T208262 Ensure there are no hard-coded IPs in use for beta
Resolved		• bd808	T210030 RedisBagOStuff is broken on beta
Resolved		Krenair	T210214 deployment-cache-text04 decomissioning
Resolved		dduvall	T210301 Status of deployment-redis0[56]?
Resolved		Andrew	T208244 ntp broken in new region
Resolved		hashar	T208803 Migrate the Integration cloud project to eqiad1-r
Duplicate		• aborrero	T222411 Decommission former cloud IPs and vlans

Event Timeline

• bd808 created this task.May 26 2017, 5:12 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMay 26 2017, 5:12 PM

• bd808 moved this task from Backlog to Outcomes on the cloud-services-team (FY2017-18) board.May 26 2017, 5:12 PM

• bd808 renamed this task from Program 1 Outcome 4: reliable and public IaaS product ecosystem for VPS hosting to Program 1 Outcome 4: VPS hosting.May 26 2017, 6:01 PM

• bd808 triaged this task as Medium priority.May 26 2017, 6:06 PM

• bd808 added a subtask: T167556: Define a metric to track OpenStack system availability.Jun 10 2017, 12:35 AM

• bd808 added a subtask: T167559: Create a detailed migration plan for implementing Neutron as our OpenStack SDN layer.Jun 10 2017, 1:00 AM

• ksmith mentioned this in T167838: Phlogiston should treat the goal tag the same way as the category tag.Jun 14 2017, 6:13 PM

Andrew closed subtask T167556: Define a metric to track OpenStack system availability as Resolved.Sep 29 2017, 3:25 PM

• bd808 added a subtask: T168470: Setup wikitech, horizon, and striker on new labweb hardware.Sep 29 2017, 10:35 PM

• bd808 edited subtasks, added: T167293: Nova-network to Neutron migration; removed: T167559: Create a detailed migration plan for implementing Neutron as our OpenStack SDN layer.Dec 15 2017, 8:33 PM

Paladox subscribed.Dec 15 2017, 10:32 PM

Andrew closed subtask T168470: Setup wikitech, horizon, and striker on new labweb hardware as Resolved.Mar 21 2018, 7:33 PM

Liuxinyu970226 subscribed.Apr 9 2018, 1:34 PM