Page MenuHomePhabricator
Create Task
Maniphest T341060

openstack eqiad1: introduce cloud-private and cloudlb
Closed, ResolvedPublic
Actions

Description

After T324992: cloudlb: create PoC on codfw and T338936: cloudlb: figure out plans for eqiad1 have been completed, we can move forward with this project.

Rough estimated plan:

Related Objects
Search...

StatusSubtypeAssignedTask
 ResolvedaborreroT296411 cloud: decide on general idea for having cloud-dedicated hardware provide service in the cloud realm & the internet
 ResolvedaborreroT297596 have cloud hardware servers in the cloud realm using a dedicated LB layer
 Resolved• taaviT341060 openstack eqiad1: introduce cloud-private and cloudlb
 ResolvedaborreroT341061 eqiad1: repurpose 2 cloudswift servers as cloudlb
 ResolvedPapaulT341200 rename cloudswift1001 as cloudlb1001
 ResolvedaborreroT341201 rename cloudswift1002 as cloudlb1002
 OpenAndrewT341062 eqiad1: procure 1 additional cloudlb server
 ResolvedcmooneyT341063 eqiad1: introduce cloud-private support
 ResolvedcmooneyT341223 Configure eqiad cloudsw devices to support cloud-private
 ResolvedcmooneyT341220 eqiad1: allocate public IPv4 CIDR for BGP-based virtual IP addresses
 OpenAndrewT341338 eqiad1: fix PTR delegations for 185.15.56.0/24
 ResolvedJclark-ctrT341494 cloud @ eqiad: hardware re-racking plan
 ResolvedPapaulT342161 Q1:rack/setup/install cloudservices1006.eqiad.wmnet
 ResolvedaborreroT345240 cloudservices1006: put into service
 Resolved• taaviT345654 cloudservices1006 can't talk to the cloud-wide puppetmaster
 OpenNoneT345731 cloudservices1006: debian bullseye installer hangs when partitioning /srv
 ResolvedJclark-ctrT346042 cloudservices1005: move to new setup
 ResolvedaborreroT346177 Certain systems failing to resolve DNS entries under toolforge.org, wmcloud.org, wmflabs.org, toolserver.org
 ResolvedRobHT346326 markmonitor update: refresh ns0.openstack.eqiad1.wikimediacloud.org glue A record to point to 185.15.56.162
 ResolvedfnegriT346385 cloudservices1006 using 10. address to send DNS NOTIFYs to cloudservices1005
 ResolvedJclark-ctrT346033 cloudservices1004: decomission
 Resolved• taaviT346891 cloudcontrol1006: move to new network setup
 Resolved• taaviT347381 Support maintain-dbusers on the new network layout
 Resolved• taaviT346892 cloudcontrol1007: move to new network setup
 Resolved• taaviT345610 cloudrabbit: connect them via cloudsw and cloud-private
 ResolvedaborreroT341495 eqiad1: cloudlb: reimage cloudcontrol1005 into new network setup
 ResolvedaborreroT342619 eqiad1: cloudlb: enable cloud-private subnet in cloudnet servers
 ResolvedaborreroT342621 eqiad1: cloudlb: transition DNS clients (VMs) to the new BGP-based recursor VIP
 InvalidaborreroT346092 cloudcontrols can't reach ns-recursor.openstack.eqiad1.wikimediacloud.org
 ResolvedaborreroT346426 Some VPS instances still using ns-recursor0
 ResolvedaborreroT346441 openstack eqiad1: verify new control plane works with cloudlb
 ResolvedaborreroT346439 cloudlb: eqiad1: change openstack.eqiad1.wikimediacloud.org endpoint to point to cloudlb
 Resolved• taaviT346630 openstack: eqiad1: cleanup leaks from the cloudlb migration
 ResolvedaborreroT346896 eqiad1 cloudcontrols can't access designate API
 ResolvedaborreroT346603 openstack: eqiad1: review DB grants for new network setup
 Resolved• taaviT346651 cloudvirt: eqiad1: connect them to cloud-private
 ResolvedJclark-ctrT346948 Move cloudvirt-wdqs hosts
 Resolved• taaviT346993 dns + puppet failures on many cloud hosts
 OpenNoneT347148 Determine how to monitor services in cloud-private / cloudlb
 Resolved• taaviT347277 metricsinfra: add support dns blackbox scrapes
 OpenNoneT288053 Add external meta-monitoring for metricsinfra
 Resolved• taaviT347554 Do not require overriding ::openstack_controllers per context
 Resolved• taaviT349801 Linting problems found for OpenstackAPIResponse
 OpenNoneT355416 Move Cloud VPS internal flows from cloud-hosts to cloud-private
 OpenNoneT355145 Use cloud-private and cfssl certs for instance live migrations
 Resolved• taaviT355417 Move cloudcontrol memcached flows to cloud-private
 ResolvedAndrewT355418 Move Galera clustering to cloud-private
 OpenNoneT357543 clouddb: evaluate moving them into cloud-private

Event Timeline

aborrero changed the task status from Open to In Progress.Jul 4 2023, 12:42 PM
aborrero triaged this task as Medium priority.
aborrero created this task.
aborrero moved this task from Backlog to Doing on the User-aborrero board.
aborrero updated the task description. (Show Details)Jul 4 2023, 2:33 PM
aborrero updated the task description. (Show Details)Jul 4 2023, 2:54 PM
aborrero changed the status of subtask T341063: eqiad1: introduce cloud-private support from Open to In Progress.Jul 6 2023, 10:59 AM
aborrero changed the status of subtask T341061: eqiad1: repurpose 2 cloudswift servers as cloudlb from Open to In Progress.Jul 6 2023, 11:01 AM
aborrero changed the status of subtask T341220: eqiad1: allocate public IPv4 CIDR for BGP-based virtual IP addresses from Open to In Progress.Jul 6 2023, 12:33 PM
cmooney added a subtask: T341223: Configure eqiad cloudsw devices to support cloud-private.Jul 6 2023, 12:54 PM
cmooney closed subtask T341220: eqiad1: allocate public IPv4 CIDR for BGP-based virtual IP addresses as Resolved.
aborrero updated the task description. (Show Details)Jul 6 2023, 2:28 PM
aborrero removed a subtask: T341223: Configure eqiad cloudsw devices to support cloud-private.
aborrero removed a subtask: T341220: eqiad1: allocate public IPv4 CIDR for BGP-based virtual IP addresses.Jul 6 2023, 2:31 PM
aborrero closed subtask T341061: eqiad1: repurpose 2 cloudswift servers as cloudlb as Resolved.Jul 10 2023, 3:42 PM
aborrero closed subtask T341063: eqiad1: introduce cloud-private support as Resolved.Jul 10 2023, 4:19 PM
aborrero updated the task description. (Show Details)
aborrero mentioned this in T341494: cloud @ eqiad: hardware re-racking plan.Jul 10 2023, 4:31 PM
aborrero updated the task description. (Show Details)
aborrero mentioned this in T341495: eqiad1: cloudlb: reimage cloudcontrol1005 into new network setup.Jul 10 2023, 4:38 PM
aborrero updated the task description. (Show Details)Jul 10 2023, 4:44 PM
aborrero updated the task description. (Show Details)
aborrero moved this task from Doing to Next on the User-aborrero board.Jul 12 2023, 9:47 AM
aborrero closed subtask T341495: eqiad1: cloudlb: reimage cloudcontrol1005 into new network setup as Resolved.Jul 25 2023, 10:51 AM
aborrero updated the task description. (Show Details)Jul 25 2023, 11:04 AM
aborrero updated the task description. (Show Details)Jul 25 2023, 11:06 AM
aborrero updated the task description. (Show Details)Jul 25 2023, 11:10 AM
aborrero updated the task description. (Show Details)Jul 25 2023, 11:22 AM
aborrero mentioned this in T342621: eqiad1: cloudlb: transition DNS clients (VMs) to the new BGP-based recursor VIP.Jul 25 2023, 11:26 AM
aborrero updated the task description. (Show Details)
fnegri edited projects, added cloud-services-team (FY2023/2024-Q1-Q2); removed cloud-services-team (FY2022/2023-Q4).Jul 26 2023, 4:01 PM
fnegri moved this task from Backlog to Planned Goals on the cloud-services-team (FY2023/2024-Q1-Q2) board.
aborrero closed subtask T342619: eqiad1: cloudlb: enable cloud-private subnet in cloudnet servers as Resolved.Jul 27 2023, 4:02 PM
fnegri moved this task from Planned Goals to In progress on the cloud-services-team (FY2023/2024-Q1-Q2) board.Aug 7 2023, 2:54 PM
aborrero changed the status of subtask T342621: eqiad1: cloudlb: transition DNS clients (VMs) to the new BGP-based recursor VIP from Open to Stalled.Aug 29 2023, 12:39 PM
aborrero changed the status of subtask T342621: eqiad1: cloudlb: transition DNS clients (VMs) to the new BGP-based recursor VIP from Stalled to In Progress.Aug 30 2023, 9:57 AM
aborrero updated the task description. (Show Details)Aug 30 2023, 10:47 AM
aborrero mentioned this in T345610: cloudrabbit: connect them via cloudsw and cloud-private.Sep 5 2023, 10:00 AM
aborrero closed subtask T342621: eqiad1: cloudlb: transition DNS clients (VMs) to the new BGP-based recursor VIP as Resolved.Sep 11 2023, 3:25 PM
aborrero moved this task from Next to Doing on the User-aborrero board.Sep 13 2023, 12:55 PM
aborrero mentioned this in T346092: cloudcontrols can't reach ns-recursor.openstack.eqiad1.wikimediacloud.org.Sep 15 2023, 8:53 AM
aborrero updated the task description. (Show Details)Sep 15 2023, 12:47 PM
aborrero updated the task description. (Show Details)Sep 15 2023, 1:14 PM
aborrero removed a subtask: T346439: cloudlb: eqiad1: change openstack.eqiad1.wikimediacloud.org endpoint to point to cloudlb.Sep 15 2023, 1:17 PM
aborrero updated the task description. (Show Details)
aborrero changed the status of subtask T346441: openstack eqiad1: verify new control plane works with cloudlb from Open to In Progress.Sep 15 2023, 1:21 PM
aborrero updated the task description. (Show Details)Sep 18 2023, 12:34 PM
aborrero closed subtask T346441: openstack eqiad1: verify new control plane works with cloudlb as Resolved.
aborrero updated the task description. (Show Details)Sep 20 2023, 11:59 AM
aborrero updated the task description. (Show Details)
aborrero updated the task description. (Show Details)Sep 20 2023, 12:23 PM
aborrero updated the task description. (Show Details)
• taavi closed subtask T346651: cloudvirt: eqiad1: connect them to cloud-private as Resolved.Sep 20 2023, 2:55 PM
• taavi closed subtask T346993: dns + puppet failures on many cloud hosts as Resolved.Sep 21 2023, 6:33 AM
aborrero reassigned this task from aborrero to • taavi.Sep 21 2023, 2:39 PM
aborrero moved this task from Doing to Radar on the User-aborrero board.
Jclark-ctr closed subtask T341494: cloud @ eqiad: hardware re-racking plan as Resolved.Oct 23 2023, 2:33 PM
• taavi added a subtask: T349801: Linting problems found for OpenstackAPIResponse.Oct 27 2023, 9:36 AM
fgiunchedi closed subtask T349801: Linting problems found for OpenstackAPIResponse as Resolved.Oct 27 2023, 11:51 AM
• taavi closed subtask T347554: Do not require overriding ::openstack_controllers per context as Resolved.Nov 10 2023, 2:03 PM
• taavi updated the task description. (Show Details)Jan 19 2024, 1:00 PM
• taavi added a project: Cloud-VPS.
cmooney mentioned this in T346946: move cloudelastic behind cloudlb.Jan 23 2024, 11:38 AM
fnegri edited projects, added cloud-services-team (FY2023/2024-Q3-Q4); removed cloud-services-team (FY2023/2024-Q1-Q2).Feb 1 2024, 11:13 AM
fnegri moved this task from Backlog to In progress on the cloud-services-team (FY2023/2024-Q3-Q4) board.
• taavi updated the task description. (Show Details)Feb 12 2024, 12:19 PM
aborrero updated the task description. (Show Details)Feb 15 2024, 9:00 AM
• taavi closed this task as Resolved.Apr 10 2024, 8:29 AM

Let's call this done.

fnegri moved this task from In progress to Done on the cloud-services-team (FY2023/2024-Q3-Q4) board.Apr 10 2024, 8:46 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits