Page MenuHomePhabricator
Create Task
Maniphest T330771

Create cookbook for gitlab switchover
Closed, ResolvedPublic
Actions

Description

Using the checklist/process from the last two gitlab switchovers, we should build a cookbook to automate as much of this process as we can.

Details

Related Changes in Gerrit:
SubjectRepoBranchLines +/-
[gitlab/failover] Rename host flagsoperations/cookbooksmaster+54 -54
gitlab: add backup type failover to script outputoperations/puppetproduction+1 -1
gitlab: add backup type failoveroperations/puppetproduction+3 -0
[gitlab/failover] Add check for DNS records updateoperations/cookbooksmaster+29 -2
Split path to extract filename from ls outputoperations/cookbooksmaster+1 -1
Change file timestamp to an int, from a stringoperations/cookbooksmaster+1 -1
Fix dry-run mode for gitlab failover cookbookoperations/cookbooksmaster+17 -12
Fixes incorrect arg nameoperations/cookbooksmaster+1 -1
Cookbook for switchover of Gitlab to a new hostoperations/cookbooksmaster+317 -48
Customize query in gerrit

Related Objects

Event Timeline

• eoghan created this task.Feb 28 2023, 4:21 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptFeb 28 2023, 4:21 PM
• eoghan moved this task from Incoming to Work in Progress on the collaboration-services board.Feb 28 2023, 4:22 PM
gerritbot added a comment.Mar 6 2023, 12:43 PM

Change 894634 had a related patch set uploaded (by EoghanGaffney; author: EoghanGaffney):

[operations/cookbooks@master] [WIP] Cookbook for switchover of Gitlab to a new host

https://gerrit.wikimedia.org/r/894634

gerritbot added a project: Patch-For-Review.Mar 6 2023, 12:43 PM
Jelto mentioned this in T331296: Create cumin host in devtools project.Mar 6 2023, 2:17 PM
LSobanski triaged this task as Medium priority.Mar 29 2023, 11:40 AM
gerritbot added a comment.Apr 17 2023, 12:45 PM

Change 894634 merged by EoghanGaffney:

[operations/cookbooks@master] Cookbook for switchover of Gitlab to a new host

https://gerrit.wikimedia.org/r/894634

gerritbot added a comment.Apr 17 2023, 1:16 PM

Change 909253 had a related patch set uploaded (by EoghanGaffney; author: EoghanGaffney):

[operations/cookbooks@master] Fixes incorrect arg name

https://gerrit.wikimedia.org/r/909253

gerritbot added a comment.Apr 17 2023, 1:21 PM

Change 909253 merged by jenkins-bot:

[operations/cookbooks@master] Fixes incorrect arg name

https://gerrit.wikimedia.org/r/909253

Maintenance_bot removed a project: Patch-For-Review.Apr 17 2023, 1:31 PM
gerritbot added a comment.Apr 17 2023, 1:42 PM

Change 909257 had a related patch set uploaded (by EoghanGaffney; author: EoghanGaffney):

[operations/cookbooks@master] Fix dry-run mode for gitlab failover cookbook

https://gerrit.wikimedia.org/r/909257

gerritbot added a project: Patch-For-Review.Apr 17 2023, 1:42 PM
gerritbot added a comment.Apr 17 2023, 1:56 PM

Change 909257 merged by jenkins-bot:

[operations/cookbooks@master] Fix dry-run mode for gitlab failover cookbook

https://gerrit.wikimedia.org/r/909257

gerritbot added a comment.Apr 17 2023, 2:02 PM

Change 909263 had a related patch set uploaded (by EoghanGaffney; author: EoghanGaffney):

[operations/cookbooks@master] Change file timestamp to an int, from a string

https://gerrit.wikimedia.org/r/909263

gerritbot added a comment.Apr 17 2023, 2:08 PM

Change 909263 merged by jenkins-bot:

[operations/cookbooks@master] Change file timestamp to an int, from a string

https://gerrit.wikimedia.org/r/909263

Maintenance_bot removed a project: Patch-For-Review.Apr 17 2023, 2:11 PM
gerritbot added a comment.Apr 17 2023, 2:11 PM

Change 909289 had a related patch set uploaded (by EoghanGaffney; author: EoghanGaffney):

[operations/cookbooks@master] Split path to extract filename from ls output

https://gerrit.wikimedia.org/r/909289

gerritbot added a project: Patch-For-Review.Apr 17 2023, 2:11 PM
gerritbot added a comment.Apr 17 2023, 2:20 PM

Change 909289 merged by jenkins-bot:

[operations/cookbooks@master] Split path to extract filename from ls output

https://gerrit.wikimedia.org/r/909289

Maintenance_bot removed a project: Patch-For-Review.Apr 17 2023, 2:31 PM
gerritbot added a comment.Apr 19 2023, 12:04 AM

Change 909765 had a related patch set uploaded (by EoghanGaffney; author: EoghanGaffney):

[operations/cookbooks@master] [gitlab/failover] Add check for DNS records update

https://gerrit.wikimedia.org/r/909765

gerritbot added a project: Patch-For-Review.Apr 19 2023, 12:04 AM
gerritbot added a comment.Apr 24 2023, 9:49 AM

Change 909765 merged by jenkins-bot:

[operations/cookbooks@master] [gitlab/failover] Add check for DNS records update

https://gerrit.wikimedia.org/r/909765

Maintenance_bot removed a project: Patch-For-Review.Apr 24 2023, 10:12 AM
• eoghan added a comment.Apr 24 2023, 3:07 PM

We ran a test of switching over gitlab-replica-old and gitlab-replica using the cookbook in T334838, and it was successful.

gerritbot added a comment.Apr 25 2023, 6:54 AM

Change 911759 had a related patch set uploaded (by Jelto; author: Jelto):

[operations/puppet@production] gitlab: add backup type failover

https://gerrit.wikimedia.org/r/911759

gerritbot added a project: Patch-For-Review.Apr 25 2023, 6:54 AM
gerritbot added a comment.Apr 26 2023, 8:47 AM

Change 911759 merged by Jelto:

[operations/puppet@production] gitlab: add backup type failover

https://gerrit.wikimedia.org/r/911759

gerritbot added a comment.Apr 26 2023, 9:06 AM

Change 912239 had a related patch set uploaded (by Jelto; author: Jelto):

[operations/puppet@production] gitlab: add backup type failover to script output

https://gerrit.wikimedia.org/r/912239

gerritbot added a comment.Apr 26 2023, 10:18 AM

Change 912239 merged by Jelto:

[operations/puppet@production] gitlab: add backup type failover to script output

https://gerrit.wikimedia.org/r/912239

Maintenance_bot removed a project: Patch-For-Review.Apr 26 2023, 10:30 AM
gerritbot added a comment.Apr 27 2023, 11:25 AM

Change 911951 had a related patch set uploaded (by EoghanGaffney; author: EoghanGaffney):

[operations/cookbooks@master] [gitlab/failover] Rename host flags

https://gerrit.wikimedia.org/r/911951

gerritbot added a project: Patch-For-Review.Apr 27 2023, 11:25 AM
• eoghan closed this task as Resolved.May 8 2023, 3:03 PM
gerritbot added a comment.May 9 2023, 12:59 PM

Change 911951 merged by jenkins-bot:

[operations/cookbooks@master] [gitlab/failover] Rename host flags

https://gerrit.wikimedia.org/r/911951

Maintenance_bot removed a project: Patch-For-Review.May 9 2023, 1:10 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits