Page MenuHomePhabricator
Create Task
Maniphest T165358

Set up and package wmfmariadbpy helper scripts so they can easily be deployed to all database server and client hosts
Closed, ResolvedPublic
Actions

Description

https://phabricator.wikimedia.org/diffusion/OSMD/ is ready. Upload there the latest version of our db misc scripts.

Also, we need to package what it has already been done and deploy it, even if it is not perfect, it is useful now.

Details

Related Changes in Gerrit:
SubjectRepoBranchLines +/-
[WIP] Change backup hosts into using the package version of scriptsoperations/puppetproduction+10 -1 K
backup_mariadb: Use path to find backup_mariadb.pyoperations/software/wmfbackupsmaster+1 -1
Add WMFBackup package creationoperations/software/wmfbackupsmaster+123 -27
[WIP] Add WMFBackup package creationoperations/software/wmfmariadbpymaster+22 -0
backup_mariadb: Use path to find backup_mariadb.pyoperations/software/wmfmariadbpymaster+1 -1
wmfmariadbpy: Load and provide a method for section to port assignmentoperations/software/wmfmariadbpymaster+118 -38
wmfbackups: Split WMFBackup into its logical components (backup methods)operations/software/wmfmariadbpymaster+286 -254
wmfbackups: Copy backup-related scripts from puppet to wmfmariadbpyoperations/software/wmfmariadbpymaster+511 -14
wmfmariadbpy: Reorganize backup scripts into its own directoryoperations/software/wmfmariadbpymaster+2 -2
mariadb-backups: Move backup scripts to its own directoryoperations/software/wmfmariadbpymaster+828 -0
Customize query in gerrit

Related Objects
Search...

Event Timeline

jcrespo created this task.May 15 2017, 4:50 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMay 15 2017, 4:50 PM
• 1978Gage2001 moved this task from Triage to In progress on the DBA board.Dec 11 2017, 9:45 AM
Marostegui moved this task from In progress to Triage on the DBA board.Dec 11 2017, 11:06 AM
jcrespo moved this task from Triage to Meta/Epic on the DBA board.Feb 7 2018, 3:37 PM
jcrespo mentioned this in T259021: Package wmfmariadbpy as a .deb.Jul 29 2020, 11:18 AM
jcrespo added a subtask: T259021: Package wmfmariadbpy as a .deb.
• Kormat closed subtask T259021: Package wmfmariadbpy as a .deb as Resolved.Aug 3 2020, 1:14 PM
jcrespo awarded a token.Aug 11 2020, 1:58 PM
gerritbot added a comment.Aug 13 2020, 7:52 AM

Change 619953 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/software/wmfmariadbpy@master] mariadb-backups: Move backup scripts to its own directory

https://gerrit.wikimedia.org/r/619953

gerritbot added a project: Patch-For-Review.Aug 13 2020, 7:52 AM
gerritbot added a comment.Aug 13 2020, 8:05 AM

Change 619958 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/software/wmfmariadbpy@master] wmfmariadbpy: Reorganize backup scripts into its own directory

https://gerrit.wikimedia.org/r/619958

gerritbot added a comment.Aug 13 2020, 8:06 AM

Change 619953 abandoned by Jcrespo:
[operations/software/wmfmariadbpy@master] mariadb-backups: Move backup scripts to its own directory

Reason:
done on a different branch

https://gerrit.wikimedia.org/r/619953

gerritbot added a comment.Aug 13 2020, 8:21 AM

Change 619962 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/software/wmfmariadbpy@master] mariadb-backups: Reorganize files and update paths

https://gerrit.wikimedia.org/r/619962

gerritbot added a comment.Aug 13 2020, 1:25 PM

Change 620005 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/software/wmfmariadbpy@master] wmfbackups: Copy backup-related scripts from puppet to wmfmariadbpy

https://gerrit.wikimedia.org/r/620005

gerritbot added a comment.Aug 13 2020, 4:17 PM

Change 619958 merged by jenkins-bot:
[operations/software/wmfmariadbpy@master] wmfmariadbpy: Reorganize backup scripts into its own directory

https://gerrit.wikimedia.org/r/619958

gerritbot added a comment.Aug 14 2020, 7:01 AM

Change 620005 merged by Jcrespo:
[operations/software/wmfmariadbpy@master] wmfbackups: Copy backup-related scripts from puppet to wmfmariadbpy

https://gerrit.wikimedia.org/r/620005

gerritbot added a comment.Aug 14 2020, 8:42 AM

Change 620291 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/software/wmfmariadbpy@master] wmfmariadbpy: Load and provide a method for section to port assignment

https://gerrit.wikimedia.org/r/620291

gerritbot added a comment.Aug 14 2020, 9:19 AM

Change 619962 merged by jenkins-bot:
[operations/software/wmfmariadbpy@master] wmfbackups: Split WMFBackup into its logical components (backup methods)

https://gerrit.wikimedia.org/r/619962

jcrespo mentioned this in rOSMDe5c34454fa83: wmfbackups: Split WMFBackup into its logical components (backup methods).Aug 14 2020, 9:19 AM
gerritbot added a comment.Aug 14 2020, 10:50 AM

Change 620309 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/software/wmfmariadbpy@master] [WIP] Add WMFBackup package creation

https://gerrit.wikimedia.org/r/620309

gerritbot added a comment.Aug 14 2020, 11:08 AM

Change 620312 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/puppet@production] [WIP] Change backup hosts into using the package version of scripts

https://gerrit.wikimedia.org/r/620312

gerritbot added a comment.Aug 14 2020, 11:15 AM

Change 620315 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/software/wmfmariadbpy@master] backup_mariadb: Use path to find backup_mariadb.py

https://gerrit.wikimedia.org/r/620315

gerritbot added a comment.Aug 26 2020, 1:02 PM

Change 620291 merged by Jcrespo:
[operations/software/wmfmariadbpy@master] wmfmariadbpy: Load and provide a method for section to port assignment

https://gerrit.wikimedia.org/r/620291

jcrespo mentioned this in rOSWB45bf9fe6c623: wmfmariadbpy: Reorganize backup scripts into its own directory.Sep 1 2020, 8:36 AM
jcrespo mentioned this in rOSWB5865892d2e41: wmfbackups: Copy backup-related scripts from puppet to wmfmariadbpy.
jcrespo mentioned this in rOSWBe5c34454fa83: wmfbackups: Split WMFBackup into its logical components (backup methods).
jcrespo mentioned this in rOSWB36505976ad9f: wmfmariadbpy: Load and provide a method for section to port assignment.
gerritbot added a comment.Sep 2 2020, 9:18 AM

Change 623754 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/software/wmfbackups@master] backup_mariadb: Use path to find backup_mariadb.py

https://gerrit.wikimedia.org/r/623754

gerritbot added a comment.Sep 2 2020, 9:18 AM

Change 620315 abandoned by Jcrespo:
[operations/software/wmfmariadbpy@master] backup_mariadb: Use path to find backup_mariadb.py

Reason:
duplicate of https://gerrit.wikimedia.org/r/c/operations/software/wmfbackups/ /623754

https://gerrit.wikimedia.org/r/620315

gerritbot added a comment.Sep 2 2020, 9:20 AM

Change 623756 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/software/wmfbackups@master] [WIP] Add WMFBackup package creation

https://gerrit.wikimedia.org/r/623756

gerritbot added a comment.Sep 2 2020, 9:21 AM

Change 620309 abandoned by Jcrespo:
[operations/software/wmfmariadbpy@master] [WIP] Add WMFBackup package creation

Reason:
Duplicate of https://gerrit.wikimedia.org/r/c/operations/software/wmfbackups/ /623756

https://gerrit.wikimedia.org/r/620309

gerritbot added a comment.Sep 18 2020, 1:08 PM

Change 623756 merged by Jcrespo:
[operations/software/wmfbackups@master] Add WMFBackup package creation

https://gerrit.wikimedia.org/r/623756

gerritbot added a comment.Sep 22 2020, 12:42 PM

Change 623754 abandoned by Jcrespo:
[operations/software/wmfbackups@master] backup_mariadb: Use path to find backup_mariadb.py

Reason:
backup-mariadb will be called instead on a new patch

https://gerrit.wikimedia.org/r/623754

Marostegui added subscribers: • Kormat, Marostegui.Oct 14 2020, 7:35 AM

@Kormat can this be considered done as wmfmariadbpy scripts are being deployed via deb (ie: db-switchover, db-compare etc? (I am not fully aware of the whole situation, so wondering whether the scope of this task is already done or if there are pending things)

• Kormat closed this task as Resolved.Oct 14 2020, 8:17 AM
• Kormat claimed this task.

@Marostegui: good point! Resolving.

gerritbot added a comment.Dec 2 2020, 3:10 PM

Change 620312 abandoned by Jcrespo:
[operations/puppet@production] [WIP] Change backup hosts into using the package version of scripts

Reason:

https://gerrit.wikimedia.org/r/620312

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits