Page MenuHomePhabricator

Prepare and check storage layer for magwiki
Closed, ResolvedPublic

Description

The new wiki's visibility will be: Public.

Event Timeline

Marostegui changed the task status from Open to Stalled.Jun 5 2026, 3:03 PM
Marostegui triaged this task as Medium priority.
Marostegui moved this task from Triage to Blocked on the DBA board.
Marostegui added subscribers: CWilliams-WMF, Marostegui.

@CWilliams-WMF once the wiki is created (the creation is not done by us) we can follow: https://wikitech.wikimedia.org/wiki/MariaDB/PII

Ladsgroup changed the task status from Stalled to Open.Jun 18 2026, 12:57 AM
Ladsgroup subscribed.

Wiki has been created!

@CWilliams-WMF once the wiki is created (the creation is not done by us) we can follow: https://wikitech.wikimedia.org/wiki/MariaDB/PII

@CWilliams-WMF do you want to try to follow this doc and get this sanitizied?

CWilliams-WMF changed the task status from Open to In Progress.Jun 18 2026, 12:28 PM
CWilliams-WMF claimed this task.

Section s5: Wikis magwiki redacted - cwilliams@cumin1003

Section s5: Wikis magwiki set up on clouddb - cwilliams@cumin1003

Data santised

% sudo cookbook sre.mysql.sanitize-wiki --wiki magwiki --task T428271                                                                                                                                                                                                         
Sanitarium hosts: db1154.eqiad.wmnet
Acquired lock for key /spicerack/locks/cookbooks/sre.mysql.sanitize-wiki:s5: {'concurrency': 1, 'created': '2026-06-18 12:34:56.185904+00:00', 'owner': 'cwilliams@cumin1003 [647071]', 'ttl': 3600}
START - Cookbook sre.mysql.sanitize-wiki Managing sanitization for wikis magwiki in section s5
[cookbooks.sre.mysql.sanitize_wiki.clean_up] Cleaning up data on sanitarium hosts
Processing wiki: magwiki
Running '/usr/local/sbin/redact_sanitarium.sh -d magwiki -S /run/mysqld/mysqld.s5.sock | /usr/local/bin/mysql -S /run/mysqld/mysqld.s5.sock' on db1154.eqiad.wmnet
----- OUTPUT for command #1: '/usr/local/sbin/...d/mysqld.s5.sock' -----
================
100.0% (1/1) success ratio (>= 100.0% threshold) for command #1: '/usr/local/sbin/...d/mysqld.s5.sock'.
100.0% (1/1) success ratio (>= 100.0% threshold) of nodes successfully executed all commands.
Updated Phabricator task T428271
[cookbooks.sre.mysql.sanitize_wiki.check_priv] Check private data on sanitarium
Running '/usr/local/sbin/check_private_data.py -S /run/mysqld/mysqld.s5.sock' on db1154.eqiad.wmnet
----- OUTPUT for command #1: '/usr/local/sbin/...d/mysqld.s5.sock' -----
-- Non-public databases that are present:
-- Non-public tables that are present:
-- Unfiltered columns that are present:
================
100.0% (1/1) success ratio (>= 100.0% threshold) for command #1: '/usr/local/sbin/...d/mysqld.s5.sock'.
100.0% (1/1) success ratio (>= 100.0% threshold) of nodes successfully executed all commands.
==> Proceed with dropping private data?
Type "go" to proceed or "abort" to interrupt the execution
> go
User input is: "go"
[cookbooks.sre.mysql.sanitize_wiki.drop_privdata] Drop private data
Running '/usr/local/sbin/check_private_data.py -S /run/mysqld/mysqld.s5.sock | /usr/local/bin/mysql -S /run/mysqld/mysqld.s5.sock' on db1154.eqiad.wmnet
----- OUTPUT for command #1: '/usr/local/sbin/...d/mysqld.s5.sock' -----
================
100.0% (1/1) success ratio (>= 100.0% threshold) for command #1: '/usr/local/sbin/...d/mysqld.s5.sock'.
100.0% (1/1) success ratio (>= 100.0% threshold) of nodes successfully executed all commands.
Skipping checking on clouddbs.
[cookbooks.sre.mysql.sanitize_wiki.check_priv] Check private data on sanitarium
Running '/usr/local/sbin/check_private_data.py -S /run/mysqld/mysqld.s5.sock' on db1154.eqiad.wmnet
----- OUTPUT for command #1: '/usr/local/sbin/...d/mysqld.s5.sock' -----
-- Non-public databases that are present:
-- Non-public tables that are present:
-- Unfiltered columns that are present:
================
100.0% (1/1) success ratio (>= 100.0% threshold) for command #1: '/usr/local/sbin/...d/mysqld.s5.sock'.
100.0% (1/1) success ratio (>= 100.0% threshold) of nodes successfully executed all commands.
==> Proceed with dropping private data?
Type "go" to proceed or "abort" to interrupt the execution
> go
User input is: "go"
[cookbooks.sre.mysql.sanitize_wiki.drop_privdata] Drop private data
Running '/usr/local/sbin/check_private_data.py -S /run/mysqld/mysqld.s5.sock | /usr/local/bin/mysql -S /run/mysqld/mysqld.s5.sock' on db1154.eqiad.wmnet
----- OUTPUT for command #1: '/usr/local/sbin/...d/mysqld.s5.sock' -----
================
100.0% (1/1) success ratio (>= 100.0% threshold) for command #1: '/usr/local/sbin/...d/mysqld.s5.sock'.
100.0% (1/1) success ratio (>= 100.0% threshold) of nodes successfully executed all commands.
[cookbooks.sre.mysql.sanitize_wiki.check] Check private data on clouddb
Running '/usr/local/sbin/check_private_data.py -S /run/mysqld/mysqld.s5.sock' on an-redacteddb1001.eqiad.wmnet,clouddb[1016,1020].eqiad.wmnet
===== NODE GROUP =====
(3) an-redacteddb1001.eqiad.wmnet,clouddb[1016,1020].eqiad.wmnet
----- OUTPUT for command #1: '/usr/local/sbin/...d/mysqld.s5.sock' -----
-- Non-public databases that are present:
-- Non-public tables that are present:
-- Unfiltered columns that are present:
================
100.0% (3/3) success ratio (>= 100.0% threshold) for command #1: '/usr/local/sbin/...d/mysqld.s5.sock'.
100.0% (3/3) success ratio (>= 100.0% threshold) of nodes successfully executed all commands.
[cookbooks.sre.mysql.sanitize_wiki.grant_and_view] Grant permissions and create view database on clouddb
Running 'CREATE DATABASE IF NOT EXISTS magwiki_p;' on an-redacteddb1001.eqiad.wmnet (s5) on an-redacteddb1001.eqiad.wmnet
Running 'GRANT SELECT, SHOW VIEW ON magwiki_p.* TO labsdbuser;' on an-redacteddb1001.eqiad.wmnet (s5) on an-redacteddb1001.eqiad.wmnet
Running 'CREATE DATABASE IF NOT EXISTS magwiki_p;' on clouddb1016.eqiad.wmnet (s5) on clouddb1016.eqiad.wmnet
Running 'GRANT SELECT, SHOW VIEW ON magwiki_p.* TO labsdbuser;' on clouddb1016.eqiad.wmnet (s5) on clouddb1016.eqiad.wmnet
Running 'CREATE DATABASE IF NOT EXISTS magwiki_p;' on clouddb1020.eqiad.wmnet (s5) on clouddb1020.eqiad.wmnet
Running 'GRANT SELECT, SHOW VIEW ON magwiki_p.* TO labsdbuser;' on clouddb1020.eqiad.wmnet (s5) on clouddb1020.eqiad.wmnet
Updated Phabricator task T428271
Sanitization completed for all wikis
Released lock for key /spicerack/locks/cookbooks/sre.mysql.sanitize-wiki:s5: {'concurrency': 1, 'created': '2026-06-18 12:34:56.185904+00:00', 'owner': 'cwilliams@cumin1003 [647071]', 'ttl': 3600}
END (PASS) - Cookbook sre.mysql.sanitize-wiki (exit_code=0) Managing sanitization for wikis magwiki in section s5
fnegri reassigned this task from fnegri to CWilliams-WMF.
fnegri subscribed.

Thanks @CWilliams-WMF, there's a separate task automatically created for the view creation, unfortunately it does not get linked automatically to this one (something to fix): T428282: [wikireplicas] Create views for new wiki magwiki

This one can be resolved, I'll take care of the other one!