We will generate on es2002 (and maybe somewhere else) an offline copy of es2 and es3 content (es1 is already at es2003 and es2004) as a one-time copy, in case of a huge disaster. This will unblock pending maintenance work and server until a proper solution is in place for proper automatic incremental backups.
Description
Details
Status | Subtype | Assigned | Task | ||
---|---|---|---|---|---|
Stalled | None | T106386 Compress data at external storage | |||
Stalled | None | T106388 Audit all existing code to ensure that any extension currently or previously adding blobs to ExternalStore has been registering a reference in the text table (and fix up if wrong) | |||
Declined | None | T106363 Migrate Flow content to new separate logical External Store in production | |||
Declined | None | T138049 Dry run of Flow External Store migration in production | |||
Declined | Tgr | T107610 Setup separate logical External Store for Flow in production | |||
Resolved | jcrespo | T153440 Create a full backup of all external storage records that would be easy to restore/setup a temporary delayed slave | |||
Resolved | Daimona | T34478 AbuseFilter not setting utf-8 flag | |||
Resolved | Urbanecm | T246539 Dry-run, then actually run updateVarDumps | |||
Declined | Daimona | T246938 How to update/delete ExternalStore entries? | |||
Resolved | Daimona | T252696 Find a good way to run the updateVarDumps script on large wikis |
Event Timeline
Change 423949 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/mediawiki-config@master] mariadb: Depool es2015 for maintenance
Change 423949 merged by jenkins-bot:
[operations/mediawiki-config@master] mariadb: Depool es2015 for maintenance
@ayounsi We are performing this 5.4TB backup by saturating the es2015 and es2002 host links, it will take 12 hours.
Change 424227 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/mediawiki-config@master] mariadb: Repool es2015, depool es2019
Change 424227 merged by jenkins-bot:
[operations/mediawiki-config@master] mariadb: Repool es2015, depool es2019
Mentioned in SAL (#wikimedia-operations) [2018-04-05T08:30:20Z] <jynus> starting backup of es2019, it may create lag T153440
es1 is in es2003/es2003 as a binary copy.
es2 and es3 is in es2002 as logical copies.
Change 424745 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/mediawiki-config@master] mariadb: Repool es2019 after maintenance
Change 424745 merged by jenkins-bot:
[operations/mediawiki-config@master] mariadb: Repool es2019 after maintenance