Page MenuHomePhabricator
Create Task
Maniphest T198312

Set the WMF cluster to use the new MCR-only schema
Closed, ResolvedPublic
Actions

Description

The following setting fully switches MediaWiki to the new, MCR enabled database schema for revision storage:

$wgMultiContentRevisionSchemaMigrationStage = SCHEMA_COMPAT_NEW;

This renders the following database fields unused:

  • revision.rev_text_id
  • revision.rev_content_model
  • revision.rev_content_format
  • archive.ar_text_id
  • archive.ar_content_model
  • archive.ar_content_format
WARNING: This marks the POINT OF NO RETURN for MCR deployment to the WMF cluster! Rolling this back would render all content of new revisions inaccessible!
WARNING: Because of cross-wiki revision access, this can only be done an ANY system on the cluster once ALL systems on the cluster write the new schema.

Details

SubjectRepoBranchLines +/-
Set all sites to use the new MCR-only schemaoperations/mediawiki-configmaster+1 -2
Set MCR migration stage to NEW on all wikisoperations/mediawiki-configmaster+1 -3
Set MCR migration stage to NEW on group 1operations/mediawiki-configmaster+1 -0
Set MCR migration stage to NEW on group 0operations/mediawiki-configmaster+1 -1
Customize query in gerrit

Related Objects
Search...

Event Timeline

daniel triaged this task as Medium priority.Jun 27 2018, 11:34 AM
daniel created this task.
daniel renamed this task from Enable new MCR storage schemas on live systems to Set the WMF cluster to use the new MCR-only schema.Jul 1 2018, 12:21 PM
daniel added a parent task: T198557: Remove the ability to write pre-MCR fields, limit the ability to read pre-MCR fields to migration scripts.
daniel removed a project: Multi-Content-Revisions (MCR-SDC File Caption Support - phase 2).Jul 1 2018, 12:23 PM
daniel updated the task description. (Show Details)
daniel edited subscribers, added: CCicalese_WMF, • Fjalapeno; removed: aude, Addshore, Anomie and 2 others.
daniel updated the task description. (Show Details)Jul 1 2018, 12:26 PM
daniel added a subtask: T198308: Enable MCR migration stage "write both, read new" on live systems.
daniel updated the task description. (Show Details)
daniel updated the task description. (Show Details)Jul 2 2018, 2:41 PM
daniel added a subtask: T198706: Make BackupDumper, WikiExporter and XmlDumpWriter compliant with the MCR revision retrival mechanism (main slot only).Jul 3 2018, 12:48 PM
daniel edited projects, added Multi-Content-Revisions (Deployment); removed SDC General, Wikidata.Jul 4 2018, 12:25 PM
daniel updated the task description. (Show Details)Jul 8 2018, 8:17 PM
daniel mentioned this in T174047: Hide deprecated/unused fields on toolforge replica [MCR].Jul 9 2018, 3:40 PM
daniel added a subtask: T174047: Hide deprecated/unused fields on toolforge replica [MCR].
daniel mentioned this in T199121: RFC: Spec for representing multiple content objects per revision (MCR) in XML dumps.Aug 6 2018, 6:05 PM
Jdforrester-WMF added a parent task: T159708: Deploy WikibaseMediaInfo extension to production.Aug 23 2018, 11:53 PM
Jdforrester-WMF mentioned this in T194750: Deploy Structured Data on Commons baseline .Sep 5 2018, 4:02 PM
Jdforrester-WMF added a parent task: T194750: Deploy Structured Data on Commons baseline .
Jdforrester-WMF added a project: Structured Data Engineering.Sep 27 2018, 11:49 PM
Jdforrester-WMF moved this task from To Do to Monitoring on the Structured Data Engineering board.
CCicalese_WMF added projects: Platform Team Legacy (Later), Platform Engineering (MCR: Deployment).Oct 3 2018, 5:23 PM
CCicalese_WMF moved this task from MCR: Deployment to MCR on the Platform Engineering board.Oct 4 2018, 3:12 PM
CCicalese_WMF edited projects, added Platform Engineering (MCR); removed Platform Engineering (MCR: Deployment).
CCicalese_WMF removed a parent task: T159708: Deploy WikibaseMediaInfo extension to production.Oct 17 2018, 5:33 PM
Anomie closed subtask T198308: Enable MCR migration stage "write both, read new" on live systems as Resolved.Nov 5 2018, 5:33 PM
Jdforrester-WMF removed a parent task: T194750: Deploy Structured Data on Commons baseline .Nov 16 2018, 7:23 PM
daniel added a parent task: T184615: Once MCR is deployed, drop the rev_text_id, rev_content_model, and rev_content_format fields from the revision table.Feb 8 2019, 4:07 PM
daniel mentioned this in T174044: Deploy MCR storage layer.Feb 8 2019, 4:10 PM
Jdforrester-WMF subscribed.Feb 8 2019, 6:42 PM
Nirmos subscribed.Feb 8 2019, 8:50 PM
greg added a project: Multimedia.Mar 7 2019, 10:59 PM
• Ramsey-WMF removed a project: Multimedia.Mar 15 2019, 5:59 PM
Restricted Application added a project: Multimedia. · View Herald TranscriptMar 15 2019, 5:59 PM
• Ramsey-WMF removed a project: Multimedia.Mar 15 2019, 5:59 PM
daniel mentioned this in T222224: RFC: Normalize MediaWiki link tables.May 7 2019, 11:19 AM
daniel closed subtask T198706: Make BackupDumper, WikiExporter and XmlDumpWriter compliant with the MCR revision retrival mechanism (main slot only) as Resolved.May 15 2019, 10:03 PM
• WDoranWMF moved this task from Later to Mop Column on the Platform Team Legacy board.Jul 5 2019, 2:13 PM
• WDoranWMF removed a project: Platform Team Legacy (Later).
• WDoranWMF moved this task from MCR to mop on the Platform Engineering board.Jul 26 2019, 6:39 PM
• WDoranWMF edited projects, added Core Platform Team Initiatives (MCR); removed Platform Engineering (MCR).
CCicalese_WMF edited projects, added Core Platform Team Initiatives (MCR Schema Migration); removed Core Platform Team Initiatives (MCR).Aug 1 2019, 3:44 AM
Aklapper added a project: Structured-Data-Backlog.Aug 10 2019, 11:55 PM
CCicalese_WMF removed a subtask: T198341: Remove all references to the rev_text_id and ar_text_id fields.Aug 30 2019, 10:51 PM
CCicalese_WMF removed parent tasks: T184615: Once MCR is deployed, drop the rev_text_id, rev_content_model, and rev_content_format fields from the revision table, T198557: Remove the ability to write pre-MCR fields, limit the ability to read pre-MCR fields to migration scripts.Aug 30 2019, 11:48 PM
CCicalese_WMF removed a subtask: T198308: Enable MCR migration stage "write both, read new" on live systems.Aug 31 2019, 12:09 AM
DannyS712 subscribed.Oct 17 2019, 6:22 AM
daniel closed subtask T198558: Set testwiki to use the new MCR-only schema as Resolved.Oct 30 2019, 1:01 PM
gerritbot added a comment.Nov 7 2019, 11:29 AM

Change 549449 had a related patch set uploaded (by Daniel Kinzler; owner: Daniel Kinzler):
[operations/mediawiki-config@master] Set all sites to use the new MCR-only schema

https://gerrit.wikimedia.org/r/549449

gerritbot added a project: Patch-For-Review.Nov 7 2019, 11:29 AM
daniel added a comment.Nov 7 2019, 11:30 AM

Config patch scheduled to be deployed on November 12.

gerritbot added a comment.Nov 7 2019, 6:33 PM

Change 549449 had a related patch set uploaded (by Krinkle; owner: Daniel Kinzler):
[operations/mediawiki-config@master] Set all sites to use the new MCR-only schema

https://gerrit.wikimedia.org/r/549449

• WDoranWMF added a project: Platform Team Workboards (Clinic Duty Team).Nov 7 2019, 7:58 PM
• WDoranWMF moved this task from Inbox to Later on the Platform Team Workboards (Clinic Duty Team) board.
gerritbot added a comment.Nov 12 2019, 7:35 PM

Change 550534 had a related patch set uploaded (by Anomie; owner: Anomie):
[operations/mediawiki-config@master] Set MCR migration stage to NEW on group 0

https://gerrit.wikimedia.org/r/550534

gerritbot added a comment.Nov 12 2019, 7:37 PM

Change 550534 merged by jenkins-bot:
[operations/mediawiki-config@master] Set MCR migration stage to NEW on group 0

https://gerrit.wikimedia.org/r/550534

Stashbot added a comment.Nov 12 2019, 7:41 PM

Mentioned in SAL (#wikimedia-operations) [2019-11-12T19:41:33Z] <anomie@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Set MCR migration stage to NEW on group0 for T198312 (duration: 00m 52s)

DannyS712 added a comment.Nov 14 2019, 3:41 AM

Potential cause of T238288: InvalidArgumentException: Unable to view diff of deleted page, please don't apply to group1 yet

CCicalese_WMF added a comment.Nov 14 2019, 1:29 PM

T238288 is a duplicate of T237709, which is unrelated to this patch. This should not block deploying to group1.

gerritbot added a comment.Nov 14 2019, 2:45 PM

Change 550844 had a related patch set uploaded (by Anomie; owner: Anomie):
[operations/mediawiki-config@master] Set MCR migration stage to NEW on group 1

https://gerrit.wikimedia.org/r/550844

gerritbot added a comment.Nov 14 2019, 2:47 PM

Change 550844 merged by jenkins-bot:
[operations/mediawiki-config@master] Set MCR migration stage to NEW on group 1

https://gerrit.wikimedia.org/r/550844

Stashbot added a comment.Nov 14 2019, 2:48 PM

Mentioned in SAL (#wikimedia-operations) [2019-11-14T14:48:43Z] <anomie@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Set MCR migration stage to NEW on group1 for T198312 (duration: 00m 53s)

DannyS712 added a comment.Nov 14 2019, 4:20 PM
In T198312#5663604, @CCicalese_WMF wrote:

T238288 is a duplicate of T237709, which is unrelated to this patch. This should not block deploying to group1.

Thanks, sorry about that

daniel added a comment.Nov 14 2019, 5:03 PM
In T198312#5664163, @DannyS712 wrote:

Thanks, sorry about that

No need to apologize, thanks for watching out for potential problems!

gerritbot added a comment.Nov 18 2019, 3:07 PM

Change 551551 had a related patch set uploaded (by Anomie; owner: Anomie):
[operations/mediawiki-config@master] Set MCR migration stage to NEW on all wikis

https://gerrit.wikimedia.org/r/551551

gerritbot added a comment.Nov 18 2019, 3:09 PM

Change 551551 merged by jenkins-bot:
[operations/mediawiki-config@master] Set MCR migration stage to NEW on all wikis

https://gerrit.wikimedia.org/r/551551

Stashbot added a comment.Nov 18 2019, 3:13 PM

Mentioned in SAL (#wikimedia-operations) [2019-11-18T15:13:42Z] <anomie@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Set MCR migration stage to NEW on remaining wikis for T198312 (duration: 00m 53s)

Anomie mentioned this in T236104: Cache of wmf-config/InitialiseSettings often 1 step behind.Nov 18 2019, 3:25 PM
Anomie closed this task as Resolved.Nov 18 2019, 3:29 PM
Anomie claimed this task.
Anomie moved this task from Later to Done on the Platform Team Workboards (Clinic Duty Team) board.
Anomie removed a project: Patch-For-Review.
gerritbot added a comment.Nov 18 2019, 3:30 PM

Change 549449 abandoned by Anomie:
Set all sites to use the new MCR-only schema

Reason:
Forgot about this patch and did it as I259a71eb17141f4e245ba143265456d0b779de9a instead.

https://gerrit.wikimedia.org/r/549449

daniel mentioned this in T252219: Drop MCR-obsoleted fields from the wiki replicas.May 11 2020, 8:35 PM
Izno removed a subtask: T174047: Hide deprecated/unused fields on toolforge replica [MCR].Nov 8 2021, 10:04 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits