Page MenuHomePhabricator

Apply updates for MCR, actor migration, and content migration, to production wikis.
Closed, ResolvedPublic

Description

The following schema changes should be applied to the revision and archive table in production, at DBA's discretion:

  • Drop rev_text_id, rev_content_model, and rev_content_format that MCR obsoleted.
  • Drop ar_text_id, ar_content_model, and ar_content_format that MCR obsoleted.
  • Replace rev_comment with rev_comment_id.
  • Replace rev_user and rev_user_text with rev_actor, plus associated index changes.

Schema change progress:

  • Labswiki
  • Labtestwiki (clouddb2001-dev)

Related Objects

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
Marostegui added a comment.EditedJul 17 2020, 8:44 AM

After a few days investigating, I have only found one query that has slightly changed its query plan on dewiki in comparison with enwiki.
Interestingly, the query plan differs on the index chosen on revision_comment_temp table, which isn't strictly part of this schema change, but I want to investigate further, to make sure that this change won't make it perform worse in enwiki.

What I am going to do is alter an enwiki host, to compare query plans before and after the change.
Will report back once done - this will also be good to get to know how long this schema change will take on enwiki and how this host will perform compared with the rest serving enwiki.

Mentioned in SAL (#wikimedia-operations) [2020-07-20T05:25:58Z] <marostegui> Deploy MCR schema change on enwiki on db1119 - T238966

The schema change on enwiki takes (per host):

  • For the archive table: 1:15h
  • For the revision table: 18h also worth mentioning that the table reduced 25% on disk size (table is innodb compressed), which is good news.

The host now running the new schema on enwiki is db1119.
I have tested the query that I found a few days ago, and the query plan has not changed, so that is good.
Next, I will slowly repool db1119 and check how it performs with the new schema.

Marostegui added a comment.EditedJul 21 2020, 5:08 AM

s1 eqiad progress

  • labsdb1012
  • labsdb1011
  • labsdb1010
  • labsdb1009
  • dbstore1003
  • db1140
  • db1139
  • db1135
  • db1134
  • db1124
  • db1119
  • db1118
  • db1084
  • db1106
  • db1105
  • db1099
  • db1091
  • db1089
  • db1083

Mentioned in SAL (#wikimedia-operations) [2020-07-21T06:54:48Z] <marostegui> Pool db1119 into enwiki with MCR schema change done - T238966

Mentioned in SAL (#wikimedia-operations) [2020-07-22T09:58:47Z] <marostegui> Deploy MCR schema change on s4 codfw master (lag will appear on codfw) - T238966

The schema change on s4 (commonswiki) takes around 9h per host.

Marostegui added a comment.EditedJul 23 2020, 9:15 AM

s4 eqiad progress

  • labsdb1012
  • labsdb1011
  • labsdb1010
  • labsdb1009
  • dbstore1004
  • db1149
  • db1148
  • db1147
  • db1146
  • db1145
  • db1144
  • db1143
  • db1142
  • db1141
  • db1138
  • db1125
  • db1121
  • db1081

s4 is complete, the master is impossible to alter while active, so it will be done once eqiad is on standby after the DC switchover.

Mentioned in SAL (#wikimedia-operations) [2020-07-30T05:26:01Z] <marostegui> Deploy MCR schema change on labswiki (wikitech) T238966

Proc added a subscriber: Proc.Aug 1 2020, 10:08 AM

Mentioned in SAL (#wikimedia-operations) [2020-08-03T07:09:04Z] <marostegui> Deploy MCR change on s7 codfw, lag will appear on codfw T238966

Mentioned in SAL (#wikimedia-operations) [2020-08-03T07:10:36Z] <marostegui> Remove revision triggers from db2095:3317 for MCR changes T238966

Marostegui added a comment.EditedAug 3 2020, 3:10 PM

Today while altering frwiktionary.revision we've been bitten by: https://jira.mariadb.org/browse/MDEV-14738
Unfortunately, we still have some schema drifts where the PK for revision is: rev_id,rev_user instead of rev_id.
Created T259524 for tracking

Marostegui added a comment.EditedAug 4 2020, 4:34 AM

s7 eqiad progress

  • labsdb1012
  • labsdb1011
  • labsdb1010
  • labsdb1009
  • dbstore1003
  • db1136
  • db1127
  • db1125
  • db1116
  • db1101
  • db1098
  • db1094
  • db1090
  • db1086
  • db1079

Mentioned in SAL (#wikimedia-operations) [2020-08-10T06:42:47Z] <marostegui> Stop replication on s8 codfw master to deploy MCR change, this will generate lag on s8 codfw T238966

Mentioned in SAL (#wikimedia-operations) [2020-08-10T06:43:28Z] <marostegui> Remove revision triggers from db2094:3318 T238966

Proc removed a subscriber: Proc.Aug 10 2020, 5:36 PM

Schema change times on s8 (wikidatawiki)
archive table -> 8 minutes
revision table -> 24 hours and 5 minutes

revision table went from 245G to 141G

Marostegui added a comment.EditedAug 11 2020, 2:57 PM

s8 eqiad progress

  • labsdb1012
  • labsdb1011
  • labsdb1010
  • labsdb1009
  • dbstore1005
  • db1126
  • db1124
  • db1116
  • db1114
  • db1111
  • db1109
  • db1104
  • db1101
  • db1099
  • db1092
  • db1087
Marostegui added a comment.EditedAug 13 2020, 7:13 AM

muswiki and mhwiktionary now live in s5 (T259004), so these need to be altered as well:

  • codfw
  • eqiad
    • labsdb1012
    • labsdb1011
    • labsdb1010
    • labsdb1009
    • dbstore1003
    • db1145
    • db1144
    • db1130
    • db1124
    • db1113
    • db1110
    • db1100
    • db1096
    • db1082

Wikis in s3 situation:
testwiki was already done at T238966#6192167 and T238966#6192173
muswiki and mhwiktionary now live in s5 (T259004) and will be removed from s3 (T260112)
The rest of new wikis that have been created recently already have the new schema.
So the final list for s3 that needs the schema change:

1aawiki
2aawikibooks
3aawiktionary
4abwiki
5abwiktionary
6acewiki
7advisorswiki
8advisorywiki
9adywiki
10afwiki
11afwikibooks
12afwikiquote
13afwiktionary
14akwiki
15akwikibooks
16akwiktionary
17alswiki
18amwiki
19amwikimedia
20amwikiquote
21amwiktionary
22angwiki
23angwikibooks
24angwikiquote
25angwikisource
26angwiktionary
27anwiki
28anwiktionary
29arbcom_cswiki
30arbcom_dewiki
31arbcom_enwiki
32arbcom_fiwiki
33arbcom_nlwiki
34arcwiki
35arwikibooks
36arwikimedia
37arwikinews
38arwikiquote
39arwikisource
40arwikiversity
41arwiktionary
42arzwiki
43astwiki
44astwikibooks
45astwikiquote
46astwiktionary
47aswiki
48aswikibooks
49aswikisource
50aswiktionary
51atjwiki
52auditcomwiki
53avwiki
54avwiktionary
55awawiki
56aywiki
57aywikibooks
58aywiktionary
59azbwiki
60azwiki
61azwikibooks
62azwikiquote
63azwikisource
64azwiktionary
65banwiki
66barwiki
67bat_smgwiki
68bawiki
69bawikibooks
70bclwiki
71bdwikimedia
72be_x_oldwiki
73betawikiversity
74bewiki
75bewikibooks
76bewikimedia
77bewikiquote
78bewikisource
79bewiktionary
80bgwikibooks
81bgwikinews
82bgwikiquote
83bgwikisource
84bhwiki
85bhwiktionary
86biwiki
87biwikibooks
88biwiktionary
89bjnwiki
90bmwiki
91bmwikibooks
92bmwikiquote
93bmwiktionary
94bnwiki
95bnwikibooks
96bnwikisource
97bnwikivoyage
98bnwiktionary
99boardgovcomwiki
100boardwiki
101bowiki
102bowikibooks
103bowiktionary
104bpywiki
105brwiki
106brwikimedia
107brwikiquote
108brwikisource
109brwiktionary
110bswiki
111bswikibooks
112bswikinews
113bswikiquote
114bswikisource
115bswiktionary
116bugwiki
117bxrwiki
118cawikibooks
119cawikimedia
120cawikinews
121cawikiquote
122cawikisource
123cawiktionary
124cbk_zamwiki
125cdowiki
126cewiki
127chairwiki
128chapcomwiki
129checkuserwiki
130chowiki
131chrwiki
132chrwiktionary
133chwiki
134chwikibooks
135chwiktionary
136chywiki
137ckbwiki
138cnwikimedia
139collabwiki
140cowiki
141cowikibooks
142cowikimedia
143cowikiquote
144cowiktionary
145crhwiki
146crwiki
147crwikiquote
148crwiktionary
149csbwiki
150csbwiktionary
151cswikibooks
152cswikinews
153cswikiquote
154cswikisource
155cswikiversity
156cswiktionary
157cuwiki
158cvwiki
159cvwikibooks
160cywiki
161cywikibooks
162cywikiquote
163cywikisource
164cywiktionary
165dawiki
166dawikibooks
167dawikiquote
168dawikisource
169dawiktionary
170dewikibooks
171dewikinews
172dewikiquote
173dewikisource
174dewikiversity
175dewikivoyage
176dewiktionary
177dinwiki
178diqwiki
179dkwikimedia
180donatewiki
181dsbwiki
182dtywiki
183dvwiki
184dvwiktionary
185dzwiki
186dzwiktionary
187ecwikimedia
188eewiki
189electcomwiki
190elwiki
191elwikibooks
192elwikinews
193elwikiquote
194elwikisource
195elwikiversity
196elwikivoyage
197elwiktionary
198emlwiki
199enwikibooks
200enwikinews
201enwikisource
202enwikiversity
203eowikibooks
204eowikinews
205eowikiquote
206eowikisource
207eowiktionary
208eswikibooks
209eswikinews
210eswikiquote
211eswikisource
212eswikiversity
213eswikivoyage
214eswiktionary
215etwiki
216etwikibooks
217etwikimedia
218etwikiquote
219etwikisource
220etwiktionary
221euwiki
222euwikibooks
223euwikiquote
224euwikisource
225euwiktionary
226execwiki
227extwiki
228fawikibooks
229fawikinews
230fawikiquote
231fawikisource
232fawikivoyage
233fawiktionary
234fdcwiki
235ffwiki
236fiu_vrowiki
237fiwikibooks
238fiwikimedia
239fiwikinews
240fiwikiquote
241fiwikisource
242fiwikiversity
243fiwikivoyage
244fiwiktionary
245fjwiki
246fjwiktionary
247foundationwiki
248fowiki
249fowikisource
250fowiktionary
251frpwiki
252frrwiki
253frwikibooks
254frwikinews
255frwikiquote
256frwikisource
257frwikiversity
258frwikivoyage
259furwiki
260fywiki
261fywikibooks
262fywiktionary
263gagwiki
264ganwiki
265gawiki
266gawikibooks
267gawikiquote
268gawiktionary
269gcrwiki
270gdwiki
271gdwiktionary
272gewikimedia
273glkwiki
274glwiki
275glwikibooks
276glwikiquote
277glwikisource
278glwiktionary
279gnwiki
280gnwikibooks
281gnwiktionary
282gomwiki
283gorwiki
284gotwiki
285gotwikibooks
286grantswiki
287grwikimedia
288guwiki
289guwikibooks
290guwikiquote
291guwikisource
292guwiktionary
293gvwiki
294gvwiktionary
295hakwiki
296hawiki
297hawiktionary
298hawwiki
299hewikibooks
300hewikinews
301hewikiquote
302hewikisource
303hewikivoyage
304hewiktionary
305hifwiki
306hifwiktionary
307hiwiki
308hiwikibooks
309hiwikimedia
310hiwikiquote
311hiwikisource
312hiwikiversity
313hiwikivoyage
314hiwiktionary
315howiki
316hrwiki
317hrwikibooks
318hrwikiquote
319hrwikisource
320hrwiktionary
321hsbwiki
322hsbwiktionary
323htwiki
324htwikisource
325huwikibooks
326huwikinews
327huwikiquote
328huwikisource
329huwiktionary
330hywiki
331hywikibooks
332hywikiquote
333hywikisource
334hywiktionary
335hywwiki
336hzwiki
337iawiki
338iawikibooks
339iawiktionary
340id_internalwikimedia
341idwikibooks
342idwikimedia
343idwikiquote
344idwikisource
345idwiktionary
346iegcomwiki
347iewiki
348iewikibooks
349iewiktionary
350igwiki
351iiwiki
352ikwiki
353ikwiktionary
354ilowiki
355ilwikimedia
356incubatorwiki
357inhwiki
358internalwiki
359iowiki
360iowiktionary
361iswiki
362iswikibooks
363iswikiquote
364iswikisource
365iswiktionary
366itwikibooks
367itwikinews
368itwikiquote
369itwikisource
370itwikiversity
371itwikivoyage
372itwiktionary
373iuwiki
374iuwiktionary
375jamwiki
376jawikibooks
377jawikinews
378jawikiquote
379jawikisource
380jawikiversity
381jawiktionary
382jbowiki
383jbowiktionary
384jvwiki
385jvwiktionary
386kaawiki
387kabwiki
388kawiki
389kawikibooks
390kawikiquote
391kawiktionary
392kbdwiki
393kbpwiki
394kgwiki
395kiwiki
396kjwiki
397kkwiki
398kkwikibooks
399kkwikiquote
400kkwiktionary
401klwiki
402klwiktionary
403kmwiki
404kmwikibooks
405kmwiktionary
406knwiki
407knwikibooks
408knwikiquote
409knwikisource
410knwiktionary
411koiwiki
412kowikibooks
413kowikinews
414kowikiquote
415kowikisource
416kowikiversity
417kowiktionary
418krcwiki
419krwiki
420krwikiquote
421kshwiki
422kswiki
423kswikibooks
424kswikiquote
425kswiktionary
426kuwiki
427kuwikibooks
428kuwikiquote
429kuwiktionary
430kvwiki
431kwwiki
432kwwikiquote
433kwwiktionary
434kywiki
435kywikibooks
436kywikiquote
437kywiktionary
438ladwiki
439lawiki
440lawikibooks
441lawikiquote
442lawikisource
443lawiktionary
444lbewiki
445lbwiki
446lbwikibooks
447lbwikiquote
448lbwiktionary
449legalteamwiki
450lezwiki
451lfnwiki
452lgwiki
453lijwiki
454liwiki
455liwikibooks
456liwikinews
457liwikiquote
458liwikisource
459liwiktionary
460lmowiki
461lnwiki
462lnwikibooks
463lnwiktionary
464loginwiki
465lowiki
466lowiktionary
467lrcwiki
468ltgwiki
469ltwiki
470ltwikibooks
471ltwikiquote
472ltwikisource
473ltwiktionary
474lvwiki
475lvwikibooks
476lvwiktionary
477maiwiki
478maiwikimedia
479map_bmswiki
480mdfwiki
481mediawikiwiki
482mgwiki
483mgwikibooks
484mhrwiki
485mhwiki
486minwiki
487minwiktionary
488miwiki
489miwikibooks
490miwiktionary
491mkwiki
492mkwikibooks
493mkwikimedia
494mkwikisource
495mkwiktionary
496mlwiki
497mlwikibooks
498mlwikiquote
499mlwikisource
500mlwiktionary
501mnwiki
502mnwikibooks
503mnwiktionary
504mnwwiki
505movementroleswiki
506mrjwiki
507mrwiki
508mrwikibooks
509mrwikiquote
510mrwikisource
511mrwiktionary
512mswiki
513mswikibooks
514mswiktionary
515mtwiki
516mtwiktionary
517mwlwiki
518mxwikimedia
519myvwiki
520mywiki
521mywikibooks
522mywiktionary
523mznwiki
524nahwiki
525nahwikibooks
526nahwiktionary
527napwiki
528napwikisource
529nawiki
530nawikibooks
531nawikiquote
532nawiktionary
533nds_nlwiki
534ndswiki
535ndswikibooks
536ndswikiquote
537ndswiktionary
538newiki
539newikibooks
540newiktionary
541newwiki
542ngwiki
543ngwikimedia
544nlwikibooks
545nlwikimedia
546nlwikinews
547nlwikiquote
548nlwikisource
549nlwikivoyage
550nlwiktionary
551nnwiki
552nnwikiquote
553nnwiktionary
554noboard_chapterswikimedia
555nostalgiawiki
556novwiki
557nowikibooks
558nowikimedia
559nowikinews
560nowikiquote
561nowikisource
562nowiktionary
563nqowiki
564nrmwiki
565nsowiki
566nvwiki
567nycwikimedia
568nywiki
569nzwikimedia
570ocwiki
571ocwikibooks
572ocwiktionary
573officewiki
574olowiki
575ombudsmenwiki
576omwiki
577omwiktionary
578orwiki
579orwikisource
580orwiktionary
581oswiki
582otrs_wikiwiki
583outreachwiki
584pa_uswikimedia
585pagwiki
586pamwiki
587papwiki
588pawiki
589pawikibooks
590pawikisource
591pawiktionary
592pcdwiki
593pdcwiki
594pflwiki
595pihwiki
596piwiki
597piwiktionary
598plwikibooks
599plwikimedia
600plwikinews
601plwikiquote
602plwikisource
603plwikivoyage
604plwiktionary
605pmswiki
606pmswikisource
607pnbwiki
608pnbwiktionary
609pntwiki
610projectcomwiki
611pswiki
612pswikibooks
613pswikivoyage
614pswiktionary
615ptwikibooks
616ptwikimedia
617ptwikinews
618ptwikiquote
619ptwikisource
620ptwikiversity
621ptwikivoyage
622ptwiktionary
623punjabiwikimedia
624qualitywiki
625quwiki
626quwikibooks
627quwikiquote
628quwiktionary
629rmwiki
630rmwikibooks
631rmwiktionary
632rmywiki
633rnwiki
634rnwiktionary
635roa_rupwiki
636roa_rupwiktionary
637roa_tarawiki
638romdwikimedia
639rowikibooks
640rowikinews
641rowikiquote
642rowikisource
643rowikivoyage
644rowiktionary
645rswikimedia
646ruewiki
647ruwikibooks
648ruwikimedia
649ruwikinews
650ruwikiquote
651ruwikisource
652ruwikiversity
653ruwikivoyage
654ruwiktionary
655rwwiki
656rwwiktionary
657sahwiki
658sahwikiquote
659sahwikisource
660satwiki
661sawiki
662sawikibooks
663sawikiquote
664sawikisource
665sawiktionary
666scnwiki
667scnwiktionary
668scowiki
669scwiki
670scwiktionary
671sdwiki
672sdwikinews
673sdwiktionary
674searchcomwiki
675sewiki
676sewikibooks
677sewikimedia
678sgwiki
679sgwiktionary
680shnwiki
681shwiktionary
682shywiktionary
683simplewiki
684simplewikibooks
685simplewikiquote
686simplewiktionary
687siwiki
688siwikibooks
689siwiktionary
690skwiki
691skwikibooks
692skwikiquote
693skwikisource
694skwiktionary
695slwiki
696slwikibooks
697slwikiquote
698slwikisource
699slwikiversity
700slwiktionary
701smwiki
702smwiktionary
703snwiki
704snwiktionary
705sourceswiki
706sowiki
707sowiktionary
708spcomwiki
709specieswiki
710sqwiki
711sqwikibooks
712sqwikinews
713sqwikiquote
714sqwiktionary
715srnwiki
716srwikibooks
717srwikinews
718srwikiquote
719srwikisource
720srwiktionary
721sswiki
722sswiktionary
723stewardwiki
724stqwiki
725strategywiki
726stwiki
727stwiktionary
728suwiki
729suwikibooks
730suwikiquote
731suwiktionary
732svwikibooks
733svwikinews
734svwikiquote
735svwikisource
736svwikiversity
737svwikivoyage
738svwiktionary
739swwiki
740swwikibooks
741swwiktionary
742szlwiki
743szywiki
744tawiki
745tawikibooks
746tawikinews
747tawikiquote
748tawikisource
749tawiktionary
750tcywiki
751techconductwiki
752tenwiki
753test2wiki
754testwikidatawiki
755tetwiki
756tewiki
757tewikibooks
758tewikiquote
759tewikisource
760tewiktionary
761tgwiki
762tgwikibooks
763tgwiktionary
764thwikibooks
765thwikinews
766thwikiquote
767thwikisource
768thwiktionary
769tiwiki
770tiwiktionary
771tkwiki
772tkwikibooks
773tkwikiquote
774tkwiktionary
775tlwiki
776tlwikibooks
777tlwiktionary
778tnwiki
779tnwiktionary
780towiki
781towiktionary
782tpiwiki
783tpiwiktionary
784transitionteamwiki
785trwikibooks
786trwikimedia
787trwikinews
788trwikiquote
789trwikisource
790trwiktionary
791tswiki
792tswiktionary
793ttwiki
794ttwikibooks
795ttwikiquote
796ttwiktionary
797tumwiki
798twwiki
799twwiktionary
800tyvwiki
801tywiki
802uawikimedia
803udmwiki
804ugwiki
805ugwikibooks
806ugwikiquote
807ugwiktionary
808ukwikibooks
809ukwikinews
810ukwikiquote
811ukwikisource
812ukwikivoyage
813ukwiktionary
814urwiki
815urwikibooks
816urwikiquote
817urwiktionary
818usabilitywiki
819uzwiki
820uzwikibooks
821uzwikiquote
822uzwiktionary
823vecwiki
824vecwikisource
825vecwiktionary
826vepwiki
827vewiki
828viwikibooks
829viwikiquote
830viwikisource
831viwikivoyage
832viwiktionary
833vlswiki
834votewiki
835vowiki
836vowikibooks
837vowikiquote
838vowiktionary
839warwiki
840wawiki
841wawikibooks
842wawiktionary
843wbwikimedia
844wg_enwiki
845wikimania2005wiki
846wikimania2006wiki
847wikimania2007wiki
848wikimania2008wiki
849wikimania2009wiki
850wikimania2010wiki
851wikimania2011wiki
852wikimania2012wiki
853wikimania2013wiki
854wikimania2014wiki
855wikimania2015wiki
856wikimania2016wiki
857wikimania2017wiki
858wikimania2018wiki
859wikimaniateamwiki
860wikimaniawiki
861wowiki
862wowikiquote
863wowiktionary
864wuuwiki
865xalwiki
866xhwiki
867xhwikibooks
868xhwiktionary
869xmfwiki
870yiwiki
871yiwikisource
872yiwiktionary
873yowiki
874yowikibooks
875yowiktionary
876yuewiktionary
877zawiki
878zawikibooks
879zawikiquote
880zawiktionary
881zeawiki
882zh_classicalwiki
883zh_min_nanwiki
884zh_min_nanwikibooks
885zh_min_nanwikiquote
886zh_min_nanwikisource
887zh_min_nanwiktionary
888zh_yuewiki
889zhwikibooks
890zhwikinews
891zhwikiquote
892zhwikisource
893zhwikiversity
894zhwikivoyage
895zhwiktionary
896zuwiki
897zuwikibooks
898zuwiktionary

Mentioned in SAL (#wikimedia-operations) [2020-08-25T05:10:02Z] <marostegui> Deploy MCR schema change on s1 codfw, this will create lag on s1 codfw - T238966

Mentioned in SAL (#wikimedia-operations) [2020-08-25T05:11:06Z] <marostegui> Remove revisions triggers from db2094:3311 T238966

Mentioned in SAL (#wikimedia-operations) [2020-09-03T12:46:28Z] <marostegui> Deploy MCR schema change on s7 eqiad master (lag might show up) - T238966

Mentioned in SAL (#wikimedia-operations) [2020-09-04T05:13:16Z] <marostegui> Deploy MCR schema change on s4 eqiad master T238966

Mentioned in SAL (#wikimedia-operations) [2020-09-04T10:28:47Z] <marostegui> Deploy MCR schema change on db1087 (sanitarium master), this will generate lag (probably a few days) on s8 labsdb hosts T238966

Mentioned in SAL (#wikimedia-operations) [2020-09-14T11:19:44Z] <marostegui> Deploy MCR schema change on s1, this will generate lag on s1 labsdb - T238966

Mentioned in SAL (#wikimedia-operations) [2020-09-14T11:20:39Z] <marostegui> Remove triggers from db1124:3311 - T238966

Mentioned in SAL (#wikimedia-operations) [2020-09-17T04:53:43Z] <marostegui> Deploy schema change on s1 eqiad primary master - T238966

Mentioned in SAL (#wikimedia-operations) [2020-09-21T05:06:02Z] <marostegui> Deploy MCR schema change on s8 eqiad master, lag will appear on s8 (wikidata) on labsdb hosts T238966

Mentioned in SAL (#wikimedia-operations) [2020-09-22T05:39:43Z] <marostegui> Deploy MCR schema change on s3 eqiad, this will generate lag on s3 on labsdb T238966

Mentioned in SAL (#wikimedia-operations) [2020-09-22T05:40:56Z] <marostegui> Log remove triggers on revision table on db1124:3313 T238966

Marostegui added a comment.EditedSep 22 2020, 1:48 PM

s3 codfw progress

  • db2127
  • db2109
  • db2105
  • db2098
  • db2094
  • db2074

Mentioned in SAL (#wikimedia-operations) [2020-09-22T13:49:19Z] <marostegui> Deploy MCR change on db2098:3313 - T238966

Mentioned in SAL (#wikimedia-operations) [2020-09-23T05:03:15Z] <marostegui> Remove triggers from db2094:3313 for MCR schema change T238966

All sanitarium hosts for all the sections were completed. I will get a patch ready to remove all those columns from the filtered_tables file

Change 629621 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] filtered_tables.txt: Update columns after MCR changes

https://gerrit.wikimedia.org/r/629621

Change 629621 merged by Marostegui:
[operations/puppet@production] filtered_tables.txt: Update columns after MCR changes

https://gerrit.wikimedia.org/r/629621

Marostegui changed the task status from Open to Stalled.Sep 24 2020, 2:55 PM

s3 is almost done, just pending s3 primary codfw master. I will do it once we are back in eqiad.
Stalling this task until then as it is the only pending thing of this mighty task :)

s3 is almost done, just pending s3 primary codfw master. I will do it once we are back in eqiad.
Stalling this task until then as it is the only pending thing of this mighty task :)

Yay! Thank you very much!

Aklapper removed a subscriber: Anomie.Oct 16 2020, 5:02 PM
Marostegui moved this task from Blocked to In progress on the DBA board.Oct 29 2020, 6:19 AM

Can this be unstalled now?

Kormat changed the task status from Stalled to Open.Nov 4 2020, 3:44 PM
Kormat added a subscriber: Kormat.

Unstalling, @Marostegui is planning to do this soon.

Mentioned in SAL (#wikimedia-operations) [2020-11-16T06:35:15Z] <marostegui> Stop replication on s3 codfw master (db2105) for MCR schema change deployment T238966

Marostegui closed this task as Resolved.Tue, Nov 17, 7:54 AM
Marostegui updated the task description. (Show Details)

Almost one year has passed by, but this is all done now!

Almost one year has passed by, but this is all done now!

Wooooo! Thank you!