Page MenuHomePhabricator
Create Task
Maniphest T307219

Put parse parse10[01-24] in production
Closed, ResolvedPublic
Actions

Description

Followup from T299573, those hosts are ready to be assigned roles and be pooled as the refresh hosts for wtp10[25-48]

Details

Related Changes in Gerrit:
SubjectRepoBranchLines +/-
scap/cumin: switch parsoid eqiad canariesoperations/puppetproduction+7 -7
Customize query in gerrit

Related Objects
Search...

StatusSubtypeAssignedTask
 ResolvedNoneT248925 Make MediaWiki release tarball compatible with PHP 8.0
 ResolvedJdforrester-WMFT300463 Make PHP 8.0 voting on MW master
 ResolvedJdforrester-WMFT313563 Bump lcobucci/jwt & league/uri-components for php8
 ResolvedJdforrester-WMFT313564 Bump onoi/message-reporter in vendor.git to 1.4.2 for php 8 support
 ResolvedJdforrester-WMFT247658 Make Wikimedia Production MediaWiki compatible with PHP 7.4
 Resolved• toanT243590 Fix WikibaseDataModel CI for php 7.4
 ResolvedLucas_Werkmeister_WMDET316923 Restore skipped test in ReferenceListTest.php
 ResolvedJoeT318918 Undeploy patch to use old PHP serialization in PHP 7.4
 ResolvedJdforrester-WMFT264168 Drop PHP 7.2 support from Wikibase master branch, once Wikimedia production is on 7.4
 ResolvedLadsgroupT270740 Drop hacky support for doctrine/dbal class renaming
 InvalidNoneT303505 [S] Remove Deprecated methods "serialize" and "unserialize" after php production upgrade to PHP 7.4
 ResolvedReedyT251043 Cleanup css-sanitizer when it only requires PHP >= 7.4
 OpenNoneT166010 The Great Namespaceization Effort
 ResolvedtstarlingT277618 var_dump() on various objects writes gigabytes of data and takes minutes to run
 ResolvedJdforrester-WMFT261872 Drop PHP 7.2 & 7.3 support from MediaWiki master branch, once Wikimedia production is on 7.4
 ResolvedPRODUCTION ERRORLegoktmT293568 PHP Notice: Undefined offset in wikimedia/remex-html when rendering rest.php error page
 ResolvedtstarlingT297667 mysqli/mysqlnd memory leak
 ResolvedJoeT271736 Migrate WMF production from PHP 7.2 to PHP 7.4
 ResolvedClement_GoubertT312638 Parsoid migration to php 7.4
 ResolvedJclark-ctrT317025 Decommission wtp10[25-48].eqiad.wmnet
 ResolvedClement_GoubertT307219 Put parse parse10[01-24] in production

Event Timeline

akosiaris created this task.Apr 29 2022, 2:07 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptApr 29 2022, 2:07 PM
akosiaris mentioned this in T307220: decommission wtp10[25-48].Apr 29 2022, 2:08 PM
Clement_Goubert claimed this task.Aug 31 2022, 9:36 AM
Clement_Goubert moved this task from Incoming 🐫 to Doing 😎 on the serviceops board.
Clement_Goubert changed the task status from Open to In Progress.Sep 1 2022, 9:27 AM
Clement_Goubert added a parent task: T312638: Parsoid migration to php 7.4.
Clement_Goubert renamed this task from Put parse parse100[01-24] in production to Put parse parse10[01-24] in production.Sep 1 2022, 10:14 AM
Clement_Goubert mentioned this in T312638: Parsoid migration to php 7.4.Sep 1 2022, 11:11 AM

As mentioned in https://phabricator.wikimedia.org/T312638 I'll be logging here the progress of putting the new parse servers in production.

parse1001 got put in the pool replacing wtp1034
parse1002 got put in the pool replacing wtp1035

8% of parse traffic now served in php7.4 only.

Clement_Goubert triaged this task as High priority.Sep 1 2022, 12:35 PM
Clement_Goubert added a comment.EditedSep 5 2022, 1:46 PM

parse1003 replaced wtp1036
parse1004 replaced wtp1037

16% of parse traffic in php7.4 only

Clement_Goubert added a comment.Sep 5 2022, 1:47 PM

marked wtp1034 and wtp1035 as inactive

Stashbot added a comment.Sep 5 2022, 1:48 PM

Mentioned in SAL (#wikimedia-operations) [2022-09-05T13:48:28Z] <claime> pooled parse1005.eqiad.wmnet (php 7.4 only) in parsoid cluster T307219

Stashbot added a comment.Sep 5 2022, 2:01 PM

Mentioned in SAL (#wikimedia-operations) [2022-09-05T14:01:33Z] <claime> depooled wtp1037.eqiad.wmnet from parsoid cluster T307219

Stashbot added a comment.Sep 5 2022, 2:23 PM

Mentioned in SAL (#wikimedia-operations) [2022-09-05T14:23:39Z] <claime> pooled parse1006.eqiad.wmnet (php 7.4 only) in parsoid cluster T307219

Stashbot added a comment.Sep 5 2022, 2:33 PM

Mentioned in SAL (#wikimedia-operations) [2022-09-05T14:33:34Z] <claime> depooled wtp1039.eqiad.wmnet from parsoid cluster T307219

Clement_Goubert added a comment.Sep 5 2022, 2:43 PM

Icinga downtime and Alertmanager silence (ID=3d4522be-4ec5-4d1a-8bba-1d5621e4d400) set by cgoubert@cumin1001 for 7 days, 0:00:00 on 3 host(s) and their services with reason: Downtiming replace wtp servers

wtp[1036-1038].eqiad.wmnet

Clement_Goubert added a comment.Sep 5 2022, 2:45 PM

parse1005 replaced wtp1038
parse1006 replaced wtp1039

32% of parse traffic in php7.4 only

marked wtp1036 and wtp1037 as inactive

Stashbot added a comment.Sep 5 2022, 3:19 PM

Mentioned in SAL (#wikimedia-operations) [2022-09-05T15:19:07Z] <claime> pooled parse1007.eqiad.wmnet (php 7.4 only) in parsoid cluster T307219

Stashbot added a comment.Sep 5 2022, 3:28 PM

Mentioned in SAL (#wikimedia-operations) [2022-09-05T15:28:24Z] <claime> depooled wtp1040.eqiad.wmnet from parsoid cluster T307219

Clement_Goubert added a comment.Sep 5 2022, 4:26 PM

parse1007 replaced wtp1040

36% of parse traffic in php7.4 only

marked wtp1038 as inactive

Stashbot added a comment.Sep 6 2022, 9:44 AM

Mentioned in SAL (#wikimedia-operations) [2022-09-06T09:44:18Z] <claime> pooled parse1008.eqiad.wmnet (php 7.4 only) in parsoid cluster T307219

Stashbot added a comment.Sep 6 2022, 9:55 AM

Mentioned in SAL (#wikimedia-operations) [2022-09-06T09:55:13Z] <claime> depooled wtp1041.eqiad.wmnet from parsoid cluster T307219

ops-monitoring-bot added a comment.Sep 6 2022, 11:26 AM

Icinga downtime and Alertmanager silence (ID=8227bbf8-d91f-4d60-821f-bb5f06579d65) set by cgoubert@cumin1001 for 7 days, 0:00:00 on 12 host(s) and their services with reason: Downtime pending inclusion in production

parse[1013-1024].eqiad.wmnet
Stashbot added a comment.Sep 6 2022, 11:27 AM

Mentioned in SAL (#wikimedia-operations) [2022-09-06T11:27:29Z] <claime> pooled parse1009.eqiad.wmnet (php 7.4 only) in parsoid cluster T307219

Stashbot added a comment.Sep 6 2022, 12:01 PM

Mentioned in SAL (#wikimedia-operations) [2022-09-06T12:01:06Z] <claime> depooled wtp1042.eqiad.wmnet from parsoid cluster T307219

Clement_Goubert added a comment.Sep 6 2022, 12:06 PM

Icinga downtime and Alertmanager silence (ID=adaec891-8daa-470f-9d2f-6c2b62e7f043) set by cgoubert@cumin1001 for 7 days, 0:00:00 on 2 host(s) and their services with reason: Downtiming replaced wtp servers

wtp[1039-1040].eqiad.wmnet
Stashbot added a comment.Sep 6 2022, 1:35 PM

Mentioned in SAL (#wikimedia-operations) [2022-09-06T13:35:57Z] <claime> pooled parse1010.eqiad.wmnet (php 7.4 only) in parsoid cluster T307219

Stashbot added a comment.Sep 6 2022, 1:56 PM

Mentioned in SAL (#wikimedia-operations) [2022-09-06T13:56:16Z] <claime> depooled wtp1043.eqiad.wmnet from parsoid cluster T307219

Stashbot added a comment.Sep 6 2022, 2:28 PM

Mentioned in SAL (#wikimedia-operations) [2022-09-06T14:28:15Z] <claime> pooled parse1011.eqiad.wmnet (php 7.4 only) in parsoid cluster T307219

Stashbot added a comment.Sep 6 2022, 2:39 PM

Mentioned in SAL (#wikimedia-operations) [2022-09-06T14:39:46Z] <claime> depooled wtp1044.eqiad.wmnet from parsoid cluster T307219

Stashbot added a comment.Sep 6 2022, 2:58 PM

Mentioned in SAL (#wikimedia-operations) [2022-09-06T14:58:51Z] <claime> pooled parse1012.eqiad.wmnet (php 7.4 only) in parsoid cluster T307219

Stashbot added a comment.Sep 6 2022, 3:08 PM

Mentioned in SAL (#wikimedia-operations) [2022-09-06T15:08:54Z] <claime> depooled wtp1045.eqiad.wmnet from parsoid cluster T307219

Clement_Goubert added a comment.Sep 6 2022, 3:15 PM

Icinga downtime and Alertmanager silence (ID=adaec891-8daa-470f-9d2f-6c2b62e7f043) set by cgoubert@cumin1001 for 7 days, 0:00:00 on 2 host(s) and their services with reason: Downtiming replaced wtp servers

wtp[1039-1040].eqiad.wmnet
gerritbot added a comment.Sep 6 2022, 3:52 PM

Change 830193 had a related patch set uploaded (by Clément Goubert; author: Clément Goubert):

[operations/puppet@production] scap/cumin: switch parsoid eqiad canaries

https://gerrit.wikimedia.org/r/830193

gerritbot added a project: Patch-For-Review.Sep 6 2022, 3:52 PM
Clement_Goubert added a comment.Sep 6 2022, 4:42 PM

parse1008 replaced wtp1041
parse1009 replaced wtp1042
parse1010 replaced wtp1043
parse1011 replaced wtp1044
parse1012 replaced wtp1045

50% of parse traffic in php7.4 only

marked wtp10[39-43] as inactive

Stashbot added a comment.Sep 7 2022, 9:31 AM

Mentioned in SAL (#wikimedia-operations) [2022-09-07T09:31:38Z] <claime> pooled parse1013.eqiad.wmnet (php 7.4 only) in parsoid cluster T307219

Stashbot added a comment.Sep 7 2022, 9:44 AM

Mentioned in SAL (#wikimedia-operations) [2022-09-07T09:44:29Z] <claime> depooled wtp1046.eqiad.wmnet from parsoid cluster T307219

Stashbot added a comment.Sep 7 2022, 10:05 AM

Mentioned in SAL (#wikimedia-operations) [2022-09-07T10:05:18Z] <claime> pooled parse1014.eqiad.wmnet (php 7.4 only) in parsoid cluster T307219

Stashbot added a comment.Sep 7 2022, 10:12 AM

Mentioned in SAL (#wikimedia-operations) [2022-09-07T10:12:06Z] <claime> repooled parse1014.eqiad.wmnet (php 7.4 only) in parsoid cluster T307219

Stashbot added a comment.Sep 7 2022, 10:21 AM

Mentioned in SAL (#wikimedia-operations) [2022-09-07T10:21:45Z] <claime> depooled wtp1047.eqiad.wmnet from parsoid cluster T307219

Stashbot added a comment.Sep 7 2022, 10:26 AM

Mentioned in SAL (#wikimedia-operations) [2022-09-07T10:26:23Z] <claime> pooled parse1015.eqiad.wmnet (php 7.4 only) in parsoid cluster T307219

Stashbot added a comment.Sep 7 2022, 10:36 AM

Mentioned in SAL (#wikimedia-operations) [2022-09-07T10:36:30Z] <claime> depooled wtp1048.eqiad.wmnet from parsoid cluster T307219

Stashbot added a comment.Sep 7 2022, 10:40 AM

Mentioned in SAL (#wikimedia-operations) [2022-09-07T10:40:04Z] <claime> pooled parse1016.eqiad.wmnet (php 7.4 only) in parsoid cluster T307219

ops-monitoring-bot added a comment.Sep 7 2022, 10:52 AM

Icinga downtime and Alertmanager silence (ID=6ae25b9f-a382-4184-824f-2ae58210788f) set by cgoubert@cumin1001 for 7 days, 0:00:00 on 3 host(s) and their services with reason: Downtiming replaced wtp servers

wtp[1044-1046].eqiad.wmnet
ops-monitoring-bot added a comment.Sep 7 2022, 11:00 AM

Icinga downtime and Alertmanager silence (ID=ceb79fae-b2a5-4618-9cd0-d21af9cca032) set by cgoubert@cumin1001 for 7 days, 0:00:00 on 7 host(s) and their services with reason: Downtime pending inclusion in production

parse[1018-1024].eqiad.wmnet
Stashbot added a comment.Sep 7 2022, 2:02 PM

Mentioned in SAL (#wikimedia-operations) [2022-09-07T14:02:42Z] <claime> depooled wtp1027.eqiad.wmnet from parsoid cluster T307219

gerritbot added a comment.Sep 7 2022, 2:20 PM

Change 830193 merged by Clément Goubert:

[operations/puppet@production] scap/cumin: switch parsoid eqiad canaries

https://gerrit.wikimedia.org/r/830193

Stashbot added a comment.Sep 7 2022, 2:20 PM

Mentioned in SAL (#wikimedia-operations) [2022-09-07T14:20:38Z] <claime> Switching canaries for parsoid eqiad T307219

Maintenance_bot removed a project: Patch-For-Review.Sep 7 2022, 2:31 PM
Stashbot added a comment.Sep 7 2022, 2:32 PM

Mentioned in SAL (#wikimedia-operations) [2022-09-07T14:32:36Z] <claime> parsoid eqiad canaries switched to parse1001 and parse1002 T307219

Stashbot added a comment.Sep 7 2022, 2:37 PM

Mentioned in SAL (#wikimedia-operations) [2022-09-07T14:37:16Z] <claime> pooled parse1017.eqiad.wmnet (php 7.4 only) in parsoid cluster T307219

Stashbot added a comment.Sep 7 2022, 2:48 PM

Mentioned in SAL (#wikimedia-operations) [2022-09-07T14:48:35Z] <claime> depooled wtp1025.eqiad.wmnet from parsoid cluster T307219

Stashbot added a comment.Sep 7 2022, 2:52 PM

Mentioned in SAL (#wikimedia-operations) [2022-09-07T14:52:38Z] <claime> pooled parse1018.eqiad.wmnet (php 7.4 only) in parsoid cluster T307219

Stashbot added a comment.Sep 7 2022, 3:07 PM

Mentioned in SAL (#wikimedia-operations) [2022-09-07T15:07:31Z] <claime> depooled wtp1026.eqiad.wmnet from parsoid cluster T307219

ops-monitoring-bot added a comment.Sep 7 2022, 3:10 PM

Icinga downtime and Alertmanager silence (ID=abae9736-4890-49f5-ae11-999ff8a0514e) set by cgoubert@cumin1001 for 7 days, 0:00:00 on 3 host(s) and their services with reason: Downtiming replaced wtp servers

wtp[1027,1047-1048].eqiad.wmnet
Clement_Goubert added a comment.Sep 7 2022, 3:17 PM

parse1013.eqiad.wmnet replaced wtp1046.eqiad.wmnet
parse1014.eqiad.wmnet replaced wtp1047.eqiad.wmnet
parse1015.eqiad.wmnet replaced wtp1048.eqiad.wmnet
parse1016.eqiad.wmnet replaced wtp1027.eqiad.wmnet
parse1017.eqiad.wmnet replaced wtp1025.eqiad.wmnet
parse1018.eqiad.wmnet replaced wtp1026.eqiad.wmnet

75% of parse traffic in php7.4 only

Marked wtp[1027,1047-1048] as inactive

Stashbot added a comment.Sep 8 2022, 8:24 AM

Mentioned in SAL (#wikimedia-operations) [2022-09-08T08:24:14Z] <claime> pooled parse1019.eqiad.wmnet (php 7.4 only) in parsoid cluster T307219

Stashbot added a comment.Sep 8 2022, 8:40 AM

Mentioned in SAL (#wikimedia-operations) [2022-09-08T08:40:18Z] <claime> depooled wtp1028.eqiad.wmnet from parsoid cluster T307219

Stashbot added a comment.Sep 8 2022, 8:41 AM

Mentioned in SAL (#wikimedia-operations) [2022-09-08T08:41:19Z] <claime> pooled parse1020.eqiad.wmnet (php 7.4 only) in parsoid cluster T307219

Stashbot added a comment.Sep 8 2022, 8:53 AM

Mentioned in SAL (#wikimedia-operations) [2022-09-08T08:53:09Z] <claime> depooled wtp1029.eqiad.wmnet from parsoid cluster T307219

Stashbot added a comment.Sep 8 2022, 9:04 AM

Mentioned in SAL (#wikimedia-operations) [2022-09-08T09:04:24Z] <claime> pooled parse1021.eqiad.wmnet (php 7.4 only) in parsoid cluster T307219

Stashbot added a comment.Sep 8 2022, 9:14 AM

Mentioned in SAL (#wikimedia-operations) [2022-09-08T09:14:25Z] <claime> depooled wtp1030.eqiad.wmnet from parsoid cluster T307219

ops-monitoring-bot added a comment.Sep 8 2022, 9:16 AM

Icinga downtime and Alertmanager silence (ID=ebbd495c-3b68-48ff-9689-249fb45b7e02) set by cgoubert@cumin1001 for 7 days, 0:00:00 on 4 host(s) and their services with reason: Downtiming replaced wtp servers

wtp[1025-1028].eqiad.wmnet
Stashbot added a comment.Sep 8 2022, 9:21 AM

Mentioned in SAL (#wikimedia-operations) [2022-09-08T09:21:05Z] <claime> pooled parse1022.eqiad.wmnet (php 7.4 only) in parsoid cluster T307219

Stashbot added a comment.Sep 8 2022, 9:33 AM

Mentioned in SAL (#wikimedia-operations) [2022-09-08T09:33:00Z] <claime> depooled wtp1031.eqiad.wmnet from parsoid cluster T307219

Stashbot added a comment.Sep 8 2022, 9:37 AM

Mentioned in SAL (#wikimedia-operations) [2022-09-08T09:37:25Z] <claime> pooled parse1023.eqiad.wmnet (php 7.4 only) in parsoid cluster T307219

Stashbot added a comment.Sep 8 2022, 9:47 AM

Mentioned in SAL (#wikimedia-operations) [2022-09-08T09:47:13Z] <claime> depooled wtp1032.eqiad.wmnet from parsoid cluster T307219

Stashbot added a comment.Sep 8 2022, 9:50 AM

Mentioned in SAL (#wikimedia-operations) [2022-09-08T09:50:32Z] <claime> pooled parse1024.eqiad.wmnet (php 7.4 only) in parsoid cluster T307219

Stashbot added a comment.Sep 8 2022, 10:00 AM

Mentioned in SAL (#wikimedia-operations) [2022-09-08T10:00:53Z] <claime> depooled wtp1033.eqiad.wmnet from parsoid cluster T307219

Stashbot added a comment.Sep 8 2022, 10:01 AM

Mentioned in SAL (#wikimedia-operations) [2022-09-08T10:01:13Z] <claime> Serving 100% of parsoid traffic with php 7.4 T307219

ops-monitoring-bot added a comment.Sep 8 2022, 10:06 AM

Icinga downtime and Alertmanager silence (ID=6f733b0f-40ea-4041-9f04-a763b9c4800e) set by cgoubert@cumin1001 for 7 days, 0:00:00 on 3 host(s) and their services with reason: Downtiming replaced wtp servers

wtp[1029-1031].eqiad.wmnet
Clement_Goubert added a comment.Sep 8 2022, 10:13 AM

parse1019.eqiad.wmnet replaced wtp1028.eqiad.wmnet
parse1020.eqiad.wmnet replaced wtp1029.eqiad.wmnet
parse1021.eqiad.wmnet replaced wtp1030.eqiad.wmnet
parse1022.eqiad.wmnet replaced wtp1031.eqiad.wmnet
parse1023.eqiad.wmnet replaced wtp1032.eqiad.wmnet
parse1024.eqiad.wmnet replaced wtp1033.eqiad.wmnet

100% of parse traffic in php7.4 only

Marked wtp[25-26] and wtp[28-31] as inactive

ops-monitoring-bot added a comment.Sep 8 2022, 10:18 AM

Icinga downtime and Alertmanager silence (ID=cab1609c-6ed0-4c7d-b9ad-b74825cd9914) set by cgoubert@cumin1001 for 7 days, 0:00:00 on 7 host(s) and their services with reason: Downtiming replaced wtp servers

wtp[1025-1031].mgmt
ops-monitoring-bot added a comment.Sep 8 2022, 10:18 AM

Icinga downtime and Alertmanager silence (ID=70990857-b496-4c85-adb4-d10e9748c1fe) set by cgoubert@cumin1001 for 7 days, 0:00:00 on 15 host(s) and their services with reason: Downtiming replaced wtp servers

wtp[1034-1048].mgmt
ops-monitoring-bot added a comment.Sep 8 2022, 12:25 PM

Icinga downtime and Alertmanager silence (ID=44dff5a3-6ba9-406e-bc1e-cda6337f8c64) set by cgoubert@cumin1001 for 7 days, 0:00:00 on 2 host(s) and their services with reason: Downtiming replaced wtp servers

wtp[1032-1033].mgmt
ops-monitoring-bot added a comment.Sep 8 2022, 12:26 PM

Icinga downtime and Alertmanager silence (ID=ad41fb53-7491-45d5-83e5-1e634c9d9190) set by cgoubert@cumin1001 for 7 days, 0:00:00 on 2 host(s) and their services with reason: Downtiming replaced wtp servers

wtp[1032-1033].eqiad.wmnet
Clement_Goubert changed the status of subtask T317025: Decommission wtp10[25-48].eqiad.wmnet from Open to In Progress.Sep 9 2022, 9:56 AM
Clement_Goubert closed this task as Resolved.Sep 9 2022, 9:59 AM
Jdforrester-WMF removed a subtask: T317025: Decommission wtp10[25-48].eqiad.wmnet.Sep 28 2022, 1:24 PM
Jdforrester-WMF added a parent task: T317025: Decommission wtp10[25-48].eqiad.wmnet.
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits