Page MenuHomePhabricator
Create Task
Maniphest T247045

Migrate all of production metal and VMs to Buster or later
Open, LowPublic
Actions

Description

Top-level epic task to see progress.

Related Objects
Search...

StatusSubtypeAssignedTask
 OpenNoneT247045 Migrate all of production metal and VMs to Buster or later
 ResolvedMoritzMuehlenhoffT245114 Migrate Cumin hosts to Buster
 OpenNoneT244753 Migrate WDQS to Debian Buster
 OpenNoneT244736 Migrate Elasticsearch to Debian Buster
 OpenakosiarisT239835 setup new, buster based, kubernetes etcd servers for staging/codfw/eqiad cluster
 ResolvedakosiarisT239838 EQIAD+CODFW: (9) VM request for kubernetes etcd
 ResolvedDzahnT247648 miscweb1001/2001 - upgrade to buster or decom
 ResolvedDzahnT247646 migrate racktables to a buster VM (was: decom racktables?)
 ResolvedDzahnT247887 Site: eqiad/codfw 2 VM request for miscweb
 OpenNoneT247653 replace doc1001.eqiad.wmnet with a buster VM
 OpenDzahnT247652 replace backends for releases.wikimedia.org with buster VMs
 ResolvedDzahnT255590 Site: eqiad/codfw 2 VM request for releases
 ResolvedDzahnT247651 upgrade planet.wikimedia.org backends to buster
 ResolvedDzahnT248863 Site: EQIAD/CODFW 2 VM request for planet
 ResolvedDzahnT247650 replace bromine and vega with buster VMs
 ResolvedDzahnT247649 upgrade people.wikimedia.org backend to buster
 ResolvedDzahnT249907 eqiad/codfw: 1 each VM request for people.wikimedia.org
 ResolvedDzahnT253296 decom people1001
 ResolvedBstormT224583 Migrate labstore1006/1007 to Stretch/Buster
 OpenNoneT216815 Upgrade Thumbor to Buster
 OpenNoneT212941 Investigate systemd hardening to replace Firejail for Thumbor
 ResolvedfgiunchediT212946 Stream Thumbor logs to logstash
 ResolvedGillesT187765 Replace the Nginx fronting Thumbor with Haproxy
 ResolvedfgiunchediT204266 Backport prometheus haproxy exporter for Jessie
 ResolvedjijikiT220499 Export useful metrics from haproxy logs for Thumbor
 ResolvedNoneT216892 Santali font shown as square boxes in thumbnail version of a specific SVG file
 ResolvedjijikiT221562 Build Thumbor packages for buster
 StalledNoneT231067 Install Debian Buster on Hadoop
 DuplicateNoneT220542 Update R from 3.3.3 to 3.6.0 on stat and notebook machines
 ResolvedelukeyT230724 Upgrade all SWAP users to JupyterLab 1.0
 ResolvedMoritzMuehlenhoffT233604 Create OpenJDK 8 packages for Buster
 StalledNoneT213089 Upgrade memcached for Debian Stretch/Buster
 ResolvedelukeyT217020 Test different growth factors for memcached (prep step for upgrade to newer versions)
 ResolvedelukeyT223863 memkeys segfaults on Debian Stretch
 ResolvedjbondT251574 prepare mcrouter package for Debian Buster
 ResolvedDzahnT224576 Upgrade install servers to Buster
 ResolvedDzahnT244390 VM requests for install_server replacements
 InvalidRequestNoneT251131 decommission install1002.wikimedia.org
 InvalidRequestNoneT251130 decommission install2002.wikimedia.org
 OpenakosiarisT245272 Draft a plan for upgrading kubernetes machines to buster
 OpenakosiarisT255273 Upgrade kubernetes nodes to kernel 4.19.x
Restricted Task
 ResolvedakosiarisT238927 Build and supply buster nodejs (nodejs-slim and nodejs-devel) container images
 ResolvedakosiarisT225680 Migrate Proton to k8s
 ResolvedMSantosT238830 Profile proton memory usage for Helm chart
 ResolvedMSantosT240594 Upgrade puppeteer to allow Proton to move to Buster
 StalledNoneT245757 upgrade MediaWiki appservers to Debian 10 (buster)
 OpenNoneT252434 Test MW code in buster as well as stretch
 ResolvedJdforrester-WMFT250514 Create buster-based images for quibble
 OpenNoneT253377 WMF deployed EasyTimeline extension depends on Ploticus package which is not available in Debian Buster (but available again in Debian Bullseye)
 OpenNoneT250515 Please provide our special component/php72 in buster-wikimedia
 OpenNoneT247962 Migrate role::prometheus to Buster
 OpenNoneT243057 Move Prometheus off eqsin/ulsfo/esams bastions
 OpenNoneT247963 Migrate role::graphite::production to Buster
 OpenNoneT247966 Migrate role::alerting_host to Buster
 OpenNoneT247967 Migrate role::netmon to Buster
 OpenNoneT247968 Migrate logging::webrequest::ops to Buster
 StalledNoneT224589 Migrate dbmonitor hosts to Buster
 StalledNoneT249085 Convert Tendril TokuDB tables to InnoDB
 ResolvedjcrespoT236406 Switchover backup director service from helium to backup1001
 ResolvedDzahnT237233 vega, bromine (bugzilla-static) is trying to backup a directory that doesn't exist
 ResolvedAndrewT237237 cloudweb2001-dev & labweb1001 backing up non-existing or empty directories
 OpenNoneT249724 Track and remove jessie based container images from production
 OpenNoneT224908 Drop jessie testing support
 ResolvedJdforrester-WMFT224907 Drop php55 testing support
 ResolvedReedyT205039 Release MediaWiki 1.27.6/1.30.2/1.31.2/1.32.2
 ResolvedReedyT205041 Tracking bug for 1.27.6/1.30.2/1.31.2/1.32.2 security release
 ResolvedBawolffT197279 Direct POST to Special:ChangeEmail will bypass reauth check
 ResolvedAnomieT204729 Potential enwiki DOS due to slow WatchedItemStore::countVisitingWatchersMultiple
 ResolvedBawolffT207603 Loading JS from user space where the username is not a registered account is dangerous and should be banned
 ResolvedBawolffT208881 CSS using var() to create exponential sized calc() on wiki page will crash visitor's browser
 ResolvedLegoktmT199540 Forbid blocking IP ranges as big as /1 and /2, as done on ruwikiquote using the API
 ResolvedLucas_Werkmeister_WMDET212118 API responses for unpatrolled or (not) autopatrolled recent changes require privileges but may be cached publicly
 ResolvedBawolffT209794 Need to make a limit of count of attempts to change email address
 ResolvedsbassettT222036 Exposed suppressed username or log in Special:EditTags
 ResolvedsbassettT222038 Exposed suppressed log in RevisionDelete page
 ResolvedJdforrester-WMFT221739 Patch jQuery due to CVE-2019-11358
 ResolvedsbassettT25227 Use token when logging out
 ResolvedsbassettT221868 Send out wikitech-l post for T25227 ("Use token when logging out")
 ResolvedReedyT205042 Write and send release announcements for 1.27.6/1.30.2/1.31.2/1.32.2 security releases
 ResolvedReedyT205043 Write and send pre-release Announcements for MediaWiki 1.27.6/1.30.2/1.31.2/1.32.2
 ResolvedJdforrester-WMFT205044 Update onwiki release notes for 1.27.6/1.30.2/1.31.2/1.32.2
 ResolvedReedyT205046 Update HISTORY in master after 1.27.6/1.30.2/1.31.2/1.32.2
 ResolvedReedyT205047 Tag MW 1.27.6/1.30.2/1.31.2/1.32.2
 ResolvedReedyT224499 RELEASE-NOTES for 1.27.6/1.30.2/1.31.2/1.32.2
 ResolvedJdforrester-WMFT224912 Update MediaWiki.org links and versions
 ResolvedJdforrester-WMFT224913 EOL REL1_27 and REL1_30 onwiki
 ResolvedReedyT225201 Formally announce EOL of MW 1.27 and 1.30
 ResolvedReedyT225149 Update CVEs and publish them
 ResolvedReedyT205048 Obtain CVEs for 1.27.6/1.30.2/1.31.2/1.32.2 security releases
 ResolvedJdforrester-WMFT224906 Drop php56 testing support
 Resolved• hasharT223348 Run wikimedia/fundraising/crm CI jobs on PHP7x, not PHP5x
 Resolved• hasharT210287 Migrate wikimedia-fundraising-civicrm to a Docker container
 ResolvedJdforrester-WMFT224905 Move wikiba.se tests from php56 to php72
 Resolved• hasharT224591 Migrate contint* hosts to Buster
 DeclinedMoritzMuehlenhoffT226236 Upload docker-ce 18.06.3 upstream package for Stretch
 InvalidthciprianiT239880 Replacement hardware for buster/stretch upgrade of contint1001 and contint2001
 ResolvedmmodellT215458 Convert zuul to use scap
 Resolved• hasharT240551 Remove Zuul Debian package from WMCS instances
 ResolvedJoeT249110 Build and publish a python2 based container to build wheels
 ResolvedJMeybohmT249812 Rebuild helm/helm-diff for buster-wikimedia
 ResolvedJMeybohmT250479 Rebuild helmfile for buster-wikimedia
 DuplicateDzahnT210008 upgrade krypton (webserver_misc_apps) to stretch
 DeclinedDzahnT224194 switch webserver_misc_apps to PHP 7.2 (7.1)
 StalledJdforrester-WMFT211784 Upgrade all CI jobs from node6/npm3 to node10/npm6 across all projects
 InvalidJdforrester-WMFT211785 Upgrade the mobileapps CI job from npm3 to npm6
 ResolvedMoritzMuehlenhoffT203239 Create Debian packages for Node.js 10 upgrade
 ResolvedKrinkleT213944 Jenkins jobs for npm-test fail on project with deps on node-gyp which requires python2.7
 ResolvedKrinkleT215562 npm 6 consistently fails with "Z_DATA_ERROR: invalid distance too far back" on some repos
 Resolved• hasharT217545 Update selenium-daily-beta-* jobs to node10/npm6
 ResolvedJdforrester-WMFT222406 Switch quibble-based CI jobs from node6 to node10
 ResolvedJdforrester-WMFT224983 mediawiki-phpunit-coverage-patch-docker fails to install fibers@3.1.1
 DeclinedJdforrester-WMFT224997 Update MobileFrontend-npm-run-lint-modules-docker to run node10
 DuplicateNoneT224978 WikibaseMediaInfo selenium tests failing when run against beta commons
 ResolvedMilimetricT228451 Fix the analytics/mediawiki-storage repo to work on node10
 ResolvedMilimetricT228452 Fix the analytics/wikistats2 repo to work on node10
 ResolvedLadsgroupT228453 Fix the data-values/value-view repo to work on node10
 OpenMhollowayT218733 Migrate mobileapps to k8s and node 10
 OpenNoneT215539 Node.js 10 changes encoding for at least one Georgian character
 DuplicateNoneT225107 Migrate recommendation-api to node 10
 OpenNoneT225678 Migrate 3d2png to k8s
 ResolvedMSantosT217114 Migrate Proton to k8s and nodejs 10
 DuplicateNoneT228907 Migrate the wikimedia-portals-build timed CI job to node10
 ResolvedjeenaT213806 Migrate wikimedia-portals-build to Docker container
 ResolvedJdforrester-WMFT237479 Update the wikimedia-portals repo's CI/linting code for various security issues
 ResolvedJdrewniakT247996 Fix issues with Gulp 4 migration
 DuplicateNoneT229276 Fix the data-values/value-view repo to work on node10
 ResolvedJdforrester-WMFT230841 Migrate documentation generation to Node 10.15.2 from node 6.11.0
 ResolvedJdforrester-WMFT235570 Move the OOUI repo to a new custom docker image for node10 and php72
 ResolvedJdforrester-WMFT247536 Migrate mediawiki-core-jsduck-docker-publish off node 6 so it works again
 OpenNoneT250666 Upgrade WMF database-and-backup-related hosts to buster
 OpenNoneT244696 Remove deprecated status options from grafana in mariadb 10.4
 ResolvedMarosteguiT242702 Test MariaDB 10.4 in production
 ResolvedMarosteguiT245807 ApiQueryRecentChanges chooses a different plan on 10.4
 ResolvedMarosteguiT246604 Install 1 buster+10.4 host per section
 ResolvedMarosteguiT247290 mysql_exporter_last_scrape_error flag on prometheus-mysqld-exporter increases after 10.4 upgrade
 DeclinedMarosteguiT248957 Test tendril events and tokudb on 10.4
 ResolvedMarosteguiT245489 Possibly disable optimizer flag: rowid_filter on 10.4
 OpenMarosteguiT246069 Slow query on 10.4: SpecialRecentChanges::doMainQuery
 ResolvedMarosteguiT247728 Events set to SLAVESIDE_DISABLED when upgrading from 10.1 to 10.4
 DeclinedMarosteguiT249188 Reimage labsdb1011 to Buster and MariaDB 10.4
 ResolvedMarosteguiT248843 Upgrade wmf-pt-kill package for Debian Buster
 ResolvedJclark-ctrT251481 Recreate RAID on labsdb1011
 ResolvedKormatT252182 Upgrade parsercache to Buster and MariaDB 10.4
 OpenKormatT252761 Research changes on prometheus-mysqld-exporter after buster/mariadb upgrade
 ResolvedMarosteguiT254556 Upgrade m1 to Buster and Mariadb 10.4
 ResolvedMarosteguiT254870 Upgrade analytics dbstore databases to Buster and Mariadb 10.4
 OpenMarosteguiT254871 Upgrade x1 databases to Buster and Mariadb 10.4
 OpenMarosteguiT255408 Upgrade dbproxyXXXX to Buster
 ResolvedMarosteguiT255755 Switchover es5 master from es1023 to es1024
 OpenKormatT257284 Upgrade es4 to debian buster + mariadb 10.4
 OpenMarosteguiT257540 Upgrade m2 to Buster and Mariadb 10.4
 OpenMoritzMuehlenhoffT253779 Migrate role::bastionhost::general and role::bastionhost::pop to Buster

Event Timeline

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMar 6 2020, 12:35 AM
Jdforrester-WMF renamed this task from Migrate all of production to Buster or later to Migrate all of production metal to Buster or later.Mar 6 2020, 12:35 AM
Jdforrester-WMF added subtasks: T245114: Migrate Cumin hosts to Buster, T244753: Migrate WDQS to Debian Buster, T244736: Migrate Elasticsearch to Debian Buster.
akosiaris triaged this task as Low priority.Mar 6 2020, 11:30 AM
Dzahn added a subscriber: Dzahn.Mar 14 2020, 12:08 AM
Dzahn added a comment.Mar 17 2020, 6:12 PM

@Jdforrester-WMF I noticed the "metal" in the ticket title after adding VMs. But i guess i would argue that metal or VM does not matter for the need to upgrade and security.

Jdforrester-WMF added a comment.Mar 17 2020, 6:38 PM
In T247045#5976882, @Dzahn wrote:

@Jdforrester-WMF I noticed the "metal" in the ticket title after adding VMs. But i guess i would argue that metal or VM does not matter for the need to upgrade and security.

Yeah, it was mostly from the "SRE need to be involved" side that bare-metal requires but sometimes VMs can be converted in user land (e.g. the CI VM instances). Happy for the task to be used as is most useful for SRE. :-)

Dzahn renamed this task from Migrate all of production metal to Buster or later to Migrate all of production metal and VMs to Buster or later.Apr 7 2020, 9:06 AM
Content licensed under Creative Commons Attribution-ShareAlike 3.0 (CC-BY-SA) unless otherwise noted; code licensed under GNU General Public License (GPL) or other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL