Page MenuHomePhabricator
Create Task
Maniphest T247648

miscweb1001/2001 - upgrade to buster or decom
Closed, ResolvedPublic
Actions

Description

miscweb1001/2001 are on stretch and currently host the following apps:

All 3 of them have tickets above that are about to decide whether we keep these apps or not.

So find that out and then either decom miscweb entirely or ..upgrade to buster.

estimated timeframe / due date: by end of Q4 2020

also see: T210008 and T224247 (jessie -> stretch upgrade of the same services)

Details

Show related patches Customize query in gerrit

Related Objects
Search...

Event Timeline

Dzahn created this task.Mar 13 2020, 11:49 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMar 13 2020, 11:49 PM
Dzahn claimed this task.Mar 13 2020, 11:49 PM
Dzahn updated the task description. (Show Details)
Dzahn updated the task description. (Show Details)
Dzahn added a project: serviceops.Mar 13 2020, 11:56 PM
Dzahn added a parent task: T247045: Migrate all of production metal and VMs to Buster or later.Mar 14 2020, 12:10 AM
Dzahn added a subtask: T247646: migrate racktables to a buster VM (was: decom racktables?).Mar 17 2020, 6:01 PM
Dzahn updated the task description. (Show Details)
Dzahn mentioned this in T247887: Site: eqiad/codfw 2 VM request for miscweb.Mar 17 2020, 6:09 PM
gerritbot added a comment.Mar 27 2020, 9:24 AM

Change 583899 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] racktables: fix php.ini path for buster support

https://gerrit.wikimedia.org/r/583899

gerritbot added a project: Patch-For-Review.Mar 27 2020, 9:24 AM
gerritbot added a comment.Mar 27 2020, 9:26 AM

Change 583898 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] iegreview: if on buster, use mariadb-client instead of mysql-client

https://gerrit.wikimedia.org/r/583898

gerritbot added a comment.Mar 27 2020, 9:27 AM

Change 583895 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] wikimania_scholarships: fix php-mysql installation on buster

https://gerrit.wikimedia.org/r/583895

gerritbot added a comment.Mar 27 2020, 9:39 AM

Change 583895 merged by Dzahn:
[operations/puppet@production] wikimania_scholarships: fix php-mysql installation on buster

https://gerrit.wikimedia.org/r/583895

gerritbot added a comment.Mar 27 2020, 9:51 AM

Change 583898 merged by Dzahn:
[operations/puppet@production] iegreview: use mariadb-client instead of mysql-client

https://gerrit.wikimedia.org/r/583898

gerritbot added a comment.Mar 27 2020, 10:07 AM

Change 583899 merged by Dzahn:
[operations/puppet@production] racktables: fix php.ini path for buster support

https://gerrit.wikimedia.org/r/583899

Maintenance_bot removed a project: Patch-For-Review.Mar 27 2020, 10:10 AM
Stashbot added a comment.Mar 27 2020, 10:12 AM

Mentioned in SAL (#wikimedia-operations) [2020-03-27T10:12:48Z] <mutante> miscweb1002 - sed -i 's/tin.eqiad/deployment.eqiad/g' /srv/deployment/iegreview/iegreview-cache/.config T247648

Dzahn updated the task description. (Show Details)Mar 27 2020, 10:22 AM
Dzahn updated the task description. (Show Details)
Stashbot mentioned this in T247646: migrate racktables to a buster VM (was: decom racktables?).Mar 27 2020, 10:45 AM

Mentioned in SAL (#wikimedia-operations) [2020-03-27T10:45:47Z] <mutante> miscweb1002 - upload and unpack RackTables-0.21.4 (T247646 T247648)

gerritbot added a comment.Mar 27 2020, 11:09 AM

Change 583921 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] update certificate for webserver-misc-apps.discovery.wmnet

https://gerrit.wikimedia.org/r/583921

gerritbot added a project: Patch-For-Review.Mar 27 2020, 11:09 AM
gerritbot added a comment.Mar 27 2020, 11:16 AM

Change 583921 merged by Dzahn:
[operations/puppet@production] update certificate for webserver-misc-apps.discovery.wmnet

https://gerrit.wikimedia.org/r/583921

Maintenance_bot removed a project: Patch-For-Review.Mar 27 2020, 12:10 PM
gerritbot added a comment.Mar 30 2020, 11:07 AM

Change 584570 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] site: add miscweb2002.codfw.wmnet

https://gerrit.wikimedia.org/r/584570

gerritbot added a project: Patch-For-Review.Mar 30 2020, 11:07 AM
gerritbot added a comment.Mar 30 2020, 11:10 AM

Change 584570 merged by Dzahn:
[operations/puppet@production] site: add miscweb2002.codfw.wmnet

https://gerrit.wikimedia.org/r/584570

Stashbot added a comment.Mar 30 2020, 11:37 AM

Mentioned in SAL (#wikimedia-operations) [2020-03-30T11:37:30Z] <mutante> miscweb2002 - installed OS, added to puppet, added role and ... sed -i 's/tin.eqiad/deployment.eqiad/g' /srv/deployment/iegreview/iegreview-cache/.config (T247648)

Dzahn added a subtask: T247887: Site: eqiad/codfw 2 VM request for miscweb.Mar 30 2020, 11:55 AM
Dzahn closed subtask T247887: Site: eqiad/codfw 2 VM request for miscweb as Resolved.
gerritbot added a comment.Mar 30 2020, 11:56 AM

Change 584581 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] ATS: switch scholarships.wm.org to miscweb1002 backend

https://gerrit.wikimedia.org/r/584581

gerritbot added a comment.Mar 30 2020, 12:01 PM

Change 584581 merged by Dzahn:
[operations/puppet@production] ATS: switch scholarships.wm.org to miscweb1002 backend

https://gerrit.wikimedia.org/r/584581

Maintenance_bot removed a project: Patch-For-Review.Mar 30 2020, 12:10 PM
gerritbot added a comment.Mar 30 2020, 12:17 PM

Change 584583 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] ATS: switch iegreview.wm.org to miscweb1002 backend

https://gerrit.wikimedia.org/r/584583

gerritbot added a project: Patch-For-Review.Mar 30 2020, 12:17 PM
gerritbot added a comment.Mar 30 2020, 1:32 PM

Change 584583 merged by Dzahn:
[operations/puppet@production] ATS: switch iegreview.wm.org to miscweb1002 backend

https://gerrit.wikimedia.org/r/584583

Dzahn updated the task description. (Show Details)Mar 30 2020, 1:41 PM
Dzahn mentioned this in T243037: Shutdown scholarships.wikimedia.org and archive project.
gerritbot added a comment.Mar 30 2020, 1:57 PM

Change 584606 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/dns@master] switch webserver-misc-apps discovery record to miscweb1002

https://gerrit.wikimedia.org/r/584606

gerritbot added a comment.Mar 30 2020, 2:01 PM

Change 584607 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] ATS: use discovery name instead of miscweb again after migration

https://gerrit.wikimedia.org/r/584607

gerritbot added a comment.Apr 1 2020, 8:20 AM

Change 584607 merged by Dzahn:
[operations/puppet@production] ATS: use discovery name instead of miscweb again after migration

https://gerrit.wikimedia.org/r/584607

gerritbot added a comment.Apr 6 2020, 1:06 PM

Change 584606 merged by Dzahn:
[operations/dns@master] switch webserver-misc-apps discovery record to miscweb1002

https://gerrit.wikimedia.org/r/584606

Maintenance_bot removed a project: Patch-For-Review.Apr 6 2020, 1:10 PM
Dzahn updated the task description. (Show Details)Apr 6 2020, 3:10 PM

racktables has been switched to miscweb1002 on buster

gerritbot added a comment.Apr 6 2020, 3:12 PM

Change 586370 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] decom miscweb1002 and miscweb2001

https://gerrit.wikimedia.org/r/586370

gerritbot added a project: Patch-For-Review.Apr 6 2020, 3:12 PM
gerritbot added a comment.Apr 6 2020, 3:15 PM

Change 586371 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/dns@master] decom miscweb1001 and miscweb2001

https://gerrit.wikimedia.org/r/586371

ops-monitoring-bot added a comment.Apr 7 2020, 8:31 AM

cookbooks.sre.hosts.decommission executed by dzahn@cumin1001 for hosts: miscweb2001.codfw.wmnet

  • miscweb2001.codfw.wmnet (PASS)
    • Downtimed host on Icinga
    • Found Ganeti VM
    • VM shutdown
    • Started forced sync of VMs in Ganeti cluster ganeti01.svc.codfw.wmnet to Netbox
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
    • VM removed
Stashbot added a comment.Apr 7 2020, 8:37 AM

Mentioned in SAL (#wikimedia-operations) [2020-04-07T08:37:34Z] <mutante> decom ganeti VM miscweb1001 (stretch) - kept backup of old racktables files and db dump in /root/racktables on miscweb1002 (T247648)

ops-monitoring-bot added a comment.Apr 7 2020, 8:42 AM

cookbooks.sre.hosts.decommission executed by dzahn@cumin1001 for hosts: miscweb1001.eqiad.wmnet

  • miscweb1001.eqiad.wmnet (PASS)
    • Downtimed host on Icinga
    • Found Ganeti VM
    • VM shutdown
    • Started forced sync of VMs in Ganeti cluster ganeti01.svc.eqiad.wmnet to Netbox
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
    • VM removed
gerritbot added a comment.Apr 7 2020, 8:44 AM

Change 586370 merged by Dzahn:
[operations/puppet@production] decom miscweb1001 and miscweb2001

https://gerrit.wikimedia.org/r/586370

gerritbot added a comment.Apr 7 2020, 8:51 AM

Change 586371 merged by Dzahn:
[operations/dns@master] decom miscweb1001 and miscweb2001

https://gerrit.wikimedia.org/r/586371

Dzahn closed this task as Resolved.Apr 7 2020, 9:01 AM
Dzahn removed a project: Patch-For-Review.

miscweb1001 and miscweb2001 (stretch) have been removed.

services have migrated to miscbweb1002 and miscweb2002 on buster.

Dzahn closed subtask T247646: migrate racktables to a buster VM (was: decom racktables?) as Resolved.Apr 7 2020, 9:05 AM
bd808 mentioned this in T252815: iegreview: missing grants@ sender address (was: login failing with csrf token missing warning).May 14 2020, 7:46 PM
Content licensed under Creative Commons Attribution-ShareAlike 3.0 (CC-BY-SA) unless otherwise noted; code licensed under GNU General Public License (GPL) or other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL