Page MenuHomePhabricator
Create Task
Maniphest T359387

Cleanup parsoid-php service
Closed, ResolvedPublic
Actions

Description

Per T357392 and T358752, we 've migrated all of traffic away from the parsoid-php service. This is a followup task to clean up after the migration as the main migration task is probably best resolved.

Things to definitely clean up:

  • Removal of parsoid-php from the services_proxy
  • Removal of parsoid-async (it is apparently unused) from the service::catalog
  • Removal of parsoid-php from the service::catalog
  • Reimaging of parse1001, parse2001 as WikiKube nodes
  • Any RESTBase configuration leftovers in puppet

This to possibly clean up:

[ ] Parsoid Puppet Code In the interest of not breaking deployment-prep/beta, we 'll keep the code around for some (currently undecided and undefined) time

Details

Show related patches Customize query in gerrit

Related Objects

Event Timeline

akosiaris created this task.Mar 6 2024, 2:32 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMar 6 2024, 2:32 PM
akosiaris mentioned this in T357392: Create parsoid mediawiki deployment and migrate parsoid-php.discovery.wmnet traffic to it.Mar 6 2024, 2:33 PM
akosiaris triaged this task as Low priority.Mar 6 2024, 2:54 PM
akosiaris moved this task from Incoming 🐫 to this.quarter 🍕 on the serviceops board.
gerritbot added a comment.Mar 6 2024, 4:21 PM

Change 1006899 had a related patch set uploaded (by Alexandros Kosiaris; author: Alexandros Kosiaris):

[operations/puppet@production] Clean up all the RESTBase hosts's parsoid uri changes

https://gerrit.wikimedia.org/r/1006899

gerritbot added a project: Patch-For-Review.Mar 6 2024, 4:21 PM

Change 1006900 had a related patch set uploaded (by Alexandros Kosiaris; author: Alexandros Kosiaris):

[operations/puppet@production] services_proxy: Remove parsoid-php, parsoid-async

https://gerrit.wikimedia.org/r/1006900

ssastry edited projects, added Parsoid (Tracking); removed Parsoid.Mar 8 2024, 9:40 PM
akosiaris mentioned this in T360636: Phase out cergen for ServiceOps services.Apr 8 2024, 4:00 PM
MoritzMuehlenhoff subscribed.Apr 9 2024, 9:15 AM
gerritbot added a comment.Apr 10 2024, 10:22 AM

Change #1018660 had a related patch set uploaded (by Alexandros Kosiaris; author: Alexandros Kosiaris):

[operations/deployment-charts@master] Remove parsoid-php certificates from mw deployments

https://gerrit.wikimedia.org/r/1018660

gerritbot added a comment.Apr 10 2024, 10:22 AM

Change #1018661 had a related patch set uploaded (by Alexandros Kosiaris; author: Alexandros Kosiaris):

[operations/deployment-charts@master] fixtures: Rename all parsoid-php references

https://gerrit.wikimedia.org/r/1018661

MoritzMuehlenhoff mentioned this in T357750: Phase out cergen.Apr 12 2024, 7:35 AM
gerritbot added a comment.Apr 17 2024, 12:28 PM

Change #1020807 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] Remove parsoid-canary Cumin alias

https://gerrit.wikimedia.org/r/1020807

gerritbot added a comment.Apr 17 2024, 12:32 PM

Change #1020807 merged by Muehlenhoff:

[operations/puppet@production] Remove parsoid-canary Cumin alias

https://gerrit.wikimedia.org/r/1020807

gerritbot added a comment.Jul 30 2024, 1:09 PM

Change #1006899 merged by Alexandros Kosiaris:

[operations/puppet@production] Clean up all the RESTBase hosts's parsoid uri changes

https://gerrit.wikimedia.org/r/1006899

gerritbot added a comment.Jul 30 2024, 1:13 PM

Change #1058165 had a related patch set uploaded (by Alexandros Kosiaris; author: Alexandros Kosiaris):

[operations/deployment-charts@master] Switch all fixtures to mw-parsoid from parsoid-php

https://gerrit.wikimedia.org/r/1058165

gerritbot added a comment.Jul 30 2024, 1:14 PM

Change #1058165 abandoned by Alexandros Kosiaris:

[operations/deployment-charts@master] Switch all fixtures to mw-parsoid from parsoid-php

Reason:

Already done in https://gerrit.wikimedia.org/r/c/operations/puppet/+/1006900

https://gerrit.wikimedia.org/r/1058165

gerritbot added a comment.Jul 30 2024, 1:29 PM

Change #1058166 had a related patch set uploaded (by Alexandros Kosiaris; author: Alexandros Kosiaris):

[operations/deployment-charts@master] Remove parsoid-async from fixtures

https://gerrit.wikimedia.org/r/1058166

gerritbot added a comment.Jul 30 2024, 1:32 PM

Change #1018661 merged by jenkins-bot:

[operations/deployment-charts@master] fixtures: Rename all parsoid-php references

https://gerrit.wikimedia.org/r/1018661

gerritbot added a comment.Jul 30 2024, 1:32 PM

Change #1018660 merged by jenkins-bot:

[operations/deployment-charts@master] Remove parsoid-php certificates from mw deployments

https://gerrit.wikimedia.org/r/1018660

gerritbot added a comment.Jul 30 2024, 1:37 PM

Change #1058166 merged by jenkins-bot:

[operations/deployment-charts@master] Remove parsoid-async from fixtures

https://gerrit.wikimedia.org/r/1058166

gerritbot added a comment.Jul 30 2024, 1:37 PM

Change #1006900 merged by Alexandros Kosiaris:

[operations/puppet@production] services_proxy: Remove parsoid-php, parsoid-async

https://gerrit.wikimedia.org/r/1006900

akosiaris updated the task description. (Show Details)Jul 30 2024, 1:44 PM
gerritbot added a comment.Jul 30 2024, 1:54 PM

Change #1058169 had a related patch set uploaded (by Alexandros Kosiaris; author: Alexandros Kosiaris):

[operations/puppet@production] parsoid-php: remove discovery, hosts, dsh groups

https://gerrit.wikimedia.org/r/1058169

gerritbot added a comment.Jul 30 2024, 2:05 PM

Change #1058171 had a related patch set uploaded (by Alexandros Kosiaris; author: Alexandros Kosiaris):

[operations/puppet@production] service: Switch parsoid-php to service_setup

https://gerrit.wikimedia.org/r/1058171

gerritbot added a comment.Jul 30 2024, 2:06 PM

Change #1058171 merged by Alexandros Kosiaris:

[operations/puppet@production] service: Switch parsoid-php to service_setup

https://gerrit.wikimedia.org/r/1058171

gerritbot added a comment.Jul 30 2024, 2:58 PM

Change #1058189 had a related patch set uploaded (by Ssingh; author: Ssingh):

[operations/dns@master] Remove parsoid-php discovery record

https://gerrit.wikimedia.org/r/1058189

gerritbot added a comment.Jul 30 2024, 3:16 PM

Change #1058189 merged by Alexandros Kosiaris:

[operations/dns@master] Remove parsoid-php discovery record

https://gerrit.wikimedia.org/r/1058189

Stashbot added a comment.Jul 30 2024, 3:20 PM

Mentioned in SAL (#wikimedia-operations) [2024-07-30T15:20:50Z] <akosiaris> restart pybal for parsoid-php removal on lvs1020, lvs2014 T359387

Stashbot added a comment.Jul 30 2024, 3:56 PM

Mentioned in SAL (#wikimedia-operations) [2024-07-30T15:56:39Z] <akosiaris> restart pybal for parsoid-php removal on lvs1019, lvs2013 T359387

gerritbot added a comment.Jul 31 2024, 7:26 AM

Change #1058169 merged by Alexandros Kosiaris:

[operations/puppet@production] parsoid-php: remove discovery, conftool, dsh groups

https://gerrit.wikimedia.org/r/1058169

Maintenance_bot removed a project: Patch-For-Review.Jul 31 2024, 7:31 AM
gerritbot added a comment.Jul 31 2024, 7:53 AM

Change #1058562 had a related patch set uploaded (by Alexandros Kosiaris; author: Alexandros Kosiaris):

[operations/puppet@production] service: Remove old parsoid-php from catalog

https://gerrit.wikimedia.org/r/1058562

gerritbot added a project: Patch-For-Review.Jul 31 2024, 7:53 AM

Change #1058559 had a related patch set uploaded (by Alexandros Kosiaris; author: Alexandros Kosiaris):

[operations/puppet@production] parse[12]001: Move them to wikikube workers

https://gerrit.wikimedia.org/r/1058559

gerritbot added a comment.Jul 31 2024, 7:55 AM

Change #1058562 merged by Alexandros Kosiaris:

[operations/puppet@production] service: Remove old parsoid-php from catalog

https://gerrit.wikimedia.org/r/1058562

akosiaris updated the task description. (Show Details)Jul 31 2024, 7:57 AM
gerritbot added a comment.Jul 31 2024, 9:51 AM

Change #1058559 merged by Alexandros Kosiaris:

[operations/puppet@production] parse[12]001: Move them to wikikube workers

https://gerrit.wikimedia.org/r/1058559

ops-monitoring-bot added a comment.Jul 31 2024, 10:25 AM

Cookbook cookbooks.sre.hosts.reimage was started by akosiaris@cumin1002 for host parse1001.eqiad.wmnet with OS bullseye

ops-monitoring-bot added a comment.Jul 31 2024, 10:26 AM

Cookbook cookbooks.sre.hosts.reimage was started by akosiaris@cumin1002 for host parse2001.codfw.wmnet with OS bullseye

Maintenance_bot removed a project: Patch-For-Review.Jul 31 2024, 10:31 AM
ops-monitoring-bot added a comment.Jul 31 2024, 11:01 AM

Cookbook cookbooks.sre.hosts.reimage started by akosiaris@cumin1002 for host parse1001.eqiad.wmnet with OS bullseye completed:

  • parse1001 (PASS)
    • Downtimed on Icinga/Alertmanager
    • Disabled Puppet
    • Removed from Puppet and PuppetDB if present and deleted any certificates
    • Removed from Debmonitor if present
    • Forced PXE for next reboot
    • Host rebooted via IPMI
    • Host up (Debian installer)
    • Add puppet_version metadata to Debian installer
    • Checked BIOS boot parameters are back to normal
    • Host up (new fresh bullseye OS)
    • Generated Puppet certificate
    • Signed new Puppet certificate
    • Run Puppet in NOOP mode to populate exported resources in PuppetDB
    • Found Nagios_host resource for this host in PuppetDB
    • Downtimed the new host on Icinga/Alertmanager
    • Removed previous downtime on Alertmanager (old OS)
    • First Puppet run completed and logged in /var/log/spicerack/sre/hosts/reimage/202407311042_akosiaris_3509417_parse1001.out
    • configmaster.wikimedia.org updated with the host new SSH public key for wmf-update-known-hosts-production
    • Rebooted
    • Automatic Puppet run was successful
    • Forced a re-check of all Icinga services for the host
    • Icinga status is optimal
    • Icinga downtime removed
    • Updated Netbox data from PuppetDB
ops-monitoring-bot added a comment.Jul 31 2024, 11:05 AM

Cookbook cookbooks.sre.hosts.reimage started by akosiaris@cumin1002 for host parse2001.codfw.wmnet with OS bullseye completed:

  • parse2001 (PASS)
    • Downtimed on Icinga/Alertmanager
    • Disabled Puppet
    • Removed from Puppet and PuppetDB if present and deleted any certificates
    • Removed from Debmonitor if present
    • Forced PXE for next reboot
    • Host rebooted via IPMI
    • Host up (Debian installer)
    • Add puppet_version metadata to Debian installer
    • Checked BIOS boot parameters are back to normal
    • Host up (new fresh bullseye OS)
    • Generated Puppet certificate
    • Signed new Puppet certificate
    • Run Puppet in NOOP mode to populate exported resources in PuppetDB
    • Found Nagios_host resource for this host in PuppetDB
    • Downtimed the new host on Icinga/Alertmanager
    • Removed previous downtime on Alertmanager (old OS)
    • First Puppet run completed and logged in /var/log/spicerack/sre/hosts/reimage/202407311046_akosiaris_3509571_parse2001.out
    • configmaster.wikimedia.org updated with the host new SSH public key for wmf-update-known-hosts-production
    • Rebooted
    • Automatic Puppet run was successful
    • Forced a re-check of all Icinga services for the host
    • Icinga status is optimal
    • Icinga downtime removed
    • Updated Netbox data from PuppetDB
akosiaris updated the task description. (Show Details)Jul 31 2024, 11:35 AM
akosiaris closed this task as Resolved.Aug 1 2024, 7:03 AM
akosiaris claimed this task.

Node reimaged, pooled with weight 10 and uncordoned. I 'll happily resolve this, the legacy parsoid cluster is no more!

Stashbot added a comment.Aug 1 2024, 7:04 AM

Mentioned in SAL (#wikimedia-operations) [2024-08-01T07:03:59Z] <akosiaris> uncordon parse2001, parse1001 T359387

gerritbot added a comment.Aug 17 2024, 12:36 AM

Change #1063261 had a related patch set uploaded (by Scott French; author: Scott French):

[operations/cookbooks@master] Remove parsoid-php from MEDIAWIKI_SERVICES

https://gerrit.wikimedia.org/r/1063261

gerritbot added a project: Patch-For-Review.Aug 17 2024, 12:36 AM
gerritbot added a comment.Aug 19 2024, 9:23 AM

Change #1063744 had a related patch set uploaded (by Clément Goubert; author: Clément Goubert):

[operations/puppet@production] cumin: Remove parsoid from aliases

https://gerrit.wikimedia.org/r/1063744

gerritbot added a comment.Aug 19 2024, 10:21 AM

Change #1063744 merged by Clément Goubert:

[operations/puppet@production] cumin: Remove parsoid from aliases

https://gerrit.wikimedia.org/r/1063744

gerritbot added a comment.Aug 19 2024, 4:52 PM

Change #1063261 merged by jenkins-bot:

[operations/cookbooks@master] Remove parsoid-php from MEDIAWIKI_SERVICES

https://gerrit.wikimedia.org/r/1063261

gerritbot added a comment.Fri, Sep 13, 12:35 PM

Change #1072737 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] Remove old parsoid certs

https://gerrit.wikimedia.org/r/1072737

gerritbot added a comment.Fri, Sep 13, 12:35 PM

Change #1072738 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[labs/private@master] labs-private: Remove parsoid stub secrets

https://gerrit.wikimedia.org/r/1072738

gerritbot added a comment.Fri, Sep 13, 2:51 PM

Change #1072737 merged by Alexandros Kosiaris:

[operations/puppet@production] Remove old parsoid certs

https://gerrit.wikimedia.org/r/1072737

gerritbot added a comment.Fri, Sep 13, 2:51 PM

Change #1072738 merged by Alexandros Kosiaris:

[labs/private@master] labs-private: Remove parsoid stub secrets

https://gerrit.wikimedia.org/r/1072738

Muehlenhoff mentioned this in rLPRI92ec426bd176: labs-private: Remove parsoid stub secrets.Fri, Sep 13, 3:15 PM
Maintenance_bot removed a project: Patch-For-Review.Fri, Sep 13, 3:31 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits