Page MenuHomePhabricator
Create Task
Maniphest T393400

Create metric to measure Parsoid speed on small/medium/large pages
Closed, ResolvedPublic
Actions

Description

It would be nice to bucket the existing Parsoid kb/s parse speed metrics by page size, so we can see if parsoid is approximate O(N) (kb/s independent of size) or O(N^2) (kb/s drops off significantly for large pages) in practice.

This could probably be done with the addition of a single label to parsoid's existing kb/s metric.

Details

Related Changes in Gerrit:
SubjectRepoBranchLines +/-
stats: Fix bucket offsetmediawiki/extensions/Lintermaster+2 -2
stats: Add buckets based on wikitext size; fix increment bugmediawiki/extensions/Linterwmf/1.45.0-wmf.5+14 -5
stats: Add buckets based on wikitext size; fix increment bugmediawiki/extensions/Linterwmf/1.45.0-wmf.6+14 -5
stats: Add buckets based on wikitext size; fix increment bugmediawiki/extensions/Lintermaster+14 -5
Parser limit report: Add entry for revision sizemediawiki/coremaster+13 -0
Customize query in gerrit

Related Objects

Event Timeline

cscott created this task.May 5 2025, 4:42 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMay 5 2025, 4:42 PM
gerritbot added a comment.May 12 2025, 11:04 PM

Change #1144670 had a related patch set uploaded (by C. Scott Ananian; author: C. Scott Ananian):

[mediawiki/core@master] Parser limit report: Add entry for revision size

https://gerrit.wikimedia.org/r/1144670

gerritbot added a project: Patch-For-Review.May 12 2025, 11:04 PM
gerritbot added a comment.May 15 2025, 12:03 AM

Change #1144670 merged by jenkins-bot:

[mediawiki/core@master] Parser limit report: Add entry for revision size

https://gerrit.wikimedia.org/r/1144670

Maintenance_bot removed a project: Patch-For-Review.May 15 2025, 12:30 AM
ReleaseTaggerBot added a project: MW-1.45-notes (1.45.0-wmf.2; 2025-05-20).May 15 2025, 1:00 AM
gerritbot added a comment.Jun 17 2025, 3:27 AM

Change #1159646 had a related patch set uploaded (by C. Scott Ananian; author: C. Scott Ananian):

[mediawiki/extensions/Linter@master] stats: Add buckets based on wikitext size; fix increment bug

https://gerrit.wikimedia.org/r/1159646

gerritbot added a project: Patch-For-Review.Jun 17 2025, 3:28 AM
gerritbot added a comment.Jun 17 2025, 12:38 PM

Change #1159646 merged by jenkins-bot:

[mediawiki/extensions/Linter@master] stats: Add buckets based on wikitext size; fix increment bug

https://gerrit.wikimedia.org/r/1159646

gerritbot added a comment.Jun 17 2025, 12:42 PM

Change #1160127 had a related patch set uploaded (by C. Scott Ananian; author: C. Scott Ananian):

[mediawiki/extensions/Linter@wmf/1.45.0-wmf.6] stats: Add buckets based on wikitext size; fix increment bug

https://gerrit.wikimedia.org/r/1160127

ReleaseTaggerBot edited projects, added MW-1.45-notes (1.45.0-wmf.7; 2025-06-24); removed MW-1.45-notes (1.45.0-wmf.2; 2025-05-20).Jun 17 2025, 1:00 PM
gerritbot added a comment.Jun 17 2025, 2:45 PM

Change #1160127 merged by jenkins-bot:

[mediawiki/extensions/Linter@wmf/1.45.0-wmf.6] stats: Add buckets based on wikitext size; fix increment bug

https://gerrit.wikimedia.org/r/1160127

Stashbot added a comment.Jun 17 2025, 2:46 PM

Mentioned in SAL (#wikimedia-operations) [2025-06-17T14:46:49Z] <lucaswerkmeister-wmde@deploy1003> Started scap sync-world: Backport for [[gerrit:1160127|stats: Add buckets based on wikitext size; fix increment bug (T393400)]], [[gerrit:1154070|debug.json: add mw-experimental hosts (T276994)]]

Stashbot mentioned this in T276994: Provide an mwdebug functionality on kubernetes (mw-experimental).Jun 17 2025, 2:46 PM
Stashbot added a comment.Jun 17 2025, 2:49 PM

Mentioned in SAL (#wikimedia-operations) [2025-06-17T14:49:02Z] <lucaswerkmeister-wmde@deploy1003> lucaswerkmeister-wmde, jiji, cscott: Backport for [[gerrit:1160127|stats: Add buckets based on wikitext size; fix increment bug (T393400)]], [[gerrit:1154070|debug.json: add mw-experimental hosts (T276994)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

ReleaseTaggerBot edited projects, added MW-1.45-notes (1.45.0-wmf.6; 2025-06-17); removed MW-1.45-notes (1.45.0-wmf.7; 2025-06-24).Jun 17 2025, 3:00 PM
Stashbot added a comment.Jun 17 2025, 3:02 PM

Mentioned in SAL (#wikimedia-operations) [2025-06-17T15:02:48Z] <lucaswerkmeister-wmde@deploy1003> Finished scap sync-world: Backport for [[gerrit:1160127|stats: Add buckets based on wikitext size; fix increment bug (T393400)]], [[gerrit:1154070|debug.json: add mw-experimental hosts (T276994)]] (duration: 15m 59s)

Maintenance_bot removed a project: Patch-For-Review.Jun 17 2025, 3:30 PM
gerritbot added a comment.Jun 17 2025, 5:18 PM

Change #1160210 had a related patch set uploaded (by C. Scott Ananian; author: C. Scott Ananian):

[mediawiki/extensions/Linter@wmf/1.45.0-wmf.5] stats: Add buckets based on wikitext size; fix increment bug

https://gerrit.wikimedia.org/r/1160210

gerritbot added a project: Patch-For-Review.Jun 17 2025, 5:19 PM
Stashbot added a comment.Jun 17 2025, 8:51 PM

Mentioned in SAL (#wikimedia-operations) [2025-06-17T20:51:06Z] <cscott@deploy1003> Started scap sync-world: Backport for [[gerrit:1160127|stats: Add buckets based on wikitext size; fix increment bug (T393400)]]

Stashbot added a comment.Jun 17 2025, 8:53 PM

Mentioned in SAL (#wikimedia-operations) [2025-06-17T20:53:19Z] <cscott@deploy1003> cscott: Backport for [[gerrit:1160127|stats: Add buckets based on wikitext size; fix increment bug (T393400)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

Stashbot added a comment.Jun 17 2025, 9:01 PM

Mentioned in SAL (#wikimedia-operations) [2025-06-17T21:01:10Z] <cscott@deploy1003> Finished scap sync-world: Backport for [[gerrit:1160127|stats: Add buckets based on wikitext size; fix increment bug (T393400)]] (duration: 10m 04s)

gerritbot added a comment.Jun 17 2025, 9:03 PM

Change #1160210 merged by jenkins-bot:

[mediawiki/extensions/Linter@wmf/1.45.0-wmf.5] stats: Add buckets based on wikitext size; fix increment bug

https://gerrit.wikimedia.org/r/1160210

Stashbot added a comment.Jun 17 2025, 9:03 PM

Mentioned in SAL (#wikimedia-operations) [2025-06-17T21:03:52Z] <cscott@deploy1003> Started scap sync-world: Backport for [[gerrit:1160210|stats: Add buckets based on wikitext size; fix increment bug (T393400)]]

Stashbot added a comment.Jun 17 2025, 9:06 PM

Mentioned in SAL (#wikimedia-operations) [2025-06-17T21:06:20Z] <cscott@deploy1003> cscott: Backport for [[gerrit:1160210|stats: Add buckets based on wikitext size; fix increment bug (T393400)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

Stashbot added a comment.Jun 17 2025, 9:16 PM

Mentioned in SAL (#wikimedia-operations) [2025-06-17T21:16:02Z] <cscott@deploy1003> Finished scap sync-world: Backport for [[gerrit:1160210|stats: Add buckets based on wikitext size; fix increment bug (T393400)]] (duration: 12m 09s)

Maintenance_bot removed a project: Patch-For-Review.Jun 17 2025, 9:30 PM
ReleaseTaggerBot edited projects, added MW-1.45-notes (1.45.0-wmf.5; 2025-06-10); removed MW-1.45-notes (1.45.0-wmf.6; 2025-06-17).Jun 17 2025, 10:00 PM
gerritbot added a comment.Jun 17 2025, 10:49 PM

Change #1160303 had a related patch set uploaded (by C. Scott Ananian; author: C. Scott Ananian):

[mediawiki/extensions/Linter@master] stats: Fix bucket offset

https://gerrit.wikimedia.org/r/1160303

gerritbot added a project: Patch-For-Review.Jun 17 2025, 10:49 PM
gerritbot added a comment.Jun 18 2025, 3:37 AM

Change #1160303 merged by jenkins-bot:

[mediawiki/extensions/Linter@master] stats: Fix bucket offset

https://gerrit.wikimedia.org/r/1160303

ReleaseTaggerBot edited projects, added MW-1.45-notes (1.45.0-wmf.7; 2025-06-24); removed MW-1.45-notes (1.45.0-wmf.5; 2025-06-10).Jun 18 2025, 4:01 AM
Maintenance_bot removed a project: Patch-For-Review.Jun 18 2025, 4:30 AM
cscott added a project: Content-Transform-Team (Work In Progress).Oct 20 2025, 3:27 PM
cscott moved this task from Backlog to To Verify on the Content-Transform-Team (Work In Progress) board.
MSantos added a project: OKR-Work.Oct 23 2025, 2:25 PM
cscott claimed this task.Oct 27 2025, 3:37 PM
cscott closed this task as Resolved.Oct 27 2025, 4:47 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits