Disable storage of Parsoid content in RESTbase
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	daniel
	Aug 24 2023, 5:32 PM

Description

In order to move Parsoid out of RESTbase, we want to reduce the functionalituy implemented for parsoid in RESTbase. The most relevant functionality is storage and /preganeration of parsoid output. We want to disable this, turning RESTbase into a mere proxy for RESTbase content.

NOTE: The pre-generation in RESTbase mechanism is currently responsible for sending purges to the CDN caches when parsoid content is updated. If we disable storage in RESTbase, this task will have to be replaced by another mechanism.

Details

	Subject	Repo	Branch	Lines +/-
	changeprop: Disable restbase/parsoid related rules	operations/deployment-charts	master	+0 -98

Customize query in gerrit

Related Objects
Search...

Status	Assigned	Task
Stalled	None	T324931 Clean up open RESTBase related tickets
In Progress	None	T262315 <CORE TECHNOLOGY> API Migration & RESTbase Sunset
Open	None	T344944 Move Parsoid endpoints out of RESTbase
Resolved	Jgiannelos	T344945 Disable storage of Parsoid content in RESTbase
Resolved	daniel	T329366 Enable WarmParsoidParserCache on all wikis
Resolved	Clement_Goubert	T333528 Increase memory_limit for jobrunners to $wmgMemoryLimitParsoid
Open	None	T344946 Create a mechanism for purging output from (parsoid) HTML endpoints from edge caches (without RESTbase)
Resolved	hnowlan	T357504 Prepare amount of workers to handle enwiki traffic for parsoid endpoints

Event Timeline

daniel created this task.Aug 24 2023, 5:32 PM

daniel added subscribers: Eevans, Joe.

daniel added a subtask: T329366: Enable WarmParsoidParserCache on all wikis.Aug 24 2023, 5:37 PM

daniel closed subtask T329366: Enable WarmParsoidParserCache on all wikis as Resolved.Aug 25 2023, 8:37 AM

Presumably the same hooks we use for pregeneration could be preserved, just hollowed out so that they "only" did cache invalidation?

MSantos edited projects, added Parsoid (Tracking); removed Parsoid.Aug 31 2023, 2:20 PM

MSantos moved this task from Unsorted to Parsoid pile on the RESTBase Sunsetting board.

daniel mentioned this in T350359: Parsoid extension page endpoints should not redirect to latest revision.Nov 2 2023, 10:30 AM

akosiaris subscribed.Jan 3 2024, 11:38 AM

@Ladsgroup: Heads up that this will cause more requests to the parsoid extension endpoints, causing more ParserCache reads. Based on the information in Turnilo, about 100 req/sec. It should cause no additional writes, since we are currently doing active pre-generation on all changes already, including template changes (though PC writes from the parsoid endpoints are disabled on Commons and Wikidata).