Store Enriched Objects in Memcached
Open, MediumPublic
Actions

Assigned To

None

Authored By

	cmassaro
	Nov 13 2025, 5:09 PM

Description

Often, it's possible to have information about an object stored in memcached. Some of this object is stored in ZWrappers but is lost when we create a ZWrapper from things retrieved from memcached. This information could be used to rehydrate ZWrappers with more information.

Desired behavior/Acceptance criteria (returned value, expected error, performance expectations, etc.)

We could store any/all of the following in memcached:

object is already validated;
object is already fully resolved;
(for Wikidata) certain statements are not yet populated

Remove all the non-applicable tags from the "Tags" field, leave only the tags of the projects/repositories related to this task

Completion checklist

Before closing this task, review one by one the checklist available here: https://www.mediawiki.org/wiki/Abstract_Wikipedia_team/Definition_of_Done#Back-end_Task/Bug_completion_checklist

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Resolved		cmassaro	T406346 [26Q2] Orchestrator memory squashing
		Open		None	T410065 Store Enriched Objects in Memcached

Event Timeline

cmassaro created this task.Nov 13 2025, 5:09 PM

cmassaro updated the task description. (Show Details)Nov 13 2025, 5:11 PM

(for Wikidata) certain statements are not yet populated

Should we store the fetch booleans (wikidataImport's qualifiers and references) for these? Or is this for the "only get me things in French" / etc.? Or both?

Hi @Jdforrester-WMF - Thanks for raising this. I doubt if it's worthwhile to write code to store and check (in memcached) the fetch Booleans for qualifiers and references. I doubt if we will ever switch off the Boolean for qualifiers, and it's likely that after we turn on references, it will also continue to stay on forever. When we do turn on references, I wonder if we could just run a script that removes all stored Wikidata entities from the cache. I'll think some more about this.

Regarding the "optimization parameters" (which entity parts, languages, and statement properties were fetched), It won't be necessary to record those in memcached, because those will be baked into the key under which the first entity is stored.

Jdforrester-WMF triaged this task as Medium priority.Nov 19 2025, 6:33 PM

Jdforrester-WMF added a parent task: T406346: [26Q2] Orchestrator memory squashing.

Jdforrester-WMF edited projects, added Abstract Wikipedia team (26Q2 (Oct–Dec)), OKR-Work; removed Abstract Wikipedia team.

Jdforrester-WMF moved this task from Incoming to Ready on the Abstract Wikipedia team (26Q2 (Oct–Dec)) board.