Page MenuHomePhabricator
Create Task
Maniphest T397956

Store Wikidata objects in memcached
Closed, ResolvedPublic
Actions

Description

Description

Wikidata objects should be stored in memcached.

Desired behavior/Acceptance criteria (returned value, expected error, performance expectations, etc.)

  • determine appropriate TTL in order to have decent recency guarantees
  • store Wikidata items in memcached

Completion checklist

Details

Related Changes in Gerrit:
SubjectRepoBranchLines +/-
wikifunctions: Expand caching of Wikidata items TTL to one dayoperations/deployment-chartsmaster+1 -1
wikifunctions: Upgrade orchestrator from 2025-09-08-191243 to 2025-09-16-134119operations/deployment-chartsmaster+1 -1
wikifunctions: Expand caching of Wikidata items TTL to one minuteoperations/deployment-chartsmaster+1 -1
wikifunctions: Enable (short-lived) caching of Wikidata items, as a testoperations/deployment-chartsmaster+1 -1
wikifunctions: Upgrade orchestrator from 2025-09-02-205403 to 2025-09-04-003606operations/deployment-chartsmaster+1 -1
wikifunctions: Set Wikidata caching off in advance, with a 1-minute TTLoperations/deployment-chartsmaster+2 -0
Customize query in gerrit
Related Changes in GitLab:
TitleReferenceAuthorSource BranchDest Branch
Logging and performance fixes for Wikidata.repos/abstract-wiki/wikifunctions/function-orchestrator!443apineapine-wikidata-memcachedmain
Add support for Wikidata caching.repos/abstract-wiki/wikifunctions/function-orchestrator!434apineapine-wikidata-cachingmain
Customize query in GitLab

Related Objects
Search...

Event Timeline

cmassaro created this task.Jun 26 2025, 3:56 PM
cmassaro added a parent task: T397959: [Baby epic] Clean up remaining batching and memcached work.Jun 26 2025, 3:59 PM
DVrandecic triaged this task as Medium priority.Jul 2 2025, 3:48 PM
DVrandecic moved this task from To Triage to 26Q1 (Jul–Sep) on the Abstract Wikipedia team board.
DVrandecic edited projects, added Abstract Wikipedia team (26Q1 (Jul–Sep)); removed Abstract Wikipedia team.
Jdforrester-WMF added a parent task: T397409: If we provide caching of retrieved Wikidata entities, we will reduce by at least 50% the average runtime of Wikidata content-based functions, reducing timeouts and user frustration..Jul 8 2025, 4:49 PM
Jdforrester-WMF added a project: OKR-Work.
Jdforrester-WMF moved this task from Incoming to Ready on the Abstract Wikipedia team (26Q1 (Jul–Sep)) board.
DMartin-WMF added a subtask: T401087: Plan approach & prepare any needed instrumentation for Wikidata caching success metrics.Aug 4 2025, 5:21 AM
cmassaro claimed this task.Aug 26 2025, 10:13 PM
cmassaro changed the task status from Open to In Progress.Aug 27 2025, 3:55 PM
cmassaro moved this task from Ready to In Engineering on the Abstract Wikipedia team (26Q1 (Jul–Sep)) board.
CodeReviewBot added a project: Patch-For-Review.Sep 2 2025, 10:04 PM

apine opened https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-orchestrator/-/merge_requests/434

Add support for Wikidata caching.

cmassaro moved this task from In Engineering to In Code review on the Abstract Wikipedia team (26Q1 (Jul–Sep)) board.Sep 2 2025, 10:06 PM
gerritbot added a comment.Sep 3 2025, 1:01 PM

Change #1184519 had a related patch set uploaded (by Jforrester; author: Jforrester):

[operations/deployment-charts@master] wikifunctions: Set Wikidata caching off in advance, with a 1-minute TTL

https://gerrit.wikimedia.org/r/1184519

gerritbot added a comment.Sep 3 2025, 2:13 PM

Change #1184519 merged by jenkins-bot:

[operations/deployment-charts@master] wikifunctions: Set Wikidata caching off in advance, with a 1-minute TTL

https://gerrit.wikimedia.org/r/1184519

CodeReviewBot added a comment.Sep 3 2025, 11:20 PM

jforrester merged https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-orchestrator/-/merge_requests/434

Add support for Wikidata caching.

Maintenance_bot removed a project: Patch-For-Review.Sep 3 2025, 11:31 PM
gerritbot added a comment.Sep 4 2025, 12:40 AM

Change #1184620 had a related patch set uploaded (by Jforrester; author: Jforrester):

[operations/deployment-charts@master] wikifunctions: Upgrade orchestrator from 2025-09-02-205403 to 2025-09-04-003606

https://gerrit.wikimedia.org/r/1184620

gerritbot added a project: Patch-For-Review.Sep 4 2025, 12:40 AM
gerritbot added a comment.Sep 4 2025, 12:42 AM

Change #1184620 merged by jenkins-bot:

[operations/deployment-charts@master] wikifunctions: Upgrade orchestrator from 2025-09-02-205403 to 2025-09-04-003606

https://gerrit.wikimedia.org/r/1184620

Jdforrester-WMF moved this task from In Code review to Ready to deploy on the Abstract Wikipedia team (26Q1 (Jul–Sep)) board.Sep 4 2025, 12:43 AM
Jdforrester-WMF subscribed.

OK, all that's remaining is to enable this and ensure it works, but let's not do so during an emergency deploy.

Maintenance_bot removed a project: Patch-For-Review.Sep 4 2025, 1:31 AM
cmassaro moved this task from Ready to deploy to Needs Sign-off on the Abstract Wikipedia team (26Q1 (Jul–Sep)) board.Sep 5 2025, 2:17 AM
gerritbot added a comment.Sep 10 2025, 12:50 PM

Change #1186981 had a related patch set uploaded (by Jforrester; author: Jforrester):

[operations/deployment-charts@master] wikifunctions: Enable (short-lived) caching of Wikidata items, as a test

https://gerrit.wikimedia.org/r/1186981

gerritbot added a project: Patch-For-Review.Sep 10 2025, 12:50 PM

Change #1186982 had a related patch set uploaded (by Jforrester; author: Jforrester):

[operations/deployment-charts@master] wikifunctions: Expand caching of Wikidata items TTL to one day

https://gerrit.wikimedia.org/r/1186982

gerritbot added a comment.Sep 10 2025, 2:23 PM

Change #1186981 merged by jenkins-bot:

[operations/deployment-charts@master] wikifunctions: Enable (short-lived) caching of Wikidata items, as a test

https://gerrit.wikimedia.org/r/1186981

gerritbot added a comment.Sep 10 2025, 2:31 PM

Change #1187006 had a related patch set uploaded (by Jforrester; author: Jforrester):

[operations/deployment-charts@master] wikifunctions: Expand caching of Wikidata items TTL to one minute

https://gerrit.wikimedia.org/r/1187006

gerritbot added a comment.Sep 10 2025, 2:33 PM

Change #1187006 merged by jenkins-bot:

[operations/deployment-charts@master] wikifunctions: Expand caching of Wikidata items TTL to one minute

https://gerrit.wikimedia.org/r/1187006

CodeReviewBot added a comment.Sep 10 2025, 11:03 PM

apine updated https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-orchestrator/-/merge_requests/443

Logging and performance fixes for Wikidata.

CodeReviewBot added a comment.Sep 11 2025, 6:12 PM

apine merged https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-orchestrator/-/merge_requests/443

Logging and performance fixes for Wikidata.

DMartin-WMF changed the status of subtask T401087: Plan approach & prepare any needed instrumentation for Wikidata caching success metrics from Open to In Progress.Sep 12 2025, 12:46 AM
cmassaro closed this task as Resolved.Sep 16 2025, 1:46 PM
gerritbot added a comment.Sep 17 2025, 1:03 PM

Change #1189156 had a related patch set uploaded (by Jforrester; author: Jforrester):

[operations/deployment-charts@master] wikifunctions: Upgrade orchestrator from 2025-09-08-191243 to 2025-09-16-134119

https://gerrit.wikimedia.org/r/1189156

gerritbot added a comment.Sep 17 2025, 2:13 PM

Change #1189156 merged by jenkins-bot:

[operations/deployment-charts@master] wikifunctions: Upgrade orchestrator from 2025-09-08-191243 to 2025-09-16-134119

https://gerrit.wikimedia.org/r/1189156

gerritbot added a comment.Sep 24 2025, 9:13 PM

Change #1186982 merged by jenkins-bot:

[operations/deployment-charts@master] wikifunctions: Expand caching of Wikidata items TTL to one day

https://gerrit.wikimedia.org/r/1186982

DMartin-WMF closed subtask T401087: Plan approach & prepare any needed instrumentation for Wikidata caching success metrics as Resolved.Oct 16 2025, 2:35 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits