Page MenuHomePhabricator
Create Task
Maniphest T404652

Enable import of references in Wikidata entity fetches
Open, HighPublic
Actions

Description

Description

The orchestrator coding for Importing references has been completed and will soon be deployed (T399920), with a feature flag currently set to false. We decided to hold off on enabling it until (at least) after the resolution of our request for additional orchestrator memory (T403094), so as to hopefully lessen the potential for additional out of memory conditions.

Once that has been resolved, we can proceed with enablement.

Desired behavior/Acceptance criteria (returned value, expected error, performance expectations, etc.)

  • ...

Remove all the non-applicable tags from the "Tags" field, leave only the tags of the projects/repositories related to this task

Completion checklist

Related Objects
Search...

Event Timeline

DMartin-WMF created this task.Sep 15 2025, 9:19 PM
DMartin-WMF mentioned this in T399920: [Stretch] Update orchestrator code of Wikidata Fetch functions to instantiate references.
Jdforrester-WMF subscribed.Sep 17 2025, 2:23 PM
Jdforrester-WMF moved this task from To Triage to Product Backlog on the Abstract Wikipedia team board.Sep 17 2025, 3:50 PM
DVrandecic triaged this task as High priority.Sep 29 2025, 3:50 PM
DVrandecic added a subtask: T403094: Request to increase function-orchestrator memory to 10GiB.
DVrandecic subscribed.

Once we have more memory, we should test this out with two or three big items, and if it works fine, switch it on.

If there are still issues, please send back to product for reassessment.

DVrandecic moved this task from Product Backlog to To Triage on the Abstract Wikipedia team board.Sep 29 2025, 3:53 PM
Jdforrester-WMF moved this task from To Triage to Engineering Backlog on the Abstract Wikipedia team board.Oct 1 2025, 5:51 PM

Product do not have concerns about this blocking their work on citation/reference support, so this is just waiting on dependencies at this point.

Jdforrester-WMF closed subtask T403094: Request to increase function-orchestrator memory to 10GiB as Declined.Nov 13 2025, 5:06 PM
DMartin-WMF added a comment.Jan 23 2026, 12:55 AM

The original idea of getting additional orchestrator memory has been abandoned, and we've had some performance improvements in the meantime, so we will likely do this sometime in February/March, 2026. We don't have a way to realistically check the performance impact using development environments or beta servers, but we can monitor a few basic indicator metrics on production for a week or 2 prior to deployment, and then the same period of time after deployment, and compare.

99of9 subscribed.Mon, Mar 23, 9:09 PM
So9q subscribed.Tue, Mar 31, 2:31 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits