Page MenuHomePhabricator
Create Task
Maniphest T378044

Ingest more statements when retrieving lexemes, forms, & senses; add ranks to statements
Closed, ResolvedPublic
Actions

Description

Description

Currently, When transforming a retrieved Lexeme, Lexeme form, or Lexeme sense into the corresponding Wikidata type, we only ingest nested statements whose values are strings. All other statements are ignored. In this task, we add statements whose values are any of these:

  • Lexeme
  • Lexeme form
  • Lexeme sense
  • Item
  • Monolingual text

In addition, we had a new field rank to each statement that gets ingested, using the type & instances created in T378678.

Completion checklist

Details

Related Changes in Gerrit:
SubjectRepoBranchLines +/-
wikifunctions: Upgrade orchestrator from version: 2025-01-22-203140 to 2025-01-28-144249operations/deployment-chartsmaster+1 -1
wikifunctions: Upgrade orchestrator from 2024-11-18-142635 to 2024-11-19-132736operations/deployment-chartsmaster+1 -1
Customize query in gerrit
Related Changes in GitLab:
TitleReferenceAuthorSource BranchDest Branch
Ingest more statements when fetching lexemes, etc; add ranks to statementsrepos/abstract-wiki/wikifunctions/function-orchestrator!249dmartinT378044main
Customize query in GitLab

Related Objects
Search...

Event Timeline

DMartin-WMF created this task.Oct 24 2024, 1:01 AM
DMartin-WMF added a parent task: T376662: [25Q2] Iterate the Wikidata integration, and plan its and the Type system's evolution.
Hogue subscribed.Oct 25 2024, 2:48 PM
Unite_together subscribed.Oct 25 2024, 2:49 PM
Hogue added a comment.Oct 25 2024, 2:58 PM

I am interested in parsing the Wikidata Lexeme Dump and have experimented with it in the past. Maybe it is more efficient regarding needed resources per request to create lists in Wikifunctions as Z-Objects with the content what is needed per Lexeme. Updating the list of Lexemes in Wikifunctions is necessary in this case as new Lexemes will be added or updates to existing lexemes occur.

DMartin-WMF claimed this task.Oct 25 2024, 7:15 PM
Jdforrester-WMF moved this task from To Triage to 25Q2 (Oct–Dec) on the Abstract Wikipedia team board.Oct 28 2024, 5:48 PM
Jdforrester-WMF edited projects, added Abstract Wikipedia team (25Q2 (Oct–Dec)); removed Abstract Wikipedia team.
Jdforrester-WMF moved this task from Incoming to In Engineering on the Abstract Wikipedia team (25Q2 (Oct–Dec)) board.
Jdforrester-WMF triaged this task as Medium priority.Oct 28 2024, 5:52 PM
DMartin-WMF added a subtask: T378678: definitions: add predefined type "Wikidata statement rank" & a new key of that type in Z6003.Oct 31 2024, 12:41 AM
DMartin-WMF renamed this task from Ingest more statements when retrieving lexemes, forms, and senses to Ingest more statements when retrieving lexemes, forms, & senses; add ranks to statements.Nov 4 2024, 5:04 AM
DMartin-WMF updated the task description. (Show Details)
CodeReviewBot added a project: Patch-For-Review.Nov 4 2024, 5:12 AM

dmartin opened https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-orchestrator/-/merge_requests/249

Ingest more statements when fetching lexemes, etc; add ranks to statements

CodeReviewBot added a comment.Nov 18 2024, 6:32 PM

apine merged https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-orchestrator/-/merge_requests/249

Ingest more statements when fetching lexemes, etc; add ranks to statements

Maintenance_bot removed a project: Patch-For-Review.Nov 18 2024, 7:31 PM
gerritbot added a comment.Nov 20 2024, 2:25 PM

Change #1093349 had a related patch set uploaded (by Jforrester; author: Jforrester):

[operations/deployment-charts@master] wikifunctions: Upgrade orchestrator from 2024-11-18-142635 to 2024-11-19-132736

https://gerrit.wikimedia.org/r/1093349

gerritbot added a project: Patch-For-Review.Nov 20 2024, 2:25 PM
gerritbot added a comment.Nov 20 2024, 3:26 PM

Change #1093349 merged by jenkins-bot:

[operations/deployment-charts@master] wikifunctions: Upgrade orchestrator from 2024-11-18-142635 to 2024-11-19-132736

https://gerrit.wikimedia.org/r/1093349

Maintenance_bot removed a project: Patch-For-Review.Nov 20 2024, 3:31 PM
Jdforrester-WMF closed this task as Resolved.Nov 25 2024, 4:05 PM
Jdforrester-WMF closed subtask T378678: definitions: add predefined type "Wikidata statement rank" & a new key of that type in Z6003 as Resolved.
Jdforrester-WMF moved this task from In Engineering to Needs Sign-off on the Abstract Wikipedia team (25Q2 (Oct–Dec)) board.
gerritbot added a comment.Jan 29 2025, 2:34 PM

Change #1115032 had a related patch set uploaded (by Cory Massaro; author: Cory Massaro):

[operations/deployment-charts@master] wikifunctions: Upgrade orchestrator from version: 2025-01-22-203140 to 2025-01-28-144249

https://gerrit.wikimedia.org/r/1115032

gerritbot added a project: Patch-For-Review.Jan 29 2025, 2:34 PM
gerritbot added a comment.Jan 29 2025, 2:36 PM

Change #1115032 abandoned by Cory Massaro:

[operations/deployment-charts@master] wikifunctions: Upgrade orchestrator from version: 2025-01-22-203140 to 2025-01-28-144249

Reason:

already done

https://gerrit.wikimedia.org/r/1115032

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits