Page MenuHomePhabricator
Create Task
Maniphest T293628

Get baseline measurements/expectations for splitting various subgraphs from Wikidata
Closed, ResolvedPublic
Actions

Description

As a Data Analyst for Wikidata and WDQS, I would like to know what are the various large subgraphs in Wikidata and what are the benefits/losses of splitting them off from Wikidata. The aim is to identify large subgraphs along with those already known (scholarly articles, astronomical objects) and find out how often these subgraphs are queried. This can be estimated from:

  • The subgraph sizes
  • Connection of subgraphs to other subgraphs
  • Number of queries that inquire of this subgraph
  • Number of queries that span multiple subgraphs (estimation of how much federation load)

Related Objects
Search...

Event Timeline

AKhatun_WMF created this task.Oct 18 2021, 1:51 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptOct 18 2021, 1:51 PM
AKhatun_WMF added a parent task: T282790: [EPIC] Get estimates for dropping data from Wikidata in case of Blazegraph catastrophic failure.Oct 18 2021, 1:51 PM
AKhatun_WMF added a subtask: T291205: Analysis: Property usage by items' P31.
AKhatun_WMF added a subtask: T281854: Get baseline measurements/expectations for splitting scholarly articles from Wikidata.Oct 18 2021, 1:57 PM
AKhatun_WMF added a subtask: T288257: Get estimates for size of astronomical objects and queries in Wikidata graph.
AKhatun_WMF updated the task description. (Show Details)Oct 18 2021, 2:01 PM
AKhatun_WMF moved this task from Incoming to Analysis on the Wikidata-Query-Service board.Oct 18 2021, 2:38 PM
MPhamWMF triaged this task as High priority.Oct 26 2021, 6:00 PM
Gehel closed subtask T291205: Analysis: Property usage by items' P31 as Resolved.Nov 15 2021, 2:14 PM
AKhatun_WMF moved this task from incoming to in progress on the Wikidata board.EditedJan 6 2022, 5:35 AM

With the completion of all subtasks, this task is complete.

AKhatun_WMF moved this task from Analysis to Current work on the Wikidata-Query-Service board.Jan 6 2022, 5:36 AM
AKhatun_WMF added a project: Discovery-Search (Current work).
AKhatun_WMF moved this task from Incoming to Needs Reporting on the Discovery-Search (Current work) board.
Gehel closed this task as Resolved.Jan 10 2022, 1:38 PM
Gehel closed subtask T293631: Get estimates for splitting other large subgraphs from Wikidata as Resolved.
Gehel closed subtask T288257: Get estimates for size of astronomical objects and queries in Wikidata graph as Resolved.
AKhatun_WMF mentioned this in T303831: Productionize Wikidata subgraph analysis.Mar 15 2022, 2:08 PM
AndrewTavis_WMDE mentioned this in T337021: [Analytics] Find out size of term subgraph.Jul 14 2023, 3:13 PM
Content licensed under Creative Commons Attribution-ShareAlike 4.0 (CC-BY-SA) unless otherwise noted; code licensed under GNU General Public License (GPL) or other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL