Page MenuHomePhabricator

WDQS
Closed, InvalidPublic

Description

Request Status: FY23 Dependency
Request Type: project support request
Related OKRs: WMDE: Support the work around scaling Query Service with community and strategy input. WMF: Scaling the Query Service. Continue the research and implementation of scaling improvement.

Request Title: WMDE - WDQS

  • Request Description: The Wikidata development team supports the WMF Search Platform team with input for the scaling of the Wikidata Query Service on topics of Wikidata's strategy, requirements and existing usage as well as in communication with Wikidata's editors and re-users.

Proposed Key result for WMF teams: The different options for a replacement of Blazegraph have been discussed and socialized with Wikidata's editors and re-users.

  • Indicate Priority Level:
  • Main Requestors: Wikidata Team
  • Ideal Delivery Date:
  • Stakeholders: Wikidata, Wikidata Community

Request Documentation

Document TypeRequired?Document/Link
Related PHAB TicketsYes<add link here>
Product One PagerYes<add link here>
Product Requirements Document (PRD)Yes<add link here>
Product RoadmapNo<add link here>
Product Planning/Business CaseNo<add link here>
Product BriefNo<add link here>
Other LinksNo<add links here>

Event Timeline

What are the goals for this work

  1. Auth
    • We need to provide a response to the community on how we will manage Auth going forward
      • Dependencies: Auth Experiment + API Platform (Gateway + Portal)
      • talk to Andrew Lee
  2. Stabilizing Queries (Short Term)
    • Provide ways to immediately stabilize queries and results
      • Limits dependencies: Auth Experiment + API Gateway
    • Generate insights into types of queries, errors, etc.
      • Logging, etc.
    • Timeouts, automated circuit breakers, etc.
      • Dependencies: API Gateway + Data Platform (Events & Pipelines) +
  3. Overall Architecture (Long-term)
    • What to do with Blazegraph
    • Long-term stabilization options

I am not sure it is helpful to treat WDQS and WCQS the same and together here.

DAbad changed the task status from Open to In Progress.Aug 17 2022, 4:27 PM
DAbad claimed this task.
DAbad moved this task from Backlog to Investigate on the Foundational Technology Requests board.

We can separate PRDs for WDQS and WCQS.

Investigation has commenced with Lydia and Shari.

Removing inactive task assignee. (Please do so as part of offboarding - thanks.)