Page MenuHomePhabricator
Create Task
Maniphest T415696

Decommission WDQS Linked Data Fragment (LDF) endpoint
Open, In Progress, MediumPublic
Actions

Description

The Wikidata Platform and Wikimedia Deutschland teams have decided to decommission the WDQS LDF endpoint. This endpoint serves very limited traffic, which the WMDE reuse team is in the process of migrating. Several other data access methods can support the use cases best fit for LDF, leading the team to decide it's not worth maintaining.

We are requesting SRE support to turn off this endpoint and depool it from WDQS clusters. Messaging with power users is already underway, so the timeline can flexible based on the SRE roadmap and resources required to disable the endpoint. Ideally, we would like this change to be made by the week of February 15th, 2026.

Details

Related Changes in Gerrit:
SubjectRepoBranchLines +/-
cleanup(WDQS): remove all remaining references to the WDQS LDF endpoint.operations/puppetproduction+1 -8
cleanup(WDQS): remove WDQS LDF endpoint from cfssl configurationoperations/puppetproduction+0 -13
cleanup(WDQS): remove monitoring for WDQS LDF endpointoperations/puppetproduction+0 -24
cleanup(WDQS/traffic): cleanup backend.yaml rules for WDQS LDF endpointoperations/puppetproduction+0 -9
feat(WDQS)!: disable LDF endpointoperations/puppetproduction+0 -4
Customize query in gerrit

Related Objects

Event Timeline

BTracy-WMF created this task.Tue, Jan 27, 6:01 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptTue, Jan 27, 6:02 PM
gmodena subscribed.Tue, Jan 27, 7:43 PM
bking subscribed.Wed, Jan 28, 4:40 PM
Gehel subscribed.Fri, Jan 30, 9:58 AM

Disabling the endpoint should be almost trivial on our end. There is a bit more work to cleanup all the things related to that endpoint, but this can happen after Feb 15 (ideally, we should prepare ahead of time). We'll wait for confirmation from @BTracy-WMF before decommissioning LDF.

Gehel triaged this task as Medium priority.Fri, Jan 30, 9:58 AM
Gehel moved this task from Incoming to Scratch on the Data-Platform-SRE board.
BTracy-WMF added a comment.Fri, Jan 30, 4:10 PM

Thanks @Gehel. Knowing that the work is not complicated and that Monday, February 16th is a US holiday, we will plan on Wednesday, February 18th for the change. I'll update this ticket again closer to the date to confirm.

BTracy-WMF mentioned this in T394575: ProbeDown - wdqs1015 - disable LDF alerts until we figure this one out.Fri, Jan 30, 4:53 PM
Gehel edited projects, added Data-Platform-SRE (2026.01.23 - 2026.02.13), Wikidata-Query-Service; removed Data-Platform-SRE.Mon, Feb 2, 1:12 PM
Gehel moved this task from Backlog - project to Backlog - operations on the Data-Platform-SRE (2026.01.23 - 2026.02.13) board.
Maintenance_bot added a project: Wikidata.Mon, Feb 2, 1:31 PM
Gehel changed the task status from Open to In Progress.Thu, Feb 5, 9:10 AM
Gehel claimed this task.
Gehel moved this task from Backlog - operations to In Progress on the Data-Platform-SRE (2026.01.23 - 2026.02.13) board.
gerritbot added a comment.Thu, Feb 5, 9:16 AM

Change #1237142 had a related patch set uploaded (by Gehel; author: Gehel):

[operations/puppet@production] feat(WDQS)!: disable LDF endpoint

https://gerrit.wikimedia.org/r/1237142

gerritbot added a project: Patch-For-Review.Thu, Feb 5, 9:16 AM
gerritbot added a comment.Thu, Feb 5, 9:32 AM

Change #1237145 had a related patch set uploaded (by Gehel; author: Gehel):

[operations/puppet@production] cleanup(WDQS/traffic): cleanup backend.yaml rules for WDQS LDF endpoint

https://gerrit.wikimedia.org/r/1237145

gerritbot added a comment.Thu, Feb 5, 9:32 AM

Change #1237146 had a related patch set uploaded (by Gehel; author: Gehel):

[operations/puppet@production] cleanup(WDQS): remove monitoring for WDQS LDF endpoint

https://gerrit.wikimedia.org/r/1237146

gerritbot added a comment.Thu, Feb 5, 9:32 AM

Change #1237147 had a related patch set uploaded (by Gehel; author: Gehel):

[operations/puppet@production] cleanup(WDQS): remove WDQS LDF endpoint from cfssl configuration

https://gerrit.wikimedia.org/r/1237147

gerritbot added a comment.Thu, Feb 5, 9:32 AM

Change #1237148 had a related patch set uploaded (by Gehel; author: Gehel):

[operations/puppet@production] cleanup(WDQS): remove all remaining references to the WDQS LDF endpoint.

https://gerrit.wikimedia.org/r/1237148

Gehel reassigned this task from Gehel to RKemper.Thu, Feb 5, 9:33 AM
Gehel added a comment.Thu, Feb 5, 9:37 AM

@RKemper: I've pushed a string of patches to disable LDF endpoints and do subsequent cleanup. Can you review and make sure we are ready for Feb 18th?

Gehel added a comment.Thu, Feb 5, 9:39 AM

I checked the operations/dns repo, and there are no references to LDF in there.

Gehel moved this task from In Progress to Needs Review on the Data-Platform-SRE (2026.01.23 - 2026.02.13) board.Thu, Feb 5, 9:41 AM
RKemper moved this task from Needs Review to Blocked/Waiting on the Data-Platform-SRE (2026.01.23 - 2026.02.13) board.EditedThu, Feb 5, 9:06 PM

+1'd all the patches. Everything looks great so I couldn't find anything to change, minus one small typo in the base commit message.

I spot-checked operations/dns and operations/alerts and found no references, so I think we'll all set for the Feb 18 decom date.

Gehel added a comment.Wed, Feb 11, 3:56 PM

Let's cut traffic on Feb 18th, but wait a bit for the full cleanup, so that we can rollback if needed.

Gehel edited projects, added Data-Platform-SRE (2026-02-13 - 2026-03-06); removed Data-Platform-SRE (2026.01.23 - 2026.02.13).Mon, Feb 16, 3:30 PM
Gehel moved this task from Backlog - project to Blocked/Waiting on the Data-Platform-SRE (2026-02-13 - 2026-03-06) board.
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits