Decommission WDQS Linked Data Fragment (LDF) endpoint
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	BTracy-WMF
	Jan 27 2026, 6:01 PM

Project Tags

Referenced Files

None

Subscribers

Description

The Wikidata Platform and Wikimedia Deutschland teams have decided to decommission the WDQS LDF endpoint. This endpoint serves very limited traffic, which the WMDE reuse team is in the process of migrating. Several other data access methods can support the use cases best fit for LDF, leading the team to decide it's not worth maintaining.

We are requesting SRE support to turn off this endpoint and depool it from WDQS clusters. Messaging with power users is already underway, so the timeline can flexible based on the SRE roadmap and resources required to disable the endpoint. Ideally, we would like this change to be made by the week of February 15th, 2026.

Details

Related Changes in Gerrit:

Subject	Author	Repo	Branch	Lines +/-
cleanup(WDQS): remove all remaining references to the WDQS LDF endpoint.	Gehel	operations/puppet	production	+1 -8
cleanup(WDQS): remove WDQS LDF endpoint from cfssl configuration	Gehel	operations/puppet	production	+0 -13
cleanup(WDQS): remove monitoring for WDQS LDF endpoint	Gehel	operations/puppet	production	+0 -24
cleanup(WDQS/traffic): cleanup backend.yaml rules for WDQS LDF endpoint	Gehel	operations/puppet	production	+0 -9
feat(WDQS)!: disable LDF endpoint	Gehel	operations/puppet	production	+0 -4

Customize query in gerrit

Related Objects

Mentioned In: T195332: Allow alternative pagination options for LDF endpoint
T161240: Expose wikidata query service LDF endpoint in a scalable and available way
T256948: Evaluate using LinkedDataFragments/Server.js instead of custom blazegraph integration
T264405: Determine how to provide a way of separating linked data fragments from WDQS
T394575: ProbeDown - wdqs1015 - disable LDF alerts until we figure this one out

Event Timeline

BTracy-WMF created this task.Jan 27 2026, 6:01 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJan 27 2026, 6:02 PM

gmodena subscribed.Jan 27 2026, 7:43 PM

bking subscribed.Jan 28 2026, 4:40 PM

Disabling the endpoint should be almost trivial on our end. There is a bit more work to cleanup all the things related to that endpoint, but this can happen after Feb 15 (ideally, we should prepare ahead of time). We'll wait for confirmation from @BTracy-WMF before decommissioning LDF.

Gehel triaged this task as Medium priority.Jan 30 2026, 9:58 AM

Gehel moved this task from Incoming to Scratch on the Data-Platform-SRE board.

Thanks @Gehel. Knowing that the work is not complicated and that Monday, February 16th is a US holiday, we will plan on Wednesday, February 18th for the change. I'll update this ticket again closer to the date to confirm.

BTracy-WMF mentioned this in T394575: ProbeDown - wdqs1015 - disable LDF alerts until we figure this one out.Jan 30 2026, 4:53 PM

Gehel edited projects, added: Data-Platform-SRE (2026.01.23 - 2026.02.13), Wikidata-Query-Service; removed: Data-Platform-SRE.Feb 2 2026, 1:12 PM

Gehel moved this task from Backlog - project to Backlog - operations on the Data-Platform-SRE (2026.01.23 - 2026.02.13) board.

Maintenance_bot added a project: Wikidata.Feb 2 2026, 1:31 PM

Gehel changed the task status from Open to In Progress.Feb 5 2026, 9:10 AM

Gehel claimed this task.

Gehel moved this task from Backlog - operations to In Progress on the Data-Platform-SRE (2026.01.23 - 2026.02.13) board.

Change #1237142 had a related patch set uploaded (by Gehel; author: Gehel):

[operations/puppet@production] feat(WDQS)!: disable LDF endpoint

https://gerrit.wikimedia.org/r/1237142

gerritbot added a project: Patch-For-Review.Feb 5 2026, 9:16 AM

Change #1237145 had a related patch set uploaded (by Gehel; author: Gehel):

[operations/puppet@production] cleanup(WDQS/traffic): cleanup backend.yaml rules for WDQS LDF endpoint

https://gerrit.wikimedia.org/r/1237145

Change #1237146 had a related patch set uploaded (by Gehel; author: Gehel):

[operations/puppet@production] cleanup(WDQS): remove monitoring for WDQS LDF endpoint

https://gerrit.wikimedia.org/r/1237146

Change #1237147 had a related patch set uploaded (by Gehel; author: Gehel):

[operations/puppet@production] cleanup(WDQS): remove WDQS LDF endpoint from cfssl configuration

https://gerrit.wikimedia.org/r/1237147

Change #1237148 had a related patch set uploaded (by Gehel; author: Gehel):

[operations/puppet@production] cleanup(WDQS): remove all remaining references to the WDQS LDF endpoint.

https://gerrit.wikimedia.org/r/1237148

Gehel reassigned this task from Gehel to RKemper.Feb 5 2026, 9:33 AM

@RKemper: I've pushed a string of patches to disable LDF endpoints and do subsequent cleanup. Can you review and make sure we are ready for Feb 18th?

I checked the operations/dns repo, and there are no references to LDF in there.

Gehel moved this task from In Progress to Needs Review on the Data-Platform-SRE (2026.01.23 - 2026.02.13) board.Feb 5 2026, 9:41 AM

+1'd all the patches. Everything looks great so I couldn't find anything to change, minus one small typo in the base commit message.

I spot-checked operations/dns and operations/alerts and found no references, so I think we'll all set for the Feb 18 decom date.

Let's cut traffic on Feb 18th, but wait a bit for the full cleanup, so that we can rollback if needed.

Gehel edited projects, added: Data-Platform-SRE (2026-02-13 - 2026-03-06); removed: Data-Platform-SRE (2026.01.23 - 2026.02.13).Feb 16 2026, 3:30 PM

Gehel moved this task from Backlog - project to Blocked/Waiting on the Data-Platform-SRE (2026-02-13 - 2026-03-06) board.

Mentioned in SAL (#wikimedia-operations) [2026-02-19T22:24:05Z] <ryankemper> T415696 Will be merging https://gerrit.wikimedia.org/r/c/operations/puppet/+/1237142 shortly, which will permanently decom the LDF endpoint for wdqs services

Change #1237142 merged by Ryan Kemper:

[operations/puppet@production] feat(WDQS)!: disable LDF endpoint

https://gerrit.wikimedia.org/r/1237142

We missed the deadline slightly, but ldf has now officially been decommissioned! We'll circle back at a later date to merge the cleanup patches; let's give it at least a day before we proceed further.

bking awarded a token.Feb 19 2026, 10:52 PM

I removed a property describing the LDF endpoint from the Wikidata item for WDQS: https://www.wikidata.org/w/index.php?title=Q20950365&diff=prev&oldid=2466100467 (feel free to revert if that isn't the right move)

Good catch, thanks @TBurmeister

Change #1237145 merged by Ryan Kemper:

[operations/puppet@production] cleanup(WDQS/traffic): cleanup backend.yaml rules for WDQS LDF endpoint

https://gerrit.wikimedia.org/r/1237145

Change #1237146 merged by Ryan Kemper:

[operations/puppet@production] cleanup(WDQS): remove monitoring for WDQS LDF endpoint

https://gerrit.wikimedia.org/r/1237146

Change #1237147 merged by Ryan Kemper:

[operations/puppet@production] cleanup(WDQS): remove WDQS LDF endpoint from cfssl configuration

https://gerrit.wikimedia.org/r/1237147

Change #1237148 merged by Ryan Kemper:

[operations/puppet@production] cleanup(WDQS): remove all remaining references to the WDQS LDF endpoint.

https://gerrit.wikimedia.org/r/1237148

Merging in all the cleanup patches now. I'll let puppet auto-run across next 30 mins, so if there's any issues with these patches they'll surface by then

Maintenance_bot removed a project: Patch-For-Review.Feb 23 2026, 11:30 PM

Gehel moved this task from Blocked/Waiting to In Progress on the Data-Platform-SRE (2026-02-13 - 2026-03-06) board.Feb 24 2026, 7:44 PM

BTracy-WMF mentioned this in T264405: Determine how to provide a way of separating linked data fragments from WDQS.Feb 24 2026, 7:51 PM

BTracy-WMF mentioned this in T256948: Evaluate using LinkedDataFragments/Server.js instead of custom blazegraph integration.

BTracy-WMF mentioned this in T161240: Expose wikidata query service LDF endpoint in a scalable and available way.

BTracy-WMF mentioned this in T195332: Allow alternative pagination options for LDF endpoint.Feb 24 2026, 7:57 PM