Maniphest T414845

Publication of WDQS full graph endpoint (wdqs2009) Blazegraph journal file
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	gmodena
	Jan 16 2026, 9:23 PM

Tags

Referenced Files

None

Subscribers

Description

After T411410: Decommission WDQS full graph endpoint (wdqs2009) we will publish a copy of the journal file to clouddumps hosts.

See this thread (internal slack) for details.

The journal meets criteria for "low risk" dataset. As due diligence, back in december, I filled in the WMF Record of Data Publication according to the Data Publication Guidelines.

We will need to split the file into 130 x 10GBs chunks. The journal can be used to build self-hosted instances of Wikidata Query Service,
and will be available until March 2026.

The files will be uploaded after WDQS is turned off and no database writes are in flight. We will not need to take a snaphot of the host lvm volume.

AC:

Blazegraph journal file is available (chunked) at https://dumps.wikimedia.org.

Related Objects

Mentioned Here: T411410: Decommission WDQS full graph endpoint (wdqs2009)

Event Timeline

gmodena created this task.Jan 16 2026, 9:23 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJan 16 2026, 9:23 PM

gmodena added a subscriber: BTracy-WMF.Jan 16 2026, 9:24 PM

bking subscribed.Jan 16 2026, 9:25 PM

Maintenance_bot added a project: Wikidata.Jan 16 2026, 9:29 PM

gmodena claimed this task.Tue, Jan 20, 8:42 AM

gmodena edited projects, added Wikidata-Query-Service (Current Sprint); removed Wikidata-Query-Service.Tue, Jan 20, 9:46 AM

gmodena moved this task from Backlog to In Engineering on the Wikidata-Query-Service (Current Sprint) board.Tue, Jan 20, 3:27 PM

Done in https://phabricator.wikimedia.org/T411410#11541079

gmodena updated the task description. (Show Details)Wed, Jan 21, 1:02 PM

Gehel moved this task from Incoming to Scratch on the Data-Platform-SRE board.Thu, Jan 22, 2:30 PM

Gehel edited projects, added Data-Platform-SRE (2026.01.05 - 2026.01.23); removed Data-Platform-SRE.

Gehel moved this task from Backlog - project to Backlog - operations on the Data-Platform-SRE (2026.01.05 - 2026.01.23) board.

Gehel moved this task from Backlog - operations to Needs Review on the Data-Platform-SRE (2026.01.05 - 2026.01.23) board.

Gehel edited projects, added Data-Platform-SRE (2026.01.23 - 2026.02.13); removed Data-Platform-SRE (2026.01.05 - 2026.01.23).Fri, Jan 23, 10:03 AM

Gehel moved this task from Backlog - project to Needs Review on the Data-Platform-SRE (2026.01.23 - 2026.02.13) board.

Gehel closed this task as Resolved.Wed, Feb 4, 9:12 AM

Gehel moved this task from Needs Review to Done on the Data-Platform-SRE (2026.01.23 - 2026.02.13) board.

Gehel moved this task from Done to Reported on the Data-Platform-SRE (2026.01.23 - 2026.02.13) board.Fri, Feb 6, 8:29 AM