wdqs-common: Upgrade Sesame 2.8.11 to rdf4j >= 5.3
Open, In Progress, Needs TriagePublic
Actions

Assigned To

Authored By

	trueg
	Jun 26 2026, 2:04 PM

Project Tags

Referenced Files

None

Subscribers

Aklapper

trueg

Description

The version of Sesame used for all things RDF in wdqs-common (and, by extension the producer, the consumer, and the data processing tools) is very old and unsupported. Sesame has since been renamed to rdf4j.
In T430312 it was necessary to already port the JSON SPARQL parsing to rdf4j. Now the rest shouls follow.

AC:

wdqs-common is fully ported to rdf4j and does not depend on any Sesame components anymore
wdqs-streaming-consumer uses the latest version of wdqs-common without Sesame
wdqs-streaming-producer uses the latest version of wdqs-common without Sesame
wdqs-data-processing uses the latest version of wdqs-common without Sesame

Details

Related Changes in Gerrit:

	Subject	Author	Repo	Branch	Lines +/-
	Bump wdqs-streaming-consumer version to 0.3.1 on wdqs-next main eqiad	Trueg	operations/deployment-charts	master	+3 -0

Customize query in gerrit

Related Changes in GitLab:

	Title	Reference	Author	Source Branch	Dest Branch
	Upgrade from OpenRDF/Sesame 2.8.x to RDF4j 5.3.2	repos/wikidata-platform/wdqs/wdqs-common!10	trueg	rdf4jPort	main

Customize query in GitLab

Related Objects

Mentioned Here: T430312: wdqs-streaming-consumer: fails to parse Qlever Json result

Event Timeline

trueg created this task.Jun 26 2026, 2:04 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJun 26 2026, 2:04 PM

trueg changed the task status from Open to In Progress.Wed, Sep 9, 10:24 AM

trueg claimed this task.

trueg edited projects, added: Wikidata Platform Team (Sprint 08 (2026/08/04)); removed: Wikidata Platform Team.

trueg moved this task from Backlog to In Engineering on the Wikidata Platform Team (Sprint 08 (2026/08/04)) board.

trueg opened https://gitlab.wikimedia.org/repos/wikidata-platform/wdqs/wdqs-common/-/merge_requests/10

Upgrade from OpenRDF/Sesame 2.8.x to RDF4j 5.3.2

trueg opened https://gitlab.wikimedia.org/repos/wikidata-platform/wdqs/wdqs-streaming-consumer/-/merge_requests/24

Upgrade from OpenRDF/Sesame 2.8.x to RDF4j 5.3.2

trueg opened https://gitlab.wikimedia.org/repos/wikidata-platform/wdqs/wdqs-streaming-producer/-/merge_requests/4

Upgrade from OpenRDF/Sesame 2.8.x to RDF4j 5.3.2

trueg opened https://gitlab.wikimedia.org/repos/wikidata-platform/wdqs/wdqs-data-processing/-/merge_requests/6

Upgrade from OpenRDF/Sesame 2.8.x to RDF4j 5.3.2

trueg moved this task from In Engineering to In Code Review on the Wikidata Platform Team (Sprint 08 (2026/08/04)) board.Fri, Sep 11, 9:17 AM

trueg moved this task from Sprint 08 (2026/08/04) to Sprint 09 (2026/09/08) on the Wikidata Platform Team board.Fri, Sep 11, 11:04 AM

trueg edited projects, added: Wikidata Platform Team (Sprint 09 (2026/09/08)); removed: Wikidata Platform Team (Sprint 08 (2026/08/04)).

trueg moved this task from Backlog to In Code Review on the Wikidata Platform Team (Sprint 09 (2026/09/08)) board.

Upgrading from OpenRDF 2.8.x to RDF4j 4.5.x is mostly trivial. For the most part, the two are code-compatible. The only notable changes are:

Instead of manually creating a ValueFactory in order to construct different node/resource instances, we now make use of the static litereal(), iri(), bnode() functions. The only real difference is, that these include syntax checks, which the original ValueFactory did not. Thus, in some cases, we need to fall back to a SimpleValueFactory (mostly tests) which does not validate syntax.
URI is now IRI, but that's about it
Literal::getLanguage() now returns an Optional rather than a String or null. This required changes to several null checks which are not valid anymore.