Page MenuHomePhabricator

[Epic] Evaluate alternatives to Blazegraph
Open, MediumPublic

Description

Since Blazegraph project seems to not be active anymore (last commit 2 years ago at https://github.com/blazegraph/database) we need to evaluate if we want to switch to graph DB project that is more actively supported/developed.

The requirements should be:

  • Full SPARQL 1.1 support, including SPARQL Update
  • Open source
  • Can load and run queries on full Wikidata database

Event Timeline

Smalyshev created this task.Oct 9 2018, 6:27 PM
Restricted Application added a project: Wikidata. · View Herald TranscriptOct 9 2018, 6:27 PM
Restricted Application added a subscriber: Aklapper. · View Herald Transcript

I would clarify the requirements to “SPARQL support, including SPARQL Update”. For example, Sage boasts stable response times and general responsiveness, which would be useful for us, but its backing store is HDT, a read-only RDF serialization format: since HDT files cannot be efficiently updated, Sage is read-only, so we can’t use it for a live-updating query service.

Smalyshev updated the task description. (Show Details)Oct 10 2018, 3:29 PM
Smalyshev triaged this task as Medium priority.Oct 17 2018, 4:25 PM
Gehel added a subscriber: Gehel.Oct 19 2018, 1:42 PM

A few wishes I have from an operations point of view for any replacement. Those are not necessarily mandatory, but we should evaluate them at some point:

  • ability to scale both read and write load across multiple nodes
  • ability to limit resource consumption to fail gracefully