Given a wiki and a date interval, produce an SPAQRL update statement which contains all updates to categories and memberships relevant to RDF representation, between those dates.
|mediawiki/core : master||Create update SPARQL for category changes|
Another reality check: current dumping script dumps changes for one day from enwiki in 6.5s. This performance seems to be acceptable, even if we run it for all wikis - commons might take more but even if it takes 10x it looks ok.
What are the reasons that we keep it weekly for now?
We only have weekly dump, we need to either implement daily diffs from this patch or daily dumps. I'll check to see whether daily dumps are feasible.
Is there a big downside to daily updates?
It needs daily dumps/diffs implemented :) Which means one more dump process (with accompanying data) and one more process to load them. Nothing that we can't do, just wanted to ensure we need it before we invest the time, since we've been running with weeklies for a while and nobody complained so far :)