Page MenuHomePhabricator

Make a page of database usage tips
Open, LowPublic


We get a lot of questions on irc and labs-l about how to work around the long running query time limits. The question generally goes something like "I've been running this query on (random) wiki for days/weeks/months/years with no problem, but when I try to run it on enwiki it times out! What can I do?"

The answer is "make it run faster" but that's just the snarky start. The real answer is a) look for a way to optimize your query by using indexes and b) partition your query so that you run it N times looking a M rows instead of trying to get all the results at once.

We should have an easy to find and helpful page on wikitech that explains these high level concepts and then provides step by step examples to help people understand how to use the two techniques.

Event Timeline

bd808 created this task.May 11 2017, 1:14 AM

See also my comments at T149624#2922174 (which I won't copy in full, only because I'm not sure how useful/accurate they are!)

Qgil removed a subscriber: Qgil.May 12 2017, 11:36 AM
bd808 moved this task from Triage to Database on the Cloud-Services board.Jun 8 2017, 4:29 AM
Reedy moved this task from Backlog to Cloud Services on the Documentation board.Jun 12 2017, 8:54 PM
srodlund claimed this task.Aug 28 2018, 8:21 PM
srodlund moved this task from Complete Update to New Documentation on the User-srodlund board.