Toolforge Tool Name: wikiscan (u12903, not tool)
Type and amount of quota increase requested: 15
Wikiscan is a very big site, it compute statistics for all 900+ Wikimedia wikis, providing :
*Instant detailed statistics for user, even if they total several millions edits (example 3.5M user, 68M bot).
*Global table for all users with lot of statistics https://en.wikiscan.org/users
*Most actives pages and users for last 24h https://en.wikiscan.org/hours
*Same stats for all days and months since the wiki was created https://en.wikiscan.org/calendar
*Global metrics https://en.wikiscan.org/
To achieve this, it needs to constantly refresh new data from replicas. I have made several optimizations to remove long queries on replicas, updates are much more smoother now. I log every query to follow their execution time, the longest query since 2020-05-02 took 810 seconds, only 305 queries was above 5 mins, most queries are very fast (99% are below 1 min).
Current refresh rates :
Very large wiki (en, wikidata, commons): 6h for last 24h/days, 12 hours for users.
Big wiki (de, en...): 1h for last 24h/days, 3 hours for users.
Others: 1h for last 24h/days, 2 hours for users.
There is also other slower update processes and an integrated tool to query blocks by range for frwiki.
I would like to have more connections to refresh statistics faster, I think 15 would be enough, it won't always use all of them but it will helps to handle some peaks, thanks.