Page MenuHomePhabricator

Switch Quarry to use *.analytics.db.svc.eqiad.wmflabs as replica database host
Closed, ResolvedPublic

Description

Quarry is a non-trivial user of the Wiki Replica databases and a place where a growing number of users run analytics queries which can consume a large amount of database resources. Now that the new Wiki Replica servers are on-line and ready for full use Quarry's configuration should be changed to use them.

As mentioned in the WMCS blog post, the new servers are lacking some curated data such as the u2041__ores_p database, but this will only impact a small number of users and will eventually be resolved by T173511. Switching Quarry sooner rather than later will benefit Quarry users by giving them access to the larger, faster servers. It will also remove load from the existing servers which could die at any time.

Event Timeline

bd808 created this task.Sep 26 2017, 1:19 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptSep 26 2017, 1:19 AM

I donno is the config.yaml is puppetized somewhere (probably not), but this change should do the switch:

$ sed 's/enwiki.labsdb/enwiki.analytics.db.svc.eqiad.wmflabs/' /srv/quarry/quarry/config.yaml | diff /srv/quarry/quarry/config.yaml -
15c15
< REPLICA_HOST: 'enwiki.labsdb'
---
> REPLICA_HOST: 'enwiki.analytics.db.svc.eqiad.wmflabs'

Mentioned in SAL (#wikimedia-cloud) [2017-09-26T03:59:47Z] <zhuyifei1999_> Switching REPLICA_HOST from 'enwiki.labsdb' to 'enwiki.analytics.db.svc.eqiad.wmflabs' T176694 (Executing sudo -- sudo -u quarry sed -i 's/enwiki.labsdb/enwiki.analytics.db.svc.eqiad.wmflabs/' /srv/quarry/quarry/config.yaml on all hosts)

Mentioned in SAL (#wikimedia-cloud) [2017-09-26T04:08:48Z] <zhuyifei1999_> Restarting service 'uwsgi-quarry-web' on quarry-main-01, 'celery-quarry-worker' on quarry-runner-01 & quarry-runner-02 T176694

zhuyifei1999 closed this task as Resolved.Sep 26 2017, 4:10 AM
zhuyifei1999 claimed this task.

LGTM