Page MenuHomePhabricator

Prepare and check storage layer for banwiki
Closed, ResolvedPublic

Description

As part of the new wiki creation process and as per our instructions, please be advised:

  • Project: Wikipedia.
  • Type: Public wiki.

Event Timeline

jhsoby created this task.Sun, Oct 6, 9:45 PM
Marostegui added a subscriber: Marostegui.

Let us know when the database is created so we can sanitize it on labs hosts

Let us know when the database is created so we can sanitize it on labs hosts

Done now \o/

Mentioned in SAL (#wikimedia-operations) [2019-10-14T13:10:53Z] <marostegui> Sanitize banwiki on db1124:3313 and db2094:3313 T234770

I have sanitized this wiki, but before adding the grants and creating the _p database I am running a check to make sure all the information is sanitized.
The triggers seem to be working as expected, as my user was sanitized correctly.

Marostegui removed Marostegui as the assignee of this task.Tue, Oct 15, 5:44 AM
Marostegui moved this task from In progress to Done on the DBA board.
Marostegui added subscribers: bd808, Bstorm, JHedden.

db1124, db2094, labsdb1009, labsdb1010, labsdb1011, labsdb1012 are clean.
I have created the database on all the hosts:

banwiki_p

Same for the the grant:

root@labsdb1012.eqiad.wmnet[(none)]> nopager;
PAGER set to stdout
root@labsdb1012.eqiad.wmnet[(none)]> pager grep banwiki
PAGER set to 'grep banwiki'
root@labsdb1012.eqiad.wmnet[(none)]> show grants for labsdbuser;
| GRANT SELECT, SHOW VIEW ON `banwiki\_p`.* TO 'labsdbuser'                |
909 rows in set (0.00 sec)

cloud-services-team please create the views for this wiki on labsdb1009, labsdb1010, labsdb1011, labsdb1012

JHedden claimed this task.Tue, Oct 15, 1:28 PM

Mentioned in SAL (#wikimedia-cloud) [2019-10-15T13:30:50Z] <jeh> creating indexes and views for banwiki T234770

JHedden closed this task as Resolved.Tue, Oct 15, 1:53 PM
Updates on labsdb10{09,10,11,12}
$ sudo /usr/local/sbin/maintain-replica-indexes --database banwiki --debug
$ sudo /usr/local/sbin/maintain-views --databases banwiki --debug
$ sudo /usr/local/sbin/maintain-meta_p --databases banwiki 
Updates on cloudcontrol1003
$ sudo su -
$ source /root/novaenv.sh
$ /usr/local/sbin/wmcs-wikireplica-dns --aliases
2019-10-15T13:35:33Z mwopenstackclients.DnsManager WARNING : Creating banwiki.analytics.db.svc.eqiad.wmflabs.
2019-10-15T13:40:32Z mwopenstackclients.DnsManager WARNING : Creating banwiki.web.db.svc.eqiad.wmflabs.
Testing from Toolforge
$ sql banwiki
banwiki.analytics.db.svc.eqiad.wmflabs) [banwiki_p]> select * from page limit 1\G;
*************************** 1. row ***************************
           page_id: 1
    page_namespace: 0
        page_title: Kaca_Utama
 page_restrictions:
  page_is_redirect: 0
       page_is_new: 0
       page_random: 0.831901488633
      page_touched: 20191015091019
page_links_updated: 20191015091144
       page_latest: 28041
          page_len: 2965
page_content_model: wikitext
         page_lang: NULL
1 row in set (0.01 sec)
$ sql --cluster=web banwiki
banwiki.web.db.svc.eqiad.wmflabs) [banwiki_p]> select * from page limit 1\G;
*************************** 1. row ***************************
           page_id: 1
    page_namespace: 0
        page_title: Kaca_Utama
 page_restrictions:
  page_is_redirect: 0
       page_is_new: 0
       page_random: 0.831901488633
      page_touched: 20191015091019
page_links_updated: 20191015091144
       page_latest: 28041
          page_len: 2965
page_content_model: wikitext
         page_lang: NULL
1 row in set (0.00 sec)
$ sql meta
s7.analytics.db.svc.eqiad.wmflabs) [meta_p]> select * from wiki where dbname = 'banwiki'\G
*************************** 1. row ***************************
          dbname: banwiki
            lang: ban
            name: Wikipédia
          family: wikipedia
             url: https://ban.wikipedia.org
            size: 1
           slice: s3.labsdb
       is_closed: 0
        has_echo: 1
 has_flaggedrevs: 0
has_visualeditor: 1
    has_wikidata: 1
    is_sensitive: 0
1 row in set (0.01 sec)