We need to run tests in a VPS before shipping them into production.
Description
Description
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | • Addshore | T208425 [EPIC] Kill the wb_terms table | |||
| Resolved | ArielGlenn | T226167 audit public tables and make sure we dump them all | |||
| Resolved | • Addshore | T219175 [Mega] - Migrate data from wb_terms to new schema | |||
| Resolved | • Addshore | T219121 [Checkpoint 2] Refactor Write & Migration code for Properties | |||
| Resolved | Ladsgroup | T221615 Make a test instance in cloud VPS to test new term store |
Event Timeline
Comment Actions
- Node: wikidata-new-wbterm.eqiad.wmflabs
- Public interface: https://wikidata-termstore.wmflabs.org/index.php/Item:Q112
Comment Actions
Running scripts on it to explode it:
root@wikidata-new-wbterm:/var/lib/mysql/termwiki# ls -Ssh | head total 485M 165M wb_terms.ibd 41M job.ibd 33M text.ibd 31M logging.ibd 27M recentchanges.ibd 27M wb_changes.ibd 20M revision.ibd 19M objectcache.ibd 18M page_props.ibd
Comment Actions
Some data about the node:
| name | CPUs | HDD | RAM |
| wikidata-new-wbterm | 8 | 160GB | 16GB |
Current size:
root@wikidata-new-wbterm:/var/lib/mysql/termwiki# ls -Ssh | head total 15G 9.4G wb_terms.ibd 1.3G text.ibd 535M searchindex.MYD 505M objectcache.ibd 431M searchindex.MYI 405M wb_changes.ibd 353M logging.ibd 301M recentchanges.ibd 185M revision.ibd
wb_terms number of rows:
MariaDB [termwiki]> select count(*) from wb_terms; +----------+ | count(*) | +----------+ | 16599826 | +----------+ 1 row in set (4.96 sec)
The data is roughly 1% of production but in matter of reads it's nothing compared to prod so I still would be careful.
Comment Actions
I started putting together some documentation for the instance at https://wikitech.wikimedia.org/wiki/Nova_Resource:Wikidata-dev/wikidata-new-wbterm, feel free to expand.