These machines: T131368
Description
Description
Details
Details
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | Dzahn | T123525 reduce amount of remaining Ubuntu 12.04 (precise) systems in production | |||
| Resolved | jcrespo | T125028 reimage or decom db servers on precise | |||
| Open | None | T119626 Eliminate SPOF at the main database infrastructure | |||
| Resolved | jcrespo | T111992 Physical location SPOF because of database server distribution on a single rack (D1) | |||
| Resolved | jcrespo | T120513 Apply recentchanges special partitioning to a redundant slave at least on s1, s4, and s5 | |||
| Resolved | jcrespo | T135100 High replication lag to dewiki | |||
| Resolved | jcrespo | T133398 Install, configure and provision recently arrived db core machines | |||
| Resolved | • Cmjohnson | T135253 Rack and set up 16 db's db1079-1094 |
Event Timeline
There are a very large number of changes, so older changes are hidden. Show Older Changes
Comment Actions
Prioritize db1058's replacement, which its lack is causing replication issues on T135100.
This is still block by DC work.
Comment Actions
Although looking at the graphs, not only the current capacity is lower, there was also an unusualy high amount of INSERT and UPDATES.
Comment Actions
@jcrespo If it's not a secret, maybe you can list the machines here? The task from the description is not visible ;)
Comment Actions
@Luke081515 don't worry, you will be able to see the list when we start working on this ticket. That other ticket is hidden only because it is procurement (contains private communications with 3rd parties).
I just need to plan things myself- it is (hopefuly) 16 new servers, for a (total) of 3 new per shard.
Comment Actions
OS installed and initial puppetization/salt of:
db1079
db1080
db1081
db1083
db1084
db1087
db1088
db1090
db1091
db1092
db1093
Aside from the other hosts, they still require proper shard puppetization and provisioning.
Comment Actions
Change 292197 had a related patch set uploaded (by Volans):
MariaDB: Add new coredb servers
Comment Actions
@Volans, while I appreciate the patch, I cannot use it as-is, as many machines have not yet been properly installed due to network/config issues.
I will of course use your plan and the patch iself as the basis of several, smaller patches, though. Thank you!
Comment Actions
This is the last updated list:
db1079
db1080
db1081
db1083
db1084
db1087
db1088
db1089
db1090
db1091
db1092
db1093
db1094
Comment Actions
Change 292380 had a related patch set uploaded (by Jcrespo):
Puppetize new shard s1 db servers
Comment Actions
Change 292545 had a related patch set uploaded (by Jcrespo):
Add extra new core database server to s2 shard
Comment Actions
Change 292546 had a related patch set uploaded (by Jcrespo):
Add 3 new s4 shard core db servers
Comment Actions
Change 292562 had a related patch set uploaded (by Jcrespo):
Add new s5 database core servers
Comment Actions
Change 292564 had a related patch set uploaded (by Jcrespo):
Add new s6 core database servers
Comment Actions
Change 293069 had a related patch set uploaded (by Jcrespo):
Depool db1070 for cloning
Comment Actions
Change 293082 had a related patch set uploaded (by Jcrespo):
Add new coredb servers to alias configuration
Comment Actions
Change 293085 had a related patch set uploaded (by Jcrespo):
Pool new db hosts: db1082, db1087, db1092 with low weight
Comment Actions
Change 293085 merged by Jcrespo:
Pool new db hosts: db1082, db1087, db1092 with low weight
Comment Actions
Mentioned in SAL [2016-06-07T13:49:58Z] <jynus> about to pool new dewiki/wikidata servers T133398
Comment Actions
Change 294029 had a related patch set uploaded (by Jcrespo):
Increase weight of new s5 database servers
Comment Actions
Change 294035 had a related patch set uploaded (by Jcrespo):
Depool db1052 for cloning
Comment Actions
Change 294253 had a related patch set uploaded (by Jcrespo):
Pool new s1 servers db1080, db1083, db1089
Comment Actions
Change 294265 had a related patch set uploaded (by Jcrespo):
Depool db1040 for cloning
Comment Actions
Change 294295 had a related patch set uploaded (by Jcrespo):
Repool db1024, pool for the first time db1090 with low weight
Comment Actions
Change 294295 merged by Jcrespo:
Repool db1024, pool for the first time db1090 with low weight
Comment Actions
Change 294329 had a related patch set uploaded (by Jcrespo):
Repool db1040, pool for the first time db1081, db1084, db1091
Comment Actions
Change 294329 merged by Jcrespo:
Repool db1040, pool for the first time db1081, db1084, db1091
Comment Actions
Change 294439 had a related patch set uploaded (by Jcrespo):
Depool db1033 for cloning
Comment Actions
Change 294459 had a related patch set uploaded (by Jcrespo):
Repool db1033, first pool of db1079, db1086, db1094 with low weight
Comment Actions
Change 294459 merged by Jcrespo:
Repool db1033, first pool of db1079, db1086, db1094 with low weight
Comment Actions
Change 294470 had a related patch set uploaded (by Jcrespo):
Increase new enwiki dbs weight, depool db1023 for cloning
Comment Actions
Change 294470 merged by Jcrespo:
Increase new enwiki dbs weight, depool db1023 for cloning
Comment Actions
Change 294502 had a related patch set uploaded (by Jcrespo):
Repool db1023; pool db1085 (disabled), db1088, db1092 w/low weight
Comment Actions
Change 294502 merged by Jcrespo:
Repool db1023; pool db1085 (disabled), db1088, db1092 w/low weight
Comment Actions
Change 294672 had a related patch set uploaded (by Jcrespo):
Pool db1085, increase weight of all new db servers
Comment Actions
All 16 new servers (21 in total, 3 per shard) are pooled into production- we will do some adjustments over the following weeks of the weights, but that is something in constant change anyway.