Page MenuHomePhabricator
Create Task
Maniphest T162807

Run pt-table-checksum on s1 (enwiki)
Closed, ResolvedPublic
Actions

Description

Run pt-table-checksum on s1 - enwiki.
The following tables do not have a PK and thus need to be excluded:

arbcom1_vote
categorylinks
click_tracking
click_tracking_user_properties
cur
edit_page_tracking
ep_users_per_course
exarchive
flaggedrevs_tracking
gather_list_flag
gather_list_item
hidden
imagelinks
interwiki
iwlinks
l10n_cache
langlinks
linkscc
localisation_file_hash
log_search
long_run_profiling
math
module_deps
msg_resource
msg_resource_links
objectcache
old_growth
oldimage
pagelinks
pagetriage_page_tags
prefstats
prefswitch_survey
profiling
querycache
querycache_info
querycachetwo
securepoll_lists
securepoll_msgs
securepoll_properties
site_identifiers
site_stats
templatelinks
text
transcache
user_former_groups
user_newtalk
user_properties
vote_log

The __wmf_checksums is placed on:

enwiki.__wmf_checksums

Details

ProjectBranchLines +/-Subject
operations/mediawiki-configmaster+1 -1db-eqiad.php: Repool db1067
operations/mediawiki-configmaster+2 -2db-codfw.php: Depool db2069
operations/mediawiki-configmaster+2 -2db-codfw.php: Depool db2062
operations/mediawiki-configmaster+2 -2db-eqiad.php: Depool db1083, fully repool db1089
operations/mediawiki-configmaster+2 -2db-eqiad.php: Slowly repool db1089, depool db1067
operations/mediawiki-configmaster+6 -6db-eqiad.php: Repool db1105:3311
operations/mediawiki-configmaster+7 -7db-eqiad.php: Depool db1089 and db1105:3311
operations/mediawiki-configmaster+6 -6db-eqiad.php: Depool db1099:3311
operations/mediawiki-configmaster+3 -3db-eqiad.php: Depool db1089,db1066
operations/mediawiki-configmaster+1 -1db-eqiad.php: Depool db1067
operations/mediawiki-configmaster+4 -4db-eqiad.php: Depool db1065
operations/mediawiki-configmaster+6 -6db-eqiad.php: Repool db1099:3311
operations/mediawiki-configmaster+7 -7db-eqiad.php: Depool db1089, db1099:3311
operations/mediawiki-configmaster+1 -1db-eqiad.php: Depool db1089
operations/mediawiki-configmaster+6 -6db-eqiad.php: Depool db1105:3311
operations/mediawiki-configmaster+3 -3db-eqiad.php: Depool db1066
operations/mediawiki-configmaster+1 -1db-eqiad.php: Depool db1067
operations/mediawiki-configmaster+1 -1db-eqiad.php: Repool db1067
operations/mediawiki-configmaster+1 -1db-eqiad.php: Repool db1089
operations/mediawiki-configmaster+2 -2db-eqiad.php: Depool db1089 and db1067
operations/mediawiki-configmaster+1 -1db-eqiad.php: Slowly repool db1080
operations/mediawiki-configmaster+2 -2db-eqiad.php: Depool db1080
operations/mediawiki-configmaster+1 -1db-eqiad.php: Repool db1073 with low weight
operations/mediawiki-configmaster+2 -2db-eqiad.php: Depool db1073
operations/mediawiki-configmaster+1 -1db-eqiad.php: Depool db1089
operations/mediawiki-configmaster+1 -1db-eqiad.php: Depool db1067
operations/mediawiki-configmaster+4 -4db-eqiad.php: Depool db1065
operations/mediawiki-configmaster+1 -1db-eqiad.php: Repool db1089
operations/mediawiki-configmaster+1 -1db-eqiad.php: Depool db1089
operations/mediawiki-configmaster+6 -6db-eqiad.php: Depool db1105:3311
operations/mediawiki-configmaster+6 -6db-eqiad.php: Repool db1099:3311
operations/mediawiki-configmaster+8 -8db-eqiad.php: Repool db1066, depool db1099:3311
operations/mediawiki-configmaster+3 -3db-eqiad.php: Repool db1067, depool db1067
operations/mediawiki-configmaster+2 -2db-eqiad.php: Depool db1089 and db1067
operations/mediawiki-configmaster+4 -4db-eqiad.php: Depool db1065
operations/mediawiki-configmaster+6 -6db-eqiad.php: Depool db1105:3311
operations/mediawiki-configmaster+6 -6db-eqiad.php: Depool db1099:3311
operations/mediawiki-configmaster+2 -2db-eqiad.php Depool db1066
operations/mediawiki-configmaster+1 -1db-eqiad.php: Depool db1067
operations/mediawiki-configmaster+4 -4db-eqiad.php: Depool db1065, pool db1067 for vslow
operations/mediawiki-configmaster+6 -6db-eqiad.php: Depool db1105:3311
operations/mediawiki-configmaster+6 -6db-eqiad.php: Repool db1099:3311
operations/mediawiki-configmaster+8 -8db-eqiad.php: Repool db1066, depool db1099:3311
operations/mediawiki-configmaster+3 -3db-eqiad.php: Depool db1066 and db1089
operations/mediawiki-configmaster+2 -2db-eqiad.php: Depool db1089 and db1067
operations/mediawiki-configmaster+4 -4db-eqiad.php: Depool db1065
operations/mediawiki-configmaster+1 -1db-eqiad.php: Depool db1089
operations/mediawiki-configmaster+12 -12db-eqiad.php: Depool db1105:3311,db1105:3312
operations/mediawiki-configmaster+7 -7db-eqiad.php: db1067,db1066,db1099:331{1,8}
operations/mediawiki-configmaster+12 -12db-eqiad.php: Depool db1099 s1 and s8
operations/mediawiki-configmaster+2 -2db-eqiad.php: Depool db1067,db1089
operations/mediawiki-configmaster+2 -2db-eqiad.php: Depool db1067, db1089
Show related patches Customize query in gerrit

Related Objects
Search...

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
Stashbot added a comment.Feb 9 2018, 7:50 AM

Mentioned in SAL (#wikimedia-operations) [2018-02-09T07:50:57Z] <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Slowly repool db1080 - T162807 (duration: 01m 11s)

Stashbot added a comment.Feb 9 2018, 9:06 AM

Mentioned in SAL (#wikimedia-operations) [2018-02-09T09:06:00Z] <marostegui> Fix data drifts on db1067 - T162807

Stashbot added a comment.Feb 9 2018, 9:37 AM

Mentioned in SAL (#wikimedia-operations) [2018-02-09T09:37:56Z] <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase traffic for db1080 - T162807 (duration: 01m 11s)

Stashbot added a comment.Feb 9 2018, 10:02 AM

Mentioned in SAL (#wikimedia-operations) [2018-02-09T10:02:35Z] <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase traffic for db1080 - T162807 (duration: 01m 12s)

Stashbot added a comment.Feb 9 2018, 10:29 AM

Mentioned in SAL (#wikimedia-operations) [2018-02-09T10:29:43Z] <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Fully repool db1080 - T162807 (duration: 01m 11s)

gerritbot added a comment.Feb 9 2018, 10:42 AM

Change 409307 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/mediawiki-config@master] db-eqiad.php: Depool db1089 and db1067

https://gerrit.wikimedia.org/r/409307

gerritbot added a comment.Feb 9 2018, 10:47 AM

Change 409307 merged by jenkins-bot:
[operations/mediawiki-config@master] db-eqiad.php: Depool db1089 and db1067

https://gerrit.wikimedia.org/r/409307

Stashbot added a comment.Feb 9 2018, 10:50 AM

Mentioned in SAL (#wikimedia-operations) [2018-02-09T10:50:18Z] <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1089 and db1067 for data checksumming - T162807 (duration: 01m 11s)

Stashbot added a comment.Feb 9 2018, 10:51 AM

Mentioned in SAL (#wikimedia-operations) [2018-02-09T10:51:21Z] <marostegui> Stop replication in sync on db1067 and db1089 - T162807

gerritbot added a comment.Feb 9 2018, 1:28 PM

Change 409325 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/mediawiki-config@master] db-eqiad.php: Repool db1089

https://gerrit.wikimedia.org/r/409325

gerritbot added a comment.Feb 9 2018, 1:31 PM

Change 409325 merged by jenkins-bot:
[operations/mediawiki-config@master] db-eqiad.php: Repool db1089

https://gerrit.wikimedia.org/r/409325

Stashbot added a comment.Feb 9 2018, 1:33 PM

Mentioned in SAL (#wikimedia-operations) [2018-02-09T13:33:27Z] <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1089 - T162807 (duration: 01m 12s)

gerritbot added a comment.Feb 9 2018, 4:20 PM

Change 409366 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/mediawiki-config@master] db-eqiad.php: Repool db1067

https://gerrit.wikimedia.org/r/409366

gerritbot added a comment.Feb 9 2018, 4:34 PM

Change 409366 merged by jenkins-bot:
[operations/mediawiki-config@master] db-eqiad.php: Repool db1067

https://gerrit.wikimedia.org/r/409366

Stashbot added a comment.Feb 9 2018, 4:38 PM

Mentioned in SAL (#wikimedia-operations) [2018-02-09T16:38:29Z] <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1067 - T162807 (duration: 01m 12s)

gerritbot added a comment.Feb 12 2018, 8:58 AM

Change 409815 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/mediawiki-config@master] db-eqiad.php: Depool db1089

https://gerrit.wikimedia.org/r/409815

gerritbot added a comment.Feb 12 2018, 9:04 AM

Change 409815 merged by jenkins-bot:
[operations/mediawiki-config@master] db-eqiad.php: Depool db1089

https://gerrit.wikimedia.org/r/409815

Stashbot added a comment.Feb 12 2018, 9:05 AM

Mentioned in SAL (#wikimedia-operations) [2018-02-12T09:05:28Z] <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1089 - T162807 (duration: 00m 55s)

Stashbot added a comment.Feb 12 2018, 9:05 AM

Mentioned in SAL (#wikimedia-operations) [2018-02-12T09:05:41Z] <marostegui> Stop replication in sync on db1089 and db2048 - T162807

gerritbot added a comment.Feb 12 2018, 9:41 AM

Change 409824 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/mediawiki-config@master] db-eqiad.php: Depool db1067

https://gerrit.wikimedia.org/r/409824

gerritbot added a comment.Feb 12 2018, 9:45 AM

Change 409824 merged by jenkins-bot:
[operations/mediawiki-config@master] db-eqiad.php: Depool db1067

https://gerrit.wikimedia.org/r/409824

Stashbot added a comment.Feb 12 2018, 9:46 AM

Mentioned in SAL (#wikimedia-operations) [2018-02-12T09:46:24Z] <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1067 - T162807 (duration: 00m 56s)

Stashbot added a comment.Feb 12 2018, 9:46 AM

Mentioned in SAL (#wikimedia-operations) [2018-02-12T09:46:38Z] <marostegui> Stop replication in sync on db1089 and db1067 - T162807

Stashbot added a comment.Feb 12 2018, 9:57 AM

Mentioned in SAL (#wikimedia-operations) [2018-02-12T09:57:38Z] <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1067 - T162807 (duration: 00m 55s)

gerritbot added a comment.Feb 12 2018, 10:00 AM

Change 409828 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/mediawiki-config@master] db-eqiad.php: Depool db1066

https://gerrit.wikimedia.org/r/409828

gerritbot added a comment.Feb 12 2018, 10:04 AM

Change 409828 merged by jenkins-bot:
[operations/mediawiki-config@master] db-eqiad.php: Depool db1066

https://gerrit.wikimedia.org/r/409828

Stashbot added a comment.Feb 12 2018, 10:06 AM

Mentioned in SAL (#wikimedia-operations) [2018-02-12T10:06:29Z] <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1066 - T162807 (duration: 00m 55s)

Stashbot added a comment.Feb 12 2018, 10:07 AM

Mentioned in SAL (#wikimedia-operations) [2018-02-12T10:07:02Z] <marostegui> Stop replication in sync on db1089 and db1066 - T162807

Stashbot added a comment.Feb 12 2018, 10:36 AM

Mentioned in SAL (#wikimedia-operations) [2018-02-12T10:36:47Z] <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1066 - T162807 (duration: 00m 55s)

gerritbot added a comment.Feb 12 2018, 1:37 PM

Change 409880 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/mediawiki-config@master] db-eqiad.php: Depool db1105:3311

https://gerrit.wikimedia.org/r/409880

gerritbot added a comment.Feb 12 2018, 1:41 PM

Change 409880 merged by jenkins-bot:
[operations/mediawiki-config@master] db-eqiad.php: Depool db1105:3311

https://gerrit.wikimedia.org/r/409880

Stashbot added a comment.Feb 12 2018, 1:42 PM

Mentioned in SAL (#wikimedia-operations) [2018-02-12T13:42:56Z] <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1105:3311 - T162807 (duration: 01m 06s)

Stashbot added a comment.Feb 12 2018, 3:28 PM

Mentioned in SAL (#wikimedia-operations) [2018-02-12T15:28:49Z] <marostegui> Stop replication in sync on db1089 and db1105:3311 - T162807

Stashbot added a comment.Feb 12 2018, 3:35 PM

Mentioned in SAL (#wikimedia-operations) [2018-02-12T15:35:25Z] <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1105:3311 - T162807 (duration: 00m 55s)

Stashbot added a comment.Feb 12 2018, 3:43 PM

Mentioned in SAL (#wikimedia-operations) [2018-02-12T15:43:31Z] <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1089 - T162807 (duration: 00m 55s)

Marostegui added a comment.Feb 13 2018, 8:01 AM

I have finished the text table.
Next: oldimage

gerritbot added a comment.Feb 13 2018, 8:45 AM

Change 410121 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/mediawiki-config@master] db-eqiad.php: Depool db1089, db1099:3311

https://gerrit.wikimedia.org/r/410121

gerritbot added a comment.Feb 13 2018, 8:50 AM

Change 410121 merged by jenkins-bot:
[operations/mediawiki-config@master] db-eqiad.php: Depool db1089, db1099:3311

https://gerrit.wikimedia.org/r/410121

Stashbot added a comment.Feb 13 2018, 8:51 AM

Mentioned in SAL (#wikimedia-operations) [2018-02-13T08:51:55Z] <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1089, db1099 - T162807 (duration: 00m 55s)

Stashbot added a comment.Feb 13 2018, 8:52 AM

Mentioned in SAL (#wikimedia-operations) [2018-02-13T08:52:10Z] <marostegui> Stop replication in sync on db1089 and db1099:3311 - T162807

gerritbot added a comment.Feb 13 2018, 8:56 AM

Change 410123 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/mediawiki-config@master] db-eqiad.php: Repool db1099:3311

https://gerrit.wikimedia.org/r/410123

gerritbot added a comment.Feb 13 2018, 9:00 AM

Change 410123 merged by jenkins-bot:
[operations/mediawiki-config@master] db-eqiad.php: Repool db1099:3311

https://gerrit.wikimedia.org/r/410123

Stashbot added a comment.Feb 13 2018, 9:01 AM

Mentioned in SAL (#wikimedia-operations) [2018-02-13T09:01:25Z] <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1099:3311 - T162807 (duration: 00m 55s)

gerritbot added a comment.Feb 13 2018, 9:14 AM

Change 410126 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/mediawiki-config@master] db-eqiad.php: Depool db1065

https://gerrit.wikimedia.org/r/410126

gerritbot added a comment.Feb 13 2018, 9:19 AM

Change 410126 merged by jenkins-bot:
[operations/mediawiki-config@master] db-eqiad.php: Depool db1065

https://gerrit.wikimedia.org/r/410126

Stashbot added a comment.Feb 13 2018, 9:20 AM

Mentioned in SAL (#wikimedia-operations) [2018-02-13T09:20:29Z] <marostegui> Stop replication in sync on db1089 and db1065 - T162807

Stashbot added a comment.Feb 13 2018, 9:20 AM

Mentioned in SAL (#wikimedia-operations) [2018-02-13T09:20:44Z] <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1065 - T162807 (duration: 00m 55s)

Stashbot added a comment.Feb 13 2018, 9:29 AM

Mentioned in SAL (#wikimedia-operations) [2018-02-13T09:29:08Z] <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1065 - T162807 (duration: 00m 54s)

Stashbot added a comment.Feb 13 2018, 9:30 AM

Mentioned in SAL (#wikimedia-operations) [2018-02-13T09:30:10Z] <marostegui> Stop replication in sync on db1089 and dbstore1002 - T162807

gerritbot added a comment.Feb 14 2018, 6:34 AM

Change 410391 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/mediawiki-config@master] db-eqiad.php: Depool db1067

https://gerrit.wikimedia.org/r/410391

gerritbot added a comment.Feb 14 2018, 6:42 AM

Change 410391 merged by jenkins-bot:
[operations/mediawiki-config@master] db-eqiad.php: Depool db1067

https://gerrit.wikimedia.org/r/410391

Stashbot added a comment.Feb 14 2018, 6:44 AM

Mentioned in SAL (#wikimedia-operations) [2018-02-14T06:44:00Z] <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1067 - T162807 (duration: 01m 12s)

Stashbot added a comment.Feb 14 2018, 6:44 AM

Mentioned in SAL (#wikimedia-operations) [2018-02-14T06:44:13Z] <marostegui> Stop replication in sync db1089 and db1067 - T162807

Stashbot added a comment.Feb 14 2018, 10:42 AM

Mentioned in SAL (#wikimedia-operations) [2018-02-14T10:42:43Z] <marostegui> Stop replication in sync on db1089 and db1067 - T162807

Stashbot added a comment.Feb 14 2018, 4:41 PM

Mentioned in SAL (#wikimedia-operations) [2018-02-14T16:41:58Z] <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1067 - T162807 (duration: 01m 12s)

Stashbot added a comment.Feb 14 2018, 4:58 PM

Mentioned in SAL (#wikimedia-operations) [2018-02-14T16:58:59Z] <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1089 - T162807 (duration: 01m 09s)

gerritbot added a comment.Feb 15 2018, 7:48 AM

Change 410660 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/mediawiki-config@master] db-eqiad.php: Depool db1089,db1066

https://gerrit.wikimedia.org/r/410660

gerritbot added a comment.Feb 15 2018, 7:53 AM

Change 410660 merged by jenkins-bot:
[operations/mediawiki-config@master] db-eqiad.php: Depool db1089,db1066

https://gerrit.wikimedia.org/r/410660

Stashbot added a comment.Feb 15 2018, 7:55 AM

Mentioned in SAL (#wikimedia-operations) [2018-02-15T07:54:57Z] <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1089 and db1066 - T162807 (duration: 01m 12s)

Stashbot added a comment.Feb 15 2018, 7:55 AM

Mentioned in SAL (#wikimedia-operations) [2018-02-15T07:55:55Z] <marostegui> Stop replication in sync on db1089 and db1066 - T162807

Stashbot added a comment.Feb 16 2018, 6:46 AM

Mentioned in SAL (#wikimedia-operations) [2018-02-16T06:46:24Z] <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1089 and db1067 - T162807 (duration: 00m 59s)

gerritbot added a comment.Feb 16 2018, 9:46 AM

Change 411194 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/mediawiki-config@master] db-eqiad.php: Depool db1099:3311

https://gerrit.wikimedia.org/r/411194

gerritbot added a comment.Feb 16 2018, 9:52 AM

Change 411194 merged by Marostegui:
[operations/mediawiki-config@master] db-eqiad.php: Depool db1099:3311

https://gerrit.wikimedia.org/r/411194

Stashbot added a comment.Feb 16 2018, 9:56 AM

Mentioned in SAL (#wikimedia-operations) [2018-02-16T09:56:26Z] <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1099:3311 - T162807 (duration: 00m 56s)

Marostegui added a comment.Feb 16 2018, 10:07 AM

I have finished the oldimage table.
Next: revision (which is in a pretty good state, so I don't expect it to take long)

Stashbot added a comment.Feb 16 2018, 12:23 PM

Mentioned in SAL (#wikimedia-operations) [2018-02-16T12:23:35Z] <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1099:3311 - T162807 (duration: 00m 56s)

Stashbot added a comment.Feb 16 2018, 1:11 PM

Mentioned in SAL (#wikimedia-operations) [2018-02-16T13:11:56Z] <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1089 and db1067 - T162807 (duration: 00m 55s)

gerritbot added a comment.Feb 19 2018, 6:27 AM

Change 412622 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/mediawiki-config@master] db-eqiad.php: Depool db1089 and db1105:3311

https://gerrit.wikimedia.org/r/412622

gerritbot added a comment.Feb 19 2018, 6:39 AM

Change 412622 merged by jenkins-bot:
[operations/mediawiki-config@master] db-eqiad.php: Depool db1089 and db1105:3311

https://gerrit.wikimedia.org/r/412622

Stashbot added a comment.Feb 19 2018, 6:40 AM

Mentioned in SAL (#wikimedia-operations) [2018-02-19T06:40:40Z] <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1089 and db1105 - T162807 (duration: 00m 56s)

gerritbot added a comment.Feb 19 2018, 9:13 AM

Change 412655 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/mediawiki-config@master] db-eqiad.php: Repool db1105:3311

https://gerrit.wikimedia.org/r/412655

gerritbot added a comment.Feb 19 2018, 9:17 AM

Change 412655 merged by jenkins-bot:
[operations/mediawiki-config@master] db-eqiad.php: Repool db1105:3311

https://gerrit.wikimedia.org/r/412655

Stashbot added a comment.Feb 19 2018, 9:18 AM

Mentioned in SAL (#wikimedia-operations) [2018-02-19T09:18:30Z] <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1105 - T162807 (duration: 00m 55s)

Marostegui added a comment.Feb 20 2018, 1:55 PM

Revision table is done.
Next: watchlist (which is in a pretty good state, so it shouldn't take long)

Marostegui added a comment.Feb 21 2018, 12:11 PM

watchlist table is done.
Next: ores_classification

gerritbot added a comment.Feb 22 2018, 9:55 AM

Change 413329 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/mediawiki-config@master] db-eqiad.php: Slowly repool db1089, depool db1067

https://gerrit.wikimedia.org/r/413329

gerritbot added a comment.Feb 22 2018, 9:59 AM

Change 413329 merged by jenkins-bot:
[operations/mediawiki-config@master] db-eqiad.php: Slowly repool db1089, depool db1067

https://gerrit.wikimedia.org/r/413329

Stashbot added a comment.Feb 22 2018, 10:00 AM

Mentioned in SAL (#wikimedia-operations) [2018-02-22T10:00:53Z] <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1089 with low traffic and depool db1067 - T162807 (duration: 01m 12s)

gerritbot added a comment.Feb 23 2018, 7:51 AM

Change 413678 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/mediawiki-config@master] db-eqiad.php: Depool db1083

https://gerrit.wikimedia.org/r/413678

gerritbot added a comment.Feb 23 2018, 7:56 AM

Change 413678 merged by jenkins-bot:
[operations/mediawiki-config@master] db-eqiad.php: Depool db1083, fully repool db1089

https://gerrit.wikimedia.org/r/413678

Stashbot added a comment.Feb 23 2018, 7:58 AM

Mentioned in SAL (#wikimedia-operations) [2018-02-23T07:58:05Z] <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1083, fully repool db1089 - T162807 (duration: 01m 12s)

gerritbot added a comment.Feb 28 2018, 7:44 AM

Change 415235 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/mediawiki-config@master] db-codfw.php: Depool db2062

https://gerrit.wikimedia.org/r/415235

gerritbot added a comment.Feb 28 2018, 7:49 AM

Change 415235 merged by jenkins-bot:
[operations/mediawiki-config@master] db-codfw.php: Depool db2062

https://gerrit.wikimedia.org/r/415235

Stashbot added a comment.Feb 28 2018, 7:51 AM

Mentioned in SAL (#wikimedia-operations) [2018-02-28T07:51:35Z] <marostegui@tin> Synchronized wmf-config/db-codfw.php: Depool db2062 - T162807 (duration: 00m 57s)

Stashbot added a comment.Feb 28 2018, 8:23 AM

Mentioned in SAL (#wikimedia-operations) [2018-02-28T08:23:22Z] <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool db2062 - T162807 (duration: 00m 57s)

gerritbot added a comment.Feb 28 2018, 8:29 AM

Change 415241 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/mediawiki-config@master] db-codfw.php: Depool db2069

https://gerrit.wikimedia.org/r/415241

gerritbot added a comment.Feb 28 2018, 8:32 AM

Change 415241 merged by jenkins-bot:
[operations/mediawiki-config@master] db-codfw.php: Depool db2069

https://gerrit.wikimedia.org/r/415241

Stashbot added a comment.Feb 28 2018, 8:33 AM

Mentioned in SAL (#wikimedia-operations) [2018-02-28T08:33:40Z] <marostegui@tin> Synchronized wmf-config/db-codfw.php: Depool db2069 - T162807 (duration: 00m 57s)

Stashbot added a comment.Feb 28 2018, 8:55 AM

Mentioned in SAL (#wikimedia-operations) [2018-02-28T08:55:17Z] <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool db2069 - T162807 (duration: 00m 57s)

gerritbot added a comment.Mar 2 2018, 7:37 AM

Change 415808 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/mediawiki-config@master] db-eqiad.php: Repool db1067

https://gerrit.wikimedia.org/r/415808

gerritbot added a comment.Mar 2 2018, 7:44 AM

Change 415808 merged by jenkins-bot:
[operations/mediawiki-config@master] db-eqiad.php: Repool db1067

https://gerrit.wikimedia.org/r/415808

Stashbot added a comment.Mar 2 2018, 7:45 AM

Mentioned in SAL (#wikimedia-operations) [2018-03-02T07:45:38Z] <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1067 - T162807 (duration: 00m 57s)

Marostegui added a comment.Mar 2 2018, 12:40 PM

ores_classification table is done.
Next (and last, pending another full recheck): user

Marostegui closed this task as Resolved.Mar 13 2018, 9:00 AM

user table is done.

So I consider this ticket resolved. _All_ the tables have been checked by using:

  • leftovers from pt-table-checksum
  • By running mydumper across all the "two" batches of servers we had (I explain that below). To check for all the tables differences.
  • compare.py (I will talk about this below too).

The following tables had differences and have been fixed.

archive
change_tag
geo_tags
oldimage
ores_classification
tag_summary
text
user_newtalk
watchlist
revision
user

It took quite long as some tables were pretty big and there were quite lots of different rows on some of them.
During all the checks (combining compare.py and the left overs from pt-table-checksum) I noticed that there were "two versions" of some rows. The oldest hosts (db1067, db1066) had different information from the rest of the hosts in eqiad and codfw hosts.
That was confirmed by doing a full mydumper across those and the rest of hosts in eqiad.

That was also confirmed by compare.py and its new features of being able to compare multiple hosts across them. Those were coded by Jaime lately and they have been proved to be _super_ useful and simplified these checks a lot. Being able to run all of them at once and in a very fast way.
This ticket would have taken a lot longer with those new options done by Jaime.

All the tables were fixed and I did a re-check using compare.py across all the hosts again, comparing them against each other for the tables that previously showed differences, and they are now all the same.

There is a special case of a table which is pending to fix, just on the master, which is user_newtalk. Again, just on the master (T186503).
Also a follow up - not part of this ticket/goal - is to schedule periodic table checks.
This should be done slowly and for a couple of tables to start with probably. Using the parallel features of compare.py this is pretty easy to set up and schedule.

I would start by tables like change_tag or tag_summary which have had issues historically (because of the lack of PKs), and are now fixed across all the shards.

So all in all, it is hard to say we have fixed 100% of the issues, but I believe we are in a pretty pretty good state now on s1.

jcrespo awarded a token.Mar 13 2018, 9:03 AM
Marostegui closed subtask T186503: Rebuild user_newtalk on db1052 as Declined.Apr 10 2018, 5:54 AM
jcrespo mentioned this in T202032: Duplicate ar_rev_id values in several wikis.Aug 16 2018, 8:00 AM
Content licensed under Creative Commons Attribution-ShareAlike 3.0 (CC-BY-SA) unless otherwise noted; code licensed under GNU General Public License (GPL) or other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL