Marostegui (Manuel Aróstegui)
User

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Thursday

  • Clear sailing ahead.

User Details

User Since
Sep 1 2016, 6:48 AM (101 w, 5 d)
Availability
Busy Busy until Aug 20.
IRC Nick
marostegui
LDAP User
Marostegui
MediaWiki User
MArostegui (WMF) [ Global Accounts ]

TZ: UTC +1/+2

Recent Activity

Thu, Aug 9

Marostegui triaged T201563: issue with accessing wbc_entity_usage from tools-db as High priority.

That is related to T144010 indeed.
The cloud-services-team need to re-create the views.

Thu, Aug 9, 4:56 AM · Data-Services, Toolforge
Marostegui closed T201493: Disk #9 with errors on db1068 (s4 master) as Resolved.

All good now thank you!

Number of Virtual Disks: 1
Virtual Drive: 0 (Target Id: 0)
Name                :
RAID Level          : Primary-1, Secondary-0, RAID Level Qualifier-0
Size                : 3.271 TB
Sector Size         : 512
Mirror Data         : 3.271 TB
State               : Optimal
Thu, Aug 9, 4:55 AM · Operations, ops-eqiad, DBA

Wed, Aug 8

Marostegui added a comment to T201493: Disk #9 with errors on db1068 (s4 master).

Rebuild Progress on Device at Enclosure 32, Slot 9 Completed 2% in 5 Minutes.

Wed, Aug 8, 7:02 PM · Operations, ops-eqiad, DBA
Marostegui merged task T201542: Degraded RAID on db1068 into T201493: Disk #9 with errors on db1068 (s4 master).
Wed, Aug 8, 6:54 PM · ops-eqiad, Operations
Marostegui merged T201542: Degraded RAID on db1068 into T201493: Disk #9 with errors on db1068 (s4 master).
Wed, Aug 8, 6:54 PM · Operations, ops-eqiad, DBA
Marostegui added a comment to T201493: Disk #9 with errors on db1068 (s4 master).

@Cmjohnson it failed - can you pull the disk out and then back in? We have seen that happening before.
Let's give it a second chance (I assume it is one of the new disks)

Wed, Aug 8, 6:52 PM · Operations, ops-eqiad, DBA
Marostegui added a comment to T195228: db2064 crashed and totally broken - decommission it.

https://gerrit.wikimedia.org/r/#/c/operations/dns/+/451362/ merged and deployed

Wed, Aug 8, 4:08 PM · Patch-For-Review, decommission, ops-codfw, Operations, DBA
Marostegui added a comment to T201387: Upgrade pc2004 and pc2005 BIOS.

Thanks - I will take it from here, to repool the servers once they've caught up!

Wed, Aug 8, 1:50 PM · Patch-For-Review, Operations, ops-codfw, DBA
Marostegui updated the task description for T201387: Upgrade pc2004 and pc2005 BIOS.
Wed, Aug 8, 1:26 PM · Patch-For-Review, Operations, ops-codfw, DBA
Marostegui added a comment to T172489: Monitor read_only on all databases, make it page on masters.

That is fine by me - I just wanted to give my opinion about what the current task description says.

Wed, Aug 8, 12:07 PM · Patch-For-Review, Wikimedia-Incident, monitoring, DBA
Marostegui added a comment to T172489: Monitor read_only on all databases, make it page on masters.

"jcrespo renamed this task from Monitor read_only variable and/or uptime on atabase masters, make it page to Monitor read_only variable and/or uptime on database masters, make it page."

Wed, Aug 8, 12:04 PM · Patch-For-Review, Wikimedia-Incident, monitoring, DBA
Marostegui added a comment to T172489: Monitor read_only on all databases, make it page on masters.

I think we should not include the monitoring of the uptime on this task, but just the read_only scope.
Don't think monitoring uptime will give us anything that read_only + monitor the number of mysql process isn't giving us already - maybe just more noise.

Wed, Aug 8, 12:00 PM · Patch-For-Review, Wikimedia-Incident, monitoring, DBA
Marostegui added a comment to T201387: Upgrade pc2004 and pc2005 BIOS.

@Papaul pc2005 is also depooled and with MySQL down.
You can upgrade pc2004 and pc2005 at the same time

Wed, Aug 8, 11:15 AM · Patch-For-Review, Operations, ops-codfw, DBA
Marostegui triaged T201493: Disk #9 with errors on db1068 (s4 master) as Normal priority.
Wed, Aug 8, 9:24 AM · Operations, ops-eqiad, DBA
Marostegui created T201493: Disk #9 with errors on db1068 (s4 master).
Wed, Aug 8, 9:24 AM · Operations, ops-eqiad, DBA
Marostegui added a comment to T201387: Upgrade pc2004 and pc2005 BIOS.

@Papaul as per our chat yesterday, this host is now depooled, silenced and MySQL is stopped.
You are good to go to update the BIOS whenever you arrive to the DC!

Wed, Aug 8, 7:30 AM · Patch-For-Review, Operations, ops-codfw, DBA
Marostegui moved T201387: Upgrade pc2004 and pc2005 BIOS from Next to In progress on the DBA board.
Wed, Aug 8, 5:38 AM · Patch-For-Review, Operations, ops-codfw, DBA

Tue, Aug 7

Marostegui closed T201133: db1069 (x1 master) memory errors as Resolved.

It recovered itself:

˜/icinga-wm 15:02> RECOVERY - Memory correctable errors -EDAC- on db1069 is OK: (C)4 ge (W)2 ge 1 https://grafana.wikimedia.org/dashboard/db/host-overview?orgId=1&var-server=db1069&var-datasource=eqiad%2520prometheus%252Fops
Tue, Aug 7, 1:07 PM · ops-eqiad, Operations, DBA
Marostegui closed T201133: db1069 (x1 master) memory errors, a subtask of T189107: DB meta task for next DC failover issues, as Resolved.
Tue, Aug 7, 1:07 PM · Epic, Operations, DBA
Marostegui removed a project from T171643: Clean up skin properties: DBA.
Tue, Aug 7, 12:27 PM · Performance, Wikimedia-General-or-Unknown
Marostegui added a comment to T67448: Dropping rc_cur_time on wmf databases.

I have removed the column from db2075 (codfw - s5) and I am going to leave it like that for a few days, to make sure nothing writes to that column. If that happens replication will break and we'll know.

Tue, Aug 7, 10:19 AM · Patch-For-Review, Blocked-on-schema-change, DBA, Schema-change
Marostegui added a comment to T51191: Dropping rc_moved_to_title/rc_moved_to_ns on wmf databases.

I have removed the column from db2075 (codfw - s5) and I am going to leave it like that for a few days, to make sure nothing writes to that column. If that happens replication will break and we'll know.

Tue, Aug 7, 10:19 AM · Patch-For-Review, Blocked-on-schema-change, DBA, Schema-change
Marostegui added a comment to T114117: Drop externallinks.el_from_namespace on wmf databases.

I have removed the column from db2075 (codfw - s5) and I am going to leave it like that for a few days, to make sure nothing writes to that column. If that happens replication will break and we'll know.

Tue, Aug 7, 10:19 AM · DBA, Schema-change
Marostegui updated the task description for T67448: Dropping rc_cur_time on wmf databases.
Tue, Aug 7, 10:13 AM · Patch-For-Review, Blocked-on-schema-change, DBA, Schema-change
Marostegui updated the task description for T51191: Dropping rc_moved_to_title/rc_moved_to_ns on wmf databases.
Tue, Aug 7, 10:13 AM · Patch-For-Review, Blocked-on-schema-change, DBA, Schema-change
Marostegui updated the task description for T67448: Dropping rc_cur_time on wmf databases.
Tue, Aug 7, 10:05 AM · Patch-For-Review, Blocked-on-schema-change, DBA, Schema-change
Marostegui updated the task description for T51191: Dropping rc_moved_to_title/rc_moved_to_ns on wmf databases.
Tue, Aug 7, 10:05 AM · Patch-For-Review, Blocked-on-schema-change, DBA, Schema-change
Marostegui updated the task description for T196376: Productionize old/temporary eqiad sanitariums.
Tue, Aug 7, 9:19 AM · Patch-For-Review, DBA
Marostegui moved T67448: Dropping rc_cur_time on wmf databases from Backlog to In progress on the Blocked-on-schema-change board.
Tue, Aug 7, 8:45 AM · Patch-For-Review, Blocked-on-schema-change, DBA, Schema-change
Marostegui moved T51191: Dropping rc_moved_to_title/rc_moved_to_ns on wmf databases from Backlog to In progress on the Blocked-on-schema-change board.
Tue, Aug 7, 8:45 AM · Patch-For-Review, Blocked-on-schema-change, DBA, Schema-change
Marostegui moved T51191: Dropping rc_moved_to_title/rc_moved_to_ns on wmf databases from Next to In progress on the DBA board.
Tue, Aug 7, 8:43 AM · Patch-For-Review, Blocked-on-schema-change, DBA, Schema-change
Marostegui moved T67448: Dropping rc_cur_time on wmf databases from Next to In progress on the DBA board.
Tue, Aug 7, 8:43 AM · Patch-For-Review, Blocked-on-schema-change, DBA, Schema-change
Marostegui moved T114117: Drop externallinks.el_from_namespace on wmf databases from Next to In progress on the DBA board.
Tue, Aug 7, 8:43 AM · DBA, Schema-change
Marostegui updated the task description for T67448: Dropping rc_cur_time on wmf databases.
Tue, Aug 7, 8:38 AM · Patch-For-Review, Blocked-on-schema-change, DBA, Schema-change
Marostegui updated the task description for T114117: Drop externallinks.el_from_namespace on wmf databases.
Tue, Aug 7, 8:38 AM · DBA, Schema-change
Marostegui updated the task description for T51191: Dropping rc_moved_to_title/rc_moved_to_ns on wmf databases.
Tue, Aug 7, 8:38 AM · Patch-For-Review, Blocked-on-schema-change, DBA, Schema-change
Marostegui claimed T114117: Drop externallinks.el_from_namespace on wmf databases.

This also includes the drop of KEY el_backlinks_to (el_from_namespace,el_to(60),el_from), which is not being used really:

Tue, Aug 7, 8:23 AM · DBA, Schema-change
Marostegui claimed T67448: Dropping rc_cur_time on wmf databases.
Tue, Aug 7, 8:10 AM · Patch-For-Review, Blocked-on-schema-change, DBA, Schema-change
Marostegui claimed T51191: Dropping rc_moved_to_title/rc_moved_to_ns on wmf databases.
Tue, Aug 7, 8:09 AM · Patch-For-Review, Blocked-on-schema-change, DBA, Schema-change
Marostegui closed T199368: Convert UNIQUE INDEX to PK in Production as Resolved.

This is all done - more PK in production! \o/

Tue, Aug 7, 7:38 AM · Patch-For-Review, DBA, Schema-change
Marostegui closed T199368: Convert UNIQUE INDEX to PK in Production, a subtask of T17441: Some tables lack unique or primary keys, may allow confusing duplicate data, as Resolved.
Tue, Aug 7, 7:38 AM · PostgreSQL, DBA, Schema-change, MediaWiki-Database
Marostegui changed the status of T144010: Drop eu_touched in production from Open to Stalled.

Blocking this until we have done DC failover so we can do s4 primary master (T144010#4449908)

Tue, Aug 7, 7:37 AM · Patch-For-Review, Blocked-on-schema-change, DBA, Schema-change, Wikidata
Marostegui changed the status of T144010: Drop eu_touched in production, a subtask of T51188: [DO NOT USE] Schema changes for Wikimedia wikis (tracking) [superseded by #Blocked-on-schema-change], from Open to Stalled.
Tue, Aug 7, 7:37 AM · DBA, Tracking, Schema-change
Marostegui updated the task description for T144010: Drop eu_touched in production.
Tue, Aug 7, 7:36 AM · Patch-For-Review, Blocked-on-schema-change, DBA, Schema-change, Wikidata
Marostegui closed T51190: Truncate SHA-1 indexes as Resolved.

This is all done

Tue, Aug 7, 7:36 AM · Patch-For-Review, Blocked-on-schema-change, DBA, Schema-change
Marostegui updated the task description for T51190: Truncate SHA-1 indexes.
Tue, Aug 7, 7:35 AM · Patch-For-Review, Blocked-on-schema-change, DBA, Schema-change
Marostegui updated the task description for T199368: Convert UNIQUE INDEX to PK in Production.
Tue, Aug 7, 7:35 AM · Patch-For-Review, DBA, Schema-change
Marostegui triaged T201387: Upgrade pc2004 and pc2005 BIOS as Normal priority.
Tue, Aug 7, 7:08 AM · Patch-For-Review, Operations, ops-codfw, DBA
Marostegui created T201387: Upgrade pc2004 and pc2005 BIOS.
Tue, Aug 7, 7:08 AM · Patch-For-Review, Operations, ops-codfw, DBA
Marostegui closed T200641: pc2006 rebooted itself as Resolved.

I have repooled the host so going to consider this resolved as there is not much else we can do - I am going to create a task to get pc2004 and pc2005's BIOS upgrade before we do the DC failover as we can easily depool the hosts.

Tue, Aug 7, 7:05 AM · Operations, ops-codfw, DBA

Mon, Aug 6

Marostegui closed T201245: Degraded RAID on db2054 as Resolved.

All good this time!

root@db2054:~# hpssacli controller all show config
Mon, Aug 6, 5:53 PM · DBA, Operations, ops-codfw
Marostegui added a comment to T201245: Degraded RAID on db2054.

Moved all disks in one of the decom server (db2013). Disk wipe in progress

Mon, Aug 6, 3:58 PM · DBA, Operations, ops-codfw
Marostegui added a comment to T201245: Degraded RAID on db2054.

Thanks, let's see how it goes this time!

physicaldrive 1I:1:7 (port 1I:box 1:bay 7, SAS, 600 GB, Rebuilding)
Mon, Aug 6, 3:40 PM · DBA, Operations, ops-codfw
Marostegui added a comment to T200641: pc2006 rebooted itself.

Thanks - I have started MySQL and will leave it running during the night.
There is not much we can do with this host as per T200641#4481566 - and we will at some point replace these hosts with new ones (T195878)

Mon, Aug 6, 3:39 PM · Operations, ops-codfw, DBA
Marostegui reassigned T201245: Degraded RAID on db2054 from Marostegui to Papaul.

This disk failed:

physicaldrive 1I:1:7 (port 1I:box 1:bay 7, SAS, 600 GB, Failed)
Mon, Aug 6, 3:37 PM · DBA, Operations, ops-codfw
Marostegui added a comment to T200641: pc2006 rebooted itself.

Thanks @Papaul - let's upgrade the BIOS then.

Mon, Aug 6, 3:18 PM · Operations, ops-codfw, DBA
Marostegui added a comment to T201245: Degraded RAID on db2054.

Thanks!

physicaldrive 1I:1:7 (port 1I:box 1:bay 7, SAS, 600 GB, Rebuilding)
Mon, Aug 6, 2:51 PM · DBA, Operations, ops-codfw
Marostegui moved T201245: Degraded RAID on db2054 from Triage to In progress on the DBA board.
Mon, Aug 6, 6:38 AM · DBA, Operations, ops-codfw

Sun, Aug 5

Marostegui assigned T201245: Degraded RAID on db2054 to Papaul.

Can we get this disk replaced?
Thanks!

Sun, Aug 5, 5:17 PM · DBA, Operations, ops-codfw

Fri, Aug 3

Marostegui added a comment to T193873: Run maintenance script to populate change_tag_def on WMF production (all wikis).

Right on time for the DC failover.
We are probably aiming for the 11th September week (still to be totally confirmed).
If it is not done by that time, I guess you would need to stop it before or otherwise it will fail (unless it re read the config). But safe to stop it I would say.

Fri, Aug 3, 4:52 PM · User-Ladsgroup, Wikidata-Campsite, Wikimedia-maintenance-script-run, Wikidata-Ministry-Of-Magic, MediaWiki-Change-tagging
Marostegui updated the task description for T199368: Convert UNIQUE INDEX to PK in Production.
Fri, Aug 3, 11:25 AM · Patch-For-Review, DBA, Schema-change
Marostegui updated the task description for T144010: Drop eu_touched in production.
Fri, Aug 3, 11:24 AM · Patch-For-Review, Blocked-on-schema-change, DBA, Schema-change, Wikidata
Marostegui updated the task description for T51190: Truncate SHA-1 indexes.
Fri, Aug 3, 11:24 AM · Patch-For-Review, Blocked-on-schema-change, DBA, Schema-change
Marostegui added a comment to T201001: Prepare and check storage layer for wikimaniawiki.

I have added the grants to labsdbuser so the script won't fail with access denied:

for i in labsdb1009 labsdb1010 labsdb1011; do echo $i; mysql.py -h$i -e " show grants for 'labsdbuser';" | grep -i wikimaniawiki;done
labsdb1009
GRANT SELECT, SHOW VIEW ON `wikimaniawiki\\_p`.* TO 'labsdbuser'
labsdb1010
GRANT SELECT, SHOW VIEW ON `wikimaniawiki\\_p`.* TO 'labsdbuser'
labsdb1011
GRANT SELECT, SHOW VIEW ON `wikimaniawiki\\_p`.* TO 'labsdbuser'
Fri, Aug 3, 9:15 AM · cloud-services-team (Kanban), Data-Services, User-Urbanecm, DBA
Marostegui added a comment to T199599: Prepare and check storage layer for zhwikiversity.

I assume you meant zhwikiversity, I have granted that on all hosts. Try re-running the script.

for i in labsdb1009 labsdb1010 labsdb1011; do echo $i; mysql.py -h$i -e " show grants for 'labsdbuser';" | grep -i zhwikiversity;done
labsdb1009
GRANT SELECT, SHOW VIEW ON `zhwikiversity\\_p`.* TO 'labsdbuser'
labsdb1010
GRANT SELECT, SHOW VIEW ON `zhwikiversity\\_p`.* TO 'labsdbuser'
labsdb1011
GRANT SELECT, SHOW VIEW ON `zhwikiversity\\_p`.* TO 'labsdbuser'
Fri, Aug 3, 9:14 AM · Data-Services, cloud-services-team (Kanban), DBA, Chinese-Sites, User-Urbanecm
Marostegui added a comment to T198401: Prepare and check storage layer for satwiki.

I have granted access to that, try re-running the script:

for i in labsdb1009 labsdb1010 labsdb1011; do echo $i; mysql.py -h$i -e " show grants for 'labsdbuser';" | grep -i satwiki;done
labsdb1009
GRANT SELECT, SHOW VIEW ON `satwiki\\_p`.* TO 'labsdbuser'
labsdb1010
GRANT SELECT, SHOW VIEW ON `satwiki\\_p`.* TO 'labsdbuser'
labsdb1011
GRANT SELECT, SHOW VIEW ON `satwiki\\_p`.* TO 'labsdbuser'
Fri, Aug 3, 9:14 AM · cloud-services-team (Kanban), Data-Services, User-Urbanecm, DBA
Marostegui added a comment to T144010: Drop eu_touched in production.

s3 eqiad progress

Fri, Aug 3, 8:19 AM · Patch-For-Review, Blocked-on-schema-change, DBA, Schema-change, Wikidata
Marostegui added a comment to T199368: Convert UNIQUE INDEX to PK in Production.

s3 eqiad progress

Fri, Aug 3, 8:19 AM · Patch-For-Review, DBA, Schema-change
Marostegui added a comment to T51190: Truncate SHA-1 indexes.

s3 eqiad progress

Fri, Aug 3, 8:19 AM · Patch-For-Review, Blocked-on-schema-change, DBA, Schema-change
Marostegui moved T201132: es1019 mgmt interface DOWN from Triage to Next on the DBA board.
Fri, Aug 3, 7:37 AM · Patch-For-Review, ops-eqiad, Operations, DBA
Marostegui moved T201021: HAproxy on dbproxy hosts lack enough logging from Triage to Backlog on the DBA board.
Fri, Aug 3, 7:37 AM · monitoring, Operations, DBA
Marostegui closed T157762: Drop ptrl_comment in production as Resolved.
Fri, Aug 3, 7:34 AM · Growth-Team, DBA, MediaWiki-extensions-PageCuration, Schema-change, Collaboration-Team-Triage
Marostegui updated the task description for T157762: Drop ptrl_comment in production.
Fri, Aug 3, 7:34 AM · Growth-Team, DBA, MediaWiki-extensions-PageCuration, Schema-change, Collaboration-Team-Triage
Marostegui added a comment to T157762: Drop ptrl_comment in production.

deleted from testwiki and test2wiki on all eqiad hosts (codfw was done directly on the master)

Fri, Aug 3, 7:34 AM · Growth-Team, DBA, MediaWiki-extensions-PageCuration, Schema-change, Collaboration-Team-Triage
Marostegui moved T201133: db1069 (x1 master) memory errors from Triage to Next on the DBA board.
Fri, Aug 3, 5:22 AM · ops-eqiad, Operations, DBA
Marostegui changed the status of T201133: db1069 (x1 master) memory errors from Open to Stalled.
Fri, Aug 3, 5:22 AM · ops-eqiad, Operations, DBA
Marostegui triaged T201132: es1019 mgmt interface DOWN as Normal priority.
Fri, Aug 3, 5:15 AM · Patch-For-Review, ops-eqiad, Operations, DBA
Marostegui created T201132: es1019 mgmt interface DOWN.
Fri, Aug 3, 5:15 AM · Patch-For-Review, ops-eqiad, Operations, DBA
Marostegui closed T200059: db2061 disk with predictive failure as Resolved.
Fri, Aug 3, 4:57 AM · DBA, Operations, ops-codfw
Marostegui added a comment to T200059: db2061 disk with predictive failure.

All good!

root@db2061:~# hpssacli controller all show config
Fri, Aug 3, 4:56 AM · DBA, Operations, ops-codfw

Thu, Aug 2

Marostegui updated subscribers of T201082: labtestweb2001 is sending updates to a read-only db host: db2037.

db2037 is read-only because it is m5 codfw master, and as codfw is the passive DC, nothing should write to it.
Whatever is trying to write to it, instead of using m5-master (db1073) probably needs to be reviewed.
Maybe @Andrew can help with this?

Thu, Aug 2, 7:50 PM · cloud-services-team, wikitech.wikimedia.org, Wikimedia-log-errors
Marostegui updated the task description for T199368: Convert UNIQUE INDEX to PK in Production.
Thu, Aug 2, 3:51 PM · Patch-For-Review, DBA, Schema-change
Marostegui updated the task description for T144010: Drop eu_touched in production.
Thu, Aug 2, 3:51 PM · Patch-For-Review, Blocked-on-schema-change, DBA, Schema-change, Wikidata
Marostegui updated the task description for T51190: Truncate SHA-1 indexes.
Thu, Aug 2, 3:51 PM · Patch-For-Review, Blocked-on-schema-change, DBA, Schema-change
Marostegui added a comment to T200059: db2061 disk with predictive failure.

Thanks!

physicaldrive 1I:1:10 (port 1I:box 1:bay 10, SAS, 600 GB, Rebuilding)
Thu, Aug 2, 3:32 PM · DBA, Operations, ops-codfw
Marostegui moved T200509: Make sure multi-instance slaves page from Triage to In progress on the DBA board.
Thu, Aug 2, 3:12 PM · Patch-For-Review, DBA
Marostegui updated subscribers of T201001: Prepare and check storage layer for wikimaniawiki.
Thu, Aug 2, 1:04 PM · cloud-services-team (Kanban), Data-Services, User-Urbanecm, DBA
Marostegui moved T198401: Prepare and check storage layer for satwiki from Blocked external/Not db team to Done on the DBA board.

I have sanitized this wiki and my new user was created correctly with all the sanitization done.
It is ready for cloud-services-team to create the views.

Thu, Aug 2, 1:04 PM · cloud-services-team (Kanban), Data-Services, User-Urbanecm, DBA
Marostegui triaged T199599: Prepare and check storage layer for zhwikiversity as Normal priority.

I have sanitized this wiki and my new user was created correctly with all the sanitization done.
It is ready for cloud-services-team to create the views.

Thu, Aug 2, 1:03 PM · Data-Services, cloud-services-team (Kanban), DBA, Chinese-Sites, User-Urbanecm
Marostegui closed T196748: Prepare and check storage layer for id_internalwikimedia, a subtask of T196747: Create private wiki for Wikimedia Indonesia, as Resolved.
Thu, Aug 2, 12:58 PM · Patch-For-Review, MW-1.32-release-notes (WMF-deploy-2018-07-10 (1.32.0-wmf.12)), User-Urbanecm, Wiki-Setup (Create)
Marostegui closed T196748: Prepare and check storage layer for id_internalwikimedia as Resolved.

This wiki was created in production:

root@db1075.eqiad.wmnet[id_internalwikimedia]> show databases like 'id_internal%';
+-------------------------+
| Database (id_internal%) |
+-------------------------+
| id_internalwikimedia    |
+-------------------------+
1 row in set (0.00 sec)
Thu, Aug 2, 12:58 PM · Patch-For-Review, User-Urbanecm, DBA
Marostegui triaged T201001: Prepare and check storage layer for wikimaniawiki as Normal priority.

I have sanitized this wiki and my new user was created correctly with all the sanitization done.
It is ready for cloud-services-team to create the views.

Thu, Aug 2, 12:52 PM · cloud-services-team (Kanban), Data-Services, DBA, User-Urbanecm
Marostegui updated the task description for T51190: Truncate SHA-1 indexes.
Thu, Aug 2, 8:04 AM · Patch-For-Review, Blocked-on-schema-change, DBA, Schema-change
Marostegui updated the task description for T144010: Drop eu_touched in production.
Thu, Aug 2, 8:04 AM · Patch-For-Review, Blocked-on-schema-change, DBA, Schema-change, Wikidata
Marostegui updated the task description for T199368: Convert UNIQUE INDEX to PK in Production.
Thu, Aug 2, 8:04 AM · Patch-For-Review, DBA, Schema-change
Marostegui updated the task description for T157762: Drop ptrl_comment in production.
Thu, Aug 2, 7:56 AM · Growth-Team, DBA, MediaWiki-extensions-PageCuration, Collaboration-Team-Triage, Schema-change
Marostegui added a comment to T157762: Drop ptrl_comment in production.

Dropped from enwiki and all its hosts:

Thu, Aug 2, 7:56 AM · Growth-Team, DBA, MediaWiki-extensions-PageCuration, Collaboration-Team-Triage, Schema-change
Marostegui added a comment to T104459: Automate the check and fix of object, schema and data drifts between mediawiki HEAD, production masters and slaves.

I am running some "unattended" reports for s2,s5 and s6 for the text, revision, tag_summary and user table for now to see how those go.
Picked up those sections as they don't have much wikis and they are less trafficked.

Thu, Aug 2, 7:35 AM · Release-Engineering-Team (Watching / External), Wikimedia-Incident, Datasets-General-or-Unknown, Patch-For-Review, WorkType-NewFunctionality, DBA
Marostegui triaged T121857: Implement a system to automatically deploy schema changes without needing DBA intervention as Normal priority.

Now that we are getting closer to have a way to automatic depool/repool slaves, I would like to start a conversation about the future of this task.

Thu, Aug 2, 6:48 AM · Release-Engineering-Team, DBA, Epic
Marostegui added a subtask for T159423: Meta ticket: Migrate multi-source database hosts to multi-instance: T200509: Make sure multi-instance slaves page.
Thu, Aug 2, 6:21 AM · Epic, DBA