Maniphest Advanced Search

Advanced Search
Use Results
Edit Query
Hide Query

Query

Assigned To

jcrespo (Jaime Crespo)

	N/A
	Informational
	Low
	Medium
	High
	Critical

Tasks (654)

T351491 pymysql.err.OperationalError: (2003, "Can't connect to MySQL server on 'db1164.eqiad.wmnet' ([SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self signed certificate in certificate chain (_ssl.c:1123))") on backup
database-backups
Data-Persistence-Backup
Data-Persistence
Puppet (Puppet 7.0)
Nov 17 2023, 4:10 PM
Assigned: jcrespo
T324652 Update password used for dumping databases
Security
·
Security
DBA
Data-Persistence-Backup
database-backups
Dec 7 2022, 12:58 PM
Assigned: jcrespo
T323796 Exception TypeError when trying to delete a file from media backups
BUG REPORT
·
media-backups
Data-Persistence-Backup
Data-Persistence
Nov 25 2022, 11:36 AM
Assigned: jcrespo
T177772 Purge 90% of rows from recentchanges (and posibly defragment) from commonswiki and ruwiki (the ones with source:wikidata)
MediaWiki-Watchlist
DBA
Wikidata
Russian-Sites
Patch-For-Review
Oct 13 2017, 3:43 PM
Assigned: jcrespo
T148790 apply events killing long running queries to db1070; any other production server
DBA
Patch-For-Review
Oct 21 2016, 9:49 AM
Assigned: jcrespo
T139755 Need snapshot of 'reviewdb' on spare machine to test gerrit schema upgrades
DBA
Gerrit
SRE
Release-Engineering-Team
Jul 8 2016, 4:40 PM
Assigned: jcrespo
T139346 All s4 (commons) slaves failed replication
DBA
SRE
Patch-For-Review
Jul 8 2016, 6:32 AM
Assigned: jcrespo
T135948 irc.wikimedia.org is not sending out changes
Wikimedia-IRC-RC-Server
SRE
Patch-For-Review
May 22 2016, 4:03 PM
Assigned: jcrespo
T127821 Icinga errors on neon: Contact group 'admin' specified in service XXX is not specified anywhere
SRE
Icinga
Patch-For-Review
Feb 23 2016, 1:53 PM
Assigned: jcrespo
T124172 Replication lag starting a script on tools.taxonbot
Cloud-Services
Toolforge
Jan 21 2016, 9:31 AM
Assigned: jcrespo
T123634 EL replication having issues since at least January 11th
Analytics-Kanban
DBA
Patch-For-Review
Jan 19 2016, 3:34 PM
Assigned: jcrespo
T118162 Wikibase dispatchChanges.php runs slow, creates an absurd amount of database connections
Wikidata
SRE
DBA
MediaWiki-extensions-WikibaseRepository
Wikidata-Sprint-2015-11-17
MW-1.27-release-notes
MW-1.27-release (WMF-deploy-2015-11-17_(1.27.0-wmf.7))
Patch-For-Review
MW-1.27-release (WMF-deploy-2015-11-10_(1.27.0-wmf.6))
Nov 18 2015, 6:04 PM
Assigned: jcrespo
T105607 wikidatawiki_p (and maybe others) not available on Labs
Cloud-VPS
Cloud-Services
Jul 20 2015, 1:46 PM
Assigned: jcrespo
T105585 Replication lag on multiple databases on tool-labs
Cloud-Services
Toolforge
Jul 15 2015, 5:02 PM
Assigned: jcrespo
T362509 Setup new dbprov hosts and decommission the old ones
Data-Persistence-Backup
database-backups
Patch-For-Review
Tue, Apr 23, 11:23 AM
Assigned: jcrespo
T361087 backup1005 crashed
media-backups
Data-Persistence-Backup
DC-Ops
ops-eqiad
SRE
Wed, Apr 24, 4:51 PM
Assigned: jcrespo
T342743 All backups failing for releases1002, releases2002
Release-Engineering-Team
collaboration-services
bacula
Jul 26 2023, 12:32 PM
Assigned: jcrespo
T339176 Recovery of text table in nlwiki and enwiki
Data-Persistence-Backup
Jul 27 2023, 3:50 PM
Assigned: jcrespo
T338128 Recovery text table in a couple of wikis
database-backups
Data-Persistence-Backup
Data-Persistence
Jun 7 2023, 12:54 PM
Assigned: jcrespo
T321147 Degraded RAID on db2139
ops-codfw
SRE
Data-Persistence-Backup
Oct 19 2022, 10:04 AM
Assigned: jcrespo
T307154 Incident: 2022-02-01_ulsfo_network
SRE-OnFire (FY2021/2022-Q3)
Apr 29 2022, 8:35 AM
Assigned: jcrespo
T293975 Document troubleshooting a failing snapshot backup
Data-Persistence-Backup
Documentation
Patch-For-Review
Mar 18 2022, 7:16 PM
Assigned: jcrespo
T287467 Features to be put into dbbackups monitoring dashboards
dbbackups-dashboard
May 12 2022, 4:57 PM
Assigned: jcrespo
T280979 Upgrade pending stretch backup hosts to buster
Data-Persistence-Backup
Goal
Patch-For-Review
database-backups
Nov 12 2021, 11:24 AM
Assigned: jcrespo
T274636 Develop a web dashboard or a command line tool to help inventory and/or monitor database and backup objects
Google-Summer-of-Code (2021)
Jun 1 2021, 8:39 AM
Assigned: jcrespo
T263662 check-mariadb-backups pkg_resources.VersionConflict: 0.2 (/usr/lib/python3/dist-packages), Requirement.parse('wmfbackups==0.1')
observability
Data-Persistence
Data-Persistence-Backup
SRE
Sep 23 2020, 5:05 PM
Assigned: jcrespo
T256725 Execution error after moving to debian package
DBA
Jun 30 2020, 9:46 AM
Assigned: jcrespo
T251728 snapshot of s3 in eqiad critical
SRE
May 4 2020, 9:13 AM
Assigned: jcrespo
T251017 Degraded RAID on es2004
ops-codfw
SRE
DBA
Apr 27 2020, 6:48 AM
Assigned: jcrespo
T249014 Domain of sender address of Wikimedia mail notifications is set to mw1337.eqiad.wmn for emails from Sinhala Wikipedia
MediaWiki-Internationalization
Language-Team
Wikimedia-Site-requests
Apr 2 2020, 4:32 PM
Assigned: jcrespo
T246435 Create or improve a tool for monitoring or automating tasks for Wikimedia databases
Epic
Google-Summer-of-Code (2020)
May 6 2020, 7:34 AM
Assigned: jcrespo
T233701 No grafana dashboard with working disk writes and reads in bytes
observability
Sep 24 2019, 2:12 PM
Assigned: jcrespo
T214831 dbstore2001 low on disk space
DBA
SRE
Jan 28 2019, 4:38 PM
Assigned: jcrespo
T210067 During scap sync-file error on one endpoint (mw1265)
SRE
Nov 27 2018, 5:44 PM
Assigned: jcrespo
T207940 Large transaction-related errors and other problems (tracking)
Tracking-Neverending
MediaWiki-General
Jul 29 2021, 7:59 AM
Assigned: jcrespo
T205294 Request to create database and account for recommendation API
Research
DBA
Patch-For-Review
Sep 25 2018, 3:46 PM
Assigned: jcrespo
T202364 Switchover es2 master (es1011) to es1015
DBA
Patch-For-Review
Aug 23 2018, 6:39 AM
Assigned: jcrespo
T202055 labsdb1004's toolsdb mariadb is lagging behind labsdb1005
DBA
Data-Services
Patch-For-Review
Aug 20 2018, 7:58 AM
Assigned: jcrespo
T201761 Degraded RAID on db2039
ops-codfw
SRE
Aug 16 2018, 10:31 AM
Assigned: jcrespo
T200398 Document clearly the mariadb backup and recovery setup, specially how to recover a backup
User-Marostegui
Data-Persistence-Backup
Mar 21 2022, 11:27 AM
Assigned: jcrespo
T199614 dbstore1002 MySQL crashed and got restarted
Analytics
Jul 14 2018, 12:07 PM
Assigned: jcrespo
T199518 Undocumented grants on striker from californium
Striker
Jul 13 2018, 6:34 PM
Assigned: jcrespo
T194343 quentinv57-tools/tools/globalcontribs.php generates slow/complex SQL queries which impact server performance
Data-Services
DBA
Tool-Quentinv57's-tools
Dec 20 2018, 12:37 PM
Assigned: jcrespo
T190488 Possibly a big update going to: u2815__p`.`all_articles
Data-Services
Toolforge
DBA
Patch-For-Review
Mar 23 2018, 2:15 PM
Assigned: jcrespo
T189378 Table 'labswiki.mathoid' doesn't exist (10.64.16.79)
PRODUCTION ERROR
·
Mathoid
cloud-services-team
Wikimedia-production-error
wikitech.wikimedia.org
Math
Mar 12 2018, 3:47 PM
Assigned: jcrespo
T188260 Long-open transactions on zhwiki
MediaWiki-General
Chinese-Sites
Wikimedia-Slow-DB-Query
Apr 9 2022, 8:35 PM
Assigned: jcrespo
T188048 Deploy ReadingLists schema change for efficient count(*) handling
Product-Infrastructure-Team-Backlog-Deprecated (Kanban)
Schema-change-in-production
Reading List Service
Mar 5 2018, 11:27 AM
Assigned: jcrespo
T186730 Change user u11106 to have max 1 open connection
DBA
Mar 14 2019, 7:18 PM
Assigned: jcrespo
T185435 Phabricator two-factor authentication reset request for 'matmarex'
Phabricator
Jan 25 2018, 1:05 AM
Assigned: jcrespo
T185294 db2036 storage issues? (mysql crashed, installer issues)
DBA
SRE
ops-codfw
Patch-For-Review
Jan 29 2018, 12:11 AM
Assigned: jcrespo
T183123 Precautionary backup needed for the log database on db1107 before applying regular purging/sanitization
DBA
Analytics-Kanban
User-Elukey
Dec 18 2017, 4:22 PM
Assigned: jcrespo
T183077 s51580 blocked from access to wikireplicas with suspicion of having tried a DOS
Tools
Jan 3 2018, 6:32 PM
Assigned: jcrespo
T182995 heavy queries from s51205, unlikely to finish?
Tools
Jan 3 2018, 7:12 PM
Assigned: jcrespo
T180917 db1100 replication broken
DBA
MediaWiki-Change-tagging
Nov 20 2017, 6:14 AM
Assigned: jcrespo
T180380 "ERROR 2006 (HY000): MySQL server has gone away" failures for a variety of queries against Wiki Replica servers
Data-Services
DBA
Mar 16 2018, 1:35 PM
Assigned: jcrespo
T178272 labsdb1005's mysql crashed
DBA
Data-Services
Oct 17 2017, 8:08 AM
Assigned: jcrespo
T178237 Access to x1 broken on stat1006
DBA
Analytics-Radar
Oct 19 2017, 4:03 PM
Assigned: jcrespo
T178094 High replication lag causing read only mode on commons
Commons
MediaWiki-Debug-Logger
observability
Performance Issue
Release-Engineering-Team (Watching / External)
Jun 12 2018, 6:19 PM
Assigned: jcrespo
T177908 dbstore2001:s3 crashed while backups were running
DBA
Oct 11 2017, 10:32 AM
Assigned: jcrespo
T177466 linter creates unsafe SQL writes
MediaWiki-extensions-Linter
Oct 5 2017, 5:19 PM
Assigned: jcrespo
T175970 Lost access to x1-analytics-slave
SRE
DBA
Patch-For-Review
Oct 20 2017, 10:31 AM
Assigned: jcrespo
T175487 Significant replication lag for the s1, s2, and s4 wikis on labsdb100[13]
Data-Services
DBA
Sep 19 2017, 8:01 AM
Assigned: jcrespo
T174543 CHAR_LENGTH does not return the character count
Quarry
DBA
Data-Services
Sep 5 2017, 5:22 PM
Assigned: jcrespo
T174140 s51203__baglama2_p generating lag on tools-db
Tools
Aug 25 2017, 9:40 AM
Assigned: jcrespo
T172784 Unable to drop tables on dewiki.labsdb/s51072__dwl_p
Cloud-Services
DBA
Aug 8 2017, 5:48 PM
Assigned: jcrespo
T172670 reset 2-factor authentication for Dan Garry on Phabricator
Phabricator
Aug 7 2017, 9:00 AM
Assigned: jcrespo
T171928 Wikidata and dewiki databases locked
Wikidata
SRE
Wikimedia-Incident
Patch-For-Review
User-notice-archive
Aug 4 2017, 3:21 PM
Assigned: jcrespo
T169658 Improve database backups' coverage, monitoring and data recovery time (part 1) (tracking)
Goal
SRE
Oct 3 2017, 10:44 AM
Assigned: jcrespo
T168356 Prepare mysql hosts for stretch
DBA
SRE
Patch-For-Review
Jun 30 2017, 11:00 AM
Assigned: jcrespo
T165739 db2049 cannot install jessie - let's try upgrading the firmware first
ops-codfw
SRE
Patch-For-Review
May 26 2017, 9:51 AM
Assigned: jcrespo
T165705 No data after 20170517193000 available via Quarry from tables (recentchanges, revision, logging) for several Mediawiki databases (svwiki_p, fiwiki_p, nowiki_p, ...)
Quarry
May 19 2017, 9:48 AM
Assigned: jcrespo
T165625 Evaluate future of wmf puppet module "mysql"
SRE
DBA
Community-Wikimetrics
Quarry
Icinga
Sep 7 2018, 8:59 AM
Assigned: jcrespo
T164915 ruthenium is going to run out of space on /srv and stop working
SRE
Parsoid
May 10 2017, 2:52 PM
Assigned: jcrespo
T164092 db1062 (s7 master eqiad) in a reboot cycle
ops-eqiad
DBA
SRE
Apr 29 2017, 1:01 PM
Assigned: jcrespo
T163557 Maintenance scripts have not updated the special pages content for the last days
codfw-rollout
MediaWiki-Special-pages
WMF-General-or-Unknown
May 9 2017, 5:24 PM
Assigned: jcrespo
T163192 s51053 is running unnecessarily long running queries on revision
Toolforge
Cloud-Services
Apr 21 2017, 6:47 PM
Assigned: jcrespo
T163023 S1 replag at 3 hours
Cloud-Services
DBA
Apr 14 2017, 7:12 PM
Assigned: jcrespo
T162593 Run pt-table-checksum on s4 (commonswiki)
DBA
Sep 12 2017, 11:50 AM
Assigned: jcrespo
T162212 dbstore1002 in bad shape
SRE
DBA
Apr 5 2017, 7:42 AM
Assigned: jcrespo
T161159 Cannot access the database: Can't connect to MySQL server on '10.192.48.41' (111) (10.192.48.41)
DBA
Mar 23 2017, 8:58 AM
Assigned: jcrespo
T160832 db1094 crash
ops-eqiad
SRE
DBA
Patch-For-Review
Mar 22 2017, 7:59 PM
Assigned: jcrespo
T160691 Refreshing testreduce_vd database on ruthenium
DBA
Mar 17 2017, 9:11 PM
Assigned: jcrespo
T160585 Access Denied
Cloud-Services
Toolforge
Mar 15 2017, 11:19 PM
Assigned: jcrespo
T159493 Data integrity issue with enwiki_p user_groups on Wikimedia Tool Labs (missing rows)
DBA
Cloud-Services
Cloud-VPS
Mar 3 2017, 8:59 AM
Assigned: jcrespo
T159023 Possible labs imagelinks drift
DBA
Cloud-Services
Mar 6 2017, 3:20 PM
Assigned: jcrespo
T158764 m1 slaves all broke replication due to bacula.DelCandidates temporary table
DBA
observability
Mar 2 2017, 5:52 PM
Assigned: jcrespo
T156560 lab's templatelinks contain possible garbage rows
DBA
Cloud-Services
Jan 28 2017, 8:00 PM
Assigned: jcrespo
T152894 high s1 replag to labs
Cloud-Services
DBA
Dec 11 2016, 8:06 PM
Assigned: jcrespo
T152117 enwiki_p replica corruption
Cloud-Services
Toolforge
Dec 1 2016, 6:42 PM
Assigned: jcrespo
T151756 Prepare and check storage layer for new fi.wikivoyage.org
DBA
Cloud-Services
Dec 1 2016, 4:45 PM
Assigned: jcrespo
T150759 s51412__data reverted to last year state
Tools
Jan 2 2017, 11:07 AM
Assigned: jcrespo
T150659 Recover/Rename p50380g51020_perfectbot on replica LabsDBs or toolDBs
Cloud-Services
DBA
Nov 15 2016, 6:57 PM
Assigned: jcrespo
T150474 Under high load, there is replication check pile-ups on coredbs, specially enwiki API servers
PRODUCTION ERROR
·
DBA
Wikimedia-production-error
Feb 14 2017, 2:50 PM
Assigned: jcrespo
T150334 db2042 reimage
DBA
Patch-For-Review
Nov 16 2016, 10:14 AM
Assigned: jcrespo
T149703 Degraded RAID on db2052
ops-codfw
SRE
Nov 2 2016, 6:34 PM
Assigned: jcrespo
T149633 db1065 paged for NRPE timeout
DBA
SRE
Nov 3 2016, 11:48 AM
Assigned: jcrespo
T149624 Labsdbs for WMF tools and contributors: get more data, faster
Wikimedia-Developer-Summit (2017)
Cloud-Services
Cloud-VPS
Toolforge
DBA
Feb 14 2017, 3:08 PM
Assigned: jcrespo
T149422 Prepare for mariadb 10.1
DBA
Patch-For-Review
Nov 3 2016, 5:20 PM
Assigned: jcrespo
T149186 Check wikitech has the right db grants
DBA
Patch-For-Review
Nov 3 2016, 11:35 AM
Assigned: jcrespo
T146529 5-10 times more rows are currently read from the s5 master than from all other masters together
Performance Issue
Wikidata
DBA
Sep 28 2016, 4:31 PM
Assigned: jcrespo
T146079 s5-master contention caused (?) by refreshlinksprioritized/addUsagesForPage jobs running for all wikis
PRODUCTION ERROR
·
Wikimedia-production-error
Wikidata
DBA
WMF-JobQueue
Sep 20 2016, 6:46 PM
Assigned: jcrespo
T145317 Do the schema changes for uniqueness constraints.
MediaWiki-extensions-ORES
Schema-change
Machine-Learning-Team (Active Tasks)
Sep 11 2016, 3:14 PM
Assigned: jcrespo
T144470 Grant Manuel root on WMF cluster
SRE-Access-Requests
SRE
Sep 1 2016, 11:00 AM
Assigned: jcrespo
T144469 onboarding Manuel Arostegui in ops
SRE-Access-Requests
SRE
Patch-For-Review
Sep 1 2016, 3:11 PM
Assigned: jcrespo
T143934 s2 replag currently 8 hours
Cloud-Services
DBA
Aug 26 2016, 7:39 AM
Assigned: jcrespo
T142482 u3532 is executing several concurrent, highly-intensive, innefficient long-running queries on at least labsdb1003, potentially hurting the stability of the system
Cloud-Services
Toolforge
Aug 9 2016, 4:03 PM
Assigned: jcrespo
T142475 s51059 is doing unnecessarily slow queries
Cloud-Services
Toolforge
Aug 9 2016, 3:06 PM
Assigned: jcrespo
T142310 Replication seems to be halted for multiple databases
Cloud-Services
DBA
Toolforge
Aug 12 2016, 8:38 AM
Assigned: jcrespo
T142273 dbstore2002 stopped providing mysql service despite the process being running
SRE
DBA
Aug 9 2016, 8:38 AM
Assigned: jcrespo
T141601 db2069 crashed due to RAID controller
ops-codfw
DBA
SRE
Jul 29 2016, 11:39 AM
Assigned: jcrespo
T140968 Wikibase refreshLinks hook breaks implicit transactions
Wikidata
MediaWiki-libs-Rdbms
Aug 31 2016, 3:27 PM
Assigned: jcrespo
T140650 Special:Block request makes the database timeout on db1055
PRODUCTION ERROR
·
DBA
MediaWiki-libs-Rdbms
Wikimedia-production-error
Jul 28 2016, 2:50 PM
Assigned: jcrespo
T140598 db2056 RAID controller (temporary) failure
SRE
ops-eqiad
Jul 18 2016, 2:17 PM
Assigned: jcrespo
T139970 Centralauth last deployment creating database contention on CentralAuthUser::saveSettings (Lock wait timeout exceeded; try restarting transaction)
PRODUCTION ERROR
·
MediaWiki-extensions-CentralAuth
Wikimedia-production-error
Patch-For-Review
Notifications
MW-1.28-release (WMF-deploy-2016-07-19_(1.28.0-wmf.11))
Collaboration-Team-Triage
Jul 20 2016, 3:36 PM
Assigned: jcrespo
T139618 Petscan is being used with excesive parallelism by a user on Wikidata
Cloud-Services
Toolforge
DBA
Wikidata
Jul 11 2016, 10:48 AM
Assigned: jcrespo
T137567 Review ORES extension for data leaks
DBA
MediaWiki-extensions-ORES
Machine-Learning-Team (Active Tasks)
Jun 10 2016, 5:05 PM
Assigned: jcrespo
T136813 string Wikimedia and MediaWiki not found on https://phabricator.wikimedia.org:443
Phabricator
observability
Release-Engineering-Team
Jun 2 2016, 11:19 AM
Assigned: jcrespo
T136417 Requesting access to stats for Ladsgroup
SRE-Access-Requests
SRE
Patch-For-Review
May 31 2016, 3:31 PM
Assigned: jcrespo
T136136 db1056 BBU Failed
DBA
SRE
ops-eqiad
Patch-For-Review
May 25 2016, 2:54 PM
Assigned: jcrespo
T136135 DB backup plan for ptwikibooks Flow cleanup
DBA
May 26 2016, 9:02 AM
Assigned: jcrespo
T135944 db1034 was killed 22-05-16 at 14:17:06
DBA
Jun 6 2016, 9:24 AM
Assigned: jcrespo
T135930 Kraz (irc.wikimedia.org) has been flapping on IRC most of day
SRE
Wikimedia-IRC-RC-Server
May 22 2016, 11:17 PM
Assigned: jcrespo
T135801 categorylinks tables are missing rows
MediaWiki-libs-Rdbms
May 20 2016, 3:08 PM
Assigned: jcrespo
T135471 Hundreds of concurrent SELECT MASTER_POS_WAIT('db1049-bin.002927', 354219766, 10) without debugging information (no user, not function) on s5 API node
DBA
Performance Issue
Wikidata
MediaWiki-General
May 26 2016, 1:10 PM
Assigned: jcrespo
T135330 rutherfordium (powers people.wikimedia.org) flapping in channel
SRE
May 16 2016, 9:32 AM
Assigned: jcrespo
T133160 Jobqueue increase activity on refreshlinks for frwiktionary
MediaWiki-Core-JobQueue
SRE
DBA
Apr 22 2016, 1:45 PM
Assigned: jcrespo
T133122 Backfill data into db1065 and db1066
DBA
Apr 20 2016, 9:49 AM
Assigned: jcrespo
T132539 Dumps for misc triggers unnecessary pages
DBA
Dec 14 2016, 2:09 PM
Assigned: jcrespo
T129830 large s2 database traffic
DBA
MediaWiki-Core-JobQueue
Mar 16 2016, 10:39 AM
Assigned: jcrespo
T129829 db1053 failed disk (degraded RAID)
ops-eqiad
SRE
DC-Ops
Mar 17 2016, 12:19 PM
Assigned: jcrespo
T127811 MariaDB package improvements
DBA
Packaging
Patch-For-Review
Nov 10 2016, 12:19 PM
Assigned: jcrespo
T127164 Some databases cannot be backed up/replicated on toolsdb
DBA
Cloud-Services
Feb 18 2016, 6:22 AM
Assigned: jcrespo
T125927 labs copy of nlwiktionary db corrupted
Toolforge
Cloud-Services
DBA
Feb 5 2016, 4:52 PM
Assigned: jcrespo
T125386 Clarify how mysql dumps will be architectured during codfw failover
SRE
DBA
codfw-rollout
codfw-rollout-Jan-Mar-2016
Dumps-Generation
Feb 1 2016, 12:19 PM
Assigned: jcrespo
T124705 New database for access from stat1003 (project_illustration)
DBA
Patch-For-Review
Jan 25 2016, 8:56 PM
Assigned: jcrespo
T124289 Please reset (delete) Phabricator's jcrespo 2FA
Phabricator
Jan 22 2016, 11:19 AM
Assigned: jcrespo
T122429 Batch updates create slave lag on s3 over WAN
MediaWiki-Special-pages
Performance Issue
DBA
SRE
Wikidata
Feb 5 2016, 1:24 PM
Assigned: jcrespo
T122148 DBs provided on Tool Labs should have utf8 charset and collation by default
Cloud-Services
Toolforge
DBA
Patch-For-Review
Dec 22 2015, 2:28 PM
Assigned: jcrespo
T121491 Define minimum criteria for using the "official" schema change process
DBA
Dec 18 2015, 10:37 AM
Assigned: jcrespo
T120926 s52721__pagecount_stats_p import is making labsdb1005 100% utilized (and lagging its backup slave)
Tools
Cloud-Services
Cloud-VPS
Dec 10 2015, 10:35 AM
Assigned: jcrespo
T119820 Lock wait timeout when trying to save "Anexo:Ascensos y descensos de la Categoría Primera A" on eswiki
WMF-General-or-Unknown
MediaWiki-libs-Rdbms
Nov 29 2015, 9:18 PM
Assigned: jcrespo
T119728 The hewiki Special:DeadendPages disabled by configuration
MediaWiki-Configuration
Nov 26 2015, 5:17 PM
Assigned: jcrespo
T119695 tools.joanjoc is executing the same >1h query every 5 minutes
Cloud-Services
DBA
Toolforge
Nov 26 2015, 10:47 AM
Assigned: jcrespo
T119604 Faebot is crashing labsdb1002
Toolforge
Cloud-Services
DBA
Jan 8 2016, 10:29 AM
Assigned: jcrespo
T116600 Data missing from dbstore1002 but present in dbstore2002
DBA
Analytics-Kanban
Oct 26 2015, 3:45 PM
Assigned: jcrespo
T115940 FULLTEXT not working
Cloud-Services
Toolforge
Tool-Database-Queries
Oct 20 2015, 8:35 AM
Assigned: jcrespo
T115275 Replicate Echo tables to analytics-store
DBA
Collaboration-Team-Triage
Contributors-Analysis
Oct 20 2017, 10:33 AM
Assigned: jcrespo
T114559 s51053 (tools.jackbot) is abusing resources on labsdbs, throttle his grants
Cloud-Services
Toolforge
DBA
Oct 3 2015, 3:40 PM
Assigned: jcrespo
T114556 Icinga configuration broken by aqs
Analytics
Services
Icinga
SRE
Oct 5 2015, 10:57 AM
Assigned: jcrespo
T114519 Another slow running query on - lvwiki.labsdb this time.
DBA
Cloud-Services
Toolforge
Oct 2 2015, 7:17 PM
Assigned: jcrespo
T114513 Slow running query on cawiki.labsdb; incomplete/missing table stats?
Toolforge
Cloud-Services
DBA
Oct 2 2015, 6:16 PM
Assigned: jcrespo
T114159 New db grants for labservices1001
Cloud-Services
Cloud-VPS
Patch-For-Review
Sep 29 2015, 9:58 PM
Assigned: jcrespo
T113786 db1051 degraded raid (disk)
ops-eqiad
SRE
Oct 2 2015, 4:41 PM
Assigned: jcrespo
T111254 Run "patch-remove_unique_ref_indices.sql" and phase 1 of "Segregate Reference objects by source wiki." on officewiki
StructuredDiscussions
Collaboration-Team-Archive-2015-2016
DBA
Schema-change
OKR-Work
Sep 4 2015, 11:01 AM
Assigned: jcrespo
T109282 db2034 crashed
DBA
SRE
Aug 23 2015, 7:11 AM
Assigned: jcrespo
T108701 RAID disk failure on db2023
ops-codfw
SRE
Aug 19 2015, 4:25 PM
Assigned: jcrespo
T108592 es2007 degraded RAID - disk failure
ops-codfw
SRE
Aug 11 2015, 4:01 PM
Assigned: jcrespo
T108033 duplicate key error on db1056
DBA
SRE
Aug 18 2015, 9:53 AM
Assigned: jcrespo
T105503 Tables corrupted or impossible to work with them
DBA
Cloud-Services
Jul 13 2015, 9:04 AM
Assigned: jcrespo
T104953 Investigate upgrading kernel on DB servers
Performance-Team
SRE
Jul 7 2015, 8:26 AM
Assigned: jcrespo
T98998 Database connection failure issues on s7 shard
DBA
SRE
May 15 2015, 6:06 PM
Assigned: jcrespo
T98682 labswiki DB is inaccessible from tin, terbium, etc.
wikitech.wikimedia.org
Cloud-Services
DBA
Patch-For-Review
SRE
Aug 20 2015, 5:01 PM
Assigned: jcrespo
T361718 Resharded files fail to be deleted/recovered
Data-Persistence-Backup
media-backups
Fri, Apr 5, 5:20 AM
Assigned: jcrespo
T360641 Requesting access to analytics-privatedata-users for mpham
Request
·
SRE-Access-Requests
SRE
Patch-For-Review
Wed, Mar 27, 8:42 AM
Assigned: jcrespo
T357878 db2097 rebooted itself
Data-Persistence-Backup
DC-Ops
ops-codfw
SRE
Feb 21 2024, 2:28 PM
Assigned: jcrespo
T355884 Enable DB backups for ipoid
iPoid-Service
Data-Persistence-Backup
database-backups
Jan 29 2024, 2:24 PM
Assigned: jcrespo
T353526 Migrate dbbackups from cumin1001 to cumin1002
SRE
Infrastructure-Foundations
Data-Persistence-Backup
Data-Persistence
database-backups
Jan 15 2024, 11:18 AM
Assigned: jcrespo
T352655 Automate backup file deletion by using a batch file
media-backups
Data-Persistence-Backup
Data-Persistence
Dec 5 2023, 2:29 PM
Assigned: jcrespo
T351617 Several backup alerts fired
Data-Persistence-Backup
Nov 22 2023, 8:26 AM
Assigned: jcrespo
T345241 Grant Access to wmf,ops for arnaudb
LDAP-Access-Requests
SRE
Aug 31 2023, 8:57 AM
Assigned: jcrespo
T334066 Replace db1116 with db1216
Data-Persistence-Backup
Apr 18 2023, 10:49 AM
Assigned: jcrespo
T327770 Data check es2020 after replication broke
Sustainability (Incident Followup)
SRE
Data-Persistence
Data-Persistence-Backup
database-backups
DBA
Jan 31 2023, 8:59 PM
Assigned: jcrespo
T327157 Create and deploy the logic to generate incremental backups of MediaWiki media files, to keep its file storage backup up to date, automatically
Goal
Data-Persistence-Backup
media-backups
Data-Persistence
Jan 11 2024, 11:36 AM
Assigned: jcrespo
T327155 Setup dbprov1004 an dbprov2004 as an expansion of the dbprov (database provisioning) cluster, in preparation of binlog backups backup implementation
Data-Persistence
Data-Persistence-Backup
database-backups
Goal
Feb 8 2023, 11:55 AM
Assigned: jcrespo
T323485 Transferpy: Enable PBKDF2 usage
database-backups
Data-Persistence-Backup
Data-Persistence
Nov 23 2022, 10:25 AM
Assigned: jcrespo
T323207 Grant Access to wmf for Atripathi
LDAP-Access-Requests
SRE
Nov 16 2022, 5:33 PM
Assigned: jcrespo
T319383 Mydumper incompatibility with MariaDB 10.6 (was: Logical recoveries (myloader) to db2098:s7 are failing with "Lock wait timeout exceeded; try restarting transaction")
database-backups
DBA
Data-Persistence-Backup
Jan 12 2023, 9:16 AM
Assigned: jcrespo
T315274 Wikimedia\Rdbms\DBTransactionError: Explicit transaction still active; a caller might have failed to call endAtomic() or cancelAtomic().
PRODUCTION ERROR
·
Wikimedia-production-error
Performance-Team
Wikimedia-Incident
SRE-OnFire
MW-1.39-notes (1.39.0-wmf.25; 2022-08-15)
Aug 19 2022, 2:03 AM
Assigned: jcrespo
T313582 Migrate bacula director to new hardware and setup independent bacula directors/storage/metadata for each primary datacenter for increased redundancy
Data-Persistence-Backup
bacula
Goal
Patch-For-Review
Nov 29 2023, 12:27 PM
Assigned: jcrespo
T311215 Create a script to easily query and remove backups from the media storage backups (primarily to attend T&S deletion requests)
Goal
Data-Persistence-Backup
media-backups
Patch-For-Review
Jun 30 2022, 5:05 PM
Assigned: jcrespo
T305978 Grant Access to ldap/wmf for Nathillard
LDAP-Access-Requests
SRE
Infrastructure-Foundations
Apr 27 2022, 3:02 PM
Assigned: jcrespo
T305934 Grant Access to wmf for vyuen
LDAP-Access-Requests
SRE
Apr 12 2022, 5:02 PM
Assigned: jcrespo
T305634 Requesting access to analytics-privatedata-users for drochford (superset access with no server access)
Request
·
SRE-Access-Requests
SRE
Apr 26 2022, 8:59 AM
Assigned: jcrespo
T305446 Upgrade backup* hosts to bullseye
Data-Persistence-Backup
media-backups
bacula
database-backups
Goal
Patch-For-Review
May 12 2022, 11:13 AM
Assigned: jcrespo
T300020 Develop, package, deploy and document a single file recovery utility
Data-Persistence-Backup
media-backups
Mar 31 2022, 8:25 AM
Assigned: jcrespo
T299920 Rebalance db1102 backup source, which often causes alert spam due to network throughput
Data-Persistence-Backup
database-backups
May 13 2022, 5:59 PM
Assigned: jcrespo
T299876 Upgrade database backup sources and dbprov* hosts to Bullseye + MariaDB 10.4
Data-Persistence-Backup
database-backups
Goal
Apr 8 2022, 12:59 PM
Assigned: jcrespo
T299764 Document media recovery use case proposals and decide their priority
SRE
Goal
Data-Persistence-Backup
media-backups
Patch-For-Review
Jun 30 2022, 5:08 PM
Assigned: jcrespo
T289807 Remove fdans from analytics-alerts mailing list
Analytics
SRE
Aug 27 2021, 3:35 PM
Assigned: jcrespo
T289783 Grant Access to Logstash for SimoneThisDot
LDAP-Access-Requests
SRE
Sep 2 2021, 3:00 PM
Assigned: jcrespo
T289537 Add dancy to `gerritadmin` LDAP group
SRE-Access-Requests
LDAP-Access-Requests
Gerrit
SRE
Aug 24 2021, 8:05 AM
Assigned: jcrespo
T289477 Enable CAS U2F for Majavah
SRE
LDAP-Access-Requests
Aug 23 2021, 3:56 PM
Assigned: jcrespo
T288195 Update media backup TLS certificates
Data-Persistence-Backup
media-backups
Aug 9 2021, 8:35 AM
Assigned: jcrespo
T287304 Restore ~tjones/reindex directory from mwmaint1002
Data-Persistence-Backup
SRE
bacula
Jul 27 2021, 3:08 PM
Assigned: jcrespo
T284980 Put db2100 back into service after hardware maintenance
Data-Persistence-Backup
database-backups
Jun 21 2021, 7:42 AM
Assigned: jcrespo
T284415 dbprov2003 full disk space
Data-Persistence-Backup
database-backups
Jun 8 2021, 4:56 AM
Assigned: jcrespo
T283017 Create a dashboard for database backups monitoring/reporting
Data-Persistence-Backup
database-backups
Goal
Patch-For-Review
dbbackups-dashboard
Aug 7 2023, 3:59 PM
Assigned: jcrespo
T282249 Setup backup1003 and backup2003 as the storage location for es bacula backups
Data-Persistence-Backup
Patch-For-Review
May 29 2021, 10:07 PM
Assigned: jcrespo
T281094 xtrabackup --prepare hits open_files_limit on buster
Data-Persistence-Backup
Patch-For-Review
Apr 27 2021, 5:45 PM
Assigned: jcrespo
T280232 Uncached wiki requests partially unavailable due to excessive request rates from a bot
Wikimedia-Incident
SRE
Dec 15 2021, 11:18 AM
Assigned: jcrespo
T276445 Create a first release of the media backups automation tools
SRE
Goal
Data-Persistence-Backup
Mar 22 2022, 6:27 PM
Assigned: jcrespo
T276442 Puppetize media backups infrastructure
SRE
Goal
Data-Persistence-Backup
Patch-For-Review
Aug 24 2021, 9:13 AM
Assigned: jcrespo
T274234 Understand (and mitigate) the backup speed differences between backup1002->backup2002 and backup2002->backup1002
Data-Persistence-Backup
SRE
netops
bacula
Infrastructure-Foundations
Sep 23 2021, 4:38 PM
Assigned: jcrespo
T272628 Replace SSH key for cluster access for VolkerE
Request
·
SRE-Access-Requests
SRE
Jan 22 2021, 10:38 AM
Assigned: jcrespo
T272541 Requesting ssh key change for production shell for Andy Craze
Request
·
SRE-Access-Requests
SRE
Jan 21 2021, 8:15 PM
Assigned: jcrespo
T272489 Add wikitrent to `wmf` LDAP group
SRE
LDAP-Access-Requests
Jan 21 2021, 5:18 PM
Assigned: jcrespo
T272477 Grant Access to ldap/wmf for Dom Walden
LDAP-Access-Requests
SRE
Jan 20 2021, 1:42 PM
Assigned: jcrespo
T272264 Requesting access to analytics for lilients
Request
·
SRE-Access-Requests
SRE
Jan 20 2021, 5:25 PM
Assigned: jcrespo
T271725 Allow WMDE intern Amrutha to access Superset
WMF-NDA-Requests
SRE
LDAP-Access-Requests
Mar 31 2021, 9:51 AM
Assigned: jcrespo
T264190 Research storage solutions for media backups
SRE-swift-storage
SRE
Goal
Data-Persistence-Backup
Mar 18 2021, 5:51 PM
Assigned: jcrespo
T262669 Plan logical and physical design for media backups
SRE-swift-storage
SRE
Goal
Sep 30 2020, 1:52 PM
Assigned: jcrespo
T257551 Expand database provisioning/backup service to accomodate for growing capacity and high availability needs
DBA
Goal
Patch-For-Review
Sep 29 2020, 8:44 AM
Assigned: jcrespo
T249281 Request for new list COVID-19-stats
Wikimedia-Mailing-lists
SRE
Apr 3 2020, 9:54 AM
Assigned: jcrespo
T241089 Restore access for bmansurov
SRE
SRE-Access-Requests
Dec 26 2019, 5:16 PM
Assigned: jcrespo
T240732 Requesting access to stat1004, stat1007, stat1006, notebook1003, notebook1004 for Kate Zimmerman
Request
·
SRE-Access-Requests
SRE
Dec 24 2019, 8:59 AM
Assigned: jcrespo
T238048 Followup to backup1001 bacula switchover (misc pending tasks)
SRE
Goal
Data-Persistence-Backup
Patch-For-Review
Feb 15 2021, 6:14 PM
Assigned: jcrespo
T236406 Switchover backup director service from helium to backup1001
SRE
serviceops
DBA
Goal
Patch-For-Review
Nov 12 2019, 9:22 AM
Assigned: jcrespo
T234900 Setup bacula backup monitoring
SRE
Goal
observability
Sustainability
Patch-For-Review
Data-Persistence-Backup
Oct 20 2020, 4:54 PM
Assigned: jcrespo
T219631 Create a recovery/provisioning script for database binary backups
DBA
Jul 19 2019, 5:29 PM
Assigned: jcrespo
T218302 Choose DB/Cluster for WikimediaEditorTasks tables
WikimediaEditorTasks
DBA
Product-Infrastructure-Team-Backlog-Deprecated
May 23 2019, 4:20 PM
Assigned: jcrespo
T213664 correctable memory errors db1068 (commons primary master database)
SRE
DBA
Patch-For-Review
May 11 2019, 5:12 AM
Assigned: jcrespo
T213406 Purchase and setup remaining hosts for database backups
DBA
Goal
May 10 2019, 4:40 PM
Assigned: jcrespo
T213404 Design the final architecture for the database binary backups
DBA
Mar 14 2019, 7:00 PM
Assigned: jcrespo
T213108 db1082 power loss resulted on mysql crash
SRE
DBA
Data-Services
Patch-For-Review
Jan 9 2019, 4:24 PM
Assigned: jcrespo
T209726 Need to shut down a list, mediation-en-l
Wikimedia-Mailing-lists
SRE
Nov 28 2018, 10:16 AM
Assigned: jcrespo
T208565 db2094 s3 replication broke
DBA
Nov 2 2018, 3:14 PM
Assigned: jcrespo
T206203 Implement database binary backups into the production infrastructure
DBA
Goal
Jun 26 2019, 12:05 PM
Assigned: jcrespo
T201603 db2069 storage crash
ops-codfw
DBA
SRE
Aug 22 2018, 11:55 AM
Assigned: jcrespo
T199224 Test database master switchover script on codfw
DBA
Patch-For-Review
Jul 24 2018, 5:08 PM
Assigned: jcrespo
T193919 provide proxysql for stretch, add package to puppet
SRE
Patch-For-Review
Jul 2 2018, 12:32 PM
Assigned: jcrespo
T191149 labsdb1009 crashed
DBA
Data-Services
Patch-For-Review
Apr 2 2018, 6:48 PM
Assigned: jcrespo
T188505 Investigate why query killer didn't kill 1-hour long queries
DBA
Sustainability (Incident Followup)
Mar 6 2018, 4:34 PM
Assigned: jcrespo
T186585 Review m5 backups
Data-Services
cloud-services-team (Kanban)
DBA
Feb 14 2018, 10:50 AM
Assigned: jcrespo
T186318 Exporting wiki (Special:Export) pages instability/high error rate
MediaWiki-Core-Snapshots
User-notice-archive
Mar 8 2018, 4:58 PM
Assigned: jcrespo
T176557 High replag on s1, s3, s5
Toolforge
DBA
Sep 24 2017, 11:10 AM
Assigned: jcrespo
T172490 Monitor swap/memory usage on databases
DBA
observability
Sustainability (Incident Followup)
Patch-For-Review
Aug 10 2020, 4:56 PM
Assigned: jcrespo
T169038 SQL dewiki_p categorylinks cl_from index missing
Cloud-VPS
cloud-services-team
Cloud-Services
DBA
Jun 28 2017, 4:22 PM
Assigned: jcrespo
T167784 WMF ParserCache disk space exhaustion
MediaWiki-Parser
DBA
Performance-Team
MediaWiki-Platform-Team-Archived (MWPT-Q1-Jul-Sep-2017)
Aug 24 2017, 11:33 AM
Assigned: jcrespo
T167567 Migrate parsercache hosts to file per table
DBA
Patch-For-Review
Jun 19 2017, 11:27 AM
Assigned: jcrespo
T166207 Convert unique keys into primary keys for some wiki tables on s5
DBA
Schema-change-in-production
Patch-For-Review
Jun 28 2017, 4:45 PM
Assigned: jcrespo
T166194 Database replication issues with deleted pages (affecting Tool Labs and Analytics Store)
DBA
Tool-Database-Queries
Analytics
MediaWiki-Page-deletion
Cloud-Services
May 24 2017, 5:58 AM
Assigned: jcrespo
T162519 s51362 has been rate limited to 2 concurrent connections for creating hundreds of 1400-second queries to labsdb1001 and labsdb1003 every 10 seconds
DBA
Toolforge
Cloud-Services
Tools
Tool-Erwin's-tools
Jul 31 2017, 9:46 AM
Assigned: jcrespo
T160984 Reduce max execution time of interactive queries or a better detection and killing of bad query patterns
DBA
Performance Issue
Patch-For-Review
Sustainability (Incident Followup)
Apr 28 2017, 6:11 PM
Assigned: jcrespo
T160916 Special:AllPages disabled due to performance issues
WMF-General-or-Unknown
MW-1.29-release (WMF-deploy-2017-03-28_(1.29.0-wmf.18))
MW-1.29-release-notes
User-notice-archive
Mar 23 2017, 5:34 PM
Assigned: jcrespo
T160509 run pt-tablechecksum on s6
DBA
Patch-For-Review
Jan 18 2018, 12:20 PM
Assigned: jcrespo
T156373 During Phabricator upgrade on 2017-01-26, all m3 replica dbs crashed at the same time
DBA
SRE
Release-Engineering-Team
Phabricator
Upstream
Feb 1 2017, 6:48 AM
Assigned: jcrespo
T156305 Update page_assessments_projects schema for subprojects in production
DBA
Schema-change-in-production
MediaWiki-extensions-PageAssessments
Community-Tech
Feb 2 2017, 6:40 PM
Assigned: jcrespo
T156005 Reimage db1065 and db1066
SRE
DBA
Patch-For-Review
Jan 25 2017, 6:55 AM
Assigned: jcrespo
T154485 run pt-table-checksum on s2 (WAS: run pt-table-checksum before decommissioning db1015, db1035,db1044,db1038)
DBA
Patch-For-Review
Jan 17 2018, 6:20 PM
Assigned: jcrespo
T153440 Create a full backup of all external storage records that would be easy to restore/setup a temporary delayed slave
SRE
DBA
Patch-For-Review
Apr 6 2018, 5:04 AM
Assigned: jcrespo
T153184 s3 database resource usage and contention increased 2-10x times
DBA
Performance Issue
Dec 15 2016, 6:12 PM
Assigned: jcrespo
T152766 dbstore1001 duplicate entry on s4 commonswiki.recentchanges
DBA
Patch-For-Review
Dec 12 2016, 6:31 PM
Assigned: jcrespo
T152029 Rolling restart of parsercache servers for TLS certificate update
DBA
SRE
Patch-For-Review
Dec 1 2016, 7:53 PM
Assigned: jcrespo
T151995 Rolling restart of external storage servers for TLS certificate update
DBA
SRE
Patch-For-Review
Dec 1 2016, 7:04 PM
Assigned: jcrespo
T151029 duplicate key problems
DBA
Patch-For-Review
Jul 21 2017, 3:24 PM
Assigned: jcrespo
T148434 es2014 raid controler temporary failure
ops-codfw
SRE
DBA
Oct 18 2016, 4:42 PM
Assigned: jcrespo
T146673 Contention on search phabricator database creating full phabricator outages
Phabricator
Patch-For-Review
DBA
Sustainability (Incident Followup)
Oct 14 2016, 8:14 AM
Assigned: jcrespo
T145607 db1082 hardware check
DBA
SRE
ops-eqiad
Sep 15 2016, 1:02 PM
Assigned: jcrespo
T143932 MySQL chooses poor query plan for link counting query
Discovery-ARCHIVED
CirrusSearch
Discovery-Search (Current work)
DBA
Patch-For-Review
MW-1.28-release (WMF-deploy-2016-08-30_(1.28.0-wmf.17))
MW-1.28-release (WMF-deploy-2016-08-23_(1.28.0-wmf.16))
MW-1.28-release (WMF-deploy-2016-10-25_(1.28.0-wmf.23))
MW-1.29-release (WMF-deploy-2016-11-08_(1.29.0-wmf.2))
Nov 17 2016, 9:47 PM
Assigned: jcrespo
T142545 Create production database and users for Striker
Community-Tech-Tool-Labs
Striker
DBA
Patch-For-Review
Aug 25 2016, 11:54 PM
Assigned: jcrespo
T141046 db1011 disk failure (degraded RAID)
ops-eqiad
SRE
Jul 22 2016, 2:00 PM
Assigned: jcrespo
T140452 Initial setup and provision of labsdb1009, labsdb1010 and labsdb1011
Cloud-Services
DBA
Cloud-VPS
Patch-For-Review
Nov 3 2016, 6:13 PM
Assigned: jcrespo
T138559 Correct m1 backups, that were being done supposing m1-master was still a slave
Wikimedia-Etherpad
DBA
SRE
Patch-For-Review
Jun 24 2016, 10:59 AM
Assigned: jcrespo
T138283 Some users use persistent connections that are idle, wasting memory and other resources that could be used for other users
DBA
Cloud-Services
Toolforge
Discovery-ARCHIVED
Maps
Jun 28 2016, 3:29 PM
Assigned: jcrespo
T137707 Antigng-bot improper non-api http requests
DBA
Cloud-Services
Toolforge
Traffic
SRE
Jul 14 2016, 1:14 PM
Assigned: jcrespo
T137084 db2034 crash
DBA
ops-codfw
SRE
Jun 10 2016, 1:12 PM
Assigned: jcrespo
T136618 Wrong page title in labs database replica enwiki page table
DBA
Cloud-Services
Mar 3 2017, 10:16 AM
Assigned: jcrespo
T135971 labsdb1001 crashed yesterday at 21:48:07
Cloud-VPS
DBA
Cloud-Services
May 31 2016, 3:46 PM
Assigned: jcrespo
T135100 High replication lag to dewiki
DBA
SRE
May 26 2016, 1:12 PM
Assigned: jcrespo
T134349 Upgrade db1069
Cloud-Services
SRE
DBA
Cloud-VPS
May 7 2016, 3:15 PM
Assigned: jcrespo
T134203 enwiki_p replica on s1 is corrupted
Cloud-Services
Toolforge
DBA
Jan 24 2017, 2:56 PM
Assigned: jcrespo
T133339 Improve lag detection mechanism's reliability and agility
DBA
May 18 2016, 4:53 PM
Assigned: jcrespo
T132431 labsdb1001 and labsdb1003 short on available space
DBA
Toolforge
Cloud-Services
Apr 27 2017, 9:42 AM
Assigned: jcrespo
T130692 Add new indexes from eec016ece6d2b30addcdf3d3efcc2ba59b10e858 to production databases
DBA
Schema-change-in-production
Community-Tech
Patch-For-Review
May 24 2016, 9:36 AM
Assigned: jcrespo
T130647 alias /apple-app-site-association and /.well-known/apple-app-site-association
Traffic
SRE
Mobile-Apps
Patch-For-Review
Jun 7 2016, 7:22 AM
Assigned: jcrespo
T130351 Configure and provision db1074-db1078
DBA
Mar 24 2016, 1:25 PM
Assigned: jcrespo
T129432 Lost database changes on s2 for 3 hours on labs replicas
Cloud-Services
Cloud-VPS
DBA
Chinese-Sites
Feb 14 2017, 3:23 PM
Assigned: jcrespo
T129236 Improve documentation about database switchover
SRE
codfw-rollout
codfw-rollout-Jan-Mar-2016
DBA
Apr 28 2016, 9:49 AM
Assigned: jcrespo
T128737 Move labs pdns database off of m5-master
Cloud-Services
DBA
Patch-For-Review
May 10 2016, 2:59 PM
Assigned: jcrespo
T128185 Prepare mysql account and options for prometheus
DBA
Patch-For-Review
Prometheus-metrics-monitoring
Aug 3 2016, 10:01 AM
Assigned: jcrespo
T127107 Copy user database to c1
Toolforge
Cloud-Services
DBA
Feb 17 2016, 6:45 PM
Assigned: jcrespo
T126946 disk failure on labsdb1002
SRE
Cloud-Services
DBA
Jul 28 2016, 5:13 PM
Assigned: jcrespo
T125591 Set up additional filters for Echo tables
SRE
DBA
Cloud-Services
Patch-For-Review
Feb 4 2016, 2:35 PM
Assigned: jcrespo
T125527 Backup all of /srv on mira and/or tin (deployment servers)
Deployments
Release-Engineering-Team
SRE
Patch-For-Review
Feb 2 2016, 4:19 PM
Assigned: jcrespo
T125215 Prepare db1018 and s2-slaves for s2 master failover
SRE
DBA
Patch-For-Review
Feb 10 2016, 2:17 PM
Assigned: jcrespo
T124795 codfw is in read only according to mediawiki
codfw-rollout
MediaWiki-Configuration
DBA
SRE
codfw-rollout-Jan-Mar-2016
Release-Engineering-Team
Patch-For-Review
Mar 10 2016, 7:09 PM
Assigned: jcrespo
T124704 puppetize mysql m5-master access on parsoid-test server
Parsoid-Tests
Parsoid
DBA
Jan 27 2016, 5:53 PM
Assigned: jcrespo
T124703 Need databases provisioned for parsoid-rt testing, visual diff testing
SRE
Parsoid
Jan 26 2016, 6:14 PM
Assigned: jcrespo
T124697 Stress-test mediawiki application servers at codfw (specially to figure out db weights configuration) and basic buffer warming
codfw-rollout
codfw-rollout-Jan-Mar-2016
DBA
SRE
Performance Issue
Patch-For-Review
Mar 31 2016, 4:10 PM
Assigned: jcrespo
T123731 Migrate labsdb1005/1006/1007 to jessie
SRE
Cloud-VPS
Cloud-Services
DBA
Patch-For-Review
Mar 31 2017, 3:26 PM
Assigned: jcrespo
T123130 Labs: High Replication Lag (s6 on c1, s1 and s5 on c2)
Cloud-Services
DBA
Jan 18 2016, 1:33 PM
Assigned: jcrespo
T121509 Correct the schema to make revision id columns of cx_translations nullable
ContentTranslation
DBA
Schema-change
Schema-change-in-production
LE-CX7-Sprint 4
OKR-Work
Dec 17 2015, 11:49 AM
Assigned: jcrespo
T121207 Implement slave_run_triggers_for_rbr at sanitarium for labs filtering
DBA
Jul 20 2017, 4:06 PM
Assigned: jcrespo
T120674 Drop tables MobileWebClickTracking_* from eventlogging db
Analytics-Backlog
MediaWiki-extensions-EventLogging
DBA
Dec 15 2015, 6:33 PM
Assigned: jcrespo
T120122 Perform a rolling restart of all MySQL slaves (masters too for those services with low traffic)
SRE
DBA
Patch-For-Review
Apr 22 2016, 9:58 AM
Assigned: jcrespo
T119642 Create a Master-master topology between datacenters for easier failover (setup circular replication dallas -> eqiad for mysql databases)
DBA
SRE
codfw-rollout
codfw-rollout-Jan-Mar-2016
Mar 16 2016, 11:36 AM
Assigned: jcrespo
T119619 Decide storage backend for performance schema monitoring stats
SRE
DBA
Prometheus-metrics-monitoring
Feb 14 2017, 3:17 PM
Assigned: jcrespo
T119414 Global user contributions doesn't work
Stewards-and-global-tools
Tool-Global-user-contributions
Dec 1 2015, 6:00 PM
Assigned: jcrespo
T119315 labsdb1002 and labsdb1003 crashed, affecting replication
DBA
Cloud-Services
SRE
Toolforge
Nov 24 2015, 11:15 AM
Assigned: jcrespo
T118079 Bug on MariaDB use_stat_tables
SRE
DBA
Apr 22 2016, 4:04 PM
Assigned: jcrespo
T117787 Make ref_id of flow_wiki_ref and flow_ext_ref not null and PK (DBA phase 2)
Patch-For-Review
OKR-Work
Collaboration-Team-Archive-2015-2016
StructuredDiscussions
DBA
Schema-change-in-production
Dec 17 2015, 11:49 AM
Assigned: jcrespo
T117783 Add ref_id to flow_wiki_ref and flow_ext_ref (DBA phase 1)
Patch-For-Review
OKR-Work
StructuredDiscussions
Schema-change-in-production
DBA
Collaboration-Team-Archive-2015-2016
Nov 5 2015, 6:10 PM
Assigned: jcrespo
T116599 Eventlogging tables not replicating from master to slave
Analytics-Backlog
MediaWiki-extensions-EventLogging
DBA
Oct 27 2015, 3:23 PM
Assigned: jcrespo
T113901 Odd plan for simple query on revisions + page
DBA
Upstream
Apr 22 2016, 4:03 PM
Assigned: jcrespo
T112492 Can't delete security group rules after OpenStack upgrade
Cloud-Services
Toolforge
Cloud-VPS
Labs-Sprint-115
Sep 25 2015, 6:05 PM
Assigned: jcrespo
T112479 Check, test and tune pool-of-connections and max_connections configuration
DBA
SRE
Oct 29 2015, 3:28 PM
Assigned: jcrespo
T112478 Upgrade db1055 mysql version and configuration, and reduce its pool weight
DBA
SRE
Oct 8 2015, 2:09 PM
Assigned: jcrespo
T112041 New database for designate pool manager
Cloud-Services
Cloud-VPS
DBA
Patch-For-Review
Sep 10 2015, 9:48 AM
Assigned: jcrespo
T111333 wikishared database has latin1 as the default encoding
ContentTranslation
DBA
ContentTranslation-Release6
OKR-Work
Schema-change-in-production
Sep 10 2015, 10:00 AM
Assigned: jcrespo
T111084 Do backfill and final schema change for "Segregate Reference objects by source wiki."
Collaboration-Team-Archive-2015-2016
StructuredDiscussions
OKR-Work
DBA
Patch-For-Review
WMF-deploy-2015-09-15_(1.26wmf23)
Oct 22 2015, 2:05 PM
Assigned: jcrespo
T109069 TokuDB crashes frequently -consider upgrade it or search for alternative engines with similar features
DBA
SRE
Upstream
Aug 3 2016, 12:37 PM
Assigned: jcrespo
T106682 SpecialWhatLinksHere::showIndirectLinks - Lost connection to MySQL server during query (10.64.16.28)
MediaWiki-Special-pages
DBA
Wikimedia-production-error
Patch-For-Review
MW-1.26-release
WMF-deploy-2015-08-04_(1.26wmf17)
Aug 6 2015, 12:48 PM
Assigned: jcrespo
T106647 mariadb multi-source replication glitch with site_identifiers
DBA
SRE
Aug 15 2015, 2:49 PM
Assigned: jcrespo
T106470 Tool Labs enwiki_p replicated database missing rows
Toolforge
Cloud-Services
DBA
Jul 29 2015, 7:14 PM
Assigned: jcrespo
T105713 missing database on replica server
Cloud-Services
Toolforge
Jul 17 2015, 3:40 PM
Assigned: jcrespo
T105135 Implement mariadb 10.0 masters
DBA
SRE
Patch-For-Review
Apr 22 2016, 4:24 PM
Assigned: jcrespo
T104743 Check wikilove_log table exists on all wikis and create it where it doesn't
Technical-Debt
Collaboration-Team-Triage
WikiLove
Wikimedia-Site-requests
DBA
Jul 8 2015, 6:55 PM
Assigned: jcrespo
T104471 Tables created on the s7 master have not been replicated to dbstore2001 and dbstore2002. Replication issue?
DBA
Patch-For-Review
Jul 3 2015, 11:12 AM
Assigned: jcrespo
T99485 implement performance_schema for mysql monitoring
DBA
Patch-For-Review
SRE
Prometheus-metrics-monitoring
Feb 14 2017, 3:16 PM
Assigned: jcrespo
T98958 Reinstall db1009.eqiad from zero
Cloud-Services
Patch-For-Review
May 14 2015, 12:33 PM
Assigned: jcrespo
T94427 Perform schema change to echo_target_page changing from a 1 to 1 mapping between pages and user/notification to a 1 to many.
Schema-change
Notifications
Collaboration-Team-Sprint-T-2015-04-08
Collaboration-Team-Archive-2015-2016
OKR-Work
Aug 28 2015, 5:28 PM
Assigned: jcrespo
T92841 Database replicas: replicate user.user_touched
Cloud-Services
DBA
Nov 29 2015, 10:51 PM
Assigned: jcrespo
T92693 Get Labs openstack service dbs on a proper db server
Cloud-Services
Patch-For-Review
DBA
Jun 16 2015, 8:32 AM
Assigned: jcrespo
T88718 Make sure tools-db is replicated somewhere
Cloud-Services
Toolforge
ToolLabs-Goals-Q4
Labs-Q4-Sprint-2
Labs-Q4-Sprint-1
Labs-Sprint-100
Patch-For-Review
DBA
labs-sprint-116
Oct 5 2015, 9:03 AM
Assigned: jcrespo
T362883 decommission db2099.codfw.wmnet
Request
·
decommission-hardware
Thu, Apr 18, 1:30 PM
Assigned: jcrespo
T362802 decommission db2097.codfw.wmnet
Request
·
decommission-hardware
Thu, Apr 18, 1:30 PM
Assigned: jcrespo
T362611 Alert in need of triage: SystemdUnitFailed (instance db2200:9100)
sre-alert-triage
DBA
Tue, Apr 16, 7:59 AM
Assigned: jcrespo
T361705 ProbeDown - miscweb1003
collaboration-services
Wed, Apr 3, 1:51 PM
Assigned: jcrespo
T360751 Upgrade backup sources to MariaDB 10.6
Data-Persistence-Backup
Data-Persistence
Patch-For-Review
Tue, Apr 23, 12:50 PM
Assigned: jcrespo
T358922 Requesting access to analytics-privatedata-users for GeorgeMikesell
SRE-Access-Requests
SRE
Patch-For-Review
Tue, Mar 26, 5:22 PM
Assigned: jcrespo
T351895 Make it easy to retrieve disk usage trends on backup storage for hw provisioning
Data-Persistence-Backup
bacula
media-backups
database-backups
Nov 23 2023, 3:13 PM
Assigned: jcrespo
T347674 Expand bacula space by provisioning new backup hosts
Data-Persistence-Backup
bacula
Nov 6 2023, 6:00 PM
Assigned: jcrespo
T346233 Setup automation to detect long running backups
DBA
database-backups
Data-Persistence-Backup
Data-Persistence
Sep 20 2023, 9:21 AM
Assigned: jcrespo
T335269 Update production ssh public key for jcrespo
SRE-Access-Requests
SRE
Apr 24 2023, 10:57 AM
Assigned: jcrespo
T334057 Replace db1102 with db1225
Data-Persistence-Backup
database-backups
Apr 18 2023, 10:49 AM
Assigned: jcrespo
T330882 transferpy should not log cumin subcomands as ERRORs on a normal, succesful run
Data-Persistence-Backup
database-backups
Patch-For-Review
Nov 14 2023, 12:42 PM
Assigned: jcrespo
T317169 Find the right procedure to update wiki footers (was en.wikibooks.org has changed legal footer)
SRE
observability
Observability-Alerting
WikimediaMessages
WMF-Legal
Jan 12 2023, 5:17 PM
Assigned: jcrespo
T299964 Incident: 2021-11-02 Cloud VPS networking
SRE-OnFire (FY2021/2022-Q2)
cloud-services-team (Kanban)
Apr 28 2022, 6:39 PM
Assigned: jcrespo
T298120 Delay run of weekly backups for es4 and s5 content to avoid running it while the dump is incomplete
database-backups
bacula
Data-Persistence-Backup
Jul 22 2022, 9:24 AM
Assigned: jcrespo
T295157 Incident: 2021-10-29 graphite
SRE-OnFire (FY2021/2022-Q2)
Apr 28 2022, 6:46 PM
Assigned: jcrespo
T278408 db2135 crashed
DBA
Wikimedia-Mailing-lists
SRE
Apr 5 2021, 9:58 AM
Assigned: jcrespo
T277323 (Need By: 2021-04-30) rack/setup/install backup200[4-7]
DC-Ops
ops-codfw
SRE
Patch-For-Review
May 25 2021, 8:36 AM
Assigned: jcrespo
T274809 Drop unused database "bacula" from m1
Data-Persistence
Data-Persistence-Backup
DBA
Mar 2 2021, 2:49 PM
Assigned: jcrespo
T274206 (Need By: 2021-03-31) rack/setup/install ms-backup100[12]
DC-Ops
ops-eqiad
SRE
Jan 10 2022, 4:54 PM
Assigned: jcrespo
T274185 (Need By: TBD) rack/setup/install backup2003
DC-Ops
ops-codfw
SRE
Mar 4 2021, 6:36 PM
Assigned: jcrespo
T273182 Revert OpenSSL min version configuration introduced for bacula compatibility
SRE
Data-Persistence-Backup
Apr 29 2021, 8:37 AM
Assigned: jcrespo
T272686 print a list of backed up directories in the MOTD of production servers
SRE
Data-Persistence-Backup
Jan 29 2021, 11:47 AM
Assigned: jcrespo
T268212 cumin1001 & cumin2001: regular_snapshot.service: Failed
SRE
Data-Persistence-Backup
Nov 19 2020, 10:23 AM
Assigned: jcrespo
T266636 Orchestrator db logical backups
DBA
Data-Persistence-Backup
Orchestrator
Jan 28 2021, 7:07 AM
Assigned: jcrespo
T265323 Add toil::systemd_scope_cleanup to dbprov hosts
SRE-tools
SRE
Data-Persistence-Backup
Oct 27 2020, 1:23 PM
Assigned: jcrespo
T264189 Prepare a proof of concept of the minimum setup capable of backup and recover testwiki media files
SRE-swift-storage
SRE
Goal
Data-Persistence-Backup
Dec 21 2020, 10:31 PM
Assigned: jcrespo
T263842 S5 replication issue, affecting watchlist and probably recentchanges
DBA
SRE
Wikimedia-Incident
Sustainability (Incident Followup)
Oct 6 2020, 7:34 AM
Assigned: jcrespo
T260876 dbtree slowdown 2020-08-20
DBA
Aug 21 2020, 9:16 AM
Assigned: jcrespo
T260717 decom helium and heze
SRE
DC-Ops
Patch-For-Review
Data-Persistence-Backup
Jan 29 2021, 11:12 AM
Assigned: jcrespo
T260686 check_mariadb_dump failing on alert[12]* hosts
observability
DBA
Aug 28 2020, 9:26 AM
Assigned: jcrespo
T258045 Move database backups metadata to m1
SRE
Jul 15 2020, 2:27 PM
Assigned: jcrespo
T257928 Create a parallel OTRS database with a frozen snapshot of the production one
Znuny
SRE
serviceops
DBA
Jul 16 2020, 7:23 AM
Assigned: jcrespo
T257502 Requesting access to analytics-privatedata-users for mooeypoo
SRE-Access-Requests
SRE
Jul 13 2020, 8:03 AM
Assigned: jcrespo
T257187 Requesting access to production infrastructure services for jgiannelos
Request
·
SRE-Access-Requests
SRE
Jul 10 2020, 8:53 AM
Assigned: jcrespo
T256846 labtestpuppetmaster2001 is failing to backup
cloud-services-team (Kanban)
Puppet
DBA
Patch-For-Review
Aug 20 2020, 3:14 PM
Assigned: jcrespo
T256201 Add Guergana Tzatchkova to the ldap/wmde and ldap/nda group
SRE
LDAP-Access-Requests
WMF-Legal
Jul 10 2020, 9:56 AM
Assigned: jcrespo
T254516 Get a writable reviewdb clone to test Gerrit upgrade with
Gerrit
DBA
Jun 10 2020, 10:39 AM
Assigned: jcrespo
T252698 Lost password for wikimedia-vn mailling list
Wikimedia-Mailing-lists
SRE
May 13 2020, 5:27 PM
Assigned: jcrespo
T250817 (Need By: TBD) rack/setup/install backup2002 + array
DC-Ops
SRE
ops-codfw
Apr 21 2020, 3:18 PM
Assigned: jcrespo
T250816 (Need By: TBD) rack/setup/install backup1002 + array
DC-Ops
SRE
ops-eqiad
DBA
May 11 2020, 6:18 PM
Assigned: jcrespo
T250361 replace phabricator db passwords with longer passwords
SRE
DBA
Phabricator
Aug 18 2020, 8:46 AM
Assigned: jcrespo
T249272 LDAP access to the wmf group for Alex Paskulin
LDAP-Access-Requests
SRE
Apr 3 2020, 8:09 AM
Assigned: jcrespo
T248949 Remove the account "Matthias Geisler" from the wmde LDAP group
LDAP-Access-Requests
SRE
cloud-services-team (Kanban)
Apr 1 2020, 12:03 PM
Assigned: jcrespo
T248910 Creation of three Wikimedia CH mailing lists
Wikimedia-Mailing-lists
SRE
Apr 3 2020, 9:36 AM
Assigned: jcrespo
T247750 Offboard Sandra Müllrick from WMF systems
SRE
LDAP-Access-Requests
Apr 1 2020, 4:49 PM
Assigned: jcrespo
T246198 db1140 s2 replication disconnected temporarily
DBA
Feb 26 2020, 1:46 PM
Assigned: jcrespo
T244958 db1095 backup source crashed: broken BBU
DBA
SRE
ops-eqiad
Feb 27 2020, 7:45 AM
Assigned: jcrespo
T243265 Check why compare.py doesn't work with Percona 8.0
DBA
Mar 26 2020, 2:55 PM
Assigned: jcrespo
T240680 Requesting access to Turnilo
LDAP-Access-Requests
SRE
Dec 16 2019, 2:15 PM
Assigned: jcrespo
T240570 Upload zuul_2.5.1-wmf11 to apt.wikimedia.org
Zuul
Gerrit
Continuous-Integration-Infrastructure
Release-Engineering-Team-TODO (201912)
Release-Engineering-Team (CI & Testing services)
SRE
Dec 13 2019, 10:45 AM
Assigned: jcrespo
T240382 Grant "contint-roots" and "releasers-mediawiki" to user brennen
SRE
Release-Engineering-Team-TODO
Continuous-Integration-Infrastructure
SRE-Access-Requests
Dec 17 2019, 10:12 AM
Assigned: jcrespo
T240243 Add accraze to analytics-privatedata-users
SRE-Access-Requests
SRE
Analytics
Dec 12 2019, 3:03 PM
Assigned: jcrespo
T237927 Add replication lag (and other checks) to misc all hosts
DBA
May 13 2020, 2:10 PM
Assigned: jcrespo
T237264 Schema change for T234955 - add column wetc_revert_count to wikimedia_editor_tasks_counts
Wikipedia-Android-App-Backlog (Android-app-release-v2.7.29x-N-Nanaimo-Bar)
Product-Infrastructure-Team-Backlog-Deprecated
DBA
Schema-change-in-production
Nov 5 2019, 5:28 PM
Assigned: jcrespo
T236924 dbprov2002 slower to generate snapshots
DBA
Nov 5 2019, 9:43 AM
Assigned: jcrespo
T234152 snapshot for s6/s7 at eqiad taken more than 4 days ago
SRE
DBA
Sep 30 2019, 8:00 PM
Assigned: jcrespo
T229209 Strengthen backup infrastructure and support
SRE
serviceops
DBA
Goal
Patch-For-Review
Apr 16 2020, 8:12 AM
Assigned: jcrespo
T228613 Re-build db2097 s1 and s6
DBA
May 13 2020, 10:14 AM
Assigned: jcrespo
T225378 db2097 (codfw s1&s6 source backups) mariadb@s6 *process* (10.1.39) crashed on 2019-06-08
DBA
SRE
Jul 22 2019, 5:04 AM
Assigned: jcrespo
T225131 (OoW) Degraded RAID on es2003
ops-codfw
SRE
Jul 18 2019, 5:02 AM
Assigned: jcrespo
T224456 Degraded RAID on db2035
ops-codfw
SRE
DBA
May 28 2019, 6:24 PM
Assigned: jcrespo
T220572 Productionize eqiad and codfw source backup hosts & codfw backup test host
DBA
May 9 2019, 8:57 AM
Assigned: jcrespo
T219399 rack/setup/deploy eqiad dedicated backup recovery/provisioning hosts
DBA
ops-eqiad
SRE
Patch-For-Review
Apr 25 2019, 5:08 PM
Assigned: jcrespo
T210299 Wikimedia-GIN
Wikimedia-Mailing-lists
SRE
Nov 28 2018, 10:40 AM
Assigned: jcrespo
T210292 Implement a proof of concept of a snapshot cycle automation for a mediawiki section database
DBA
Patch-For-Review
Mar 22 2019, 6:23 PM
Assigned: jcrespo
T210028 LDAP requests for Jeena Huneidi
LDAP-Access-Requests
Release-Engineering-Team (Kanban)
SRE
Nov 27 2018, 6:29 PM
Assigned: jcrespo
T210027 access request for Jeena Huneidi (deployment, conint-admins, contint-docker)
Request
·
SRE-Access-Requests
SRE
Patch-For-Review
Nov 27 2018, 6:28 PM
Assigned: jcrespo
T210022 Allow access to Data Lake/Hive for Niharika
Analytics
SRE-Access-Requests
SRE
Patch-For-Review
Nov 26 2018, 11:24 PM
Assigned: jcrespo
T209081 Requesting creation of librarycard-dev mailing list
Wikimedia-Mailing-lists
SRE
Nov 28 2018, 11:09 AM
Assigned: jcrespo
T208462 Error Unknown column ipb_sitewide in field list on query
SRE
Anti-Harassment
DBA
Nov 22 2018, 1:33 PM
Assigned: jcrespo
T208432 Requesting access to Jupyter notebook / analytics-privatedata-users for jgleeson
Request
·
SRE-Access-Requests
SRE
Patch-For-Review
Nov 30 2018, 11:01 AM
Assigned: jcrespo
T208151 prometheus-mysqld-exporter not starts on db1117
DBA
User-Banyek
Oct 30 2018, 2:36 PM
Assigned: jcrespo
T206743 S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")
Wikidata
Wikidata Lexicographical data
Datacenter-Switchover
User-Addshore
DBA
Wikimedia-Incident
Wikidata-Campsite (Wikidata-Campsite-Iteration-∞ (On Hold))
User-notice-archive
Oct 30 2018, 3:00 PM
Assigned: jcrespo
T206204 Research options for producing binary backups (lvm snapshots, cold backups, mariabackup)
DBA
Nov 30 2018, 12:09 PM
Assigned: jcrespo
T204311 Upgrade all core (mediawiki) database servers to mariadb 10.1
DBA
SRE
Patch-For-Review
Sep 17 2018, 6:05 PM
Assigned: jcrespo
T203969 Create Icinga alerts on backup generation failure
DBA
Patch-For-Review
Sep 27 2018, 12:15 PM
Assigned: jcrespo
T201392 Finish eqiad metadata database backup setup (s1-s8, x1)
DBA
Patch-For-Review
Oct 4 2018, 9:51 AM
Assigned: jcrespo
T200035 DB backup restore skip empty databases
Upstream
Data-Persistence-Backup
Mar 1 2023, 12:27 PM
Assigned: jcrespo
T198987 Gather statistics about the backups on a database
DBA
Patch-For-Review
Sep 27 2018, 12:38 PM
Assigned: jcrespo
T198937 Setup database on tendril hosts to gather backup statistics
DBA
Patch-For-Review
Jul 6 2018, 6:20 PM
Assigned: jcrespo
T198447 Monitor backup generation for failure or incorrect generation
DBA
Goal
Sep 27 2018, 2:56 PM
Assigned: jcrespo
T197073 switchover es1014 to es1017
DBA
Patch-For-Review
Jul 25 2018, 7:31 AM
Assigned: jcrespo
T196339 pc2005 down
ops-codfw
SRE
DBA
Patch-For-Review
Jul 2 2018, 5:05 AM
Assigned: jcrespo
T196047 reimage db2083 back into wikidata (s8)
DBA
Patch-For-Review
Jul 2 2018, 2:11 AM
Assigned: jcrespo
T194516 Bug on mariadb systemd unit on stretch for multi-instance hosts
DBA
Packaging
Patch-For-Review
Jul 1 2018, 6:41 PM
Assigned: jcrespo
T193226 Test MySQL 8.0 with production data and evaluate its fit for WMF databases
DBA
Apr 20 2020, 9:19 AM
Assigned: jcrespo
T192979 Productionize 8 eqiad hosts
DBA
Patch-For-Review
Jul 1 2018, 5:14 AM
Assigned: jcrespo
T192358 Setup database logical backups on eqiad
DBA
Patch-For-Review
Jul 6 2018, 7:22 AM
Assigned: jcrespo
T192340 Cron <www-data@terbium> /usr/local/bin/mwscriptwikiset extensions/FlaggedRevs/maintenance/updateStats.php flaggedrevs.dblist > /dev/null creates cron spam every 2 hours
MediaWiki-extensions-FlaggedRevs
Patch-For-Review
Apr 25 2018, 3:59 PM
Assigned: jcrespo
T191977 remote ipmi doesn't work for es2013
DBA
SRE
Patch-For-Review
DC-Ops
ops-codfw
Apr 12 2018, 4:46 PM
Assigned: jcrespo
T189656 Switchover m2 master from db1020 to db1051
DBA
SRE
Patch-For-Review
Mar 15 2018, 4:05 PM
Assigned: jcrespo
T189655 Switchover m1 master from db1016 to db1063
DBA
SRE
Patch-For-Review
Mar 20 2018, 5:12 PM
Assigned: jcrespo
T189384 Faster backups by starting mydumper execution of different sections in parallel when they are about to finish and are running on a limited number of threads
DBA
Patch-For-Review
Mar 28 2018, 8:27 AM
Assigned: jcrespo
T189383 Faster backups by archiving and unarchiving databases in parallel
DBA
Patch-For-Review
Mar 27 2018, 11:24 AM
Assigned: jcrespo
T187143 Upcoming phabricator upgrade requires unusually long database migrations
DBA
Release
Phabricator (2018-02-15)
Patch-For-Review
Feb 15 2018, 6:59 AM
Assigned: jcrespo
T186596 dbstore1001 crashed: Multibit ECC errors were detected on the RAID controller.
DBA
SRE
ops-eqiad
Patch-For-Review
Apr 5 2018, 4:05 PM
Assigned: jcrespo
T186579 labsdb1010 crashed
DBA
Data-Services
Patch-For-Review
Mar 2 2018, 7:57 PM
Assigned: jcrespo
T184805 Move some wikis to s5
SRE
DBA
cloud-services-team
wikitech.wikimedia.org
Release-Engineering-Team (Watching / External)
Oct 30 2018, 12:39 PM
Assigned: jcrespo
T184797 Move mariadb_maintenance away from terbium/wasat (mediawiki_maintenance)
DBA
SRE
Puppet
May 8 2018, 8:03 AM
Assigned: jcrespo
T184704 Setup tendril database monitoring on 2 new hosts, one on eqiad and one on codfw
DBA
Patch-For-Review
Feb 28 2018, 5:26 PM
Assigned: jcrespo
T184699 Generate consistent logical database backups in CODFW
DBA
Goal
SRE
Mar 19 2018, 11:12 AM
Assigned: jcrespo
T184696 Finish the database backups generation script to create consistent logical backups in CODFW
DBA
Patch-For-Review
Mar 9 2018, 3:12 PM
Assigned: jcrespo
T183470 Setup newer machines and replace all old misc (m*) and x1 codfw machines
DBA
SRE
Patch-For-Review
Feb 21 2018, 3:30 PM
Assigned: jcrespo
T183469 Setup newer machines and replace all old misc (m*) and x1 eqiad machines
DBA
SRE
Patch-For-Review
Mar 22 2018, 6:41 AM
Assigned: jcrespo
T183249 Reimage and upgrade to stretch all dbproxies
DBA
SRE
Patch-For-Review
Mar 16 2018, 6:20 PM
Assigned: jcrespo
T182450 db1102 (sanitarium) filling up (WAS: Clean up old binlogs from db1102 (sanitarium multi-instance))
DBA
Jan 23 2018, 12:33 PM
Assigned: jcrespo
T179244 labsdb1009 crashed - OOM
DBA
cloud-services-team (Kanban)
Patch-For-Review
Nov 17 2017, 10:58 AM
Assigned: jcrespo
T177782 Reduce false positives on database pages
DBA
observability
Epic
Patch-For-Review
Sustainability (Incident Followup)
May 13 2020, 2:42 PM
Assigned: jcrespo
T177274 Provide a new s8 master for sanitarium
DBA
Data-Services
Jan 9 2018, 11:03 AM
Assigned: jcrespo
T177264 Degraded RAID on db1092
SRE
ops-eqiad
DBA
Oct 18 2017, 3:53 PM
Assigned: jcrespo
T177208 Provide dedicated database resources for wikidata
Goal
SRE
Patch-For-Review
Jan 10 2018, 11:26 AM
Assigned: jcrespo
T177096 Some queries to new replica hosts are dramatically slower than labsdb; missing indexes?
Data-Services
DBA
Patch-For-Review
Oct 4 2017, 5:42 PM
Assigned: jcrespo
T175672 Evaluate proxysql and native php-mysql client for TLS connection between Apache and mariadb
DBA
Sustainability (MediaWiki-MultiDC)
Performance-Team (Radar)
Services (watching)
May 25 2022, 12:14 AM
Assigned: jcrespo
T172489 Monitor read_only on all databases, make it page on masters
DBA
observability
Patch-For-Review
Sustainability (Incident Followup)
May 7 2020, 2:04 PM
Assigned: jcrespo
T170666 Refactor prometheus-mysqld-exporter to support multi-instance hosts
DBA
Patch-For-Review
Oct 9 2017, 3:38 PM
Assigned: jcrespo
T169517 Research backup storage options and prepare a design document
DBA
Documentation
Sep 30 2017, 12:19 PM
Assigned: jcrespo
T169516 Implement cron-based mydumper backups on the dbstore role
DBA
Patch-For-Review
Sep 29 2017, 7:37 PM
Assigned: jcrespo
T169514 Refactor puppet mariadb class to support multi-instance hosts
DBA
Patch-For-Review
Oct 2 2017, 4:32 PM
Assigned: jcrespo
T169501 Move some masters away from B6
ops-codfw
SRE
DBA
Patch-For-Review
Jan 16 2018, 4:01 PM
Assigned: jcrespo
T168409 Migrate dbstore2001 to multi instance
DBA
Patch-For-Review
Sep 12 2017, 4:07 PM
Assigned: jcrespo
T167961 Terbium cronjobs attempting to connect to labstestweb2001
PRODUCTION ERROR
·
Wikimedia-production-error
SRE
cloud-services-team
DBA
Patch-For-Review
Jun 19 2017, 2:59 PM
Assigned: jcrespo
T166683 db2044 cannot install jessie - requires BIOS firmware upgrade
DBA
SRE
ops-codfw
Jun 2 2017, 9:26 AM
Assigned: jcrespo
T166546 Point labsdb1001 and labsdb1003 to db1095 and db1102
DBA
Patch-For-Review
Aug 9 2017, 7:39 AM
Assigned: jcrespo
T166326 db2055 mariadb weirdness -lagging after reboot and upgrade
DBA
May 30 2017, 10:35 AM
Assigned: jcrespo
T163110 Reclone db1068 to become master in s4
DBA
Patch-For-Review
Apr 20 2017, 6:22 PM
Assigned: jcrespo
T162789 Create less overhead on bacula jobs when dumping production databases
DBA
SRE
Patch-For-Review
Mar 9 2018, 3:18 PM
Assigned: jcrespo
T162138 How many revision comments are exactly the same? Get some stats.
DBA
Apr 7 2017, 7:03 AM
Assigned: jcrespo
T162133 Replace some masters in eqiad while it is not active
DBA
codfw-rollout
Patch-For-Review
Apr 26 2017, 10:45 AM
Assigned: jcrespo
T161296 Upgrade mysqld_exporter in production
Prometheus-metrics-monitoring
SRE
User-fgiunchedi
DBA
Patch-For-Review
May 21 2020, 10:51 AM
Assigned: jcrespo
T161007 Decouple Mariadb semi-sync replication from $::mw_primary
SRE
DC-Switchover-Prep-Q3-2016-17
DBA
Patch-For-Review
Sustainability (MediaWiki-MultiDC)
Mar 27 2017, 3:47 PM
Assigned: jcrespo
T160242 es2015 crashed on 2017-03-11
SRE
ops-codfw
DBA
Patch-For-Review
Mar 23 2017, 9:48 AM
Assigned: jcrespo
T160229 Back up of Commons files
Commons
Community-Wishlist-Survey-2016
Datasets-General-or-Unknown
SRE
Datasets-Archiving
media-backups
Goal
Dec 23 2021, 5:09 PM
Assigned: jcrespo
T159572 labsdb1004 MySQL crash
DBA
Cloud-Services
Patch-For-Review
Mar 8 2017, 10:42 AM
Assigned: jcrespo
T159524 backup space is used unwisely
SRE
Patch-For-Review
Apr 3 2020, 10:23 AM
Assigned: jcrespo
T156465 For switchovers: A way to check if slaves are up to date
DBA
Jul 25 2018, 10:40 AM
Assigned: jcrespo
T156462 Framework to transfer files over the LAN
DBA
Nov 2 2023, 9:15 AM
Assigned: jcrespo
T155399 db1045 disk space - compression needed
DBA
Feb 22 2017, 11:05 AM
Assigned: jcrespo
T152377 Create labsdb_accounts db on m5 to store state about labsdb accounts
Cloud-Services
Cloud-VPS
DBA
Patch-For-Review
Dec 5 2016, 4:04 PM
Assigned: jcrespo
T152194 Provision sanitized data on labsdb1009, labsdb1010, labsdb1011 with from db1095
Cloud-Services
Cloud-VPS
DBA
Patch-For-Review
Dec 21 2016, 5:10 PM
Assigned: jcrespo
T151999 Create script to monitor db dumps for backups are successful
observability
SRE
DBA
Patch-For-Review
Jun 29 2018, 5:09 AM
Assigned: jcrespo
T151752 Prepare and check storage layer for the future private wiki arbcom-cs.wikipedia.org
DBA
Nov 29 2016, 1:23 PM
Assigned: jcrespo
T151579 dbstore1001 backup jobs failed between 2016-10-19 and 2016-11-23
observability
SRE
Nov 30 2016, 12:44 PM
Assigned: jcrespo
T151076 labsdbadmin needs to be able to drop users and update passwords
Cloud-Services
DBA
Nov 18 2016, 6:44 PM
Assigned: jcrespo
T150767 Wikireplica service for tools and labs - issues and missing available views (tracking)
DBA
Tracking-Neverending
Data-Services
Oct 18 2017, 2:29 AM
Assigned: jcrespo
T149844 Decide between proxysql and haproxy for labsdbproxy service
Cloud-Services
Cloud-VPS
DBA
Sustainability
Nov 14 2016, 6:20 PM
Assigned: jcrespo
T149829 Move labsdb1008 to production, rename it back to db1095, use it as a temporary sanitarium
hardware-requests
SRE
ops-eqiad
Patch-For-Review
netops
Nov 15 2016, 9:01 PM
Assigned: jcrespo
T149557 Site: 2 VM request for tendril (switch tendril from einsteinium to dbmonitor*)
SRE
vm-requests
Patch-For-Review
Jul 25 2017, 4:41 PM
Assigned: jcrespo
T149526 es2019 crashed again
SRE
DBA
Patch-For-Review
May 9 2017, 7:13 AM
Assigned: jcrespo
T149377 Degraded RAID on db2052
ops-codfw
SRE
DBA
Nov 3 2016, 9:16 AM
Assigned: jcrespo
T148988 Cognate DB review
DBA
Cognate
Wikidata
User-Addshore
Jan 26 2017, 12:13 PM
Assigned: jcrespo
T148560 Create maintain-views user for labsdb1001 and labsdb1003
DBA
Cloud-Services
Cloud-VPS
SRE
Nov 2 2016, 5:55 PM
Assigned: jcrespo
T148500 Implement proxysql both for labs and for later production usage
Cloud-Services
Cloud-VPS
DBA
Patch-For-Review
Oct 26 2016, 8:48 AM
Assigned: jcrespo
T146055 Improve privilege separation for phabricator's config files and mysql credentials
Phabricator
User-MModell
DBA
serviceops
Release-Engineering-Team-TODO
Release-Engineering-Team (Development services)
Security
Sep 1 2020, 6:46 AM
Assigned: jcrespo
T146018 Investigate db1061 crash
DBA
ops-eqiad
SRE
Sep 22 2016, 5:27 PM
Assigned: jcrespo
T141097 Implement a frontend failover solution for labsdb replicas
Cloud-Services
Cloud-VPS
DBA
Patch-For-Review
Dec 21 2016, 4:43 PM
Assigned: jcrespo
T141096 Having lots of accounts with separate grants makes auditing difficult.
Cloud-Services
Cloud-VPS
DBA
Feb 14 2017, 3:10 PM
Assigned: jcrespo
T140983 dbproxy1002 down
ops-eqiad
DBA
SRE
Patch-For-Review
Jul 28 2016, 5:35 PM
Assigned: jcrespo
T140955 Wikibase\Repo\Store\WikiPageEntityStore::updateWatchlist: Automatic transaction with writes in progress (from DatabaseBase::query (LinkCache::addLinkObj)), performing implicit commit!
PRODUCTION ERROR
·
Wikimedia-production-error
Wikidata
Wikidata-Sprint-2016-07-19
Aug 31 2016, 3:28 PM
Assigned: jcrespo
T140803 Remove oresc_rev index
Machine-Learning-Team (Active Tasks)
SRE
DBA
Schema-change
Schema-change-in-production
Patch-For-Review
MW-1.28-release (WMF-deploy-2016-07-26_(1.28.0-wmf.12))
Jul 28 2016, 11:48 AM
Assigned: jcrespo
T140788 Labs databases rearchitecture (tracking)
Cloud-VPS
Cloud-Services
DBA
Tracking-Neverending
Epic
Mar 26 2018, 7:50 PM
Assigned: jcrespo
T139714 BIOS upgrade on certain codfw machines
ops-codfw
DBA
SRE
Aug 3 2016, 9:25 AM
Assigned: jcrespo
T139552 Create tables for PageAssessments in enwiki database
DBA
Community-Tech
MediaWiki-extensions-PageAssessments
Schema-change
Reports-bot
Jul 22 2016, 12:21 AM
Assigned: jcrespo
T139090 Deploy I2b042685 to all databases
Schema-change-in-production
DBA
Patch-For-Review
Nov 8 2016, 7:38 PM
Assigned: jcrespo
T138967 Labs database replica drift
DBA
Epic
Data-Services
Oct 18 2017, 2:09 AM
Assigned: jcrespo
T138810 Set databases as read-only or switchover to secondary datacenter
Sustainability
SRE
Apr 21 2017, 8:38 AM
Assigned: jcrespo
T138460 Upgrade m3 (phabricator) db servers
SRE
DBA
Phabricator
Jul 22 2016, 4:48 PM
Assigned: jcrespo
T137691 Add shared edit rights between eranbot and copypatrol tools
Cloud-VPS
Cloud-Services
DBA
Jun 15 2016, 8:07 AM
Assigned: jcrespo
T136612 Requesting deployment access (for deploying to scb) for Halfak
SRE
SRE-Access-Requests
Patch-For-Review
Jun 7 2016, 6:45 AM
Assigned: jcrespo
T136560 NDA-Request Jan Dittrich
WMF-NDA-Requests
SRE-Access-Requests
SRE
Jun 13 2016, 5:33 PM
Assigned: jcrespo
T136406 Requesting deployment access (for deploying to scb) for Ladsgroup
SRE-Access-Requests
SRE
Patch-For-Review
Jun 6 2016, 11:50 PM
Assigned: jcrespo
T136343 Requesting access to stat1002 for Pcoombe
SRE-Access-Requests
SRE
Patch-For-Review
Jun 3 2016, 11:05 AM
Assigned: jcrespo
T136319 Labs users missing grants on replicas
DBA
Cloud-Services
May 31 2016, 3:45 PM
Assigned: jcrespo
T135973 Upgrade m1 db servers
SRE
DBA
Patch-For-Review
Jun 27 2016, 11:17 AM
Assigned: jcrespo
T135947 Missing grants on tools.labsdb
Cloud-VPS
Cloud-Services
DBA
May 26 2016, 5:02 PM
Assigned: jcrespo
T135699 Schema changes for Echo moderation
DBA
Schema-change-in-production
Collab-Team-2016-Apr-Jun-Q4
Schema-change
Notifications
May 27 2016, 6:46 AM
Assigned: jcrespo
T134651 NDA for Amir Sarabadani
WMF-NDA-Requests
Machine-Learning-Team (Active Tasks)
Research-management
Research
Jun 7 2016, 4:57 PM
Assigned: jcrespo
T134555 db1033 (old s7 master) needs backup and reimage
SRE
DBA
Patch-For-Review
May 20 2016, 12:13 PM
Assigned: jcrespo
T134480 Improve replication lag detection for multi-dc environment
DBA
May 18 2016, 4:18 PM
Assigned: jcrespo
T134392 Add shared edit rights between eranbot and plagiabot tools
Cloud-Services
DBA
Cloud-VPS
May 5 2016, 6:32 AM
Assigned: jcrespo
T133715 Missing data on labs replica database
Cloud-Services
DBA
Dec 21 2016, 5:17 PM
Assigned: jcrespo
T133398 Install, configure and provision recently arrived db core machines
DBA
SRE
Patch-For-Review
Jun 16 2016, 8:46 AM
Assigned: jcrespo
T133386 Change dbstore1001 delayed slave to be a direct slave of the eqiad masters
DBA
Dec 9 2016, 3:23 PM
Assigned: jcrespo
T133385 Implement GTID replication on MariaDB 10 servers
SRE
DBA
MediaWiki-libs-Rdbms
Performance Issue
Jun 6 2016, 8:20 AM
Assigned: jcrespo
T133337 Automate database datacenter switchover steps
DBA
Patch-For-Review
codfw-rollout
Jul 14 2016, 2:28 PM
Assigned: jcrespo
T133145 NDA request for @WMDE-leszek
WMF-NDA-Requests
SRE-Access-Requests
SRE
Jun 13 2016, 5:32 PM
Assigned: jcrespo
T132011 Reimage db2047 - check for hardware errors
SRE
DBA
Patch-For-Review
Apr 29 2016, 3:36 PM
Assigned: jcrespo
T131630 Tgr unable to login on Horizon
Cloud-Services
Horizon
DBA
May 30 2016, 9:42 AM
Assigned: jcrespo
T131236 Identical EventLogging queries give different results on db1047 and dbstore1002
DBA
Jun 6 2016, 9:39 AM
Assigned: jcrespo
T130595 labsdb accounts being created without grants to create personal databases
Cloud-Services
Toolforge
May 31 2016, 3:44 PM
Assigned: jcrespo
T129947 Intermittent read-only errors on s3 wikis on March 14th
SRE
Release-Engineering-Team
MediaWiki-General
Apr 28 2016, 1:33 PM
Assigned: jcrespo
T128057 db2018 failed disk (degraded RAID)
ops-codfw
SRE
DC-Ops
Sep 22 2016, 8:07 AM
Assigned: jcrespo
T127970 New project for job candidate tests
Cloud-Services
Feb 29 2016, 5:31 PM
Assigned: jcrespo
T127638 Email spam from some MariaDB's logrotate
DBA
SRE
Jun 8 2016, 10:47 AM
Assigned: jcrespo
T127266 Tool Labs queries die
Cloud-Services
DBA
Toolforge
Dec 21 2016, 5:21 PM
Assigned: jcrespo
T126996 Reimage db1021 database
DBA
Patch-For-Review
Feb 25 2016, 3:01 PM
Assigned: jcrespo
T126209 Reimage db2012
DBA
SRE
Patch-For-Review
Feb 11 2016, 8:30 PM
Assigned: jcrespo
T126006 es2011-es2019 racking and onsite setup tasks
SRE
ops-codfw
Patch-For-Review
Feb 18 2016, 4:41 PM
Assigned: jcrespo
T125435 Grant mysql client access to testreduce_vd and testreduce_0715 databases
SRE-Access-Requests
SRE
DBA
Patch-For-Review
Feb 8 2016, 8:05 PM
Assigned: jcrespo
T125028 reimage or decom db servers on precise
SRE
DBA
Patch-For-Review
Jul 22 2016, 5:59 AM
Assigned: jcrespo
T125027 upgrade dbproxy1001/1002 to jessie
SRE
DBA
Patch-For-Review
Jul 28 2016, 5:29 PM
Assigned: jcrespo
T124681 Architecture decision to solve the need larger serves (for better capacity and consolidation) vs. more, smaller servers (for high availability)
Architecture
DBA
SRE
Aug 12 2016, 8:45 AM
Assigned: jcrespo
T124670 Figure out and document the datacenter switchover process
SRE
codfw-rollout
codfw-rollout-Jan-Mar-2016
Patch-For-Review
Apr 28 2016, 9:53 AM
Assigned: jcrespo
T124645 db2012 degraded RAID
ops-codfw
SRE
DC-Ops
May 10 2016, 7:49 AM
Assigned: jcrespo
T124464 db1069 is running low on space
Cloud-Services
DBA
SRE
Cloud-VPS
Feb 13 2016, 8:59 PM
Assigned: jcrespo
T123985 Inconsistencies between labs replicas
DBA
Cloud-Services
Cloud-VPS
Jan 19 2016, 2:56 PM
Assigned: jcrespo
T123108 Unthrottle faebot
Cloud-Services
DBA
Toolforge
Jan 19 2016, 1:32 PM
Assigned: jcrespo
T122998 setup/install/deploy db2033
SRE
DBA
Patch-For-Review
Apr 29 2016, 3:38 PM
Assigned: jcrespo
T122658 MySQL connections die in less than 30 seconds using tools-login tunnels
Cloud-Services
Toolforge
DBA
Jan 18 2016, 1:06 PM
Assigned: jcrespo
T122338 Rename user database
Cloud-Services
DBA
Toolforge
Dec 24 2015, 2:35 PM
Assigned: jcrespo
T121888 rack/setup pc1004-1006
SRE
Patch-For-Review
Jan 27 2016, 7:34 PM
Assigned: jcrespo
T121879 rack/setup pc2004-2006
ops-codfw
SRE
codfw-rollout
codfw-rollout-Jan-Mar-2016
Patch-For-Review
Jan 28 2016, 12:53 PM
Assigned: jcrespo
T121335 Create oauth_registered_consumer.oarc_owner_only column on metawiki
Reading-Infrastructure-Team-Old (Don't use)
MediaWiki-extensions-OAuth
Schema-change
DBA
Schema-change-in-production
Dec 17 2015, 11:48 AM
Assigned: jcrespo
T120073 db2019 has a failed disk
ops-codfw
SRE
DC-Ops
Oct 25 2016, 3:56 PM
Assigned: jcrespo
T119752 Review schema changes for T119495
Patch-For-Review
OKR-Work
ContentTranslation-Release7
ContentTranslation
LE-CX7-Sprint 4
DBA
Schema-change-in-production
Dec 15 2015, 7:56 AM
Assigned: jcrespo
T119751 Rename Database to DBA, create blocked-by-schema-change
Project-Admins
DBA
MediaWiki-libs-Rdbms
Dec 23 2015, 12:21 PM
Assigned: jcrespo
T119461 Evaluate security concerns of logging beta cluster db queries on tendril
DBA
SRE
Beta-Cluster-Infrastructure
Nov 24 2015, 6:08 PM
Assigned: jcrespo
T117398 number of database updates multiplied x3 since 29 October
Performance Issue
DBA
SRE
Performance-Team
Aug 8 2016, 12:51 PM
Assigned: jcrespo
T116903 Adapt wmf-mariadb101 package for stretch and adapt its service to systemd
DBA
SRE
Patch-For-Review
Jun 22 2017, 7:21 PM
Assigned: jcrespo
T116902 Issues with partman/install server/autoinstall for db servers on Jessie
SRE
Patch-For-Review
Feb 17 2016, 6:00 PM
Assigned: jcrespo
T114752 Puppetize pt-heartbeat on MariaDB10 masters and its corresponding checks on the several monitoring backends
DBA
Patch-For-Review
SRE
Aug 3 2016, 9:07 AM
Assigned: jcrespo
T114396 Grant 'show view' permissions on s1-analytics-slave/jmorgan to user jmorgan
DBA
SRE
Oct 2 2015, 7:31 PM
Assigned: jcrespo
T112835 Document stricter MySQL policy and settings for MediaWiki
Documentation
MediaWiki-Documentation
DBA
Nov 5 2015, 8:04 AM
Assigned: jcrespo
T112732 Truncate table cx_suggestions, cx_lists
ContentTranslation
DBA
ContentTranslation-Release6
LE-CX6-Sprint 4
OKR-Work
Sep 16 2015, 8:11 AM
Assigned: jcrespo
T112573 Drop phlegal_* databases from m3
DBA
SRE
Jul 6 2016, 7:10 AM
Assigned: jcrespo
T112080 the bounce_records table in x1 wikishared has latin1 encoding
MediaWiki-extensions-BounceHandler
DBA
Jan 29 2016, 10:22 AM
Assigned: jcrespo
T111929 Puppetize grants for mysql hosts that are the source of recovery (dbstore, passive misc)
DBA
SRE
Mar 2 2021, 3:19 PM
Assigned: jcrespo
T111766 Add icinga check for all MySQL/MariaDB hosts to check they have the right read_only value
DBA
SRE
Oct 1 2016, 4:40 PM
Assigned: jcrespo
T111756 Requesting access to fluorine / mw-log-readers group for Addshore
SRE-Access-Requests
Patch-For-Review
SRE
Sep 10 2015, 7:59 PM
Assigned: jcrespo
T111654 Set up TLS for MariaDB replication
DBA
SRE
Patch-For-Review
Feb 9 2017, 5:08 PM
Assigned: jcrespo
T111371 Potential templatelinks data integrity issue on Tool Labs' enwiki_p
Cloud-Services
Toolforge
DBA
Sep 7 2015, 7:24 PM
Assigned: jcrespo
T111317 Review and create table for Content Translation
ContentTranslation
ContentTranslation-Release6
ContentTranslation-Deployments
Schema-change
DBA
OKR-Work
LE-CX6-Sprint 4
SRE
Sep 11 2015, 7:06 AM
Assigned: jcrespo
T111204 Requesting access to hadoop / hive (analytics-privatedata-users) for Addshore
SRE-Access-Requests
Patch-For-Review
SRE
Sep 10 2015, 8:04 PM
Assigned: jcrespo
T111200 Grant puppet script access to "phabricator_project" DB
DBA
SRE
Sep 3 2015, 11:07 AM
Assigned: jcrespo
T110693 MySQL database for Nodepool
Continuous-Integration-Scaling
DBA
Patch-For-Review
SRE
Sep 2 2015, 10:37 AM
Assigned: jcrespo
T110504 defragment db1015, db1035 and db1027
DBA
SRE
Nov 17 2015, 2:03 PM
Assigned: jcrespo
T110008 es1005 and es1006 have degraded RAIDs (failed disks each)
ops-eqiad
SRE
Aug 27 2015, 11:25 AM
Assigned: jcrespo
T109159 Determine limited maps deployment options
Maps
Discovery-ARCHIVED
Patch-For-Review
SRE
Sep 11 2015, 5:46 PM
Assigned: jcrespo
T109116 dbproxy servers for codfw
hardware-requests
SRE
Feb 8 2016, 9:12 PM
Assigned: jcrespo
T108856 Set up bucketization of editCount fields {tick}
DBA
Analytics-Radar
May 13 2016, 3:21 AM
Assigned: jcrespo
T107070 Measure capacity and utilization of labsdb*** boxes
Cloud-Services
DBA
Apr 1 2016, 4:25 PM
Assigned: jcrespo
T106667 kartotherian service does not start on maps-test cluster
Discovery-ARCHIVED
Maps
Maps-Sprint
SRE
Jul 23 2015, 5:13 PM
Assigned: jcrespo
T106312 m1-master switch from db1001 to db1016
DBA
SRE
Patch-For-Review
Jun 22 2016, 7:42 PM
Assigned: jcrespo
T105843 new external storage cluster(s)
DBA
hardware-requests
SRE
Sep 27 2015, 3:18 PM
Assigned: jcrespo
T105699 Uncommitted DB writes in GlobalUsage::getLinksFromPage()
Multimedia
Wikimedia-production-error
GlobalUsage
DBA
Nov 7 2016, 4:01 PM
Assigned: jcrespo
T105698 Uncommitted DB writes in GeoData::getAllCoordinates()
Wikimedia-production-error
GeoData
DBA
Discovery-Search
Nov 7 2016, 3:57 PM
Assigned: jcrespo
T104573 codfw frontends cannot connect to mysql at db2029
DBA
SRE
Jul 6 2015, 7:03 PM
Assigned: jcrespo
T104310 Create a whitelist of tables to checksum on all wikis
DBA
Sep 29 2015, 9:48 AM
Assigned: jcrespo
T103417 Change character set on etherpad- lite database to utf8mb4_bin
Wikimedia-Etherpad
DBA
SRE
Jun 23 2015, 11:13 AM
Assigned: jcrespo
T101567 Rebuild s6 and s7 on labsdb1002
Cloud-Services
DBA
Patch-For-Review
Jun 12 2015, 3:02 PM
Assigned: jcrespo
T101516 Upgrade db1022, which has an older kernel
DBA
SRE
Oct 28 2015, 11:55 AM
Assigned: jcrespo
T101182 Permission problem on parsercache db servers
DBA
Patch-For-Review
SRE
Jun 16 2015, 8:52 AM
Assigned: jcrespo
T101084 es[12]00[123] maintenance and upgrade
DBA
SRE
Jun 25 2015, 1:55 PM
Assigned: jcrespo
T100954 Wikitech: update Bacula article
Documentation
SRE
Aug 25 2020, 9:58 AM
Assigned: jcrespo
T100441 Santitize recent wikis: wikimania 2016 and cn.wikimedia.org at labs dbs
DBA
Cloud-Services
SRE
Jun 26 2015, 3:02 AM
Assigned: jcrespo
T100301 pc100[123] maintenance and upgrade
SRE
Jun 1 2015, 5:52 PM
Assigned: jcrespo
T98339 m3 set max_allowed_packet to 33554432 or greater
Phabricator
Patch-For-Review
SRE
May 18 2015, 9:08 AM
Assigned: jcrespo
T95705 bacula restore job waiting on higher jobs
SRE
bacula
Data-Persistence-Backup
Mar 18 2022, 10:46 AM
Assigned: jcrespo
T89986 Update GeoData schema
Schema-change
GeoData
DBA
Oct 23 2015, 10:23 AM
Assigned: jcrespo
T86958 install/deploy dbproxy1003 through dbproxy1011
DBA
SRE
Dec 2 2016, 12:19 PM
Assigned: jcrespo
T85813 "sites" table missing from some wikis
WMF-General-or-Unknown
DBA
Schema-change-in-production
Nov 16 2015, 9:37 AM
Assigned: jcrespo
T85278 Setup an Offsite backup infrastructure
SRE
Data-Persistence-Backup
Mar 25 2021, 10:01 AM
Assigned: jcrespo
T84178 investigate RAID BBU auto-learn on db hosts
Patch-For-Review
DBA
SRE
Sep 2 2015, 4:17 PM
Assigned: jcrespo
T79922 Set up backup strategy for es clusters
SRE
Goal
Patch-For-Review
Data-Persistence-Backup
Feb 16 2021, 3:08 PM
Assigned: jcrespo
T75047 Replicate flowdb from X1 to analytics-store
DBA
SRE
Patch-For-Review
Nov 2 2015, 11:49 AM
Assigned: jcrespo
T69223 Schema change for page content language
All-and-every-Wikisource
DBA
Wikimedia-Site-requests
Schema-change-in-production
TechCom-RFC (TechCom-RFC-Closed)
Community-Wishlist-Survey-2016
Mar 11 2017, 2:48 AM
Assigned: jcrespo
T66088 Replication checks disabled in Icinga for most analytics slaves
Analytics-General-or-Unknown
Oct 5 2015, 9:34 AM
Assigned: jcrespo
T59185 Archive and drop all article feedback related tables from all wikis
DBA
Aug 12 2016, 1:16 PM
Assigned: jcrespo
T57406 Monitor database hosts' disk performance
WMF-General-or-Unknown
OKR-Work
May 14 2021, 10:40 AM
Assigned: jcrespo
T54934 Drop database table "optin_survey" from Wikimedia wikis
DBA
SRE
Aug 26 2015, 1:22 PM
Assigned: jcrespo
T50930 Database replication problems - production and labs (tracking)
Tracking-Neverending
Cloud-Services
DBA
SRE
Aug 13 2018, 2:30 PM
Assigned: jcrespo
T43668 WikiExporter does not respect groupLoadsByDB[$wiki]['dump']
MediaWiki-Maintenance-system
SRE
Jan 7 2016, 1:23 AM
Assigned: jcrespo
T257329 After arming a new key in keyholder, the identity file path does not show up
Keyholder
SRE
Jul 8 2020, 2:24 PM
Assigned: jcrespo
T253959 Check we are preparing (xtrabackup --prepare) with the same package version as the server version of which the backup was taken
Data-Persistence-Backup
database-backups
Upstream
Patch-For-Review
Mar 18 2022, 5:59 PM
Assigned: jcrespo
T235838 Backups on buster hosts fail to run
SRE
serviceops
DBA
Patch-For-Review
Nov 5 2019, 10:39 AM
Assigned: jcrespo
T172494 Change oom_adj for dedicated mysql server processes
DBA
DC-Ops
Packaging
Patch-For-Review
Sustainability (Incident Followup)
Oct 11 2017, 1:07 PM
Assigned: jcrespo
T161024 dbstore2001 creates bad query plans for wikidata.wb_changes
DBA
Mar 22 2017, 7:55 PM
Assigned: jcrespo
T153058 LabsDB infrastructure pending work
DBA
Data-Services
Patch-For-Review
Mar 26 2018, 7:51 PM
Assigned: jcrespo
T152188 Restart pending mysql hosts with old TLS cert
DBA
SRE
Patch-For-Review
Feb 8 2017, 12:24 AM
Assigned: jcrespo
T152081 Moving eventlogging mariadb role into its own .pp
DBA
Patch-For-Review
Jul 14 2017, 7:29 AM
Assigned: jcrespo
T150850 Decouple roles from mariadb.pp into their own file
DBA
Epic
Patch-For-Review
Dec 14 2017, 3:13 PM
Assigned: jcrespo
T150553 High replication activity filled up labsdb1004 with binlogs
Cloud-Services
DBA
Tools
Patch-For-Review
Feb 14 2017, 3:53 PM
Assigned: jcrespo
T143220 es2004 has a dead disk, but it is not under warranty
ops-codfw
DBA
SRE
Aug 24 2016, 12:17 PM
Assigned: jcrespo
T142759 New entries in meta_p.wiki are missing a URL
Cloud-Services
Apr 5 2017, 11:34 AM
Assigned: jcrespo
T142356 p50380g50921 has 20+ open persistent connections to labsdb1001 & labsdb1003
Toolforge
Cloud-Services
Discovery-ARCHIVED
Maps
May 4 2017, 2:49 PM
Assigned: jcrespo
T140341 dbstore1002 lag on s7
DBA
Jul 14 2016, 9:49 AM
Assigned: jcrespo
T139280 db1034 decommission
DBA
SRE
Oct 13 2016, 7:46 PM
Assigned: jcrespo
T136333 dbstore1002 crashed
DBA
Analytics-Radar
Jun 6 2016, 9:22 AM
Assigned: jcrespo
T134977 Throttle mysql backups on dbstore1001 in order to not saturate the node
DBA
SRE
Patch-For-Review
Jan 3 2017, 11:13 AM
Assigned: jcrespo
T133906 install and puppetize memcached on dbmonitor hosts (tendril frontends)
DBA
Patch-For-Review
May 9 2018, 1:03 PM
Assigned: jcrespo
T133588 Gerrit 285208 broke eventlogging_sync.sh
SRE
DBA
Patch-For-Review
Nov 10 2016, 12:08 PM
Assigned: jcrespo
T133309 db1041 regular mysql stalls creates connection failures
DBA
Apr 22 2016, 2:30 PM
Assigned: jcrespo
T131705 dbstore1001 low available space
DBA
Patch-For-Review
Jun 30 2016, 11:07 AM
Assigned: jcrespo
T129350 es2014 revert data compression
DBA
Patch-For-Review
Mar 24 2017, 12:16 PM
Assigned: jcrespo
T126252 Populate the wikishared db on all dbstores
DBA
SRE
Oct 24 2018, 1:59 PM
Assigned: jcrespo
T123509 "db1047/eventlogging_sync processes" icinga alert is flaky since at least early January
Icinga
SRE
DBA
observability
Patch-For-Review
Apr 12 2017, 2:47 PM
Assigned: jcrespo
T120513 Apply recentchanges special partitioning to a redundant slave at least on s1, s4, and s5
DBA
MediaWiki-libs-Rdbms
Mar 29 2017, 8:34 AM
Assigned: jcrespo
T119841 labs db inconsistent data
Toolforge
Cloud-Services
DBA
Dec 11 2015, 11:56 AM
Assigned: jcrespo
T118816 mysql privs: restrict access to racktables to krypton
DBA
SRE
Jan 29 2016, 11:35 AM
Assigned: jcrespo
T118723 Drop tables no longer in use (tracking)
DBA
Nov 16 2015, 12:21 PM
Assigned: jcrespo
T115711 Drop `user_daily_contribs` table from all production wikis
DBA
SRE
Patch-For-Review
MW-1.27-release (WMF-deploy-2015-12-15_(1.27.0-wmf.9))
Nov 26 2015, 8:25 AM
Assigned: jcrespo
T115517 Data missing from June 11/12 on s3.labsdb
Cloud-Services
DBA
Dec 21 2016, 5:30 PM
Assigned: jcrespo
T115207 Lots of rows are missing from enwiki_p.`revision`
Cloud-Services
DBA
Feb 14 2017, 3:49 PM
Assigned: jcrespo
T113842 `pr_index` to be replicated to Labs public databases
Data-Services
DBA
Patch-For-Review
cloud-services-team (Kanban)
Dec 21 2018, 7:40 AM
Assigned: jcrespo
T113720 Update kernel on db1011
SRE
Feb 14 2017, 4:01 PM
Assigned: jcrespo
T112228 Need to run postgresql::user twice to set the password
Puppet
Patch-For-Review
SRE
Sep 16 2015, 8:57 AM
Assigned: jcrespo
T112103 fix m5 shard mysql issues with default encoding binary
Cloud-Services
DBA
Cloud-VPS
Dec 16 2016, 8:47 AM
Assigned: jcrespo
T111992 Physical location SPOF because of database server distribution on a single rack (D1)
DBA
SRE
Jun 16 2016, 8:50 AM
Assigned: jcrespo
T111656 Replica database tables may need to be ANALYZEd again
Cloud-Services
DBA
Sep 7 2015, 7:18 PM
Assigned: jcrespo
T108316 huge (140GB) decrease on available disk space on db1042
DBA
SRE
Aug 14 2015, 2:05 PM
Assigned: jcrespo
T107753 Puppet failure on all hosts with Error: Could not retrieve catalog from remote server: Error 400 on SERVER: Mysql::Error: Out of range value for column 'id' at row 1: INSERT INTO `fact_values` (`updated_at`, `host_id`, `created_at`, `fact_name_id`, `value`) VALUES('date', etc)
DBA
Puppet
SRE
May 1 2016, 5:03 PM
Assigned: jcrespo
T107282 Reduce memory commitment on database hosts with many objects, specially s3, dbstore/research and labs
DBA
SRE
Patch-For-Review
Feb 14 2017, 4:02 PM
Assigned: jcrespo
T107072 Spikes of job runner new connection errors to mysql "Error connecting to 10.64.32.24: Can't connect to MySQL server on '10.64.32.24' (4)" - mainly on db1035
DBA
SRE
Wikimedia-production-error
Dec 16 2015, 10:25 AM
Assigned: jcrespo
T104748 db1046 innodb signal 6 abort and restart
DBA
MediaWiki-extensions-EventLogging
Jan 25 2016, 7:38 PM
Assigned: jcrespo
T103345 Test and fix db1047 BBU
SRE
Dec 22 2015, 12:15 PM
Assigned: jcrespo
T103230 Disk issue on db1028
ops-eqiad
DBA
Patch-For-Review
SRE
Sep 3 2015, 3:47 PM
Assigned: jcrespo
T102647 Add Wikipedia Northern Luri and Wikipedia Goan Konkani to labs replicas
DBA
Cloud-Services
Patch-For-Review
Jun 26 2015, 8:12 AM
Assigned: jcrespo
T102236 db2068 is unresponsive
SRE
Jun 16 2015, 5:15 PM
Assigned: jcrespo
T101937 setup logging for #wikimedia-databases
DBA
Patch-For-Review
Nov 25 2016, 4:26 PM
Assigned: jcrespo
T101009 Enabling automatic buffer pool dumping on start/stop (puppet) for all servers
DBA
Patch-For-Review
SRE
Jun 3 2015, 7:07 AM
Assigned: jcrespo
T100501 mysql user and group should be a system user/group
DBA
SRE
Patch-For-Review
May 15 2020, 9:47 AM
Assigned: jcrespo
T99520 On a maintenance window, upgrade db1063 to 14.04 and its MariaDB package to 10.0.16
DBA
Patch-For-Review
SRE
May 26 2015, 3:59 PM
Assigned: jcrespo
T99486 switch to innodb tables for replication state
DBA
SRE
Aug 18 2015, 4:28 PM
Assigned: jcrespo
T85266 Look into Maria 10 parallel-replication
Sustainability
DBA
Sep 30 2020, 10:00 AM
Assigned: jcrespo
T82225 package and puppetize ishmael
SRE
Sep 30 2015, 1:26 PM
Assigned: jcrespo
T72221 internal_api_error_DBQueryError on page edit; db1024
DBA
Dec 7 2015, 7:10 PM
Assigned: jcrespo
T71463 Create a table in labs with replication lag data
Analytics-General-or-Unknown
DBA
Patch-For-Review
Nov 25 2015, 7:56 PM
Assigned: jcrespo
T59184 cl_collation index redundant
MediaWiki-libs-Rdbms
Schema-change
Jun 2 2016, 7:52 PM
Assigned: jcrespo
T50628 Provide replication lag as a database function
Toolforge
DBA
Cloud-Services
Apr 22 2016, 1:17 PM
Assigned: jcrespo
T108032 Replication issue with Fa WP replica
Cloud-Services
Mar 3 2017, 9:58 AM
Assigned: jcrespo

Advanced SearchUse ResultsEdit QueryHide Query

Tasks (654)

Advanced Search
Use Results
Edit Query
Hide Query