Page MenuHomePhabricator
Feed Advanced Search

Yesterday

ABran-WMF claimed T362619: Database request for Bitu Cloud DEV installation.
Fri, Apr 19, 7:22 AM · Bitu, DBA, Infrastructure-Foundations, SRE
ABran-WMF moved T362619: Database request for Bitu Cloud DEV installation from Refine to Ready on the DBA board.
Fri, Apr 19, 7:21 AM · Bitu, DBA, Infrastructure-Foundations, SRE
ABran-WMF moved T360149: Create a database for Striker test instance from Refine to Blocked on the DBA board.
Fri, Apr 19, 6:50 AM · Data-Persistence-Backup, Patch-For-Review, DBA, cloud-services-team, Striker
ABran-WMF added a comment to T362619: Database request for Bitu Cloud DEV installation.

@SLyngshede-WMF would you be OK using idmclouddev to comply with our no underscore in the database name policy?

Fri, Apr 19, 6:49 AM · Bitu, DBA, Infrastructure-Foundations, SRE
ABran-WMF moved T362619: Database request for Bitu Cloud DEV installation from Triage to Refine on the DBA board.
Fri, Apr 19, 6:49 AM · Bitu, DBA, Infrastructure-Foundations, SRE

Thu, Apr 18

ABran-WMF updated the task description for T358741: Decommission db2096-db2120.
Thu, Apr 18, 1:31 PM · Patch-For-Review, DBA
ABran-WMF changed the status of T358741: Decommission db2096-db2120, a subtask of T355422: Productionize db2196-db2220, from In Progress to Stalled.
Thu, Apr 18, 1:31 PM · database-backups, Patch-For-Review, DBA
ABran-WMF changed the status of T358741: Decommission db2096-db2120 from In Progress to Stalled.
Thu, Apr 18, 1:31 PM · Patch-For-Review, DBA
ABran-WMF renamed T362802: decommission db2097.codfw.wmnet from decommission db2098.codfw.wmnet to decommission db2097.codfw.wmnet.
Thu, Apr 18, 1:30 PM · decommission-hardware
ABran-WMF renamed T362802: decommission db2097.codfw.wmnet from decommission db2102.codfw.wmnet to decommission db2098.codfw.wmnet.
Thu, Apr 18, 1:30 PM · decommission-hardware
ABran-WMF created T362883: decommission db2099.codfw.wmnet.
Thu, Apr 18, 1:29 PM · decommission-hardware
ABran-WMF assigned T362802: decommission db2097.codfw.wmnet to jcrespo.
Thu, Apr 18, 1:28 PM · decommission-hardware
ABran-WMF updated the task description for T362801: decommission db2103.codfw.wmnet.
Thu, Apr 18, 1:21 PM · SRE, ops-codfw, Patch-For-Review, decommission-hardware
ABran-WMF updated the task description for T358741: Decommission db2096-db2120.
Thu, Apr 18, 1:21 PM · Patch-For-Review, DBA
ABran-WMF updated the task description for T358741: Decommission db2096-db2120.
Thu, Apr 18, 1:04 PM · Patch-For-Review, DBA
ABran-WMF updated the task description for T362800: decommission db2105.codfw.wmnet.
Thu, Apr 18, 1:04 PM · SRE, ops-codfw, Patch-For-Review, decommission-hardware
ABran-WMF updated the task description for T362799: decommission db2106.codfw.wmnet.
Thu, Apr 18, 12:48 PM · SRE, ops-codfw, Patch-For-Review, decommission-hardware
ABran-WMF updated the task description for T358741: Decommission db2096-db2120.
Thu, Apr 18, 12:46 PM · Patch-For-Review, DBA
ABran-WMF updated the task description for T362798: decommission db2107.codfw.wmnet.
Thu, Apr 18, 12:30 PM · SRE, ops-codfw, Patch-For-Review, decommission-hardware
ABran-WMF updated the task description for T358741: Decommission db2096-db2120.
Thu, Apr 18, 12:30 PM · Patch-For-Review, DBA
ABran-WMF updated the task description for T362797: decommission db2108.codfw.wmnet.
Thu, Apr 18, 9:38 AM · SRE, ops-codfw, Patch-For-Review, decommission-hardware
ABran-WMF updated the task description for T358741: Decommission db2096-db2120.
Thu, Apr 18, 9:38 AM · Patch-For-Review, DBA
ABran-WMF updated the task description for T362796: decommission db2109.codfw.wmnet.
Thu, Apr 18, 9:23 AM · SRE, ops-codfw, Patch-For-Review, decommission-hardware
ABran-WMF updated the task description for T358741: Decommission db2096-db2120.
Thu, Apr 18, 9:21 AM · Patch-For-Review, DBA
ABran-WMF updated the task description for T362795: decommission db2110.codfw.wmnet.
Thu, Apr 18, 9:07 AM · SRE, ops-codfw, Patch-For-Review, decommission-hardware
ABran-WMF updated the task description for T358741: Decommission db2096-db2120.
Thu, Apr 18, 9:05 AM · Patch-For-Review, DBA
ABran-WMF updated the task description for T362794: decommission db2111.codfw.wmnet.
Thu, Apr 18, 8:44 AM · SRE, ops-codfw, Patch-For-Review, decommission-hardware
ABran-WMF updated the task description for T358741: Decommission db2096-db2120.
Thu, Apr 18, 8:42 AM · Patch-For-Review, DBA
ABran-WMF updated the task description for T362793: decommission db2112.codfw.wmnet.
Thu, Apr 18, 8:28 AM · SRE, ops-codfw, Patch-For-Review, decommission-hardware
ABran-WMF updated the task description for T358741: Decommission db2096-db2120.
Thu, Apr 18, 8:28 AM · Patch-For-Review, DBA
ABran-WMF updated the task description for T362792: decommission db2113.codfw.wmnet.
Thu, Apr 18, 8:05 AM · SRE, ops-codfw, Patch-For-Review, decommission-hardware
ABran-WMF updated the task description for T358741: Decommission db2096-db2120.
Thu, Apr 18, 8:03 AM · Patch-For-Review, DBA
ABran-WMF reopened T360116: Upgrade s5 to MariaDB 10.6 as "Open".
  • db1245.eqiad.wmnet

was missing from the initial inventory

Thu, Apr 18, 6:43 AM · DBA
ABran-WMF reopened T360116: Upgrade s5 to MariaDB 10.6, a subtask of T356960: Upgrade hosts to MariaDB 10.6, as Open.
Thu, Apr 18, 6:43 AM · DBA
ABran-WMF updated the task description for T360116: Upgrade s5 to MariaDB 10.6.
Thu, Apr 18, 6:42 AM · DBA
ABran-WMF closed T360116: Upgrade s5 to MariaDB 10.6 as Resolved.
Thu, Apr 18, 6:41 AM · DBA
ABran-WMF closed T360116: Upgrade s5 to MariaDB 10.6, a subtask of T356960: Upgrade hosts to MariaDB 10.6, as Resolved.
Thu, Apr 18, 6:40 AM · DBA
ABran-WMF updated the task description for T360332: Make the cupe_actor column nullable on WMF wikis.
Thu, Apr 18, 6:40 AM · DBA, Schema-change-in-production
ABran-WMF closed T362668: Switchover s5 master (db1183 -> db1230) as Resolved.
Thu, Apr 18, 5:45 AM · Patch-For-Review, DBA
ABran-WMF updated the task description for T362668: Switchover s5 master (db1183 -> db1230).
Thu, Apr 18, 5:33 AM · Patch-For-Review, DBA

Wed, Apr 17

ABran-WMF placed T362790: decommission db2119.codfw.wmnet up for grabs.
Wed, Apr 17, 4:12 PM · SRE, ops-codfw, Patch-For-Review, decommission-hardware
ABran-WMF updated the task description for T358741: Decommission db2096-db2120.
Wed, Apr 17, 4:11 PM · Patch-For-Review, DBA
ABran-WMF updated the task description for T358741: Decommission db2096-db2120.
Wed, Apr 17, 3:53 PM · Patch-For-Review, DBA
ABran-WMF created T362802: decommission db2097.codfw.wmnet.
Wed, Apr 17, 3:52 PM · decommission-hardware
ABran-WMF created T362801: decommission db2103.codfw.wmnet.
Wed, Apr 17, 3:52 PM · SRE, ops-codfw, Patch-For-Review, decommission-hardware
ABran-WMF created T362800: decommission db2105.codfw.wmnet.
Wed, Apr 17, 3:51 PM · SRE, ops-codfw, Patch-For-Review, decommission-hardware
ABran-WMF created T362799: decommission db2106.codfw.wmnet.
Wed, Apr 17, 3:51 PM · SRE, ops-codfw, Patch-For-Review, decommission-hardware
ABran-WMF created T362798: decommission db2107.codfw.wmnet.
Wed, Apr 17, 3:51 PM · SRE, ops-codfw, Patch-For-Review, decommission-hardware
ABran-WMF created T362797: decommission db2108.codfw.wmnet.
Wed, Apr 17, 3:50 PM · SRE, ops-codfw, Patch-For-Review, decommission-hardware
ABran-WMF created T362796: decommission db2109.codfw.wmnet.
Wed, Apr 17, 3:50 PM · SRE, ops-codfw, Patch-For-Review, decommission-hardware
ABran-WMF created T362795: decommission db2110.codfw.wmnet.
Wed, Apr 17, 3:50 PM · SRE, ops-codfw, Patch-For-Review, decommission-hardware
ABran-WMF created T362794: decommission db2111.codfw.wmnet.
Wed, Apr 17, 3:50 PM · SRE, ops-codfw, Patch-For-Review, decommission-hardware
ABran-WMF created T362793: decommission db2112.codfw.wmnet.
Wed, Apr 17, 3:49 PM · SRE, ops-codfw, Patch-For-Review, decommission-hardware
ABran-WMF created T362792: decommission db2113.codfw.wmnet.
Wed, Apr 17, 3:49 PM · SRE, ops-codfw, Patch-For-Review, decommission-hardware
ABran-WMF created T362790: decommission db2119.codfw.wmnet.
Wed, Apr 17, 3:48 PM · SRE, ops-codfw, Patch-For-Review, decommission-hardware
ABran-WMF placed T362787: decommission db2120.codfw.wmnet up for grabs.
Wed, Apr 17, 3:47 PM · SRE, ops-codfw, decommission-hardware
ABran-WMF updated the task description for T362787: decommission db2120.codfw.wmnet.
Wed, Apr 17, 3:23 PM · SRE, ops-codfw, decommission-hardware
ABran-WMF created T362787: decommission db2120.codfw.wmnet.
Wed, Apr 17, 3:22 PM · SRE, ops-codfw, decommission-hardware
ABran-WMF added a comment to T360149: Create a database for Striker test instance.

@taavi you can replace all occurrences of striker_toolsbeta by strikertoolsbeta (i.e. striker_toolsbeta_adminstrikertoolsbeta_admin). I've also updated credentials in the previous location
@jcrespo database has been properly renamed, good catch!

Wed, Apr 17, 10:44 AM · Data-Persistence-Backup, Patch-For-Review, DBA, cloud-services-team, Striker
ABran-WMF moved T362668: Switchover s5 master (db1183 -> db1230) from Triage to Ready on the DBA board.
Wed, Apr 17, 7:15 AM · Patch-For-Review, DBA

Tue, Apr 16

ABran-WMF updated the task description for T360332: Make the cupe_actor column nullable on WMF wikis.
Tue, Apr 16, 4:08 PM · DBA, Schema-change-in-production
ABran-WMF updated the task description for T360332: Make the cupe_actor column nullable on WMF wikis.
Tue, Apr 16, 4:07 PM · DBA, Schema-change-in-production
ABran-WMF claimed T362668: Switchover s5 master (db1183 -> db1230).
Tue, Apr 16, 2:36 PM · Patch-For-Review, DBA
ABran-WMF updated the task description for T360116: Upgrade s5 to MariaDB 10.6.
Tue, Apr 16, 2:35 PM · DBA
ABran-WMF updated the task description for T360116: Upgrade s5 to MariaDB 10.6.
Tue, Apr 16, 2:32 PM · DBA
ABran-WMF closed T362614: Switchover s5 master (db2123 -> db2213) as Resolved.
Tue, Apr 16, 9:33 AM · Patch-For-Review, DBA
ABran-WMF updated the task description for T360116: Upgrade s5 to MariaDB 10.6.
Tue, Apr 16, 9:33 AM · DBA
ABran-WMF changed the status of T362614: Switchover s5 master (db2123 -> db2213) from Open to In Progress.
Tue, Apr 16, 9:10 AM · Patch-For-Review, DBA
ABran-WMF updated the task description for T362614: Switchover s5 master (db2123 -> db2213).
Tue, Apr 16, 9:08 AM · Patch-For-Review, DBA
ABran-WMF reopened T360149: Create a database for Striker test instance as "Open".

@taavi would you be OK to drop & recreate that db so we discard the underscore?

Tue, Apr 16, 9:02 AM · Data-Persistence-Backup, Patch-For-Review, DBA, cloud-services-team, Striker
ABran-WMF reopened T360149: Create a database for Striker test instance, a subtask of T360025: Deploy Striker instance for toolsbeta, as Open.
Tue, Apr 16, 9:02 AM · Patch-For-Review, cloud-services-team, Striker
ABran-WMF updated the task description for T360116: Upgrade s5 to MariaDB 10.6.
Tue, Apr 16, 8:22 AM · DBA
ABran-WMF closed T360149: Create a database for Striker test instance as Resolved.
Tue, Apr 16, 8:22 AM · Data-Persistence-Backup, Patch-For-Review, DBA, cloud-services-team, Striker
ABran-WMF closed T360149: Create a database for Striker test instance, a subtask of T360025: Deploy Striker instance for toolsbeta, as Resolved.
Tue, Apr 16, 8:22 AM · Patch-For-Review, cloud-services-team, Striker
ABran-WMF assigned T362611: Alert in need of triage: SystemdUnitFailed (instance db2200:9100) to jcrespo.
Tue, Apr 16, 7:24 AM · DBA, sre-alert-triage
ABran-WMF moved T362611: Alert in need of triage: SystemdUnitFailed (instance db2200:9100) from Triage to Ready on the DBA board.
Tue, Apr 16, 7:24 AM · DBA, sre-alert-triage

Mon, Apr 15

ABran-WMF updated the task description for T360116: Upgrade s5 to MariaDB 10.6.
Mon, Apr 15, 2:23 PM · DBA
ABran-WMF updated the task description for T360116: Upgrade s5 to MariaDB 10.6.
Mon, Apr 15, 12:59 PM · DBA

Fri, Apr 12

ABran-WMF closed T355422: Productionize db2196-db2220 as Resolved.

sure!

Fri, Apr 12, 10:56 AM · database-backups, Patch-For-Review, DBA
ABran-WMF closed T355422: Productionize db2196-db2220, a subtask of T355350: Q#:rack/setup/install db2196-db2220, as Resolved.
Fri, Apr 12, 10:56 AM · Data-Persistence, SRE, ops-codfw, DC-Ops
ABran-WMF added a comment to T355422: Productionize db2196-db2220.

thanks @jcrespo! I'm OK to wait for the full service takeover

Fri, Apr 12, 10:49 AM · database-backups, Patch-For-Review, DBA

Thu, Apr 11

ABran-WMF reopened T360149: Create a database for Striker test instance as "Open".
Thu, Apr 11, 2:42 PM · Data-Persistence-Backup, Patch-For-Review, DBA, cloud-services-team, Striker
ABran-WMF reopened T360149: Create a database for Striker test instance, a subtask of T360025: Deploy Striker instance for toolsbeta, as Open.
Thu, Apr 11, 2:41 PM · Patch-For-Review, cloud-services-team, Striker
ABran-WMF moved T362311: Decommission db2101 (was: db2101 crashed) from Triage to In progress on the DBA board.
Thu, Apr 11, 9:47 AM · SRE, ops-codfw, decommission-hardware, DC-Ops, Patch-For-Review, database-backups, Data-Persistence-Backup, DBA
ABran-WMF added a comment to T355422: Productionize db2196-db2220.

Thanks, db2199 and db2200 are almost finished (currently catching up and about to add them to tendril zarcillo and later reenable notifications).

The other 2 go next.

Data loading should be finished this week, it is the service migration what may take some time, as I may use the soon-to-be-decommissioned hosts to help with the 10.6 upgrade/reimage progress.

Thu, Apr 11, 9:45 AM · database-backups, Patch-For-Review, DBA
ABran-WMF updated the task description for T360332: Make the cupe_actor column nullable on WMF wikis.
Thu, Apr 11, 9:38 AM · DBA, Schema-change-in-production
ABran-WMF closed T362302: Switchover s6 master (db2129 -> db2114) as Resolved.
Thu, Apr 11, 9:25 AM · Patch-For-Review, DBA
ABran-WMF updated the task description for T360332: Make the cupe_actor column nullable on WMF wikis.
Thu, Apr 11, 8:40 AM · DBA, Schema-change-in-production
ABran-WMF moved T362229: Drop MachineVision tables from beta and production from Triage to Refine on the DBA board.
Thu, Apr 11, 7:56 AM · DBA, Structured-Data-Backlog, MachineVision

Wed, Apr 10

ABran-WMF added a comment to T355422: Productionize db2196-db2220.

remaining node has been pooled, @jcrespo please let me know if I can help you for the remaining ones :-)

Wed, Apr 10, 9:56 AM · database-backups, Patch-For-Review, DBA
ABran-WMF updated the task description for T355422: Productionize db2196-db2220.
Wed, Apr 10, 9:54 AM · database-backups, Patch-For-Review, DBA
ABran-WMF updated the task description for T360332: Make the cupe_actor column nullable on WMF wikis.
Wed, Apr 10, 9:51 AM · DBA, Schema-change-in-production
ABran-WMF moved T360149: Create a database for Striker test instance from Ready to In progress on the DBA board.
Wed, Apr 10, 9:28 AM · Data-Persistence-Backup, Patch-For-Review, DBA, cloud-services-team, Striker
ABran-WMF changed the status of T360149: Create a database for Striker test instance from Open to In Progress.

Database has been created, account and admin account SQL passwords are in your mwmaint1002 homedir under /home/taavi/.super.secret.pw.txt and puppet has been updated here: https://gerrit.wikimedia.org/r/1018408

Wed, Apr 10, 9:25 AM · Data-Persistence-Backup, Patch-For-Review, DBA, cloud-services-team, Striker
ABran-WMF changed the status of T360149: Create a database for Striker test instance, a subtask of T360025: Deploy Striker instance for toolsbeta, from Open to In Progress.
Wed, Apr 10, 9:24 AM · Patch-For-Review, cloud-services-team, Striker

Tue, Apr 9

ABran-WMF placed T361627: Create cuc_agent_id, cule_agent_id and cupe_agent_id columns in cu_changes, cu_log_event and cu_private_event tables respectively on WMF wikis up for grabs.
Tue, Apr 9, 2:42 PM · CheckUser, Schema-change-in-production, DBA
ABran-WMF updated the task description for T355422: Productionize db2196-db2220.
Tue, Apr 9, 11:50 AM · database-backups, Patch-For-Review, DBA
ABran-WMF updated the task description for T360332: Make the cupe_actor column nullable on WMF wikis.
Tue, Apr 9, 9:00 AM · DBA, Schema-change-in-production
ABran-WMF updated the task description for T360116: Upgrade s5 to MariaDB 10.6.
Tue, Apr 9, 8:19 AM · DBA
ABran-WMF updated the task description for T360332: Make the cupe_actor column nullable on WMF wikis.
Tue, Apr 9, 7:11 AM · DBA, Schema-change-in-production