Page MenuHomePhabricator

Stashbot (Stashbot)
Bot that likes to stash things away for laterBot

Projects

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Thursday

  • Clear sailing ahead.

User Details

User Since
Feb 10 2016, 12:29 AM (179 w, 6 d)
Roles
Bot
Availability
Available
IRC Nick
stashbot
LDAP User
Stashbot
MediaWiki User
Unknown

Recent Activity

Today

Stashbot added a comment to T226522: Modern Event Platform: Stream Intake Service: Migrate change-prop events to new (EventGate) style schemas.

Mentioned in SAL (#wikimedia-operations) [2019-07-23T17:00:17Z] <ppchelko@deploy1001> Finished deploy [changeprop/deploy@894f735]: Switch internal events to the new schema T226522 (duration: 01m 30s)

Tue, Jul 23, 5:00 PM · Patch-For-Review, Services (later), Analytics, Core Platform Team Backlog (Watching / External), EventBus
Stashbot added a comment to T226522: Modern Event Platform: Stream Intake Service: Migrate change-prop events to new (EventGate) style schemas.

Mentioned in SAL (#wikimedia-operations) [2019-07-23T16:58:46Z] <ppchelko@deploy1001> Started deploy [changeprop/deploy@894f735]: Switch internal events to the new schema T226522

Tue, Jul 23, 4:58 PM · Patch-For-Review, Services (later), Analytics, Core Platform Team Backlog (Watching / External), EventBus
Stashbot added a comment to T227139: a3-eqiad pdu refresh.

Mentioned in SAL (#wikimedia-operations) [2019-07-23T16:22:11Z] <godog> pool prometheus1003 - T227139

Tue, Jul 23, 4:22 PM · DC-Ops, Operations, ops-eqiad
Stashbot added a comment to T227193: Request access to deployment cluster for Jakob_WMDE.

Mentioned in SAL (#wikimedia-releng) [2019-07-23T16:00:31Z] <hashar> gerrit: adding Jakob_WMDE to wmf-deployment group ( https://gerrit.wikimedia.org/r/#/admin/groups/21,members ) # T227193

Tue, Jul 23, 4:00 PM · Release-Engineering-Team (Deployment services), Operations, SRE-Access-Requests
Stashbot added a comment to T227141: a5-eqiad pdu refresh.

Mentioned in SAL (#wikimedia-operations) [2019-07-23T15:46:41Z] <robh> side b of a5-eqiad swapping pdu via T227141

Tue, Jul 23, 3:47 PM · DC-Ops, Operations, ops-eqiad
Stashbot added a comment to T195364: Remove pear/mail packages from WMF MW app servers.

Mentioned in SAL (#wikimedia-operations) [2019-07-23T15:08:33Z] <_joe_> uninstalling php-pear, php-mail, php-mail-mime from mw1267 T195364

Tue, Jul 23, 3:08 PM · serviceops, Patch-For-Review, Wikimedia-General-or-Unknown, Operations
Stashbot added a comment to T211248: Modern Event Platform: Stream Intake Service: Migrate eventlogging-service-eventbus events to eventgate-main.

Mentioned in SAL (#wikimedia-operations) [2019-07-23T14:52:42Z] <ppchelko@deploy1001> Finished deploy [restbase/deploy@ea10fa5]: Switch event production to eventgate T211248, attempt 2 (duration: 13m 08s)

Tue, Jul 23, 2:52 PM · Patch-For-Review, Core Platform Team (Modern Event Platform (TEC2)), Core Platform Team Workboards (Clinic Duty Team), MW-1.34-notes (1.34.0-wmf.15; 2019-07-23), Services (watching), Analytics-EventLogging, EventBus, Analytics-Kanban
Stashbot added a comment to T211248: Modern Event Platform: Stream Intake Service: Migrate eventlogging-service-eventbus events to eventgate-main.

Mentioned in SAL (#wikimedia-operations) [2019-07-23T14:39:34Z] <ppchelko@deploy1001> Started deploy [restbase/deploy@ea10fa5]: Switch event production to eventgate T211248, attempt 2

Tue, Jul 23, 2:39 PM · Patch-For-Review, Core Platform Team (Modern Event Platform (TEC2)), Core Platform Team Workboards (Clinic Duty Team), MW-1.34-notes (1.34.0-wmf.15; 2019-07-23), Services (watching), Analytics-EventLogging, EventBus, Analytics-Kanban
Stashbot added a comment to T227139: a3-eqiad pdu refresh.

Mentioned in SAL (#wikimedia-operations) [2019-07-23T14:14:28Z] <robh> a3-eqiad pdu swap taking place now via T227139

Tue, Jul 23, 2:14 PM · DC-Ops, Operations, ops-eqiad
Stashbot added a comment to T227139: a3-eqiad pdu refresh.

Mentioned in SAL (#wikimedia-operations) [2019-07-23T13:45:39Z] <godog> depool restbase1016 restbase1019 restbase1011 restbase1010 prometheus1003 ahead of PDU work - T227139

Tue, Jul 23, 1:45 PM · DC-Ops, Operations, ops-eqiad
Stashbot added a comment to T226851: Drop abuse_filter_log.afl_log_id in production.

Mentioned in SAL (#wikimedia-operations) [2019-07-23T13:06:17Z] <marostegui> Drop abuse_filter_log.afl_log_id from s8 codfw (lag will happen on codfw s8) - T226851

Tue, Jul 23, 1:06 PM · AbuseFilter, DBA
Stashbot added a comment to T227139: a3-eqiad pdu refresh.

Mentioned in SAL (#wikimedia-operations) [2019-07-23T12:02:11Z] <akosiaris> drain kubernetes1001. T227139

Tue, Jul 23, 12:02 PM · DC-Ops, Operations, ops-eqiad
Stashbot added a comment to T227139: a3-eqiad pdu refresh.

Mentioned in SAL (#wikimedia-operations) [2019-07-23T12:01:07Z] <akosiaris> empty ganeti1007 from running instances. T227139

Tue, Jul 23, 12:01 PM · DC-Ops, Operations, ops-eqiad
Stashbot added a comment to T224572: Migrate pool counters to Stretch/Buster.

Mentioned in SAL (#wikimedia-operations) [2019-07-23T11:59:31Z] <akosiaris> enable disable poolcounter1003, switchover codfw poolcounters T224572

Tue, Jul 23, 11:59 AM · Patch-For-Review, serviceops, Operations
Stashbot added a comment to T214902: Show mobile termbox on Wikidata test wiki.

Mentioned in SAL (#wikimedia-operations) [2019-07-23T11:56:37Z] <tarrow@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:525065|T214902 Fix missing /termbox in SSRTermboxServerUrl]] (duration: 00m 44s)

Tue, Jul 23, 11:56 AM · Wikidata, Wikidata-Termbox-Hike
Stashbot added a comment to T214902: Show mobile termbox on Wikidata test wiki.

Mentioned in SAL (#wikimedia-operations) [2019-07-23T11:25:05Z] <tarrow@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:525062|T214902 Enable termbox on testwikidatawiki]] (duration: 01m 37s)

Tue, Jul 23, 11:25 AM · Wikidata, Wikidata-Termbox-Hike
Stashbot added a comment to T226851: Drop abuse_filter_log.afl_log_id in production.

Mentioned in SAL (#wikimedia-operations) [2019-07-23T10:17:21Z] <marostegui> Drop abuse_filter_log.afl_log_id from db1096:3316, db1139:3316 and dbstore1005:3316 T226851

Tue, Jul 23, 10:17 AM · AbuseFilter, DBA
Stashbot added a comment to T226851: Drop abuse_filter_log.afl_log_id in production.

Mentioned in SAL (#wikimedia-operations) [2019-07-23T09:53:57Z] <marostegui> Drop abuse_filter_log.afl_log_id from s6 codfw with replication (this will cause lag in s6 codfw) - T226851

Tue, Jul 23, 9:54 AM · AbuseFilter, DBA
Stashbot added a comment to T224572: Migrate pool counters to Stretch/Buster.

Mentioned in SAL (#wikimedia-operations) [2019-07-23T09:51:38Z] <akosiaris> enable poolcounter1005, disablepoolcounter1001 T224572

Tue, Jul 23, 9:51 AM · Patch-For-Review, serviceops, Operations
Stashbot added a comment to T228731: https://dumps.wikimedia.org/other/pageviews/ lacks hourly pageviews since 20190722-17:00.

Mentioned in SAL (#wikimedia-analytics) [2019-07-23T09:23:53Z] <elukey> restart projectview-hourly-coordinator with correct config - T228731

Tue, Jul 23, 9:24 AM · Analytics-Kanban, Analytics, cloud-services-team, Wikimedia-Portals
Stashbot added a comment to T202367: Productionize dbproxy101[2-7].eqiad.wmnet and dbproxy200[1-4].

Mentioned in SAL (#wikimedia-operations) [2019-07-23T08:08:29Z] <marostegui> Stop MySQL on db2044 to test dbproxy2002 notifications - T202367

Tue, Jul 23, 8:08 AM · Patch-For-Review, DBA
Stashbot added a comment to T228639: wikimedia-portals-build job failing with "node: command not found".

Mentioned in SAL (#wikimedia-releng) [2019-07-23T08:00:30Z] <hashar> Restore puppet class contint::packages::javascript on permanent slave ( reverting https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/524221/ ) # T228639

Tue, Jul 23, 8:00 AM · Release-Engineering-Team-TODO (201907), Release-Engineering-Team (CI & Testing services), Wikimedia-Portals, Jenkins
Stashbot added a comment to T202367: Productionize dbproxy101[2-7].eqiad.wmnet and dbproxy200[1-4].

Mentioned in SAL (#wikimedia-operations) [2019-07-23T07:31:23Z] <marostegui> Deploy grants for dbproxy2002 on m2 - T202367

Tue, Jul 23, 7:31 AM · Patch-For-Review, DBA
Stashbot added a comment to T227139: a3-eqiad pdu refresh.

Mentioned in SAL (#wikimedia-operations) [2019-07-23T04:43:46Z] <marostegui> Failover m1 from dbproxy1001 to dbproxy1006 T227139

Tue, Jul 23, 4:43 AM · DC-Ops, Operations, ops-eqiad
Stashbot added a comment to T208984: Slovene projects: Alphabetical order in categories (collation).

Mentioned in SAL (#wikimedia-operations) [2019-07-23T00:06:56Z] <Urbanecm> slwiki updateCollection.php completed (T208984)

Tue, Jul 23, 12:07 AM · Patch-For-Review, Wikimedia-Site-requests

Yesterday

Stashbot added a comment to T223052: Server-side upload request for Hurtigruten minutt for minutt videos.

Mentioned in SAL (#wikimedia-operations) [2019-07-22T23:54:50Z] <Urbanecm> Run mwscript importImages.php --wiki=commonswiki --user=Meisam /home/urbanecm/T223052

Mon, Jul 22, 11:54 PM · User-Urbanecm, Commons, Wikimedia-Site-requests
Stashbot added a comment to T228529: Become failed for newly created tool .

Mentioned in SAL (#wikimedia-cloud) [2019-07-22T23:44:30Z] <bd808> Restarted maintain-kubeusers on tools-k8s-master-01 (T228529)

Mon, Jul 22, 11:44 PM · cloud-services-team (Kanban), Toolforge
Stashbot added a comment to T208984: Slovene projects: Alphabetical order in categories (collation).

Mentioned in SAL (#wikimedia-operations) [2019-07-22T23:42:34Z] <Urbanecm> All updateCollation.php runs completed, except the one for slwiki (T208984)

Mon, Jul 22, 11:42 PM · Patch-For-Review, Wikimedia-Site-requests
Stashbot added a comment to T228521: Enable usergroup "flood" at ptwiki.

Mentioned in SAL (#wikimedia-operations) [2019-07-22T23:42:19Z] <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: Add flood group to ptwiki (T228521) (duration: 00m 47s)

Mon, Jul 22, 11:42 PM · User-Urbanecm, User-DannyS712, Wikimedia-Site-requests
Stashbot added a comment to T208984: Slovene projects: Alphabetical order in categories (collation).

Mentioned in SAL (#wikimedia-operations) [2019-07-22T23:39:29Z] <Urbanecm> Run mwscript updateCollation.php --wiki=slwiktionary --previous-collation=uppercase (T208984)

Mon, Jul 22, 11:39 PM · Patch-For-Review, Wikimedia-Site-requests
Stashbot added a comment to T208984: Slovene projects: Alphabetical order in categories (collation).

Mentioned in SAL (#wikimedia-operations) [2019-07-22T23:39:08Z] <Urbanecm> Run mwscript updateCollation.php --wiki=slwikiversity --previous-collation=uppercase (T208984)

Mon, Jul 22, 11:39 PM · Patch-For-Review, Wikimedia-Site-requests
Stashbot added a comment to T208984: Slovene projects: Alphabetical order in categories (collation).

Mentioned in SAL (#wikimedia-operations) [2019-07-22T23:37:43Z] <Urbanecm> Run mwscript updateCollation.php --wiki=slwikisource --previous-collation=uppercase (T208984)

Mon, Jul 22, 11:37 PM · Patch-For-Review, Wikimedia-Site-requests
Stashbot added a comment to T227000: Configuration request for Flagged Reviews at Hebrew Wikisource.

Mentioned in SAL (#wikimedia-operations) [2019-07-22T23:36:09Z] <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: Fix comment in IS.php (noop, T227000) (duration: 00m 46s)

Mon, Jul 22, 11:36 PM · MediaWiki-extensions-FlaggedRevs, User-DannyS712, Wikimedia-Site-requests
Stashbot added a comment to T208984: Slovene projects: Alphabetical order in categories (collation).

Mentioned in SAL (#wikimedia-operations) [2019-07-22T23:34:44Z] <Urbanecm> Run mwscript updateCollation.php --wiki=slwikiquote --previous-collation=uppercase (T208984)

Mon, Jul 22, 11:35 PM · Patch-For-Review, Wikimedia-Site-requests
Stashbot added a comment to T208984: Slovene projects: Alphabetical order in categories (collation).

Mentioned in SAL (#wikimedia-operations) [2019-07-22T23:34:17Z] <Urbanecm> Run mwscript updateCollation.php --wiki=slwikibooks --previous-collation=uppercase (T208984)

Mon, Jul 22, 11:34 PM · Patch-For-Review, Wikimedia-Site-requests
Stashbot added a comment to T227000: Configuration request for Flagged Reviews at Hebrew Wikisource.

Mentioned in SAL (#wikimedia-operations) [2019-07-22T23:33:54Z] <urbanecm@deploy1001> Synchronized wmf-config/flaggedrevs.php: SWAT: [[:gerrit:524704|Fix "Remove "עמוד" namespace from wgFlaggedRevsNamespaces for hewikisource"]] (T227000) (duration: 00m 47s)

Mon, Jul 22, 11:34 PM · MediaWiki-extensions-FlaggedRevs, User-DannyS712, Wikimedia-Site-requests
Stashbot added a comment to T208984: Slovene projects: Alphabetical order in categories (collation).

Mentioned in SAL (#wikimedia-operations) [2019-07-22T23:29:37Z] <Urbanecm> Run mwscript updateCollation.php --wiki=slwiki --previous-collation=uppercase (T208984)

Mon, Jul 22, 11:29 PM · Patch-For-Review, Wikimedia-Site-requests
Stashbot added a comment to T208984: Slovene projects: Alphabetical order in categories (collation).

Mentioned in SAL (#wikimedia-operations) [2019-07-22T23:27:54Z] <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: Set wgCategoryCollation to uca-sl-u-kn on Slovene projects (sl) (T208984) (duration: 00m 47s)

Mon, Jul 22, 11:28 PM · Patch-For-Review, Wikimedia-Site-requests
Stashbot added a comment to T187716: Sunset Wikipedia Zero.

Mentioned in SAL (#wikimedia-operations) [2019-07-22T22:11:37Z] <mutante> dropped zero.wikiMedia.org from DNS (T187716)

Mon, Jul 22, 10:11 PM · Patch-For-Review, MW-1.34-notes (1.34.0-wmf.14; 2019-07-16), Release-Engineering-Team-TODO (201907), Epic, Reading-Infrastructure-Team-Backlog, Wikimedia-Site-requests
Stashbot added a comment to T211248: Modern Event Platform: Stream Intake Service: Migrate eventlogging-service-eventbus events to eventgate-main.

Mentioned in SAL (#wikimedia-operations) [2019-07-22T21:38:39Z] <ppchelko@deploy1001> Finished deploy [restbase/deploy@9a99b17]: Rollback: Switch event production to eventgate T211248 (duration: 13m 01s)

Mon, Jul 22, 9:38 PM · Patch-For-Review, Core Platform Team (Modern Event Platform (TEC2)), Core Platform Team Workboards (Clinic Duty Team), MW-1.34-notes (1.34.0-wmf.15; 2019-07-23), Services (watching), Analytics-EventLogging, EventBus, Analytics-Kanban
Stashbot added a comment to T211248: Modern Event Platform: Stream Intake Service: Migrate eventlogging-service-eventbus events to eventgate-main.

Mentioned in SAL (#wikimedia-operations) [2019-07-22T21:25:40Z] <ppchelko@deploy1001> Started deploy [restbase/deploy@9a99b17]: Rollback: Switch event production to eventgate T211248

Mon, Jul 22, 9:25 PM · Patch-For-Review, Core Platform Team (Modern Event Platform (TEC2)), Core Platform Team Workboards (Clinic Duty Team), MW-1.34-notes (1.34.0-wmf.15; 2019-07-23), Services (watching), Analytics-EventLogging, EventBus, Analytics-Kanban
Stashbot added a comment to T211248: Modern Event Platform: Stream Intake Service: Migrate eventlogging-service-eventbus events to eventgate-main.

Mentioned in SAL (#wikimedia-operations) [2019-07-22T21:21:11Z] <ppchelko@deploy1001> Finished deploy [restbase/deploy@ea10fa5]: Switch event production to eventgate T211248 (duration: 16m 14s)

Mon, Jul 22, 9:21 PM · Patch-For-Review, Core Platform Team (Modern Event Platform (TEC2)), Core Platform Team Workboards (Clinic Duty Team), MW-1.34-notes (1.34.0-wmf.15; 2019-07-23), Services (watching), Analytics-EventLogging, EventBus, Analytics-Kanban
Stashbot added a comment to T211248: Modern Event Platform: Stream Intake Service: Migrate eventlogging-service-eventbus events to eventgate-main.

Mentioned in SAL (#wikimedia-operations) [2019-07-22T21:04:57Z] <ppchelko@deploy1001> Started deploy [restbase/deploy@ea10fa5]: Switch event production to eventgate T211248

Mon, Jul 22, 9:05 PM · Patch-For-Review, Core Platform Team (Modern Event Platform (TEC2)), Core Platform Team Workboards (Clinic Duty Team), MW-1.34-notes (1.34.0-wmf.15; 2019-07-23), Services (watching), Analytics-EventLogging, EventBus, Analytics-Kanban
Stashbot added a comment to T228696: jsub no longer allows overriding path.

Mentioned in SAL (#wikimedia-cloud) [2019-07-22T20:55:04Z] <lucaswerkmeister> Deployed cb848cc4a7 (fix PATH specification, working around T228696)

Mon, Jul 22, 8:55 PM · Toolforge
Stashbot added a comment to T211248: Modern Event Platform: Stream Intake Service: Migrate eventlogging-service-eventbus events to eventgate-main.

Mentioned in SAL (#wikimedia-operations) [2019-07-22T19:09:01Z] <ppchelko@deploy1001> Finished deploy [changeprop/deploy@3f8aad2]: Switch revision-score to eventgate T211248 (duration: 01m 31s)

Mon, Jul 22, 7:09 PM · Patch-For-Review, Core Platform Team (Modern Event Platform (TEC2)), Core Platform Team Workboards (Clinic Duty Team), MW-1.34-notes (1.34.0-wmf.15; 2019-07-23), Services (watching), Analytics-EventLogging, EventBus, Analytics-Kanban
Stashbot added a comment to T211248: Modern Event Platform: Stream Intake Service: Migrate eventlogging-service-eventbus events to eventgate-main.

Mentioned in SAL (#wikimedia-operations) [2019-07-22T19:07:30Z] <ppchelko@deploy1001> Started deploy [changeprop/deploy@3f8aad2]: Switch revision-score to eventgate T211248

Mon, Jul 22, 7:07 PM · Patch-For-Review, Core Platform Team (Modern Event Platform (TEC2)), Core Platform Team Workboards (Clinic Duty Team), MW-1.34-notes (1.34.0-wmf.15; 2019-07-23), Services (watching), Analytics-EventLogging, EventBus, Analytics-Kanban
Stashbot added a comment to T227140: a4-eqiad pdu refresh.

Mentioned in SAL (#wikimedia-operations) [2019-07-22T18:59:13Z] <herron> repooling kafka1001 T227140

Mon, Jul 22, 6:59 PM · DC-Ops, Operations, ops-eqiad
Stashbot added a comment to T226729: Setup and deploy Help panel on Arabic Wikipedia.

Mentioned in SAL (#wikimedia-operations) [2019-07-22T18:31:25Z] <catrope@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Enable help panel for 50% of new users on arwiki (T226729) (duration: 00m 47s)

Mon, Jul 22, 6:31 PM · Growth-Team (Current Sprint), GrowthExperiments-Help panel
Stashbot added a comment to T224448: Gerrit http threads stuck behind sendemail thread.

Mentioned in SAL (#wikimedia-operations) [2019-07-22T18:15:10Z] <thcipriani> restarting gerrit due to T224448

Mon, Jul 22, 6:15 PM · Release-Engineering-Team-TODO (201907), Release-Engineering-Team (Development services), serviceops-radar, Gerrit
Stashbot added a comment to T226729: Setup and deploy Help panel on Arabic Wikipedia.

Mentioned in SAL (#wikimedia-operations) [2019-07-22T18:09:34Z] <catrope@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Enable GrowthExperiments help panel on arwiki (T226729) (duration: 00m 48s)

Mon, Jul 22, 6:09 PM · Growth-Team (Current Sprint), GrowthExperiments-Help panel
Stashbot added a comment to T228573: toolforge k8s nodes oom?.

Mentioned in SAL (#wikimedia-cloud) [2019-07-22T17:38:34Z] <bstorm_> Adding the prometheus servers to the ferm rules via wikitech hiera for kubelet stats T228573

Mon, Jul 22, 5:38 PM · Toolforge, cloud-services-team (Kanban)
Stashbot added a comment to T227140: a4-eqiad pdu refresh.

Mentioned in SAL (#wikimedia-operations) [2019-07-22T17:35:45Z] <elukey> depool scb1001 for PDU work T227140

Mon, Jul 22, 5:35 PM · DC-Ops, Operations, ops-eqiad
Stashbot added a comment to T227140: a4-eqiad pdu refresh.

Mentioned in SAL (#wikimedia-operations) [2019-07-22T17:22:55Z] <herron> depooling kafka1001 for PDU work T227140

Mon, Jul 22, 5:22 PM · DC-Ops, Operations, ops-eqiad
Stashbot added a comment to T87899: Convert Collection to use extension registration.

Mentioned in SAL (#wikimedia-operations) [2019-07-22T16:55:25Z] <jforrester@deploy1001> Synchronized wmf-config/CommonSettings.php: T87899 Use wfLoadExtension for Collection rather than deprecated entry point (duration: 00m 47s)

Mon, Jul 22, 4:55 PM · MW-1.34-notes (1.34.0-wmf.13; 2019-07-09), Patch-For-Review, Performance-Team (Radar), Readers-Web-Backlog (Tracking), Collection
Stashbot added a comment to T219148: Use PHP7 to run all async jobs.

Mentioned in SAL (#wikimedia-operations) [2019-07-22T15:49:51Z] <jijiki> Rolling depool and pool of mw1293, mw1294, mw1295, mw1296, mw1299 - T219148

Mon, Jul 22, 3:49 PM · User-WDoran, Core Platform Team Workboards (Clinic Duty Team), Patch-For-Review, Core Platform Team Backlog (Watching / External), User-jijiki, Services (watching), Operations, serviceops
Stashbot added a comment to T227552: pc2010 possibly broken memory.

Mentioned in SAL (#wikimedia-operations) [2019-07-22T15:38:08Z] <marostegui> Stop mysql and power off pc2010 for on-site maintenance - T227552

Mon, Jul 22, 3:38 PM · Operations, ops-codfw, DBA
Stashbot added a comment to T227814: [Regression wmf.13] Wikidata localisation is broken.

Mentioned in SAL (#wikimedia-operations) [2019-07-22T15:35:12Z] <jforrester@deploy1001> Synchronized php-1.34.0-wmf.14/extensions/Wikibase/lib/WikibaseLib.php: T227814 Wikibase: Define $wgMessagesDirs in WikibaseLib PHP entry point (duration: 00m 48s)

Mon, Jul 22, 3:35 PM · MW-1.34-notes (1.34.0-wmf.14; 2019-07-16), User-greg, Release-Engineering-Team-TODO (201907), Wikimedia-production-error (Shared Build Failure), Performance-Team (Radar), I18n, Wikidata
Stashbot added a comment to T228614: stubs dumps broken for wikidatawiki with old revision for an entity redirecting to self; content read for every revision in stubs!.

Mentioned in SAL (#wikimedia-operations) [2019-07-22T15:24:08Z] <jforrester@deploy1001> Synchronized php-1.34.0-wmf.14/includes/export/XmlDumpWriter.php: T228614 XmlDumpWriter: don't load revision text content unless requested to (duration: 00m 48s)

Mon, Jul 22, 3:24 PM · MW-1.34-notes (1.34.0-wmf.14; 2019-07-16), Wikimedia-production-error, Wikidata, Dumps-Generation
Stashbot added a comment to T226668: Factor out eventgate-wikimedia factory into its own gerrit repo and use it for deployment pipeline.

Mentioned in SAL (#wikimedia-operations) [2019-07-22T14:30:21Z] <ottomata> deploying refactored eventgate chart using eventgate-wikimedia image to eventgate-* services - T226668

Mon, Jul 22, 2:30 PM · Analytics-Kanban, Analytics, Core Platform Team Backlog (Watching / External), Services (watching), EventBus
Stashbot added a comment to T216812: CX2: Template appears as regular text in the source document, propagating as HTML into the translation.

Mentioned in SAL (#wikimedia-operations) [2019-07-22T13:12:21Z] <kart_> Updated cxserver to 2019-07-17-074415-production (T227553, T216812)

Mon, Jul 22, 1:12 PM · Language-Team (Language-2019-July-September), CX-out-of-beta
Stashbot added a comment to T227553: Test failure: TypeError: Cannot read property 'item' of undefined.

Mentioned in SAL (#wikimedia-operations) [2019-07-22T13:12:21Z] <kart_> Updated cxserver to 2019-07-17-074415-production (T227553, T216812)

Mon, Jul 22, 1:12 PM · Language-Team (Language-2019-July-September), CX-cxserver
Stashbot added a comment to T202367: Productionize dbproxy101[2-7].eqiad.wmnet and dbproxy200[1-4].

Mentioned in SAL (#wikimedia-operations) [2019-07-22T12:58:29Z] <marostegui> Stop MySQL on db1117:3321 to test dbproxy1014 (replacement for dbproxy1006) on m1 - T202367

Mon, Jul 22, 12:58 PM · Patch-For-Review, DBA
Stashbot added a comment to T228481: Activate subpages link in the main namespace of the Korean Wikiversity.

Mentioned in SAL (#wikimedia-operations) [2019-07-22T11:20:33Z] <awight@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [[gerrit:524685|Enable wgNamespacesWithSubpages on main NS for kowikiversity (T228481)]] (duration: 00m 54s)

Mon, Jul 22, 11:20 AM · User-revi, Wikimedia-Site-requests
Stashbot added a comment to T226532: If rights exist, suggest automatic deletion of the source wiki file.

Mentioned in SAL (#wikimedia-operations) [2019-07-22T11:14:36Z] <awight@deploy1001> Synchronized wmf-config/CommonSettings-labs.php: SWAT: [[gerrit:523661|Enable FileImporter source wiki edit and delete, (remove labs customizations) (T225617, T226532)]] (duration: 00m 54s)

Mon, Jul 22, 11:14 AM · MW-1.34-notes (1.34.0-wmf.13; 2019-07-09), WMDE-QWERTY-Sprint-2019-06-26, Move-Files-To-Commons, TCB-Team
Stashbot added a comment to T225617: Add the nowcommons template to the source wiki if requested.

Mentioned in SAL (#wikimedia-operations) [2019-07-22T11:14:36Z] <awight@deploy1001> Synchronized wmf-config/CommonSettings-labs.php: SWAT: [[gerrit:523661|Enable FileImporter source wiki edit and delete, (remove labs customizations) (T225617, T226532)]] (duration: 00m 54s)

Mon, Jul 22, 11:14 AM · Patch-For-Review, MW-1.34-notes (1.34.0-wmf.13; 2019-07-09), WMDE-QWERTY-Sprint-2019-06-26, WMDE-QWERTY-Sprint-2019-06-12, Move-Files-To-Commons, TCB-Team
Stashbot added a comment to T226532: If rights exist, suggest automatic deletion of the source wiki file.

Mentioned in SAL (#wikimedia-operations) [2019-07-22T11:13:05Z] <awight@deploy1001> Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:523661|Enable FileImporter source wiki edit and delete (T225617, T226532)]] (duration: 00m 56s)

Mon, Jul 22, 11:13 AM · MW-1.34-notes (1.34.0-wmf.13; 2019-07-09), WMDE-QWERTY-Sprint-2019-06-26, Move-Files-To-Commons, TCB-Team
Stashbot added a comment to T225617: Add the nowcommons template to the source wiki if requested.

Mentioned in SAL (#wikimedia-operations) [2019-07-22T11:13:05Z] <awight@deploy1001> Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:523661|Enable FileImporter source wiki edit and delete (T225617, T226532)]] (duration: 00m 56s)

Mon, Jul 22, 11:13 AM · Patch-For-Review, MW-1.34-notes (1.34.0-wmf.13; 2019-07-09), WMDE-QWERTY-Sprint-2019-06-26, WMDE-QWERTY-Sprint-2019-06-12, Move-Files-To-Commons, TCB-Team
Stashbot added a comment to T219148: Use PHP7 to run all async jobs.

Mentioned in SAL (#wikimedia-operations) [2019-07-22T10:23:44Z] <jijiki> Disable puppet on jobrunners for 524336 - T219148

Mon, Jul 22, 10:23 AM · User-WDoran, Core Platform Team Workboards (Clinic Duty Team), Patch-For-Review, Core Platform Team Backlog (Watching / External), User-jijiki, Services (watching), Operations, serviceops
Stashbot added a comment to T226516: deploy CoreDNS as a in-cluster DNS service.

Mentioned in SAL (#wikimedia-operations) [2019-07-22T10:20:57Z] <fsero> deploy coredns in staging T226516

Mon, Jul 22, 10:21 AM · serviceops
Stashbot added a comment to T228620: Frequent/Long GC old gen collections for HDFS namenodes on an-master100[1,2].

Mentioned in SAL (#wikimedia-operations) [2019-07-22T09:47:58Z] <elukey> failover + restart of Hadoop HDFS namenode on an-master1001 to apply GC settings - T228620

Mon, Jul 22, 9:48 AM · Analytics-Kanban, Analytics
Stashbot added a comment to T202367: Productionize dbproxy101[2-7].eqiad.wmnet and dbproxy200[1-4].

Mentioned in SAL (#wikimedia-operations) [2019-07-22T09:40:15Z] <marostegui> Deploy grants on m1 to allow connections from dbproxy1014 - T202367

Mon, Jul 22, 9:40 AM · Patch-For-Review, DBA
Stashbot added a comment to T228620: Frequent/Long GC old gen collections for HDFS namenodes on an-master100[1,2].

Mentioned in SAL (#wikimedia-operations) [2019-07-22T09:32:32Z] <elukey> restart hadoop hdfs namenode on an-master1002 to apply new GC settings - T228620

Mon, Jul 22, 9:32 AM · Analytics-Kanban, Analytics
Stashbot added a comment to T196055: Remove table `math` from the database.

Mentioned in SAL (#wikimedia-operations) [2019-07-22T08:33:41Z] <marostegui> Rename table enwiki.math on db2116 T196055

Mon, Jul 22, 8:33 AM · DBA, Math
Stashbot added a comment to T226851: Drop abuse_filter_log.afl_log_id in production.

Mentioned in SAL (#wikimedia-operations) [2019-07-22T07:56:59Z] <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1134 after schema change T226851 (duration: 00m 51s)

Mon, Jul 22, 7:57 AM · AbuseFilter, DBA
Stashbot added a comment to T228606: Degraded RAID on elastic1046.

Mentioned in SAL (#wikimedia-operations) [2019-07-22T07:54:48Z] <elukey> sudo -i depool on elastic1046 - broken disk (srv partition not available) - T228606

Mon, Jul 22, 7:54 AM · ops-eqiad, Operations
Stashbot added a comment to T226851: Drop abuse_filter_log.afl_log_id in production.

Mentioned in SAL (#wikimedia-operations) [2019-07-22T07:27:43Z] <marostegui> Drop afl_log_id column from enwiki.abuse_filter_log on db1134 T226851

Mon, Jul 22, 7:27 AM · AbuseFilter, DBA
Stashbot added a comment to T226851: Drop abuse_filter_log.afl_log_id in production.

Mentioned in SAL (#wikimedia-operations) [2019-07-22T07:27:27Z] <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1134 for schema change T226851 (duration: 00m 56s)

Mon, Jul 22, 7:27 AM · AbuseFilter, DBA
Stashbot added a comment to T202367: Productionize dbproxy101[2-7].eqiad.wmnet and dbproxy200[1-4].

Mentioned in SAL (#wikimedia-operations) [2019-07-22T06:47:18Z] <marostegui> Stop MySQL on db2062 to test dbproxy2001 notification T202367

Mon, Jul 22, 6:47 AM · Patch-For-Review, DBA
Stashbot added a comment to T222978: Compress and defragment tables on labsdb hosts.

Mentioned in SAL (#wikimedia-operations) [2019-07-22T05:24:34Z] <marostegui> Compress more tables on labsdb1009 - T222978

Mon, Jul 22, 5:24 AM · Data-Services, DBA
Stashbot added a comment to T228465: TorBlock maintenance failures on labweb hosts.

Mentioned in SAL (#wikimedia-operations) [2019-07-22T04:48:53Z] <tstarling@deploy1001> Synchronized php-1.34.0-wmf.14/extensions/TorBlock/extension.json: fixing UBN T228465 (duration: 00m 54s)

Mon, Jul 22, 4:48 AM · MW-1.34-notes (1.34.0-wmf.14; 2019-07-16), Patch-For-Review, MediaWiki-extensions-TorBlock
Stashbot added a comment to T228465: TorBlock maintenance failures on labweb hosts.

Mentioned in SAL (#wikimedia-operations) [2019-07-22T04:46:07Z] <tstarling@deploy1001> Synchronized php-1.34.0-wmf.14/extensions/TorBlock/maintenance/loadExitNodes.php: fixing UBN T228465 (duration: 00m 54s)

Mon, Jul 22, 4:46 AM · MW-1.34-notes (1.34.0-wmf.14; 2019-07-16), Patch-For-Review, MediaWiki-extensions-TorBlock
Stashbot added a comment to T228465: TorBlock maintenance failures on labweb hosts.

Mentioned in SAL (#wikimedia-operations) [2019-07-22T04:44:16Z] <tstarling@deploy1001> Synchronized php-1.34.0-wmf.14/extensions/TorBlock/includes/TorExitNodes.php: fixing UBN T228465 (duration: 00m 56s)

Mon, Jul 22, 4:44 AM · MW-1.34-notes (1.34.0-wmf.14; 2019-07-16), Patch-For-Review, MediaWiki-extensions-TorBlock
Stashbot added a comment to T227772: Fix or remove capability to override user rights for the current request.

Mentioned in SAL (#wikimedia-operations) [2019-07-22T04:17:00Z] <tstarling@deploy1001> Synchronized php-1.34.0-wmf.14/extensions/CentralAuth/includes/specials/SpecialMultiLock.php: fix UBN bug T227772 (duration: 00m 56s)

Mon, Jul 22, 4:17 AM · MW-1.34-notes (1.34.0-wmf.14; 2019-07-16), Core Platform Team, Stewards-and-global-tools, ArticleFeedbackv5, GraphViz, MediaWiki-extensions-CentralAuth

Sun, Jul 21

Stashbot added a comment to T228574: 'skipcaptcha' permission is not assigned to autoconfirmed users on Wikispecies.

Mentioned in SAL (#wikimedia-operations) [2019-07-21T01:06:09Z] <Urbanecm> Deployed patch for T228574

Sun, Jul 21, 1:06 AM · Wikimedia-Site-requests

Fri, Jul 19

Stashbot added a comment to T190572: Prepare a disaster recovery plan for failing over from phab1001 to phab2001 (or phab2001 to 1001).

Mentioned in SAL (#wikimedia-operations) [2019-07-19T22:36:01Z] <mutante> phab2001 - switching apache to php-fpm and worker instead of mpm-prefork (to match phab1001) (T190568 T137928 T190572)

Fri, Jul 19, 10:36 PM · Release-Engineering-Team (Development services), Release-Engineering-Team-TODO, Phabricator, Documentation, DBA, User-MModell
Stashbot added a comment to T137928: Deploy phabricator to phab2001.codfw.wmnet.

Mentioned in SAL (#wikimedia-operations) [2019-07-19T22:36:01Z] <mutante> phab2001 - switching apache to php-fpm and worker instead of mpm-prefork (to match phab1001) (T190568 T137928 T190572)

Fri, Jul 19, 10:36 PM · Release-Engineering-Team (Development services), Release-Engineering-Team-TODO, Phabricator, Availability, WorkType-NewFunctionality, User-MModell
Stashbot added a comment to T190568: Reimage both phab1001 and phab2001 to stretch.

Mentioned in SAL (#wikimedia-operations) [2019-07-19T22:36:01Z] <mutante> phab2001 - switching apache to php-fpm and worker instead of mpm-prefork (to match phab1001) (T190568 T137928 T190572)

Fri, Jul 19, 10:36 PM · Release-Engineering-Team (Development services), Release-Engineering-Team-TODO, serviceops, Phabricator, Operations
Stashbot added a comment to T226516: deploy CoreDNS as a in-cluster DNS service.

Mentioned in SAL (#wikimedia-operations) [2019-07-19T15:22:47Z] <fsero> deploy coredns in staging T226516

Fri, Jul 19, 3:22 PM · serviceops
Stashbot added a comment to T87899: Convert Collection to use extension registration.

Mentioned in SAL (#wikimedia-operations) [2019-07-19T14:42:22Z] <krinkle@deploy1001> Synchronized php-1.34.0-wmf.14/extensions/Collection/Collection.php: 90eed0fad / T87899 (duration: 00m 54s)

Fri, Jul 19, 2:42 PM · MW-1.34-notes (1.34.0-wmf.13; 2019-07-09), Patch-For-Review, Performance-Team (Radar), Readers-Web-Backlog (Tracking), Collection
Stashbot added a comment to T87899: Convert Collection to use extension registration.

Mentioned in SAL (#wikimedia-operations) [2019-07-19T14:35:20Z] <krinkle@deploy1001> Synchronized php-1.34.0-wmf.13/extensions/Collection/Collection.php: 66ce154d7d734209c76a62cf / T87899 (duration: 00m 56s)

Fri, Jul 19, 2:35 PM · MW-1.34-notes (1.34.0-wmf.13; 2019-07-09), Patch-For-Review, Performance-Team (Radar), Readers-Web-Backlog (Tracking), Collection
Stashbot added a comment to T227775: recreate staging cluster namespaces using helmfile.

Mentioned in SAL (#wikimedia-operations) [2019-07-19T10:53:43Z] <fsero> deploying calico from helmfile in staging T227775

Fri, Jul 19, 10:53 AM · serviceops
Stashbot added a comment to T228122: DB reload for WDQS.

Mentioned in SAL (#wikimedia-operations) [2019-07-19T08:24:02Z] <gehel> repooling wdqs2004 - T228122

Fri, Jul 19, 8:24 AM · Patch-For-Review, Discovery-Wikidata-Query-Service-Sprint, Wikidata-Query-Service, Wikidata
Stashbot added a comment to T228122: DB reload for WDQS.

Mentioned in SAL (#wikimedia-operations) [2019-07-19T08:22:57Z] <gehel> repooling wdqs2003 - T228122

Fri, Jul 19, 8:23 AM · Patch-For-Review, Discovery-Wikidata-Query-Service-Sprint, Wikidata-Query-Service, Wikidata
Stashbot added a comment to T228403: eqiad: One VM request for identity provider.

Mentioned in SAL (#wikimedia-operations) [2019-07-19T07:57:15Z] <moritzm> installing idp1001 T228403

Fri, Jul 19, 7:57 AM · Patch-For-Review, vm-requests, Operations
Stashbot added a comment to T225199: Fatal error during RecentChange::notifyEdit (deferred update) from ORES/RecentChangeSaveHookHandler.

Mentioned in SAL (#wikimedia-operations) [2019-07-19T06:32:14Z] <legoktm@deploy1001> Synchronized php-1.34.0-wmf.13/extensions/EventBus/includes/EventBus.php: Add more debugging to figure out which events are invalid: T225199 (duration: 00m 55s)

Fri, Jul 19, 6:32 AM · MW-1.34-notes (1.34.0-wmf.15; 2019-07-23), Scoring-platform-team, WMF-JobQueue, Growth-Team, ORES, Wikimedia-production-error
Stashbot added a comment to T225199: Fatal error during RecentChange::notifyEdit (deferred update) from ORES/RecentChangeSaveHookHandler.

Mentioned in SAL (#wikimedia-operations) [2019-07-19T06:30:26Z] <legoktm@deploy1001> Synchronized php-1.34.0-wmf.14/extensions/EventBus/includes/EventBus.php: Add more debugging to figure out which events are invalid: T225199 (duration: 00m 55s)

Fri, Jul 19, 6:30 AM · MW-1.34-notes (1.34.0-wmf.15; 2019-07-23), Scoring-platform-team, WMF-JobQueue, Growth-Team, ORES, Wikimedia-production-error
Stashbot added a comment to T228196: docker-registry: some layers has been corrupted due to deleting other swift containers.

Mentioned in SAL (#wikimedia-operations) [2019-07-19T05:26:18Z] <fsero> repool ms-fe2005 - T228196

Fri, Jul 19, 5:26 AM · Patch-For-Review, Release-Engineering-Team-TODO (201907), Operations, Wikimedia-Incident, serviceops
Stashbot added a comment to T226948: Degraded RAID on mw2250.

Mentioned in SAL (#wikimedia-operations) [2019-07-19T00:04:30Z] <mutante> install1002 - exported indices for new scap version - copied back from buster to stretch - upgraded scap version on mw2250 - scap pull now works and starts to rsync (T228482, T228328, T226948)

Fri, Jul 19, 12:04 AM · User-jijiki, serviceops, Operations, ops-codfw
Stashbot added a comment to T228328: 'scap pull' stopped working on appservers ?.

Mentioned in SAL (#wikimedia-operations) [2019-07-19T00:04:30Z] <mutante> install1002 - exported indices for new scap version - copied back from buster to stretch - upgraded scap version on mw2250 - scap pull now works and starts to rsync (T228482, T228328, T226948)

Fri, Jul 19, 12:04 AM · Release-Engineering-Team-TODO (201907), Release-Engineering-Team (Deployment services), Scap, serviceops
Stashbot added a comment to T228482: Deploy scap 3.11.1-1.

Mentioned in SAL (#wikimedia-operations) [2019-07-19T00:04:30Z] <mutante> install1002 - exported indices for new scap version - copied back from buster to stretch - upgraded scap version on mw2250 - scap pull now works and starts to rsync (T228482, T228328, T226948)

Fri, Jul 19, 12:04 AM · Release-Engineering-Team-TODO (201907), Release-Engineering-Team (Deployment services), Scap, serviceops