Stashbot (Stashbot)Bot
Bot that likes to stash things away for later

Projects

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Tuesday

  • Clear sailing ahead.

User Details

User Since
Feb 10 2016, 12:29 AM (136 w, 3 d)
Roles
Bot
Availability
Available
IRC Nick
stashbot
LDAP User
Stashbot
MediaWiki User
Unknown

Recent Activity

Yesterday

Stashbot added a comment to T183891: Archive mediawiki/extensions/Collection/OfflineContentGenerator and all OCG-related repos.

Mentioned in SAL (#wikimedia-releng) [2018-09-22T20:51:01Z] <Hauskatze> github: deleting several wikimedia/mediawiki-extensions-Collection-.* mirror repos for T183891

Sat, Sep 22, 8:51 PM · User-MarcoAurelio, Reading-Infrastructure-Team-Backlog, GitHub-Mirrors, Repository-Admins, Cleanup, Readers-Web-Backlog (Tracking), Services (watching), OCG-General, Readers-Community-Engagement, Operations
Stashbot added a comment to T183891: Archive mediawiki/extensions/Collection/OfflineContentGenerator and all OCG-related repos.

Mentioned in SAL (#wikimedia-releng) [2018-09-22T20:05:12Z] <Hauskatze> github: deleted mirror wikimedia/mediawiki-extensions-Collection-OfflineContentGenerator-zim_renderer | T183891; moving to the next one

Sat, Sep 22, 8:05 PM · User-MarcoAurelio, Reading-Infrastructure-Team-Backlog, GitHub-Mirrors, Repository-Admins, Cleanup, Readers-Web-Backlog (Tracking), Services (watching), OCG-General, Readers-Community-Engagement, Operations
Stashbot added a comment to T205162: MediaViewer shows only Black Screen in IE 11.

Mentioned in SAL (#wikimedia-operations) [2018-09-22T18:28:59Z] <krinkle@deploy1001> Synchronized php-1.32.0-wmf.22/extensions/MultimediaViewer/resources/: I0954c42a37668b0, T205162 (duration: 00m 56s)

Sat, Sep 22, 6:29 PM · MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), Wikimedia-production-error, Multimedia, MediaWiki-extensions-MultimediaViewer, Browser-Support-Internet-Explorer
Stashbot added a comment to T153468: Ferm/DNS library weirdness causing puppet errors on some deployment-prep instances.

Mentioned in SAL (#wikimedia-releng) [2018-09-22T18:20:58Z] <Krenair> removed ferm package from deployment-snapshot01 as it appeared unmanaged by puppet and was causing problems with SSH access from the current deployment hosts (previous logs referenced T153468, this just explains why puppet hadn't purged stuff)

Sat, Sep 22, 6:21 PM · Beta-Cluster-Infrastructure, Patch-For-Review, Upstream, Operations, Beta-Cluster-reproducible, DNS, Traffic
Stashbot added a comment to T153468: Ferm/DNS library weirdness causing puppet errors on some deployment-prep instances.

Mentioned in SAL (#wikimedia-releng) [2018-09-22T18:01:57Z] <Krenair> rm deployment-maps03:/etc/ferm/conf.d/10_redis_exporter_6379 as it was breaking ferm from starting (T153468), puppet has not re-created it so I assume it was historical (shouldn't puppet be purging such files?)

Sat, Sep 22, 6:02 PM · Beta-Cluster-Infrastructure, Patch-For-Review, Upstream, Operations, Beta-Cluster-reproducible, DNS, Traffic
Stashbot added a comment to T153468: Ferm/DNS library weirdness causing puppet errors on some deployment-prep instances.

Mentioned in SAL (#wikimedia-releng) [2018-09-22T18:00:20Z] <Krenair> rm deployment-snapshot01:/etc/ferm/conf.d/10_prometheus-nutcracker-exporter as it was breaking ferm from starting (T153468), puppet has not re-created it so I assume it was historical (shouldn't puppet be purging such files?)

Sat, Sep 22, 6:00 PM · Beta-Cluster-Infrastructure, Patch-For-Review, Upstream, Operations, Beta-Cluster-reproducible, DNS, Traffic

Fri, Sep 21

Stashbot added a comment to T201343: rack/setup/install mwmaint1002.eqiad.wmnet.

Mentioned in SAL (#wikimedia-operations) [2018-09-21T23:47:15Z] <mutante> mwmaint1002 - rsyncing home dirs over from mwmaint1001 which synced them from terbium. still large old files from terbium here, like a NASA video :) (T201343)

Fri, Sep 21, 11:47 PM · Patch-For-Review, ops-eqiad, Operations
Stashbot added a comment to T204564: cloudvps: toolserver-legacy project trusty deprecation.

Mentioned in SAL (#wikimedia-cloud) [2018-09-21T23:25:16Z] <mutante> deleting now unused trusty instance relic (T204564) (/etc is backed up on new instance in /root/ just in case)

Fri, Sep 21, 11:25 PM · Operations, Cloud-VPS
Stashbot added a comment to T204558: cloudvps: puppet project trusty deprecation.

Mentioned in SAL (#wikimedia-cloud) [2018-09-21T23:17:10Z] <mutante> deleting unused instance trusty-update (T204558)

Fri, Sep 21, 11:17 PM · Puppet, Cloud-VPS
Stashbot added a comment to T204558: cloudvps: puppet project trusty deprecation.

Mentioned in SAL (#wikimedia-cloud) [2018-09-21T23:16:34Z] <mutante> deleting unused instance puppet-mailman (T204558)

Fri, Sep 21, 11:16 PM · Puppet, Cloud-VPS
Stashbot added a comment to T204564: cloudvps: toolserver-legacy project trusty deprecation.

Mentioned in SAL (#wikimedia-cloud) [2018-09-21T23:12:10Z] <mutante> migration complete. shutting down trusty instance 'relic'. (T204564)

Fri, Sep 21, 11:12 PM · Operations, Cloud-VPS
Stashbot added a comment to T201343: rack/setup/install mwmaint1002.eqiad.wmnet.

Mentioned in SAL (#wikimedia-operations) [2018-09-21T22:13:38Z] <mutante> mwmaint1002 - re-enabling puppet, now that it has mcrouter certs, that works (T201343)

Fri, Sep 21, 10:13 PM · Patch-For-Review, ops-eqiad, Operations
Stashbot added a comment to T204964: Empty resultsets give broken json.

Mentioned in SAL (#wikimedia-cloud) [2018-09-21T19:29:43Z] <framawiki> deployed 4b01077 on quarry-web-01 T204964

Fri, Sep 21, 7:29 PM · Patch-For-Review, Quarry
Stashbot added a comment to T201890: Update data in `meta_p.wiki` in Cloud Services for foundationwiki move.

Mentioned in SAL (#wikimedia-cloud) [2018-09-21T17:18:54Z] <bd808> Running sudo maintain-meta_p --all-databases --purge across labsdb10(09|10|11) for T201890

Fri, Sep 21, 5:19 PM · cloud-services-team (Kanban), Data-Services, foundation.wikimedia.org
Stashbot added a comment to T201343: rack/setup/install mwmaint1002.eqiad.wmnet.

Mentioned in SAL (#wikimedia-operations) [2018-09-21T16:29:36Z] <mutante> puppetmaster: running mcrouter_generate_certs to add an mcrouter cert for mwmaint1002 (T201343) https://wikitech.wikimedia.org/wiki/Mcrouter#Generate_certs_for_a_new_host

Fri, Sep 21, 4:29 PM · Patch-For-Review, ops-eqiad, Operations
Stashbot added a comment to T203254: labstore1004 and labstore1005 high load issues following upgrades.

Mentioned in SAL (#wikimedia-cloud) [2018-09-21T15:00:15Z] <bstorm_> Installed backported packages to nfs server and demonstrated that it can be made to work by following a procedure to be documented in T203254

Fri, Sep 21, 3:00 PM · Patch-For-Review, cloud-services-team (Kanban)
Stashbot added a comment to T204562: cloudvps: shinken project trusty deprecation.

Mentioned in SAL (#wikimedia-cloud) [2018-09-21T13:41:54Z] <Krenair> Created shinken-02 for T204562

Fri, Sep 21, 1:42 PM · Patch-For-Review, Shinken, Cloud-VPS
Stashbot added a comment to T205087: ORES locks on varnish IPs and not the client IP.

Mentioned in SAL (#wikimedia-operations) [2018-09-21T13:35:33Z] <ladsgroup@deploy1001> Finished deploy [ores/deploy@7b987a7]: Pass the real IP (T205087) (duration: 24m 10s)

Fri, Sep 21, 1:35 PM · Patch-For-Review, User-Ladsgroup, ORES, Scoring-platform-team (Current)
Stashbot added a comment to T205087: ORES locks on varnish IPs and not the client IP.

Mentioned in SAL (#wikimedia-operations) [2018-09-21T13:11:23Z] <ladsgroup@deploy1001> Started deploy [ores/deploy@7b987a7]: Pass the real IP (T205087)

Fri, Sep 21, 1:11 PM · Patch-For-Review, User-Ladsgroup, ORES, Scoring-platform-team (Current)
Stashbot added a comment to T199083: Migrate the hardware inventory from Racktables to Netbox.

Mentioned in SAL (#wikimedia-operations) [2018-09-21T13:01:53Z] <volans> wiping netbox DB to re-import it cleanly from racktables - T199083

Fri, Sep 21, 1:01 PM · Goal, Operations
Stashbot added a comment to T205078: toolforge: round of package upgrades and cleanups.

Mentioned in SAL (#wikimedia-cloud) [2018-09-21T12:14:51Z] <arturo> T205078 same for {jessie,stretch}-wikimedia

Fri, Sep 21, 12:14 PM · Toolforge
Stashbot added a comment to T205078: toolforge: round of package upgrades and cleanups.

Mentioned in SAL (#wikimedia-cloud) [2018-09-21T12:12:07Z] <arturo> T205078 upgrade trusty-wikimedia packages (git-fat, debmonitor)

Fri, Sep 21, 12:12 PM · Toolforge
Stashbot added a comment to T205078: toolforge: round of package upgrades and cleanups.

Mentioned in SAL (#wikimedia-cloud) [2018-09-21T11:57:32Z] <arturo> T205078 purge packages smbclient libsmbclient libwbclient0 python-samba samba-common samba-libs from trusty machines

Fri, Sep 21, 11:57 AM · Toolforge

Thu, Sep 20

Stashbot added a comment to T202160: Evaluate different strategy for Docker CI instances.

Mentioned in SAL (#wikimedia-releng) [2018-09-20T23:20:13Z] <marxarelli> taking integration-slave-docker-1004/1005 offline for replacement (T202160)

Thu, Sep 20, 11:20 PM · Release-Engineering-Team (Kanban), Release Pipeline, Continuous-Integration-Infrastructure
Stashbot added a comment to T191068: 1.32.0-wmf.22 deployment blockers.

Mentioned in SAL (#wikimedia-operations) [2018-09-20T21:16:32Z] <hashar> 1.32.0-wmf.22 is fully deployed. A quick summary and thanks words are at https://phabricator.wikimedia.org/T191068#4604040

Thu, Sep 20, 9:16 PM · User-zeljkofilipin, Release-Engineering-Team (Kanban), Release, Train Deployments
Stashbot added a comment to T203254: labstore1004 and labstore1005 high load issues following upgrades.

Mentioned in SAL (#wikimedia-cloud) [2018-09-20T20:59:02Z] <bstorm_> nfs mount is now at /mnt/nfs/test on the client. Since it now works, we should be able to break it for T203254

Thu, Sep 20, 8:59 PM · Patch-For-Review, cloud-services-team (Kanban)
Stashbot added a comment to T106067: Undeploy DisableAccount extension.

Mentioned in SAL (#wikimedia-operations) [2018-09-20T19:57:49Z] <reedy@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Disable DisableAccount T106067 (duration: 00m 51s)

Thu, Sep 20, 7:58 PM · Patch-For-Review, Technical-Debt, Stewards-and-global-tools, Wikimedia-Extension-setup, WMF-Legal
Stashbot added a comment to T203349: Expand Commons:Monuments database/Statistics to also include empty sources.

Mentioned in SAL (#wikimedia-cloud) [2018-09-20T19:22:20Z] <JeanFred> Deploy latest from Git master: a14a46d (T203349)

Thu, Sep 20, 7:22 PM · Wiki-Loves-Monuments (2018), Patch-For-Review, Wiki-Loves-Monuments-Database
Stashbot added a comment to T195840: Track when a CentralNotice banner was displayed to the user in NavTiming.

Mentioned in SAL (#wikimedia-operations) [2018-09-20T19:12:25Z] <thcipriani@deploy1001> Synchronized php-1.32.0-wmf.22/extensions/CentralNotice/resources/subscribing/ext.centralNotice.display.js: SWAT: [[gerrit:461485|Add performance mark for when banner is inserted]] T195840 (duration: 00m 51s)

Thu, Sep 20, 7:12 PM · Wikimedia-Fundraising, MediaWiki-extensions-NavigationTiming, Performance-Team
Stashbot added a comment to T147505: [Recurring task] CirrusSearch: what is updated during re-indexing.

Mentioned in SAL (#wikimedia-operations) [2018-09-20T18:43:01Z] <SMalyshev> Initiating in-place reindex for wikidatawiki (T147505)

Thu, Sep 20, 6:43 PM · Discovery-Search (Current work), Discovery
Stashbot added a comment to T204629: AfC: Issues with reloading the page .

Mentioned in SAL (#wikimedia-operations) [2018-09-20T18:31:46Z] <thcipriani@deploy1001> Synchronized php-1.32.0-wmf.22/extensions/PageTriage/modules: SWAT: [[gerrit:461424|Correctly sync the form when afc_state === "all"]] T204629 [[gerrit:461648|Use same api params for list and stats on page load]] T204629 (duration: 00m 54s)

Thu, Sep 20, 6:31 PM · MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), Patch-For-Review, MediaWiki-extensions-PageCuration, Growth-Team (Current Sprint)
Stashbot added a comment to T204629: AfC: Issues with reloading the page .

Mentioned in SAL (#wikimedia-operations) [2018-09-20T18:31:46Z] <thcipriani@deploy1001> Synchronized php-1.32.0-wmf.22/extensions/PageTriage/modules: SWAT: [[gerrit:461424|Correctly sync the form when afc_state === "all"]] T204629 [[gerrit:461648|Use same api params for list and stats on page load]] T204629 (duration: 00m 54s)

Thu, Sep 20, 6:31 PM · MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), Patch-For-Review, MediaWiki-extensions-PageCuration, Growth-Team (Current Sprint)
Stashbot added a comment to T191086: Instrument and collect data via CitationUsage schema.

Mentioned in SAL (#wikimedia-operations) [2018-09-20T18:21:52Z] <thcipriani@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:461117|Enable logging for CitationUsage and CitationUsagePageLoad]] T191086 (duration: 00m 51s)

Thu, Sep 20, 6:22 PM · MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), Discovery-Search (Current work), Research-Archive, Performance-Team (Radar), Patch-For-Review, Research-2017-18-Q4
Stashbot added a comment to T204956: ORES should return 429 instead of 408 in case of too many requests.

Mentioned in SAL (#wikimedia-operations) [2018-09-20T17:24:37Z] <ladsgroup@deploy1001> Finished deploy [ores/deploy@ee2d28b]: Returning 429 instead of 408 in case of too many requests (T204956) (duration: 21m 15s)

Thu, Sep 20, 5:24 PM · Patch-For-Review, ORES, User-Ladsgroup, Scoring-platform-team (Current)
Stashbot added a comment to T199198: Some swift filesystems reporting negative disk usage.

Mentioned in SAL (#wikimedia-operations) [2018-09-20T17:24:29Z] <godog> repair sdk on ms-be2043 - T199198

Thu, Sep 20, 5:24 PM · User-fgiunchedi, media-storage, Operations
Stashbot added a comment to T204383: Update Debian Package for Scap to 3.8.6-1.

Mentioned in SAL (#wikimedia-operations) [2018-09-20T17:24:01Z] <godog> upload scap 3.8.6-1 - T204383

Thu, Sep 20, 5:24 PM · Patch-For-Review, Operations, Release-Engineering-Team (Kanban), Scap
Stashbot added a comment to T204956: ORES should return 429 instead of 408 in case of too many requests.

Mentioned in SAL (#wikimedia-operations) [2018-09-20T17:03:22Z] <ladsgroup@deploy1001> Started deploy [ores/deploy@ee2d28b]: Returning 429 instead of 408 in case of too many requests (T204956)

Thu, Sep 20, 5:03 PM · Patch-For-Review, ORES, User-Ladsgroup, Scoring-platform-team (Current)
Stashbot added a comment to T198309: Enable MCR migration stage "write both, read new" on testwiki.

Mentioned in SAL (#wikimedia-operations) [2018-09-20T15:56:20Z] <anomie@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Setting MCR migration stage to write-both/read-new on testwiki (T198309) (duration: 00m 59s)

Thu, Sep 20, 3:56 PM · Patch-For-Review, Multi-Content-Revisions (MCR Deployment), Wikidata, Structured-Data-Commons
Stashbot added a comment to T204351: Add a parameter controlling if templates are added to the image pages (monuments_without_id).

Mentioned in SAL (#wikimedia-cloud) [2018-09-20T15:25:27Z] <JeanFred> Deploy latest from Git master: 0252aa2, c14485e, 211a1d9, 3fd9907, af28b24, eea49d4, 2c7c42f (T204351), e295352, 093582a, 0be7477

Thu, Sep 20, 3:25 PM · Patch-For-Review, Wiki-Loves-Monuments-Database
Stashbot added a comment to T203184: Deploy PageTriage AfC to production.

Mentioned in SAL (#wikimedia-operations) [2018-09-20T15:15:05Z] <stephanebisson> Starting mwscript extensions/PageTriage/maintenance/populateDraftQueue.php --wiki enwiki (T203184)

Thu, Sep 20, 3:15 PM · MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), Growth-Team (Current Sprint), Patch-For-Review, English-Wikipedia-New-Pages-Patrol, MediaWiki-extensions-PageCuration
Stashbot added a comment to T203184: Deploy PageTriage AfC to production.

Mentioned in SAL (#wikimedia-operations) [2018-09-20T15:14:17Z] <stephanebisson> Finished mwscript extensions/PageTriage/maintenance/DeleteAfcStates.php --wiki enwiki (T203184)

Thu, Sep 20, 3:14 PM · MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), Growth-Team (Current Sprint), Patch-For-Review, English-Wikipedia-New-Pages-Patrol, MediaWiki-extensions-PageCuration
Stashbot added a comment to T203184: Deploy PageTriage AfC to production.

Mentioned in SAL (#wikimedia-operations) [2018-09-20T15:11:37Z] <stephanebisson> Starting mwscript extensions/PageTriage/maintenance/DeleteAfcStates.php --wiki enwiki (T203184)

Thu, Sep 20, 3:11 PM · MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), Growth-Team (Current Sprint), Patch-For-Review, English-Wikipedia-New-Pages-Patrol, MediaWiki-extensions-PageCuration
Stashbot added a comment to T199198: Some swift filesystems reporting negative disk usage.

Mentioned in SAL (#wikimedia-operations) [2018-09-20T14:48:57Z] <godog> repair sdn on ms-be2040 - T199198

Thu, Sep 20, 2:49 PM · User-fgiunchedi, media-storage, Operations
Stashbot added a comment to T194966: disk usage increase on maps servers.

Mentioned in SAL (#wikimedia-operations) [2018-09-20T14:44:09Z] <gehel> reduce replication factor to 2 on cassandra maps eqiad - T194966

Thu, Sep 20, 2:44 PM · Operations, Maps
Stashbot added a comment to T204907: Scap is checking canary servers in dormant instead of active-dc .

Mentioned in SAL (#wikimedia-operations) [2018-09-20T14:28:33Z] <hashar@deploy1001> Synchronized typos: Dummy sync to verify list of canaries for T204907 (duration: 00m 59s)

Thu, Sep 20, 2:28 PM · Patch-For-Review, Datacenter-Switchover-2018, Release-Engineering-Team, Scap
Stashbot added a comment to T204006: Execute the schema change for Partial Blocks.

Mentioned in SAL (#wikimedia-operations) [2018-09-20T14:22:42Z] <marostegui> Deploy schema change on s5 eqiad master with replication T204006

Thu, Sep 20, 2:22 PM · Patch-For-Review, DBA, Blocked-on-schema-change, Anti-Harassment
Stashbot added a comment to T204667: Ferm leftovers on labtestnet2003.

Mentioned in SAL (#wikimedia-operations) [2018-09-20T13:20:34Z] <gtirloni> T204667 reimage labtestnet2003

Thu, Sep 20, 1:20 PM · cloud-services-team, Operations
Stashbot added a comment to T204353: Wikidocumentaries wants to use https://wikidocumentaries.io .

Mentioned in SAL (#wikimedia-cloud) [2018-09-20T12:35:18Z] <arturo> T204353 increment quota to add 1 floating ips

Thu, Sep 20, 12:35 PM · Cloud-VPS (Quota-requests), Wikidocumentaries
Stashbot added a comment to T201675: Create new namespaces in zhwikiversity.

Mentioned in SAL (#wikimedia-operations) [2018-09-20T11:48:42Z] <zfilipin@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:455395|Create new namespaces in zhwikiversity (T201675)]] (duration: 00m 57s)

Thu, Sep 20, 11:48 AM · Patch-For-Review, User-Urbanecm, Wikimedia-Site-requests, Chinese-Sites
Stashbot added a comment to T203000: Introduce engineer user group on Czech Wikipedia.

Mentioned in SAL (#wikimedia-operations) [2018-09-20T11:35:38Z] <zfilipin@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:455853|Introduce engineer user group on Czech Wikipedia (T203000)]] (duration: 00m 58s)

Thu, Sep 20, 11:35 AM · Patch-For-Review, Wikimedia-Site-requests, User-Urbanecm
Stashbot added a comment to T204919: tox-docker fails on keyholder due to pycrypto.

Mentioned in SAL (#wikimedia-releng) [2018-09-20T11:21:21Z] <hashar> Refreshing jenkins jobs to get rid of docker run option "--tmp /tmpfs" . It is mounted with 'noexec' which causes various jobs to fail. | T203181 and T204919

Thu, Sep 20, 11:21 AM · Operations-Software-Development, Continuous-Integration-Config
Stashbot added a comment to T203181: Quibble MariaDB should use a tmpfs as a datadir.

Mentioned in SAL (#wikimedia-releng) [2018-09-20T11:21:21Z] <hashar> Refreshing jenkins jobs to get rid of docker run option "--tmp /tmpfs" . It is mounted with 'noexec' which causes various jobs to fail. | T203181 and T204919

Thu, Sep 20, 11:21 AM · Patch-For-Review, Regression, Release-Engineering-Team, Continuous-Integration-Infrastructure (shipyard), Quibble
Stashbot added a comment to T204373: Request increased quota for integration Cloud VPS project.

Mentioned in SAL (#wikimedia-cloud) [2018-09-20T09:28:02Z] <arturo> T204373 increasing quotas

Thu, Sep 20, 9:28 AM · Release-Engineering-Team, Continuous-Integration-Infrastructure, Cloud-VPS (Quota-requests)
Stashbot added a comment to T204532: Request removal of puppet3-diffs VPS project.

Mentioned in SAL (#wikimedia-cloud) [2018-09-20T09:13:06Z] <arturo> T204532 deleting project

Thu, Sep 20, 9:13 AM · Operations, Cloud-VPS (Project-requests)
Stashbot added a comment to T199198: Some swift filesystems reporting negative disk usage.

Mentioned in SAL (#wikimedia-operations) [2018-09-20T07:31:18Z] <godog> repair sdl on ms-be2042 - T199198

Thu, Sep 20, 7:31 AM · User-fgiunchedi, media-storage, Operations
Stashbot added a comment to T204154: Kafka JobQueue should respect DB readonly mode.

Mentioned in SAL (#wikimedia-operations) [2018-09-20T06:20:29Z] <mobrovac@deploy1001> Synchronized rpc/RunSingleJob.php: Have RunSingleJob send the X-Readonly header - T204154 (duration: 00m 58s)

Thu, Sep 20, 6:20 AM · MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), Patch-For-Review, ChangeProp, Services (designing), WMF-JobQueue
Stashbot added a comment to T203709: Schema change for adding indexes of ct_tag_id.

Mentioned in SAL (#wikimedia-operations) [2018-09-20T06:09:37Z] <marostegui> Deploy schema change on db2070 - T203709

Thu, Sep 20, 6:09 AM · Blocked-on-schema-change, User-Ladsgroup, Wikidata-Campsite, MediaWiki-Database, MediaWiki-Change-tagging
Stashbot added a comment to T51593: Rename two indexes in the Echo extension.

Mentioned in SAL (#wikimedia-operations) [2018-09-20T05:54:08Z] <marostegui> Deploy schema change on s3:mediawikiwiki for echo tables codfw - T51593

Thu, Sep 20, 5:54 AM · Blocked-on-schema-change, DBA, Schema-change
Stashbot added a comment to T204864: [1.32.0-wmf.22] includes/GlobalPreferencesFactory.php: PHP Notice: Undefined index: section.

Mentioned in SAL (#wikimedia-operations) [2018-09-20T01:14:45Z] <krinkle@deploy1001> Synchronized php-1.32.0-wmf.22/extensions/GlobalPreferences/includes/GlobalPreferencesFactory.php: I52434a523f60e, T204864 (duration: 00m 58s)

Thu, Sep 20, 1:14 AM · MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), Wikimedia-production-error, Community-Tech, MediaWiki-extensions-GlobalPreferences
Stashbot added a comment to T204621: Reduce footprint of ext.3d on page initialisation.

Mentioned in SAL (#wikimedia-operations) [2018-09-20T00:52:28Z] <krinkle@deploy1001> Synchronized php-1.32.0-wmf.22/extensions/3D/modules/: I9e718957a497, T204621 (duration: 00m 58s)

Thu, Sep 20, 12:52 AM · MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), Patch-For-Review, Multimedia, 3D, Performance-Team (Radar)

Wed, Sep 19

Stashbot added a comment to T203589: SWAT $wgPopupsBetaFeature reading web config cleanup.

Mentioned in SAL (#wikimedia-operations) [2018-09-19T23:21:58Z] <catrope@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Remove obsolete $wgPopupsBetaFeature, part 2 (T203589) (duration: 00m 56s)

Wed, Sep 19, 11:22 PM · Readers-Web-Backlog (Readers-Web-Kanbanana-Board-2018-19-Q1), Technical-Debt, Patch-For-Review, Wikimedia-Site-requests
Stashbot added a comment to T203589: SWAT $wgPopupsBetaFeature reading web config cleanup.

Mentioned in SAL (#wikimedia-operations) [2018-09-19T23:21:00Z] <catrope@deploy1001> Synchronized wmf-config/CommonSettings.php: Remove obsolete $wgPopupsBetaFeature, part 1 (T203589) (duration: 00m 56s)

Wed, Sep 19, 11:21 PM · Readers-Web-Backlog (Readers-Web-Kanbanana-Board-2018-19-Q1), Technical-Debt, Patch-For-Review, Wikimedia-Site-requests
Stashbot added a comment to T203184: Deploy PageTriage AfC to production.

Mentioned in SAL (#wikimedia-operations) [2018-09-19T23:17:48Z] <catrope@deploy1001> Synchronized php-1.32.0-wmf.22/extensions/PageTriage/: PageTriage fixes for T203184 (duration: 00m 58s)

Wed, Sep 19, 11:17 PM · MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), Growth-Team (Current Sprint), Patch-For-Review, English-Wikipedia-New-Pages-Patrol, MediaWiki-extensions-PageCuration
Stashbot added a comment to T204609: Turn on page issues A/B test for Latvian wikipedia .

Mentioned in SAL (#wikimedia-operations) [2018-09-19T23:14:57Z] <catrope@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Enable Page issues A/B test on lvwiki (T204609) (duration: 00m 58s)

Wed, Sep 19, 11:15 PM · Patch-For-Review, Readers-Web-Backlog (Readers-Web-Kanbanana-Board-2018-19-Q1), Wikimedia-Site-requests
Stashbot added a comment to T204873: "Special page" tab accidentally renamed to "CollabPad" .

Mentioned in SAL (#wikimedia-operations) [2018-09-19T21:24:39Z] <jforrester@deploy1001> Synchronized php-1.32.0-wmf.22/extensions/VisualEditor/includes/SpecialCollabPad.php: T204873 Fix special page override hot deploy (duration: 00m 57s)

Wed, Sep 19, 9:24 PM · MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), MediaWiki-Special-pages
Stashbot added a comment to T183891: Archive mediawiki/extensions/Collection/OfflineContentGenerator and all OCG-related repos.

Mentioned in SAL (#wikimedia-releng) [2018-09-19T21:18:07Z] <Hauskatze> github: deleted https://github.com/wikimedia/mediawiki-services-ocg-collection | T183891

Wed, Sep 19, 9:18 PM · User-MarcoAurelio, Reading-Infrastructure-Team-Backlog, GitHub-Mirrors, Repository-Admins, Cleanup, Readers-Web-Backlog (Tracking), Services (watching), OCG-General, Readers-Community-Engagement, Operations
Stashbot added a comment to T204862: ORES doesn't block hammering IPs.

Mentioned in SAL (#wikimedia-operations) [2018-09-19T20:26:27Z] <ladsgroup@deploy1001> Finished deploy [ores/deploy@76fe25a]: ORES doesn't block hammering IPs (T204862) (duration: 21m 13s)

Wed, Sep 19, 8:26 PM · Patch-For-Review, ORES, Scoring-platform-team (Current), User-Ladsgroup
Stashbot added a comment to T200557: Create a stretch and Son of Grid Engine grid in toolsbeta.

Mentioned in SAL (#wikimedia-cloud) [2018-09-19T20:10:57Z] <bstorm_> toolsbeta-puppetmaster-02 is now the puppetmaster and puppetdb works for toolsbeta -- T200557

Wed, Sep 19, 8:11 PM · Patch-For-Review, Toolforge, Epic, cloud-services-team (Kanban)
Stashbot added a comment to T204862: ORES doesn't block hammering IPs.

Mentioned in SAL (#wikimedia-operations) [2018-09-19T20:05:14Z] <ladsgroup@deploy1001> Started deploy [ores/deploy@76fe25a]: ORES doesn't block hammering IPs (T204862)

Wed, Sep 19, 8:05 PM · Patch-For-Review, ORES, Scoring-platform-team (Current), User-Ladsgroup
Stashbot added a comment to T204871: Promoting group1 to 1.32.0-wmf.22 caused a spam of web request took longer than 60 seconds and timed out.

Mentioned in SAL (#wikimedia-operations) [2018-09-19T19:40:59Z] <hashar> web request 60 second timeout when deploying is filled as https://phabricator.wikimedia.org/T204871

Wed, Sep 19, 7:41 PM · Release-Engineering-Team, Wikimedia-production-error
Stashbot added a comment to T191068: 1.32.0-wmf.22 deployment blockers.

Mentioned in SAL (#wikimedia-operations) [2018-09-19T19:30:06Z] <hashar> while promoting group1 to 1.32.0-wmf.22 lot of web requests timed out at 60 seconds. Roughly from 19:24 to 19:28. But that is no more occurring | T191068

Wed, Sep 19, 7:30 PM · User-zeljkofilipin, Release-Engineering-Team (Kanban), Release, Train Deployments
Stashbot added a comment to T204797: [Regression 1.32.0-wmf.22] ParserOutput::getLanguageLinks returns invalid values (Undefined index from ApiParse and LinksUpdate).

Mentioned in SAL (#wikimedia-operations) [2018-09-19T19:16:37Z] <hashar@deploy1001> Synchronized php-1.32.0-wmf.22/extensions/Translate/tag/PageTranslationHooks.php: Avoid warnings and errors caused by x-pagetranslation-tag - T204797 (duration: 00m 58s)

Wed, Sep 19, 7:16 PM · Language-Team, User-Nikerabbit, MediaWiki-extensions-Translate, Wikimedia-production-error
Stashbot added a comment to T204862: ORES doesn't block hammering IPs.

Mentioned in SAL (#wikimedia-releng) [2018-09-19T18:56:56Z] <Amir1> ores:76fe25a goes to beta (T204862)

Wed, Sep 19, 6:57 PM · Patch-For-Review, ORES, Scoring-platform-team (Current), User-Ladsgroup
Stashbot added a comment to T200557: Create a stretch and Son of Grid Engine grid in toolsbeta.

Mentioned in SAL (#wikimedia-cloud) [2018-09-19T17:24:53Z] <bstorm_> new puppetmaster is toolsbeta-puppetmaster-02, however, manual changes are required on each client, so it will be broken for a bit (enabling puppetdb for T200557)

Wed, Sep 19, 5:25 PM · Patch-For-Review, Toolforge, Epic, cloud-services-team (Kanban)
Stashbot added a comment to T204491: Heating alerts / memory errors on mw1254.

Mentioned in SAL (#wikimedia-operations) [2018-09-19T17:20:25Z] <cmjohnson1> powering off mw1254 to reseat DIMM T204491

Wed, Sep 19, 5:20 PM · Operations, ops-eqiad
Stashbot added a comment to T204805: wikitable download format TypeError if one of the columns is int.

Mentioned in SAL (#wikimedia-cloud) [2018-09-19T16:57:28Z] <framawiki> deployed 4994570 to quarry-web-01 T204805

Wed, Sep 19, 4:57 PM · Patch-For-Review, Quarry
Stashbot added a comment to T204758: EchoForeignWikiRequest emits PHP error "Undefined index: csrftoken".

Mentioned in SAL (#wikimedia-operations) [2018-09-19T16:49:58Z] <sbisson@deploy1001> Synchronized php-1.32.0-wmf.22/extensions/Echo/includes/api/ApiCrossWiki.php: T204758 (duration: 00m 57s)

Wed, Sep 19, 4:50 PM · MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), Growth-Team (Current Sprint), Patch-For-Review, Notifications, Wikimedia-production-error
Stashbot added a comment to T51593: Rename two indexes in the Echo extension.

Mentioned in SAL (#wikimedia-operations) [2018-09-19T13:25:53Z] <marostegui> Deploy schema change on x1 eqiad master on enwiki (this will generate some lag on x1 eqiad) - T51593

Wed, Sep 19, 1:25 PM · Blocked-on-schema-change, DBA, Schema-change
Stashbot added a comment to T203177: cloudvps: metrics and analytics .

Mentioned in SAL (#wikimedia-operations) [2018-09-19T13:03:57Z] <arturo> T203177 add initial prometheus-openstack-exporter package to reprepro (v0.0.8-1)

Wed, Sep 19, 1:04 PM · Patch-For-Review, Cloud-Services
Stashbot added a comment to T51593: Rename two indexes in the Echo extension.

Mentioned in SAL (#wikimedia-operations) [2018-09-19T12:50:36Z] <marostegui> Deploy schema change on s3 eqiad master on mediawikiwiki (this will generate some lag on s3 eqiad) - T51593

Wed, Sep 19, 12:50 PM · Blocked-on-schema-change, DBA, Schema-change
Stashbot added a comment to T204745: cloudvps: migrate projects from main to eqiad1.

Mentioned in SAL (#wikimedia-cloud) [2018-09-19T11:24:16Z] <arturo> T204745 webproxies not working due to lxc containers don't working?

Wed, Sep 19, 11:24 AM · Patch-For-Review, Cloud-Services
Stashbot added a comment to T51593: Rename two indexes in the Echo extension.

Mentioned in SAL (#wikimedia-operations) [2018-09-19T10:26:47Z] <marostegui> Deploy schema change on x1:testwiki - T51593

Wed, Sep 19, 10:26 AM · Blocked-on-schema-change, DBA, Schema-change
Stashbot added a comment to T203565: Reclone db1114 (s1 api) from another API host.

Mentioned in SAL (#wikimedia-operations) [2018-09-19T10:07:31Z] <banyek@deploy1001> Synchronized wmf-config/db-eqiad.php: T203565: Weight adjust for S1 API hosts (duration: 00m 57s)

Wed, Sep 19, 10:07 AM · User-Banyek, Patch-For-Review, DBA
Stashbot added a comment to T199198: Some swift filesystems reporting negative disk usage.

Mentioned in SAL (#wikimedia-operations) [2018-09-19T09:26:42Z] <godog> repair sdf on ms-be2043 - T199198

Wed, Sep 19, 9:26 AM · User-fgiunchedi, media-storage, Operations
Stashbot added a comment to T204745: cloudvps: migrate projects from main to eqiad1.

Mentioned in SAL (#wikimedia-cloud) [2018-09-19T09:07:34Z] <arturo> T204745 add myself as project admin

Wed, Sep 19, 9:07 AM · Patch-For-Review, Cloud-Services
Stashbot added a comment to T204745: cloudvps: migrate projects from main to eqiad1.

Mentioned in SAL (#wikimedia-cloud) [2018-09-19T08:47:40Z] <arturo> T204745 migrating project to eqiad1

Wed, Sep 19, 8:47 AM · Patch-For-Review, Cloud-Services
Stashbot added a comment to T200509: Make sure multi-instance slaves page.

Mentioned in SAL (#wikimedia-operations) [2018-09-19T08:35:20Z] <marostegui> Stop MySQL on db1110 for alert testing - T200509

Wed, Sep 19, 8:35 AM · Patch-For-Review, DBA
Stashbot added a comment to T200509: Make sure multi-instance slaves page.

Mentioned in SAL (#wikimedia-operations) [2018-09-19T07:53:29Z] <marostegui> Stop MySQL on db1110 for alert testing - T200509

Wed, Sep 19, 7:53 AM · Patch-For-Review, DBA
Stashbot added a comment to T200509: Make sure multi-instance slaves page.

Mentioned in SAL (#wikimedia-operations) [2018-09-19T07:45:51Z] <marostegui> Stop MySQL on db1096:3316 for alert testing - T200509

Wed, Sep 19, 7:45 AM · Patch-For-Review, DBA
Stashbot added a comment to T172489: Monitor read_only on all databases, make it page on masters.

Mentioned in SAL (#wikimedia-operations) [2018-09-19T07:12:22Z] <marostegui> Disable puppet on databases to test new alerts - T200509 https://phabricator.wikimedia.org/T172489

Wed, Sep 19, 7:12 AM · Patch-For-Review, Wikimedia-Incident, monitoring, DBA
Stashbot added a comment to T200509: Make sure multi-instance slaves page.

Mentioned in SAL (#wikimedia-operations) [2018-09-19T07:12:22Z] <marostegui> Disable puppet on databases to test new alerts - T200509 https://phabricator.wikimedia.org/T172489

Wed, Sep 19, 7:12 AM · Patch-For-Review, DBA
Stashbot added a comment to T153638: Drop echo tables from local wiki databases.

Mentioned in SAL (#wikimedia-operations) [2018-09-19T05:31:55Z] <marostegui> Drop echo tables from s3 db2074 - T153638

Wed, Sep 19, 5:32 AM · Patch-For-Review, DBA
Stashbot added a comment to T153638: Drop echo tables from local wiki databases.

Mentioned in SAL (#wikimedia-operations) [2018-09-19T05:19:16Z] <marostegui> Drop echo tables from s7:kowiki - T153638

Wed, Sep 19, 5:19 AM · Patch-For-Review, DBA

Tue, Sep 18

Stashbot added a comment to T204669: Slow access to Special:Contributions on mediawiki.org (due to enabling actor table WRITE_BOTH mode).

Mentioned in SAL (#wikimedia-operations) [2018-09-18T20:58:52Z] <catrope@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Set ActorTableSchemaMigrationStage back to OLD on test wikis, mediawikiwiki (T188327, T204669) (duration: 00m 57s)

Tue, Sep 18, 8:59 PM · Core-Platform-Team (CPT-Q1-Jul-Sep-2018), Patch-For-Review, Regression, MediaWiki-Special-pages, Performance
Stashbot added a comment to T188327: Deploy refactored actor storage.

Mentioned in SAL (#wikimedia-operations) [2018-09-18T20:58:52Z] <catrope@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Set ActorTableSchemaMigrationStage back to OLD on test wikis, mediawikiwiki (T188327, T204669) (duration: 00m 57s)

Tue, Sep 18, 8:58 PM · Patch-For-Review, Core-Platform-Team (CPT-Q1-Jul-Sep-2018), Epic
Stashbot added a comment to T204757: [OAuth] PHP Fatal Error: Call to undefined method MediaWiki\Extensions\OAuth\MWOAuthDAOAccessControl::getForHtml().

Mentioned in SAL (#wikimedia-operations) [2018-09-18T20:05:34Z] <hashar@deploy1001> Synchronized php-1.32.0-wmf.22/extensions/OAuth/frontend/specialpages/SpecialMWOAuthListConsumers.php: Fix escapeForHtml method name - T204757 (duration: 00m 58s)

Tue, Sep 18, 8:05 PM · MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), Wikimedia-production-error, Patch-For-Review, MediaWiki-extensions-OAuth, Release-Engineering-Team (Kanban), Train Deployments
Stashbot added a comment to T203929: cpjobqueue should log a warning when there is an HTTP error.

Mentioned in SAL (#wikimedia-operations) [2018-09-18T19:56:13Z] <ppchelko@deploy1001> Finished deploy [cpjobqueue/deploy@58f9ed3]: Log errors for HTTP error T203929 (duration: 00m 49s)

Tue, Sep 18, 7:56 PM · Services (doing), ChangeProp
Stashbot added a comment to T203929: cpjobqueue should log a warning when there is an HTTP error.

Mentioned in SAL (#wikimedia-operations) [2018-09-18T19:55:23Z] <ppchelko@deploy1001> Started deploy [cpjobqueue/deploy@58f9ed3]: Log errors for HTTP error T203929

Tue, Sep 18, 7:55 PM · Services (doing), ChangeProp
Stashbot added a comment to T186748: New service request: chromium-render/deploy.

Mentioned in SAL (#wikimedia-operations) [2018-09-18T19:18:18Z] <ppchelko@deploy1001> Finished deploy [restbase/deploy@4c3128f] (dev-cluster): Remove restrictions table T203835, Split 25% PDF traffic to Proton T186748, Metrics endpoints improvements, don't monitor PDF endpoints, take 2, feed timing out (duration: 06m 32s)

Tue, Sep 18, 7:18 PM · User-notice, Readers-Web-Backlog (Readers-Web-Kanbanana-Board-2018-19-Q1), Patch-For-Review, Readers-Web-Kanbanana-Board-Old, Services (blocked), Service-deployment-requests, Proton, Electron-PDFs, Operations
Stashbot added a comment to T186748: New service request: chromium-render/deploy.

Mentioned in SAL (#wikimedia-operations) [2018-09-18T19:11:46Z] <ppchelko@deploy1001> Started deploy [restbase/deploy@4c3128f] (dev-cluster): Remove restrictions table T203835, Split 25% PDF traffic to Proton T186748, Metrics endpoints improvements, don't monitor PDF endpoints, take 2, feed timing out

Tue, Sep 18, 7:11 PM · User-notice, Readers-Web-Backlog (Readers-Web-Kanbanana-Board-2018-19-Q1), Patch-For-Review, Readers-Web-Kanbanana-Board-Old, Services (blocked), Service-deployment-requests, Proton, Electron-PDFs, Operations