Page MenuHomePhabricator

dancy (Ahmon Dancy)
Sr. Software Engineer, Release Engineering

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Monday

  • Clear sailing ahead.

User Details

User Since
Jun 27 2020, 12:14 AM (22 w, 6 h)
Availability
Available
IRC Nick
dancy
LDAP User
Ahmon Dancy
MediaWiki User
ADancy (WMF) [ Global Accounts ]

Recent Activity

Wed, Nov 25

dancy added a comment to T268698: Add flag to rebuildLocalisationCache.php to skip MessageBlobStore::clearGlobalCacheEntry.

@Krinkle
Regarding your question in mediawiki IRC: at the end of scap sync-world or scap sync-l10n, scap calls tasks.clear_message_blobs() which runs mwscript extensions/WikimediaMaintenance/refreshMessageBlobs.php
Also, my concern with the unnecessary MBS clearing is that it (presumably) increases the load on the appservers due to the subsequent cache misses. I don't know what the magnitude of that impact is though.

Wed, Nov 25, 3:47 PM · MW-1.36-notes (1.36.0-wmf.20; 2020-12-01), MediaWiki-Internationalization, Release-Engineering-Team-TODO (2020-10-01 to 2020-12-31 (Q2))
dancy triaged T268698: Add flag to rebuildLocalisationCache.php to skip MessageBlobStore::clearGlobalCacheEntry as Medium priority.
Wed, Nov 25, 3:34 PM · MW-1.36-notes (1.36.0-wmf.20; 2020-12-01), MediaWiki-Internationalization, Release-Engineering-Team-TODO (2020-10-01 to 2020-12-31 (Q2))

Tue, Nov 24

dancy added a subtask for T260827: Investigate/trace rebuildLocalisationCache process for MW containerization: T268698: Add flag to rebuildLocalisationCache.php to skip MessageBlobStore::clearGlobalCacheEntry.
Tue, Nov 24, 11:38 PM · Release-Engineering-Team-TODO (2020-10-01 to 2020-12-31 (Q2)), Release-Engineering-Team (Pipeline)
dancy added a parent task for T268698: Add flag to rebuildLocalisationCache.php to skip MessageBlobStore::clearGlobalCacheEntry: T260827: Investigate/trace rebuildLocalisationCache process for MW containerization.
Tue, Nov 24, 11:38 PM · MW-1.36-notes (1.36.0-wmf.20; 2020-12-01), MediaWiki-Internationalization, Release-Engineering-Team-TODO (2020-10-01 to 2020-12-31 (Q2))
dancy created T268698: Add flag to rebuildLocalisationCache.php to skip MessageBlobStore::clearGlobalCacheEntry.
Tue, Nov 24, 11:37 PM · MW-1.36-notes (1.36.0-wmf.20; 2020-12-01), MediaWiki-Internationalization, Release-Engineering-Team-TODO (2020-10-01 to 2020-12-31 (Q2))

Mon, Nov 23

dancy added a comment to T236912: Return value of Parsoid\Wt2Html\PP\Processors\WrapSections::getDSR() must be of the type integer, null returned.

A burst of 116 of these errors occurred in the last 15 minutes.

Mon, Nov 23, 9:17 PM · Parsoid-PHP
dancy added a comment to T263184: 1.36.0-wmf.18 deployment blockers.

wmf.18 has been rolled back out to group1.

Mon, Nov 23, 8:09 PM · Patch-For-Review, Release-Engineering-Team-TODO, Release, Train Deployments

Fri, Nov 20

dancy awarded T267668: Some recent Commons uploads not available on other wikis (2020-11) a Orange Medal token.
Fri, Nov 20, 12:33 AM · MW-1.36-notes (1.36.0-wmf.16; 2020-11-03), Patch-For-Review, Wikimedia-production-error, Operations, Commons, MediaWiki-File-management
dancy removed a parent task for T267668: Some recent Commons uploads not available on other wikis (2020-11): T263184: 1.36.0-wmf.18 deployment blockers.
Fri, Nov 20, 12:32 AM · MW-1.36-notes (1.36.0-wmf.16; 2020-11-03), Patch-For-Review, Wikimedia-production-error, Operations, Commons, MediaWiki-File-management
dancy removed a subtask for T263184: 1.36.0-wmf.18 deployment blockers: T267668: Some recent Commons uploads not available on other wikis (2020-11).
Fri, Nov 20, 12:32 AM · Patch-For-Review, Release-Engineering-Team-TODO, Release, Train Deployments
dancy updated subscribers of T263184: 1.36.0-wmf.18 deployment blockers.

@Krinkle deployed the fix for T267668 to wmf.16 and testing looks good.

Fri, Nov 20, 12:32 AM · Patch-For-Review, Release-Engineering-Team-TODO, Release, Train Deployments

Thu, Nov 19

dancy reassigned T267668: Some recent Commons uploads not available on other wikis (2020-11) from Krinkle to aaron.
Thu, Nov 19, 6:52 PM · MW-1.36-notes (1.36.0-wmf.16; 2020-11-03), Patch-For-Review, Wikimedia-production-error, Operations, Commons, MediaWiki-File-management
dancy raised the priority of T267668: Some recent Commons uploads not available on other wikis (2020-11) from High to Unbreak Now!.

@dancy: Should this be UBN as a blocker?

Thu, Nov 19, 5:42 PM · MW-1.36-notes (1.36.0-wmf.16; 2020-11-03), Patch-For-Review, Wikimedia-production-error, Operations, Commons, MediaWiki-File-management
dancy added a comment to T263184: 1.36.0-wmf.18 deployment blockers.

The train has been rolled back to group0 (i.e., group0 = 1.36.0-wmf.18, group1 and group 2 = 1.36.0-wmf.16).

Thu, Nov 19, 5:06 PM · Patch-For-Review, Release-Engineering-Team-TODO, Release, Train Deployments
dancy added a parent task for T267668: Some recent Commons uploads not available on other wikis (2020-11): T263184: 1.36.0-wmf.18 deployment blockers.
Thu, Nov 19, 5:05 PM · MW-1.36-notes (1.36.0-wmf.16; 2020-11-03), Patch-For-Review, Wikimedia-production-error, Operations, Commons, MediaWiki-File-management
dancy added a subtask for T263184: 1.36.0-wmf.18 deployment blockers: T267668: Some recent Commons uploads not available on other wikis (2020-11).
Thu, Nov 19, 5:05 PM · Patch-For-Review, Release-Engineering-Team-TODO, Release, Train Deployments
dancy added a comment to T263184: 1.36.0-wmf.18 deployment blockers.
Thu, Nov 19, 4:27 PM · Patch-For-Review, Release-Engineering-Team-TODO, Release, Train Deployments

Wed, Nov 18

dancy created T268164: Call to a member function getResults() on null.
Wed, Nov 18, 7:17 PM · Patch-For-Review, Discovery-Search (Current work), Discovery, CirrusSearch, Wikimedia-production-error
dancy added a comment to T263184: 1.36.0-wmf.18 deployment blockers.

We found the underlying issue (it was specific to the extension) so the logspam will be fixed soon.

Wed, Nov 18, 3:45 PM · Patch-For-Review, Release-Engineering-Team-TODO, Release, Train Deployments

Tue, Nov 17

dancy added a comment to T263184: 1.36.0-wmf.18 deployment blockers.

@kostajh https://gerrit.wikimedia.org/r/c/mediawiki/extensions/GrowthExperiments/+/641294 is deployed to group0.

Tue, Nov 17, 9:04 PM · Patch-For-Review, Release-Engineering-Team-TODO, Release, Train Deployments
dancy updated the task description for T266479: Puppet Proposal to remove require_package.
Tue, Nov 17, 4:53 PM · Patch-For-Review, Operations, Puppet
dancy updated the task description for T266479: Puppet Proposal to remove require_package.
Tue, Nov 17, 4:52 PM · Patch-For-Review, Operations, Puppet
dancy added a comment to T263184: 1.36.0-wmf.18 deployment blockers.

@kostajh I will include https://gerrit.wikimedia.org/r/c/mediawiki/extensions/GrowthExperiments/+/641294 in the group0 rollout.

Tue, Nov 17, 4:21 PM · Patch-For-Review, Release-Engineering-Team-TODO, Release, Train Deployments

Mon, Nov 16

dancy added a comment to T267433: Enable support for nested VMs.

Thanks for the update @Andrew.

Mon, Nov 16, 8:02 PM · cloud-services-team (Kanban), Cloud-VPS, Patch-For-Review
dancy updated the task description for T267006: Puppet failures on many hosts.
Mon, Nov 16, 3:55 PM · Beta-Cluster-Infrastructure

Tue, Nov 10

dancy added a comment to T267433: Enable support for nested VMs.

As a workaround if needed and worst case scenario, you can try running bare/non-hardware backed qemu (really slow though :S)

Tue, Nov 10, 4:37 PM · cloud-services-team (Kanban), Cloud-VPS, Patch-For-Review

Mon, Nov 9

dancy added a comment to T267057: Experiment with generating json config.

Execution of wmf-config/CommonSettings.php requires an MW installation.

Mon, Nov 9, 4:22 PM · Performance-Team (Radar), Release-Engineering-Team-TODO (2020-10-01 to 2020-12-31 (Q2)), MW-on-K8s, Release-Engineering-Team (Pipeline)

Fri, Nov 6

dancy created T267433: Enable support for nested VMs.
Fri, Nov 6, 6:40 PM · cloud-services-team (Kanban), Cloud-VPS, Patch-For-Review

Oct 23 2020

dancy committed rICMVfffeb0c609cc: Improve error reporting (authored by dancy).
Improve error reporting
Oct 23 2020, 8:18 PM
dancy added a comment to T243009: Add option in Scap to restart php-fpm for emergency deployments, and skip depooling/pooling servers.

Addendum:
It could probably make sense to add a simple scap rolling-restart <cluster> <dc> command so that we can test everything works on the inactive datacenter, and while we're not releasing code. I guess this is requirement number 4 :P

Oct 23 2020, 7:37 PM · Patch-For-Review, Release-Engineering-Team-TODO (2020-10-01 to 2020-12-31 (Q2)), Sustainability (Incident Followup), Release-Engineering-Team (Deployment services), Scap
dancy added a comment to T243009: Add option in Scap to restart php-fpm for emergency deployments, and skip depooling/pooling servers.
  1. safe-service-restart should add two options:
    1. --force that would not try to depool and just go for the brutal restart, with no further checks.
Oct 23 2020, 7:36 PM · Patch-For-Review, Release-Engineering-Team-TODO (2020-10-01 to 2020-12-31 (Q2)), Sustainability (Incident Followup), Release-Engineering-Team (Deployment services), Scap

Oct 21 2020

dancy claimed T243009: Add option in Scap to restart php-fpm for emergency deployments, and skip depooling/pooling servers.
Oct 21 2020, 10:19 PM · Patch-For-Review, Release-Engineering-Team-TODO (2020-10-01 to 2020-12-31 (Q2)), Sustainability (Incident Followup), Release-Engineering-Team (Deployment services), Scap
dancy added a comment to T243009: Add option in Scap to restart php-fpm for emergency deployments, and skip depooling/pooling servers.

--force sounds too casual and innocent for what this does. E.g. I can see someone rolling out a patch normally, not seeing the result, and thus doing it again with force "just in case". That'd be Bad™. Perhaps --emergency or --kill would be more appropiately scary.

Agreed. I was considering --unsafe.

Oct 21 2020, 10:18 PM · Patch-For-Review, Release-Engineering-Team-TODO (2020-10-01 to 2020-12-31 (Q2)), Sustainability (Incident Followup), Release-Engineering-Team (Deployment services), Scap
dancy added a comment to T243009: Add option in Scap to restart php-fpm for emergency deployments, and skip depooling/pooling servers.

--force sounds too casual and innocent for what this does. E.g. I can see someone rolling out a patch normally, not seeing the result, and thus doing it again with force "just in case". That'd be Bad™. Perhaps --emergency or --kill would be more appropiately scary.

Oct 21 2020, 9:29 PM · Patch-For-Review, Release-Engineering-Team-TODO (2020-10-01 to 2020-12-31 (Q2)), Sustainability (Incident Followup), Release-Engineering-Team (Deployment services), Scap
dancy added a comment to T243009: Add option in Scap to restart php-fpm for emergency deployments, and skip depooling/pooling servers.

Revise /usr/local/bin/safe-service-restart to accept --force to make it skip depool/repool.

Oct 21 2020, 7:36 PM · Patch-For-Review, Release-Engineering-Team-TODO (2020-10-01 to 2020-12-31 (Q2)), Sustainability (Incident Followup), Release-Engineering-Team (Deployment services), Scap
dancy closed T266052: Interface 'MediaWiki\EditPafe\IEditObject' not found as Resolved.

Definitely opcache. Resolved by restarted php-fpm on the affected server.

Oct 21 2020, 2:51 PM · Wikimedia-production-error
dancy closed T266052: Interface 'MediaWiki\EditPafe\IEditObject' not found, a subtask of T245183: PHP7 corruption reports in 2020 (Call on wrong object, etc.), as Resolved.
Oct 21 2020, 2:50 PM · Wikimedia-production-error, serviceops, Operations
dancy added a comment to T245183: PHP7 corruption reports in 2020 (Call on wrong object, etc.).

Noting for the record in all cases where there's a bogus changed character in a string, the bad character is always one less than what it should be (i.e., it's not a bit flip, it's a decrement).

Oct 21 2020, 2:50 PM · Wikimedia-production-error, serviceops, Operations

Oct 20 2020

dancy lowered the priority of T266052: Interface 'MediaWiki\EditPafe\IEditObject' not found from Unbreak Now! to Low.
Oct 20 2020, 6:33 PM · Wikimedia-production-error
dancy added a comment to T266052: Interface 'MediaWiki\EditPafe\IEditObject' not found.

Another datapoint:

Oct 20 2020, 6:28 PM · Wikimedia-production-error
dancy added a comment to T266052: Interface 'MediaWiki\EditPafe\IEditObject' not found.

And the errors are only happening on mw2328

Oct 20 2020, 5:45 PM · Wikimedia-production-error
dancy added a comment to T266052: Interface 'MediaWiki\EditPafe\IEditObject' not found.

@dancy: should parent task be added?

Oct 20 2020, 5:37 PM · Wikimedia-production-error
dancy added a parent task for T266052: Interface 'MediaWiki\EditPafe\IEditObject' not found: T263180: 1.36.0-wmf.14 deployment blockers.
Oct 20 2020, 5:37 PM · Wikimedia-production-error
dancy added a subtask for T263180: 1.36.0-wmf.14 deployment blockers: T266052: Interface 'MediaWiki\EditPafe\IEditObject' not found.
Oct 20 2020, 5:37 PM · Release-Engineering-Team-TODO, Release, Train Deployments
dancy updated dancy.
Oct 20 2020, 5:36 PM
dancy added a comment to T263180: 1.36.0-wmf.14 deployment blockers.

Reported T266052 as a blocker.

Oct 20 2020, 5:35 PM · Release-Engineering-Team-TODO, Release, Train Deployments
dancy triaged T266052: Interface 'MediaWiki\EditPafe\IEditObject' not found as Unbreak Now! priority.
Oct 20 2020, 5:34 PM · Wikimedia-production-error
dancy created T266052: Interface 'MediaWiki\EditPafe\IEditObject' not found.
Oct 20 2020, 5:31 PM · Wikimedia-production-error

Oct 16 2020

dancy added a comment to T260827: Investigate/trace rebuildLocalisationCache process for MW containerization.

Talked to @Catrope yesterday and he confirmed that the early MBS cache clear is unnecessary.

Oct 16 2020, 6:03 PM · Release-Engineering-Team-TODO (2020-10-01 to 2020-12-31 (Q2)), Release-Engineering-Team (Pipeline)

Oct 15 2020

dancy closed T265060: get_realm_specific_filename doesn't handle datacenter correctly as Resolved.
Oct 15 2020, 5:58 PM · Scap, Wikimedia-Site-requests, Release-Engineering-Team
dancy added a comment to T264209: Run stress tests on docker images infrastructure.

We need to permanently bump the tmpfs /var/lib/nginx size if we want to be able to consistently push images with blobs that are larger than 1 GB compressed

Couldn't we get around this by using a (bigger) non tmpfs filesystem as client_body_temp_path?
Not sure how much the upload performance would suffer in this case, but we could test that...

Oct 15 2020, 3:47 PM · Release-Engineering-Team-TODO (2020-10-01 to 2020-12-31 (Q2)), MW-on-K8s, Release-Engineering-Team (Pipeline)

Oct 13 2020

dancy added a comment to T264209: Run stress tests on docker images infrastructure.

I'm looking forward to seeing the results of this stress test. Does the docker registry have any controls to limit the number of connections and/or total bandwidth?

Oct 13 2020, 4:34 PM · Release-Engineering-Team-TODO (2020-10-01 to 2020-12-31 (Q2)), MW-on-K8s, Release-Engineering-Team (Pipeline)

Oct 8 2020

dancy created T265060: get_realm_specific_filename doesn't handle datacenter correctly.
Oct 8 2020, 5:01 PM · Scap, Wikimedia-Site-requests, Release-Engineering-Team

Oct 7 2020

dancy closed T260674: Add app servers to train-dev, a subtask of T255695: Create a development & testing environment for scap + train deployments, as Resolved.
Oct 7 2020, 11:10 PM · Release-Engineering-Team-TODO (2020-10-01 to 2020-12-31 (Q2)), MediaWiki Train Development Environment, Release-Engineering-Team (Deployment services), User-brennen, Scap, Developer Productivity, Train Deployments
dancy closed T260674: Add app servers to train-dev as Resolved.
Oct 7 2020, 11:10 PM · MediaWiki Train Development Environment, Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1)), Release-Engineering-Team (Deployment services), User-brennen, Scap, Developer Productivity, Train Deployments

Oct 6 2020

dancy added a comment to T264775: Management of git repos snapshot.

This needs to be completed to allow T259586 to move forward.

Oct 6 2020, 5:05 PM · Release-Engineering-Team-TODO (2020-10-01 to 2020-12-31 (Q2)), Release-Engineering-Team (Deployment services), MediaWiki Train Development Environment
dancy added projects to T264775: Management of git repos snapshot: Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO (2020-10-01 to 2020-12-31 (Q2)).
Oct 6 2020, 5:03 PM · Release-Engineering-Team-TODO (2020-10-01 to 2020-12-31 (Q2)), Release-Engineering-Team (Deployment services), MediaWiki Train Development Environment
dancy created T264775: Management of git repos snapshot.
Oct 6 2020, 5:02 PM · Release-Engineering-Team-TODO (2020-10-01 to 2020-12-31 (Q2)), Release-Engineering-Team (Deployment services), MediaWiki Train Development Environment
dancy closed T260672: Add Gerrit to train-dev, a subtask of T255695: Create a development & testing environment for scap + train deployments, as Declined.
Oct 6 2020, 5:00 PM · Release-Engineering-Team-TODO (2020-10-01 to 2020-12-31 (Q2)), MediaWiki Train Development Environment, Release-Engineering-Team (Deployment services), User-brennen, Scap, Developer Productivity, Train Deployments
dancy closed T260672: Add Gerrit to train-dev as Declined.

I'm changing the status of this task to Declined. We don't need Gerrit to test/develop scap in train-dev. We can revive this task if needed in the future.

Oct 6 2020, 5:00 PM · MediaWiki Train Development Environment, Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1)), Release-Engineering-Team (Deployment services), User-brennen, Scap, Developer Productivity, Train Deployments

Oct 1 2020

dancy closed T260376: Try "deploy-promote testwikis" in train-dev, document what seems to be missing as Resolved.

Deploy promote works well in train-dev now.

Oct 1 2020, 3:32 PM · MediaWiki Train Development Environment, Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1)), Release-Engineering-Team (Deployment services), User-brennen, Scap, Developer Productivity, Train Deployments
dancy closed T260376: Try "deploy-promote testwikis" in train-dev, document what seems to be missing, a subtask of T255695: Create a development & testing environment for scap + train deployments, as Resolved.
Oct 1 2020, 3:32 PM · Release-Engineering-Team-TODO (2020-10-01 to 2020-12-31 (Q2)), MediaWiki Train Development Environment, Release-Engineering-Team (Deployment services), User-brennen, Scap, Developer Productivity, Train Deployments

Sep 29 2020

dancy added a comment to T245402: deployment-snapshot01.deployment-prep.eqiad.wmflabs keeps running out of space.

I asked about this in #wikimedia-cloud and Lucas pointed me to https://wikitech.wikimedia.org/wiki/Help:Adding_Disk_Space_to_Cloud_VPS_instances

Sep 29 2020, 3:36 PM · Beta-Cluster-Infrastructure

Sep 24 2020

dancy awarded Blog Post: CI now updates your deployment-charts a Mountain of Wealth token.
Sep 24 2020, 6:17 PM
dancy added a comment to T263601: ApiQueryGlobalUsage.php Undefined index error when accessing $pageIds.

ApiQueryGlobalUsage::execute() has been modified to defend against the undefined index error but the root cause has not been resolved.

Sep 24 2020, 3:13 PM · Patch-For-Review, Platform Team Workboards (Clinic Duty Team), MW-1.36-notes (1.36.0-wmf.11; 2020-09-29), GlobalUsage, Release-Engineering-Team (Logspam), Wikimedia-production-error
dancy updated subscribers of T257978: 1.36.0-wmf.10 deployment blockers.

Hi @DannyS712. @thcipriani instructed me to remove the non-blocking tasks from the subtasks list. An empty subtasks lists is the indication that there are no outstanding train blockers. Hope that helps!

Sep 24 2020, 12:30 AM · Patch-For-Review, User-brennen, Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1)), Release, Train Deployments

Sep 23 2020

dancy removed a parent task for T263592: Use of Language::commafy with a non-numeric string was deprecated in MediaWiki 1.36. [Called from Language::formatNum]: T257978: 1.36.0-wmf.10 deployment blockers.
Sep 23 2020, 11:30 PM · MW-1.36-notes (1.36.0-wmf.18; 2020-11-17), MW-1.35-notes, MW-1.31-release-notes, MediaWiki-extensions-PdfHandler, Commons, MediaWiki-File-management, MediaWiki-extensions-Scribunto, MediaWiki-Parser, MediaWiki-General, Patch-For-Review
dancy removed a parent task for T263601: ApiQueryGlobalUsage.php Undefined index error when accessing $pageIds: T257978: 1.36.0-wmf.10 deployment blockers.
Sep 23 2020, 11:30 PM · Patch-For-Review, Platform Team Workboards (Clinic Duty Team), MW-1.36-notes (1.36.0-wmf.11; 2020-09-29), GlobalUsage, Release-Engineering-Team (Logspam), Wikimedia-production-error
dancy removed subtasks for T257978: 1.36.0-wmf.10 deployment blockers: T263675: Undefined class constant 'LIMIT', T263642: TypeError when visiting Special:Unblock with no subpage, T263601: ApiQueryGlobalUsage.php Undefined index error when accessing $pageIds, T263592: Use of Language::commafy with a non-numeric string was deprecated in MediaWiki 1.36. [Called from Language::formatNum].
Sep 23 2020, 11:30 PM · Patch-For-Review, User-brennen, Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1)), Release, Train Deployments
dancy removed a parent task for T263642: TypeError when visiting Special:Unblock with no subpage: T257978: 1.36.0-wmf.10 deployment blockers.
Sep 23 2020, 11:30 PM · MW-1.36-notes (1.36.0-wmf.10; 2020-09-22), Wikimedia-production-error, MediaWiki-Blocks
dancy removed a parent task for T263675: Undefined class constant 'LIMIT': T257978: 1.36.0-wmf.10 deployment blockers.
Sep 23 2020, 11:30 PM · MW-1.36-notes (1.36.0-wmf.10; 2020-09-22), User-DannyS712, MobileFrontend, Readers-Web-Backlog, Wikimedia-production-error
dancy removed a parent task for T263014: Argument 2 passed to File::userCan() must be an instance of User, null given, called in /srv/mediawiki/php-1.36.0-wmf.9/includes/filerepo/LocalRepo.php on line 275: T257978: 1.36.0-wmf.10 deployment blockers.
Sep 23 2020, 11:27 PM · MW-1.35-notes, MW-1.36-notes (1.36.0-wmf.10; 2020-09-22), User-DannyS712, Patch-For-Review, Commons, MediaWiki-File-management, Wikimedia-production-error
dancy removed a subtask for T257978: 1.36.0-wmf.10 deployment blockers: T263014: Argument 2 passed to File::userCan() must be an instance of User, null given, called in /srv/mediawiki/php-1.36.0-wmf.9/includes/filerepo/LocalRepo.php on line 275.
Sep 23 2020, 11:27 PM · Patch-For-Review, User-brennen, Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1)), Release, Train Deployments
dancy created T263704: Invariant failed: Expected successful parse of === <div style="text-align: center;">[[WP:BLOCK|Blocking]]</div> ======= Templates ====This template uses a [[Wikipedia:Parser functions|parser function]]. To give greater detail to your message, you may specify: {{#switch:{{PAGENAME}}|Uw-block3|Uw-ublock|Uw-uhblock=|#default=the block duration,}} a specific reason for the block, and auto-include your signature: <code><nowiki>{{subst:</nowiki>{{PAGENAME}}|.
Sep 23 2020, 11:18 PM · Parsoid, Wikimedia-production-error
dancy added a project to T70526: Flow: InvalidDataException "Flow workflow is for different page" from WorkflowLoaderFactory.php: MW-1.36-notes (1.36.0-wmf.10; 2020-09-22).
Sep 23 2020, 9:00 PM · MW-1.36-notes (1.36.0-wmf.14; 2020-10-20), Patch-For-Review, Growth-Team (Current Sprint), MediaWiki-Blocks, User-kostajh, User-brennen, Wikimedia-production-error, StructuredDiscussions
dancy added a comment to T70526: Flow: InvalidDataException "Flow workflow is for different page" from WorkflowLoaderFactory.php.

Saw a few of these error messages today for https://zh.wikipedia.org/wiki/User_talk:Franklin_Yu

Sep 23 2020, 8:59 PM · MW-1.36-notes (1.36.0-wmf.14; 2020-10-20), Patch-For-Review, Growth-Team (Current Sprint), MediaWiki-Blocks, User-kostajh, User-brennen, Wikimedia-production-error, StructuredDiscussions
dancy added a project to T240642: Production crashers in WrapSections code because of missing properties ($dsr, $pi, $parts): MW-1.36-notes (1.36.0-wmf.10; 2020-09-22).
Sep 23 2020, 7:49 PM · MW-1.36-notes (1.36.0-wmf.10; 2020-09-22), Parsing-Active-Work, Wikimedia-production-error, User-brennen, Parsoid
dancy added a comment to T240642: Production crashers in WrapSections code because of missing properties ($dsr, $pi, $parts).

360 of these (PHP Notice: Undefined property: stdClass::$dsr) in the last 4 hours.

Sep 23 2020, 7:49 PM · MW-1.36-notes (1.36.0-wmf.10; 2020-09-22), Parsing-Active-Work, Wikimedia-production-error, User-brennen, Parsoid
dancy added a project to T263592: Use of Language::commafy with a non-numeric string was deprecated in MediaWiki 1.36. [Called from Language::formatNum]: MW-1.36-notes (1.36.0-wmf.10; 2020-09-22).
Sep 23 2020, 7:21 PM · MW-1.36-notes (1.36.0-wmf.18; 2020-11-17), MW-1.35-notes, MW-1.31-release-notes, MediaWiki-extensions-PdfHandler, Commons, MediaWiki-File-management, MediaWiki-extensions-Scribunto, MediaWiki-Parser, MediaWiki-General, Patch-For-Review
dancy added a comment to T263592: Use of Language::commafy with a non-numeric string was deprecated in MediaWiki 1.36. [Called from Language::formatNum].

We can either leave this task open for dealing with Scribunto, or a separate task can be created for that and this one can be closed.

Sep 23 2020, 6:48 PM · MW-1.36-notes (1.36.0-wmf.18; 2020-11-17), MW-1.35-notes, MW-1.31-release-notes, MediaWiki-extensions-PdfHandler, Commons, MediaWiki-File-management, MediaWiki-extensions-Scribunto, MediaWiki-Parser, MediaWiki-General, Patch-For-Review
dancy added a comment to T263592: Use of Language::commafy with a non-numeric string was deprecated in MediaWiki 1.36. [Called from Language::formatNum].

The commented out deprecation warning has been deployed to production so I removed the Wikimedia-production-error tag. I changed the priority from UBN to High.

Sep 23 2020, 6:48 PM · MW-1.36-notes (1.36.0-wmf.18; 2020-11-17), MW-1.35-notes, MW-1.31-release-notes, MediaWiki-extensions-PdfHandler, Commons, MediaWiki-File-management, MediaWiki-extensions-Scribunto, MediaWiki-Parser, MediaWiki-General, Patch-For-Review
dancy lowered the priority of T263592: Use of Language::commafy with a non-numeric string was deprecated in MediaWiki 1.36. [Called from Language::formatNum] from Unbreak Now! to High.
Sep 23 2020, 6:47 PM · MW-1.36-notes (1.36.0-wmf.18; 2020-11-17), MW-1.35-notes, MW-1.31-release-notes, MediaWiki-extensions-PdfHandler, Commons, MediaWiki-File-management, MediaWiki-extensions-Scribunto, MediaWiki-Parser, MediaWiki-General, Patch-For-Review
dancy added a comment to T245402: deployment-snapshot01.deployment-prep.eqiad.wmflabs keeps running out of space.

The easiest thing to do is to enlarge the virtual disk or add an additional vdisk to house /srv. How do we move forward with one of those options?

Sep 23 2020, 4:33 PM · Beta-Cluster-Infrastructure
dancy added projects to T263655: NamespaceInfo::getAssociated does not make any sense for given namespace: MW-1.36-notes (1.36.0-wmf.10; 2020-09-22), MediaWiki-Special-pages.
Sep 23 2020, 3:36 PM · MW-1.35-notes, MW-1.36-notes (1.36.0-wmf.11; 2020-09-29), User-DannyS712, MediaWiki-Special-pages, Wikimedia-production-error
dancy created T263655: NamespaceInfo::getAssociated does not make any sense for given namespace.
Sep 23 2020, 3:34 PM · MW-1.35-notes, MW-1.36-notes (1.36.0-wmf.11; 2020-09-29), User-DannyS712, MediaWiki-Special-pages, Wikimedia-production-error

Sep 22 2020

dancy updated the task description for T263601: ApiQueryGlobalUsage.php Undefined index error when accessing $pageIds.
Sep 22 2020, 11:12 PM · Patch-For-Review, Platform Team Workboards (Clinic Duty Team), MW-1.36-notes (1.36.0-wmf.11; 2020-09-29), GlobalUsage, Release-Engineering-Team (Logspam), Wikimedia-production-error
dancy triaged T263601: ApiQueryGlobalUsage.php Undefined index error when accessing $pageIds as Low priority.
Sep 22 2020, 11:10 PM · Patch-For-Review, Platform Team Workboards (Clinic Duty Team), MW-1.36-notes (1.36.0-wmf.11; 2020-09-29), GlobalUsage, Release-Engineering-Team (Logspam), Wikimedia-production-error
dancy created T263601: ApiQueryGlobalUsage.php Undefined index error when accessing $pageIds.
Sep 22 2020, 11:10 PM · Patch-For-Review, Platform Team Workboards (Clinic Duty Team), MW-1.36-notes (1.36.0-wmf.11; 2020-09-29), GlobalUsage, Release-Engineering-Team (Logspam), Wikimedia-production-error

Sep 14 2020

dancy updated the task description for T257102: Mediawiki 1.34.2 tarball incompatible with 7zip on windows due to Pax format.
Sep 14 2020, 4:48 PM · Upstream, MediaWiki-Releasing

Sep 11 2020

dancy closed T259279: Create static host keys for train dev vm as Declined.

I have been built and rebuilt the train-dev environment a zillion times without issues related to SSH host keys so I'm closing this ticket as a non-issue.

Sep 11 2020, 7:42 PM · MediaWiki Train Development Environment, Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1))

Sep 10 2020

dancy closed T259608: train-dev: Rename "vdc" to "train-dev" as Resolved.
Sep 10 2020, 4:19 PM · Patch-For-Review, User-dancy, Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1)), MediaWiki Train Development Environment
dancy closed T225109: Better error message than "Scap failed!: Call to mwscript eval.php returned: None" as Resolved.

Deployed via T261234. Closing

Sep 10 2020, 3:57 PM · User-dancy, Release-Engineering-Team (Onboarding), Release-Engineering-Team-TODO, Scap
dancy moved T259608: train-dev: Rename "vdc" to "train-dev" from Backlog to Working on the User-dancy board.
Sep 10 2020, 3:54 PM · Patch-For-Review, User-dancy, Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1)), MediaWiki Train Development Environment

Aug 27 2020

dancy created P12408 rebuildLocalisationCache backtrace.
Aug 27 2020, 5:26 PM

Aug 24 2020

dancy created P12329 Status of train-dev scap sync.
Aug 24 2020, 7:53 PM

Aug 22 2020

dancy moved T225109: Better error message than "Scap failed!: Call to mwscript eval.php returned: None" from Awaiting review/merge to Awaiting release on the User-dancy board.
Aug 22 2020, 12:01 AM · User-dancy, Release-Engineering-Team (Onboarding), Release-Engineering-Team-TODO, Scap

Aug 20 2020

dancy moved T259608: train-dev: Rename "vdc" to "train-dev" from Needs Followup to Backlog on the User-dancy board.
Aug 20 2020, 6:21 PM · Patch-For-Review, User-dancy, Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1)), MediaWiki Train Development Environment
dancy closed T259706: Scap fails when checking train version number as Resolved.
Aug 20 2020, 3:03 PM · User-dancy, Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1)), Scap
dancy moved T259706: Scap fails when checking train version number from Needs Followup to Awaiting release on the User-dancy board.
Aug 20 2020, 3:02 PM · User-dancy, Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1)), Scap
dancy moved T225109: Better error message than "Scap failed!: Call to mwscript eval.php returned: None" from Backlog to Awaiting review/merge on the User-dancy board.
Aug 20 2020, 3:01 PM · User-dancy, Release-Engineering-Team (Onboarding), Release-Engineering-Team-TODO, Scap