Page MenuHomePhabricator

thcipriani (Tyler Cipriani)
Engineering Manager, Release EngineeringAdministrator

Projects (37)

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Wednesday

  • Clear sailing ahead.

User Details

User Since
Feb 9 2015, 10:04 PM (362 w, 6 d)
Roles
Administrator
Availability
Available
IRC Nick
thcipriani
LDAP User
Unknown
MediaWiki User
TCipriani (WMF) [ Global Accounts ]

Recent Activity

Thu, Jan 20

thcipriani created T299665: InvalidArgumentException: WikiPage constructed on a Title that cannot exist as a page: commons:File:*.png.
Thu, Jan 20, 4:57 PM · CommonsMetadata, Platform Engineering, PageImages
thcipriani added a comment to T281523: Exception: Flow\Diff\FlowBoardContentDiffView: could not maintain backwards compatibility. Please use a SlotDiffRenderer..

Noticed a few of these today all from a single wiki. It's reproducible a GET to the URL in logstash.

Thu, Jan 20, 4:49 PM · MediaWiki-ContentHandler, StructuredDiscussions, Growth-Team, Wikimedia-production-error
thcipriani created T299661: PHP Notice: Undefined property: Wikimedia\Parsoid\NodeData\DataParsoid::$dsr.
Thu, Jan 20, 4:36 PM · Parsoid, Wikimedia-production-error
thcipriani added a parent task for T299659: PHP Deprecated: Use of Wikimedia\Rdbms\DBConnRef::numRows was deprecated in MediaWiki 1.37. [Called from FlaggedRevsStats::getEditReviewTimes]: T293960: 1.38.0-wmf.19 deployment blockers.
Thu, Jan 20, 4:30 PM · MW-1.38-notes (1.38.0-wmf.19; 2022-01-24), User-Ladsgroup, DBA, Unstewarded-production-error, MediaWiki-extensions-FlaggedRevs, Wikimedia-production-error
thcipriani added a subtask for T293960: 1.38.0-wmf.19 deployment blockers: T299659: PHP Deprecated: Use of Wikimedia\Rdbms\DBConnRef::numRows was deprecated in MediaWiki 1.37. [Called from FlaggedRevsStats::getEditReviewTimes].
Thu, Jan 20, 4:30 PM · Release-Engineering-Team (Next), Release, Train Deployments
thcipriani created T299659: PHP Deprecated: Use of Wikimedia\Rdbms\DBConnRef::numRows was deprecated in MediaWiki 1.37. [Called from FlaggedRevsStats::getEditReviewTimes].
Thu, Jan 20, 4:28 PM · MW-1.38-notes (1.38.0-wmf.19; 2022-01-24), User-Ladsgroup, DBA, Unstewarded-production-error, MediaWiki-extensions-FlaggedRevs, Wikimedia-production-error
thcipriani triaged T299583: Wikimedia\Assert\PreconditionException: Precondition failed: Range is not collapsed as Unbreak Now! priority.

Adding this as a train blocker as it's:

Thu, Jan 20, 4:19 PM · MW-1.38-notes (1.38.0-wmf.18; 2022-01-17), Performance-Team (Radar), Editing-team (FY2021-22 Kanban Board), DiscussionTools, Wikimedia-production-error
thcipriani added a subtask for T293959: 1.38.0-wmf.18 deployment blockers: T299583: Wikimedia\Assert\PreconditionException: Precondition failed: Range is not collapsed.
Thu, Jan 20, 4:11 PM · Patch-For-Review, Release-Engineering-Team (Next), Release, Train Deployments
thcipriani added a parent task for T299583: Wikimedia\Assert\PreconditionException: Precondition failed: Range is not collapsed: T293959: 1.38.0-wmf.18 deployment blockers.
Thu, Jan 20, 4:11 PM · MW-1.38-notes (1.38.0-wmf.18; 2022-01-17), Performance-Team (Radar), Editing-team (FY2021-22 Kanban Board), DiscussionTools, Wikimedia-production-error

Thu, Jan 13

thcipriani added a comment to T299150: TypeError: Return value of Kartographer\Tag\TagHandler::getLanguage() must be an instance of Language, instance of StubUserLang returned.

(meta note: tagged Parsoid as I'm not sure of the right tag for Content Transformation, please correct if I got it wrong)

Thu, Jan 13, 6:36 PM · MW-1.38-notes (1.38.0-wmf.18; 2022-01-17), Maps (Kartographer), Wikimedia-production-error
thcipriani created T299150: TypeError: Return value of Kartographer\Tag\TagHandler::getLanguage() must be an instance of Language, instance of StubUserLang returned.
Thu, Jan 13, 6:35 PM · MW-1.38-notes (1.38.0-wmf.18; 2022-01-17), Maps (Kartographer), Wikimedia-production-error
thcipriani moved T299149: MWException: Parser state cleared while parsing. Did you call Parser::parse recursively? from Untriaged to Jan 2022 on the Wikimedia-production-error board.
Thu, Jan 13, 6:15 PM · MW-1.38-notes (1.38.0-wmf.17; 2022-01-10), PageImages, MediaWiki-Parser, Wikimedia-production-error
thcipriani created T299149: MWException: Parser state cleared while parsing. Did you call Parser::parse recursively?.
Thu, Jan 13, 6:15 PM · MW-1.38-notes (1.38.0-wmf.17; 2022-01-10), PageImages, MediaWiki-Parser, Wikimedia-production-error

Tue, Jan 11

thcipriani updated Other Assignee for T293959: 1.38.0-wmf.18 deployment blockers, added: mmodell; removed; dduvall.
Tue, Jan 11, 10:34 PM · Patch-For-Review, Release-Engineering-Team (Next), Release, Train Deployments
thcipriani assigned T293961: 1.38.0-wmf.20 deployment blockers to dancy.
Tue, Jan 11, 12:25 AM · Release-Engineering-Team (Next), Release, Train Deployments
thcipriani reassigned T293960: 1.38.0-wmf.19 deployment blockers from jeena to brennen.
Tue, Jan 11, 12:24 AM · Release-Engineering-Team (Next), Release, Train Deployments
thcipriani assigned T293959: 1.38.0-wmf.18 deployment blockers to jeena.
Tue, Jan 11, 12:24 AM · Patch-For-Review, Release-Engineering-Team (Next), Release, Train Deployments
thcipriani triaged T293960: 1.38.0-wmf.19 deployment blockers as Medium priority.
Tue, Jan 11, 12:23 AM · Release-Engineering-Team (Next), Release, Train Deployments
thcipriani assigned T293960: 1.38.0-wmf.19 deployment blockers to jeena.
Tue, Jan 11, 12:22 AM · Release-Engineering-Team (Next), Release, Train Deployments

Mon, Jan 10

thcipriani created E1455: Thcipriani out of office (👀 PRK).
Mon, Jan 10, 4:17 PM · Release-Engineering-Team, events

Thu, Jan 6

thcipriani added a comment to T297708: Set max execution time for several expensive mediawiki actions.

Seeing the Query execution was interrupted increase (as expected, probably) in the logs since this rolled out.

Thu, Jan 6, 5:05 PM · User-notice, MW-1.38-notes (1.38.0-wmf.12; 2021-12-06), Patch-For-Review, User-Ladsgroup, Platform Engineering, Sustainability (Incident Followup), DBA
thcipriani removed a project from T298010: Querying ProcseeBot's user logs results in internal_api_error_DBQueryError: Wikimedia-production-error.
Thu, Jan 6, 5:01 PM · MediaWiki-API
thcipriani added a comment to T298010: Querying ProcseeBot's user logs results in internal_api_error_DBQueryError.

I went through logstash to find a requestid from your logs, it looks like the error on the backend (for one of your errors anyway) is Error 1969: Query execution was interrupted (max_statement_time exceeded) (db1184) this may be related to this email sent to wikitech-l https://lists.wikimedia.org/hyperkitty/list/wikitech-l@lists.wikimedia.org/thread/IPJNO75HYAQWIGTHI5LJHTDVLVOC4LJP/

Thu, Jan 6, 5:01 PM · MediaWiki-API
thcipriani moved T298223: Global suppressions throw 'Deprecated cross-wiki access' warnings from Untriaged to Dec 2021 on the Wikimedia-production-error board.
Thu, Jan 6, 4:54 PM · Platform Engineering, Wikimedia-production-error, MediaWiki-extensions-CentralAuth
thcipriani moved T298225: Database query error occurs when visiting Special:RecentChanges&tagfilter=wikieditor from Untriaged to Dec 2021 on the Wikimedia-production-error board.
Thu, Jan 6, 4:54 PM · Verified, Performance-Team (Radar), MW-1.37-release, MW-1.36-release, MW-1.35-release, SecTeam-Processed, MediaWiki-Recent-changes, Growth-Team, Performance-Team-publish, MW-1.38-notes (1.38.0-wmf.17; 2022-01-10), DBA, Vuln-DoS, Security-Team, Security, Wikimedia-production-error, Editing-team (FY2021-22 Kanban Board)
thcipriani moved T298426: Structured Discussions workflow is not associated with talk page from Untriaged to Jan 2022 on the Wikimedia-production-error board.
Thu, Jan 6, 4:53 PM · Growth-Team (Current Sprint), Wikimedia-maintenance-script-run, Regression, StructuredDiscussions, Wikimedia-production-error
thcipriani moved T298490: Suspicious {schema} event for action {logged_out,view,submit_attempt} from Untriaged to Jan 2022 on the Wikimedia-production-error board.
Thu, Jan 6, 4:53 PM · MW-1.38-notes (1.38.0-wmf.17; 2022-01-10), Growth-Team (Current Sprint), GrowthExperiments-Homepage, Wikimedia-production-error
thcipriani moved T298492: NavigationPopups: URIError: URI malformed from Untriaged to Jan 2022 on the Wikimedia-production-error board.
Thu, Jan 6, 4:53 PM · Navigation-Popups-Gadget, JavaScript, Wikimedia-production-error
thcipriani moved T298659: BadMethodCallException: Sessions are disabled for load entry point from Untriaged to Jan 2022 on the Wikimedia-production-error board.
Thu, Jan 6, 4:53 PM · MW-1.38-notes (1.38.0-wmf.17; 2022-01-10), Growth-Team, MediaWiki-Recent-changes, MediaWiki-extensions-Scribunto, Wikimedia-production-error
thcipriani moved T298707: "InvalidArgumentException: Blocker must be a local user" from GlobalBlocking from Untriaged to Jan 2022 on the Wikimedia-production-error board.
Thu, Jan 6, 4:52 PM · MW-1.38-notes (1.38.0-wmf.17; 2022-01-10), Unstewarded-production-error, GlobalBlocking, Wikimedia-production-error
thcipriani added a project to T298707: "InvalidArgumentException: Blocker must be a local user" from GlobalBlocking: Unstewarded-production-error.
Thu, Jan 6, 4:51 PM · MW-1.38-notes (1.38.0-wmf.17; 2022-01-10), Unstewarded-production-error, GlobalBlocking, Wikimedia-production-error
thcipriani updated subscribers of T298707: "InvalidArgumentException: Blocker must be a local user" from GlobalBlocking.

Adding @Zabe and @Majavah as I see some recent updates to GlobalBlock (5000c74c8b0986967f3e927f67790d5ce126a5af and 9b92b5e93702fc53bbf53e5a9bb2bcde568f09a9) — no idea if they're related to this.

Thu, Jan 6, 4:51 PM · MW-1.38-notes (1.38.0-wmf.17; 2022-01-10), Unstewarded-production-error, GlobalBlocking, Wikimedia-production-error
thcipriani created T298707: "InvalidArgumentException: Blocker must be a local user" from GlobalBlocking.
Thu, Jan 6, 4:48 PM · MW-1.38-notes (1.38.0-wmf.17; 2022-01-10), Unstewarded-production-error, GlobalBlocking, Wikimedia-production-error
thcipriani added a comment to T281932: Invariant failed: Expected an element (from Parsoid DOMUtils).

Saw a handful of these on commonswiki today, the stacktrace has shifted around a bit, pasting here in case it's helpful.

Thu, Jan 6, 4:32 PM · MediaWiki-extensions-Linter, Parsoid, Wikimedia-production-error
thcipriani added a comment to T298659: BadMethodCallException: Sessions are disabled for load entry point.

The exception is probably caused by rELUA602cef87e06d: mw.title: Add pageLanguage property (https://gerrit.wikimedia.org/r/c/mediawiki/extensions/Scribunto/+/346176). If there's no better fix, that can probably be reverted.

Thu, Jan 6, 4:24 PM · MW-1.38-notes (1.38.0-wmf.17; 2022-01-10), Growth-Team, MediaWiki-Recent-changes, MediaWiki-extensions-Scribunto, Wikimedia-production-error

Wed, Jan 5

thcipriani awarded Blog Post: Perfect Software by Gerald M. Weinberg a Love token.
Wed, Jan 5, 5:38 PM

Tue, Jan 4

thcipriani edited projects for T281122: Wikibase selenium tests timeout, seemingly due to "memory compaction" events on CI VMs, added: Release-Engineering-Team; removed Release-Engineering-Team (Seen).
Tue, Jan 4, 7:51 PM · Release-Engineering-Team, Continuous-Integration-Infrastructure, Wikidata, Cloud-VPS, cloud-services-team (Kanban), User-Addshore, wdwb-tech

Fri, Dec 31

thcipriani updated the task description for T263660: Organize a blog post writing club.
Fri, Dec 31, 11:46 PM · User-zeljkofilipin

Dec 22 2021

thcipriani reassigned T298177: CI is doing nada (Gearman) from thcipriani to Legoktm.
Dec 22 2021, 4:04 AM · Zuul, Release-Engineering-Team, Continuous-Integration-Infrastructure
thcipriani closed T298177: CI is doing nada (Gearman) as Resolved.

Ran a recheck on a core patch. This looks resolved.

Dec 22 2021, 4:04 AM · Zuul, Release-Engineering-Team, Continuous-Integration-Infrastructure
thcipriani added a comment to T298177: CI is doing nada (Gearman).

I just did a recheck and it seems to catch it on contint2001, and I see zuul processing the queue in /var/log/zuul/debug.log and I see things merging in /var/log/zuul/merger-debug.log. Though there's not much running through it at the moment.

Dec 22 2021, 3:57 AM · Zuul, Release-Engineering-Team, Continuous-Integration-Infrastructure

Dec 20 2021

thcipriani closed T293953: 1.38.0-wmf.12 deployment blockers as Resolved.
Dec 20 2021, 10:03 PM · Release-Engineering-Team (Doing), User-brennen, Patch-For-Review, Release, Train Deployments
thcipriani closed T296205: Delete temporary main branch in mediawiki/core.git until rename from master to main is ready as Resolved.

done !

Dec 20 2021, 8:02 PM · Release-Engineering-Team (Yak Shaving 🐃🪒), GitLab (Project Migration), Voice & Tone, User-brennen
thcipriani closed T296205: Delete temporary main branch in mediawiki/core.git until rename from master to main is ready, a subtask of T281593: Rename mainline Git branch from "master" to "main" on all WMF-hosted repositories during GitLab migration, as Resolved.
Dec 20 2021, 8:02 PM · Release-Engineering-Team (Doing), GitLab (Project Migration), Voice & Tone, User-brennen

Dec 17 2021

thcipriani added a comment to T297323: Grant Access to Logstash for Zabe.

@thcipriani are you OK to approve this request, please? [or suggest someone else in releng who might be appropriate to do so?]

Dec 17 2021, 5:59 PM · SRE, LDAP-Access-Requests
thcipriani awarded Deployment Training Graduate to recipient: DMartin-WMF.
Dec 17 2021, 5:39 PM
thcipriani added a comment to T297321: Deployment training request for David Martin.
  1. Training completed!
Dec 17 2021, 5:37 PM · Release-Engineering-Team (Deployment Training Requests)

Dec 16 2021

thcipriani reassigned T297321: Deployment training request for David Martin from thcipriani to brennen.
Dec 16 2021, 10:19 PM · Release-Engineering-Team (Deployment Training Requests)
thcipriani added a comment to T297621: Requesting access to 'restricted' for komla.

@thcipriani I think you're the right person to approve additions to the restricted group; can you confirm you're happy for this to go ahead, please?

Dec 16 2021, 7:23 PM · SRE, SRE-Access-Requests

Dec 14 2021

thcipriani added a comment to T297517: wtp* hosts: Out of memory (allocated 39845888) (tried to allocate 131072 bytes) in OutputHandler.php.

Documenting my understanding of this problem after reading this task (along with T297669 and T297667)).

Dec 14 2021, 5:20 PM · User-Ladsgroup, SRE, serviceops, Wikimedia-production-error
thcipriani claimed T297724: Deployment calendar: MediaWiki branch cut reported as between 3-4 AM UTC but actually it seems to be between 2-3 AM.
Dec 14 2021, 4:43 PM · Deployments, Release-Engineering-Team
thcipriani created T297724: Deployment calendar: MediaWiki branch cut reported as between 3-4 AM UTC but actually it seems to be between 2-3 AM.
Dec 14 2021, 4:34 PM · Deployments, Release-Engineering-Team

Dec 11 2021

thcipriani added a comment to T297517: wtp* hosts: Out of memory (allocated 39845888) (tried to allocate 131072 bytes) in OutputHandler.php.

noting T296098: 1.38.0-wmf.9 seems to have introduced a memory leak as possibly related

Dec 11 2021, 12:10 AM · User-Ladsgroup, SRE, serviceops, Wikimedia-production-error

Dec 10 2021

thcipriani awarded T297510: scap master rsyncd: Rename common to mediawiki-staging a Like token.
Dec 10 2021, 8:19 PM · Scap, Release-Engineering-Team

Dec 9 2021

thcipriani updated the task description for T297409: DBPerformance Watchlist-related channel errors trending upward since 2021-11-24.
Dec 9 2021, 4:52 PM · User-Urbanecm_WMF (Engineering), GrowthExperiments-MentorDashboard, Growth-Team, Wikimedia-production-error
thcipriani moved T297409: DBPerformance Watchlist-related channel errors trending upward since 2021-11-24 from Untriaged to Dec 2021 on the Wikimedia-production-error board.
Dec 9 2021, 4:51 PM · User-Urbanecm_WMF (Engineering), GrowthExperiments-MentorDashboard, Growth-Team, Wikimedia-production-error
thcipriani created T297409: DBPerformance Watchlist-related channel errors trending upward since 2021-11-24.
Dec 9 2021, 4:50 PM · User-Urbanecm_WMF (Engineering), GrowthExperiments-MentorDashboard, Growth-Team, Wikimedia-production-error
thcipriani moved T297407: MediaWiki\Page\PageAssertionException: The given PageIdentity User:* does not represent a proper page from Untriaged to Dec 2021 on the Wikimedia-production-error board.
Dec 9 2021, 4:31 PM · Patch-For-Review, MediaWiki-Special-pages, Platform Engineering, MediaWiki-General, Wikimedia-production-error
thcipriani created T297407: MediaWiki\Page\PageAssertionException: The given PageIdentity User:* does not represent a proper page.
Dec 9 2021, 4:31 PM · Patch-For-Review, MediaWiki-Special-pages, Platform Engineering, MediaWiki-General, Wikimedia-production-error
thcipriani created T297406: Exception: No recommendation found for page: *.
Dec 9 2021, 4:25 PM · Growth-Team (Current Sprint), GrowthExperiments, Wikimedia-production-error
thcipriani moved T297403: [M] FormatMetadata: PHP Notice: Array to string conversion from Untriaged to Dec 2021 on the Wikimedia-production-error board.
Dec 9 2021, 4:15 PM · Structured-Data-Backlog (Current Work), Wikimedia-production-error
thcipriani created T297403: [M] FormatMetadata: PHP Notice: Array to string conversion.
Dec 9 2021, 4:14 PM · Structured-Data-Backlog (Current Work), Wikimedia-production-error
thcipriani claimed T297321: Deployment training request for David Martin.

Hi @DMartin-WMF I've added you to the backport training on Thursday, December 16. See you then!

Dec 9 2021, 2:31 PM · Release-Engineering-Team (Deployment Training Requests)

Dec 8 2021

thcipriani closed T137729: Scope out "deployment-dashboard" project as Resolved.

Declaring https://versions.toolforge.org/ to be a reasonable approximation of the acceptance criteria of this task.

Dec 8 2021, 7:02 PM · Release-Engineering-Team (Yak Shaving 🐃🪒), Deployments
thcipriani moved T288576: Fix mwdebug dashboard to show mw and scap messages again from Backlog to Wiglaf (2021-12-08) on the Release-Engineering-Team (Yak Shaving 🐃🪒) board.
Dec 8 2021, 6:56 PM · Release-Engineering-Team (Yak Shaving 🐃🪒), Developer Productivity, Scap
thcipriani set the point value for T281391: Add local-charts to mw-cli to 5.
Dec 8 2021, 6:52 PM · Release-Engineering-Team (Yak Shaving 🐃🪒)
thcipriani moved T281391: Add local-charts to mw-cli from Backlog to Wiglaf (2021-12-08) on the Release-Engineering-Team (Yak Shaving 🐃🪒) board.
Dec 8 2021, 6:51 PM · Release-Engineering-Team (Yak Shaving 🐃🪒)
thcipriani edited projects for T290267: Experiment with automating error log triage, added: Release-Engineering-Team (Radar); removed Release-Engineering-Team (Yak Shaving 🐃🪒).
Dec 8 2021, 6:46 PM · Release-Engineering-Team (Radar), Observability-Logging, User-brennen
thcipriani set the point value for T152729: Integrate Stashbot better visually with Phabricator to 3.
Dec 8 2021, 6:43 PM · Release-Engineering-Team (Yak Shaving 🐃🪒), Stashbot, Phabricator
thcipriani set the point value for T215148: On Phabricator workboard, show status of associated Gerrit patches to 3.
Dec 8 2021, 6:42 PM · Release-Engineering-Team (Yak Shaving 🐃🪒), User-MModell, Phabricator
thcipriani claimed T296205: Delete temporary main branch in mediawiki/core.git until rename from master to main is ready.
Dec 8 2021, 6:40 PM · Release-Engineering-Team (Yak Shaving 🐃🪒), GitLab (Project Migration), Voice & Tone, User-brennen
thcipriani set the point value for T143162: Reduce task notification noise/frequency of changes to associated open patchsets to 5.
Dec 8 2021, 6:38 PM · Release-Engineering-Team (Yak Shaving 🐃🪒), Developer Productivity, Diffusion
thcipriani set the point value for T296805: Confirm with releng which docker images make the most sense to use to 1.
Dec 8 2021, 6:34 PM · Release-Engineering-Team (Yak Shaving 🐃🪒), user-sbassett, GitLab (CI & Job Runners), Security, Security Team AppSec, Security-Team
thcipriani moved T296805: Confirm with releng which docker images make the most sense to use from Backlog to Wiglaf (2021-12-08) on the Release-Engineering-Team (Yak Shaving 🐃🪒) board.
Dec 8 2021, 6:34 PM · Release-Engineering-Team (Yak Shaving 🐃🪒), user-sbassett, GitLab (CI & Job Runners), Security, Security Team AppSec, Security-Team
thcipriani edited projects for T295925: Determine a better way to track Wikimedia production security patches, added: Release-Engineering-Team (Next); removed Release-Engineering-Team.
Dec 8 2021, 6:33 PM · Release-Engineering-Team (Next), Security-Team
thcipriani edited projects for T296022: Deprecate git-ssh service on phabricator.wikimedia.org, added: Release-Engineering-Team (Next); removed Release-Engineering-Team.
Dec 8 2021, 6:32 PM · Release-Engineering-Team (Next), serviceops, Phabricator
thcipriani assigned T296381: Create new GitLab project group: Generated Data Platform to brennen.
Dec 8 2021, 6:30 PM · Release-Engineering-Team (Yak Shaving 🐃🪒), GitLab (Project Migration)
thcipriani claimed T296805: Confirm with releng which docker images make the most sense to use.

Hi @sbassett

Dec 8 2021, 6:29 PM · Release-Engineering-Team (Yak Shaving 🐃🪒), user-sbassett, GitLab (CI & Job Runners), Security, Security Team AppSec, Security-Team
thcipriani edited projects for T291501: Delete the wmf/1.37.0-wmf.* branches once we've fully deployed to 1.38.0-wmf.1 and finished with them, added: Release-Engineering-Team (Yak Shaving 🐃🪒); removed Release-Engineering-Team (Next).
Dec 8 2021, 6:23 PM · Release-Engineering-Team (Yak Shaving 🐃🪒)
thcipriani edited projects for T296205: Delete temporary main branch in mediawiki/core.git until rename from master to main is ready, added: Release-Engineering-Team (Yak Shaving 🐃🪒); removed Release-Engineering-Team (Next).
Dec 8 2021, 6:22 PM · Release-Engineering-Team (Yak Shaving 🐃🪒), GitLab (Project Migration), Voice & Tone, User-brennen
thcipriani closed T281307: Yak:Train stats as Resolved.

It seems we have all that's in the task description and more, now: https://gitlab.wikimedia.org/thcipriani/train-stats#train-stats

Dec 8 2021, 6:19 PM · Deployments, Release-Engineering-Team (Yak Shaving 🐃🪒)
thcipriani renamed Release-Engineering-Team (Done by Wed 24 Nov 🧟) from Done by Wed 24 Nov 🔥 to Done by Wed 24 Nov 🧟.
Dec 8 2021, 3:54 PM

Dec 7 2021

thcipriani edited projects for T143162: Reduce task notification noise/frequency of changes to associated open patchsets, added: Release-Engineering-Team (Yak Shaving 🐃🪒); removed Release-Engineering-Team (Seen).
Dec 7 2021, 11:21 PM · Release-Engineering-Team (Yak Shaving 🐃🪒), Developer Productivity, Diffusion
thcipriani added a comment to T293953: 1.38.0-wmf.12 deployment blockers.

If it's possible to mitigate this, that'd be ideal.

We are working to take Parsoid out of the risky patches set and should have a backport to vendor before the train rolls out. We decided to split the 2.3.0 -> 2.4.0 bump across 2 trains. That will eliminate the need for RESTBase purges altogether without needing to keep any eye on individual edits on those 3 wikis.

Dec 7 2021, 9:22 PM · Release-Engineering-Team (Doing), User-brennen, Patch-For-Review, Release, Train Deployments

Dec 6 2021

thcipriani added a comment to T293953: 1.38.0-wmf.12 deployment blockers.

All that said, if train operators prefer that we mitigate that for your sanity, I will happily work with my team to make those fixes.

Dec 6 2021, 11:43 PM · Release-Engineering-Team (Doing), User-brennen, Patch-For-Review, Release, Train Deployments
thcipriani added a comment to T277205: Centrally look for flakey browser tests.

I made a script that parses all Jenkins junit files and puts them in a database. The database (see here) has about 5 million test cases at this point.

Dec 6 2021, 11:29 PM · Wikidata, wdwb-tech, User-zeljkofilipin, User-Addshore, Continuous-Integration-Infrastructure, Browser-Tests
thcipriani added a comment to T294311: Finish node/npm initial tool ci templates for auditjs (Node 10, 12, 14).
  1. We have a node14 image; that's only meant for use in CI, currently

Ah, ok. Is there anything special about images under the releng/ namespace? i.e. does that signify they are only for CI?

Dec 6 2021, 9:27 PM · SecTeam-Processed, GitLab (CI & Job Runners), user-sbassett, Security, Security Team AppSec, Security-Team
thcipriani added a comment to T293953: 1.38.0-wmf.12 deployment blockers.

Just so this doesn't get lost in the comment above, if the train is rolled back after deploy, we will need to purge RESTBase content (See T296425) to ensure VE edits on metawiki and mediawiki on pages with <translate> tags don't break.

This is admittedly an edge case since VE editing on pages with <translate> isn't well-supported currently and so editors are unlikely to use VE on those pages. So, if a train is going to be rolled back and then rolled forward relatively quickly, there is probably some breathing room to let that be in a broken state for a while. But, if the train is going to be in a rolled back state for a long time, then, it is worth purging RESTBase storage via T296425.

Dec 6 2021, 7:39 PM · Release-Engineering-Team (Doing), User-brennen, Patch-For-Review, Release, Train Deployments
thcipriani awarded Backport Deployer to recipient: Majavah.
Dec 6 2021, 5:25 PM

Dec 2 2021

thcipriani awarded Deployment Training Graduate to recipient: JKieserman.
Dec 2 2021, 6:38 PM
thcipriani closed T296024: Deployment training request for JKieserman as Resolved.
  1. Training completed!
Dec 2 2021, 6:38 PM · Release-Engineering-Team (Deployment Training Requests)

Dec 1 2021

thcipriani updated the task description for T263660: Organize a blog post writing club.
Dec 1 2021, 3:48 AM · User-zeljkofilipin

Nov 30 2021

thcipriani added a comment to T296777: Requesting access to deployment for Majavah.

@thcipriani Thoughts on this request?

Nov 30 2021, 9:53 PM · SRE, SRE-Access-Requests

Nov 29 2021

thcipriani closed T293952: 1.38.0-wmf.11 deployment blockers as Declined.
Nov 29 2021, 10:59 PM · Release-Engineering-Team (Next), Release, Train Deployments

Nov 22 2021

thcipriani created E1439: thcipriani→🦃Out of office.
Nov 22 2021, 5:31 AM · Release-Engineering-Team, events

Nov 20 2021

thcipriani added a comment to T296125: Fatal error: Uncaught ConfigException: Failed to load configuration from etcd.

The puppet failure on the second deployment host is:

Nov 20 2021, 9:26 AM · Puppet, Infrastructure-Foundations, Beta-Cluster-Infrastructure, Release-Engineering-Team, Scap
thcipriani added a project to T296125: Fatal error: Uncaught ConfigException: Failed to load configuration from etcd: Beta-Cluster-Infrastructure.
Nov 20 2021, 8:50 AM · Puppet, Infrastructure-Foundations, Beta-Cluster-Infrastructure, Release-Engineering-Team, Scap
thcipriani created T296125: Fatal error: Uncaught ConfigException: Failed to load configuration from etcd.
Nov 20 2021, 8:48 AM · Puppet, Infrastructure-Foundations, Beta-Cluster-Infrastructure, Release-Engineering-Team, Scap

Nov 19 2021

thcipriani updated subscribers of T296024: Deployment training request for JKieserman.

Thank you! Would it be possible to attend the earlier session instead?

Nov 19 2021, 8:30 PM · Release-Engineering-Team (Deployment Training Requests)
thcipriani placed T296098: 1.38.0-wmf.9 seems to have introduced a memory leak up for grabs.

Unassigning now that this is rolled back.

Nov 19 2021, 4:49 PM · User-Ladsgroup, Release-Engineering-Team (Done by Wed 24 Nov 🧟), Release, Train Deployments