Page MenuHomePhabricator
Feed Advanced Search

Yesterday

thcipriani added a comment to T280901: MinervaNeue legacy ruby browser tests need to be updated to work on buster/ruby2.5.

@Jdforrester-WMF: Could you give an indication of the priority of this for RelEng?

Thu, May 13, 4:02 PM · Readers-Web-Backlog (Kanbanana-FY-2020-21), MinervaNeue, Continuous-Integration-Infrastructure
thcipriani lowered the priority of T182759: Add Prometheus exporter to Jenkins instances from High to Low.
Thu, May 13, 3:39 AM · Release-Engineering-Team (Seen), observability, Continuous-Integration-Infrastructure, Goal, SRE

Wed, May 12

thcipriani added a comment to P15955 (An Untitled Masterwork).

^ shows up as:

Wed, May 12, 10:30 PM
thcipriani created P15955 (An Untitled Masterwork).
Wed, May 12, 10:27 PM
thcipriani added a comment to T274461: Define auth strategy for GitLab.

from what i see and i think @Sergey.Trofimovsky.SF confirmed, this is simply not possible in CE regardless of SAML/CAS (protocol or service)/LDAP

Wed, May 12, 10:10 PM · Release-Engineering-Team (Doing), SRE, GitLab (Initialization), User-brennen
thcipriani created T282729: InvalidArgumentException: The revision does not belong to the given page..
Wed, May 12, 6:57 PM · MediaWiki-Revision-backend, Platform Engineering, Wikimedia-production-error
thcipriani created T282726: Wikimedia\Rdbms\DBTransactionStateError: Cannot execute query from CategoryMembershipChangeJob::run while transaction status is ERROR.
Wed, May 12, 6:49 PM · Growth-Team (Current Sprint), Release-Engineering-Team (Logspam), MediaWiki-Recent-changes, Wikimedia-production-error
thcipriani created T282723: MediaWiki\Revision\RevisionAccessException: Main slot of revision not found in database. See T212428..
Wed, May 12, 6:30 PM · MediaWiki-Page-derived-data, MediaWiki-Revision-backend, Platform Engineering, Wikimedia-production-error
thcipriani created T282721: PHP Warning: headers already sent by (after RequestTimeoutException from rest.php).
Wed, May 12, 6:21 PM · Parsoid, Wikimedia-production-error

Tue, May 11

thcipriani added a comment to T282610: Requesting access to releases1002/2002 for jhuneidi.

Approved as manager

Tue, May 11, 8:32 PM · SRE, SRE-Access-Requests
thcipriani added a comment to T274461: Define auth strategy for GitLab.
  • No group membership (turns out that was never a requirement)

@brennen, @thcipriani, @wkandek, @faidon this would be a step backwards from what we have currently in gerrit and would add significant overhead and tooling to on-boarding, off-boarding, and audit capabilities. further it will likely lead to authorisation fragmentation some thing we try to avoid by defining high-level group rights in a central location

Thanks to @hashar we have a rough list of gerrit groups that are currently mapped to ldap OU's

Tue, May 11, 4:53 PM · Release-Engineering-Team (Doing), SRE, GitLab (Initialization), User-brennen

Mon, May 10

thcipriani updated subscribers of T275170: Define monitoring for gitlab.

Commenting to bring together a few threads of conversation.

Mon, May 10, 5:32 PM · GitLab (Initialization), observability

Fri, May 7

thcipriani edited Description on Data³.
Fri, May 7, 8:03 PM
thcipriani updated the image for Data³ from F34280865: profile to F34445531: profile.
Fri, May 7, 8:00 PM
thcipriani added a hashtag to Data³: #data_3.
Fri, May 7, 7:59 PM
thcipriani edited Description on Data³.
Fri, May 7, 7:58 PM
thcipriani edited Description on Data³.
Fri, May 7, 7:52 PM
thcipriani edited Description on Data³.
Fri, May 7, 7:52 PM
thcipriani added a comment to T274462: Logging for GitLab.

Latest state that I am aware of:

  • Gerrit currently does not use logstash. As we use Gerrit as a guide, we currently do not know what should into Logstash. Will define in a later pahse
Fri, May 7, 5:39 PM · Wikimedia-Logstash, observability, User-brennen, GitLab (Initialization)
thcipriani added a comment to T274463: Backups for GitLab.

Will this require new hardware? If so we should add it into annual planning quickly.

I discussed this with my manager, and we had taken the required space into account for backup expansion for next fiscal year (the 7TB+ for 90 days of retention of full backups).

Fri, May 7, 1:06 PM · Data-Persistence-Backup, Patch-For-Review, User-brennen, GitLab (Initialization)
thcipriani added a project to T249152: The Train - the workshop: Release-Engineering-Team.
Fri, May 7, 5:09 AM · Release-Engineering-Team, Code-Health-DevEd-Curriculum
thcipriani added a hashtag to Release-Engineering-Team (Next): #releng-next.
Fri, May 7, 4:55 AM
thcipriani removed a hashtag from Release-Engineering-Team (Next): #releng-next.
Fri, May 7, 4:54 AM
thcipriani triaged T281121: logspam-watch broken as Medium priority.
Fri, May 7, 4:53 AM · Release-Engineering-Team (Doing), Patch-For-Review, User-brennen

Thu, May 6

thcipriani closed T268748: Onboard/offboard Harriet Ayugi as Resolved.

@thcipriani

Hi @thcipriani! A friendly reminder. This is the last thing left to finish off-boarding.

Thu, May 6, 4:00 PM · User-zeljkofilipin, Quality-and-Test-Engineering-Team (QTE)

Wed, May 5

thcipriani closed T281309: Deployment training request for **xSavitar** as Resolved.

I confirm Alangi Derick now has access to deployment server and bastions.

Wed, May 5, 11:47 PM · User-xSavitar, Release-Engineering-Team (Deployment Training Requests)
thcipriani created T282061: Deployment credentials for @egardner.
Wed, May 5, 10:01 PM · Release-Engineering-Team (Deployment Training Requests)

Tue, May 4

thcipriani edited projects for T281121: logspam-watch broken, added: Release-Engineering-Team (Next); removed Release-Engineering-Team.
Tue, May 4, 8:14 PM · Release-Engineering-Team (Doing), Patch-For-Review, User-brennen
thcipriani added a comment to T274463: Backups for GitLab.

After talking this through with contractors + @brennen and @wkandek I think we'd like to do a full daily backup.

Tue, May 4, 5:45 PM · Data-Persistence-Backup, Patch-For-Review, User-brennen, GitLab (Initialization)
thcipriani edited Description on Release-Engineering-Team.
Tue, May 4, 5:02 PM
thcipriani updated the image for Release-Engineering-Team from F3408210: fa-users-violet.png to F34440441: profile.
Tue, May 4, 5:00 PM
thcipriani edited projects for T271125: Enforce image names and namespaces in PipelineLib to avoid collisions, added: Release-Engineering-Team (Seen); removed Release-Engineering-Team (Doing).
Tue, May 4, 4:47 PM · Release-Engineering-Team (Seen), Release Pipeline
thcipriani edited projects for T273334: Re-imaged mw app servers can end up with missing l10n cache for old versions of MW needed for rollback, added: Release-Engineering-Team (Next); removed Release-Engineering-Team (Doing).
Tue, May 4, 4:45 PM · Release-Engineering-Team (Next), Scap, SRE
thcipriani closed T274000: Deploy process should be updated so JavaScript errors block the train as Resolved.
Tue, May 4, 4:45 PM · Release-Engineering-Team (Doing), Documentation, User-brennen, Instrument-ClientError
thcipriani edited projects for T267172: integration-quibble-fullrun should use a tmpfs for the mysql database, added: Release-Engineering-Team (Seen); removed Release-Engineering-Team (Doing).
Tue, May 4, 4:42 PM · Release-Engineering-Team (Seen), Continuous-Integration-Config
thcipriani closed T264775: Management of git repos snapshot as Declined.
Tue, May 4, 4:41 PM · Release-Engineering-Team (Doing), MediaWiki Train Development Environment
thcipriani placed T266055: Update Scap to perform rolling restart for all MW deploy up for grabs.
Tue, May 4, 4:40 PM · Release-Engineering-Team (Radar), User-jijiki, Patch-For-Review, Scap
thcipriani edited projects for T266055: Update Scap to perform rolling restart for all MW deploy, added: Release-Engineering-Team (Radar); removed Release-Engineering-Team (Doing).
Tue, May 4, 4:39 PM · Release-Engineering-Team (Radar), User-jijiki, Patch-For-Review, Scap
thcipriani moved T236680: Enable API integration tests in CI for MediaWiki core from Limbo to Done (within RelEng) on the Release-Engineering-Team (Radar) board.

Looked at this task during our workboard triaging: can this task be closed?

Tue, May 4, 4:38 PM · Release-Engineering-Team (Radar), MW-1.35-notes (1.35.0-wmf.19; 2020-02-11), Platform Team Initiatives (API Integration Tests), Code-Health, Continuous-Integration-Config
thcipriani edited projects for T236680: Enable API integration tests in CI for MediaWiki core, added: Release-Engineering-Team (Radar); removed Release-Engineering-Team (Doing).
Tue, May 4, 4:37 PM · Release-Engineering-Team (Radar), MW-1.35-notes (1.35.0-wmf.19; 2020-02-11), Platform Team Initiatives (API Integration Tests), Code-Health, Continuous-Integration-Config
thcipriani placed T185736: Feature request: Evaluate "require" field from "extension.json" in automated test environment up for grabs.
Tue, May 4, 4:34 PM · Release-Engineering-Team (Seen), EngProd-Virtual-Hackathon, Quibble, Continuous-Integration-Infrastructure
thcipriani edited projects for T116948: Undeploy CodeReview, added: Release-Engineering-Team (Seen); removed Release-Engineering-Team (Doing).
Tue, May 4, 4:32 PM · Release-Engineering-Team (Seen), Patch-For-Review, Technical-Debt, MediaWiki-extensions-CodeReview, Wikimedia-Site-requests
thcipriani closed T243436: Refine Seakeeper proposal for Security/SRE review as Declined.
Tue, May 4, 4:31 PM · Release-Engineering-Team (Doing)
thcipriani closed T244384: Research available third-party Argo and Kubernetes cloud providers as Declined.
Tue, May 4, 4:30 PM · Release-Engineering-Team (Doing)
thcipriani closed T244384: Research available third-party Argo and Kubernetes cloud providers, a subtask of T243436: Refine Seakeeper proposal for Security/SRE review, as Declined.
Tue, May 4, 4:30 PM · Release-Engineering-Team (Doing)
thcipriani reassigned T280197: Gerritbot turns "+" into space, thus breaking most Gerrit URLs from hashar to mmodell.

Assigning to @mmodell to verify behavior on phab side

Tue, May 4, 4:24 PM · Release-Engineering-Team (Doing), Developer Productivity, Regression, GerritBot
thcipriani triaged T281079: Generate non-restricted versions of the mediawiki-webserver image as Low priority.
Tue, May 4, 4:20 PM · Release-Engineering-Team (Seen), serviceops, MW-on-K8s
thcipriani closed T281121: logspam-watch broken as Invalid.

Is this still happening for you? Several Release-Engineering-Team folks are unable to reproduce this problem.

Tue, May 4, 4:16 PM · Release-Engineering-Team (Doing), Patch-For-Review, User-brennen
thcipriani moved T281593: Rename mainline Git branch from "master" to "main" on all WMF-hosted repositories during GitLab migration from INBOX to Next on the Release-Engineering-Team board.
Tue, May 4, 4:14 PM · Release-Engineering-Team (Next), Voice & Tone, GitLab, User-brennen
thcipriani edited projects for T281674: Archive the search/xgboot repo in gerrit, added: Release-Engineering-Team (Doing); removed Release-Engineering-Team.
Tue, May 4, 4:12 PM · Release-Engineering-Team (Doing), Discovery-Search (Current work), Projects-Cleanup
thcipriani edited projects for T281737: Zuul can't stop jobs or set the build description, added: Release-Engineering-Team (Doing); removed Release-Engineering-Team.
Tue, May 4, 4:09 PM · Upstream, Release-Engineering-Team (Doing), Patch-For-Review, Zuul, Jenkins, Continuous-Integration-Infrastructure

Mon, May 3

thcipriani added a comment to T281564: Requesting access to Deployment shell for derick.

@xSavitar Hi, ticket looks good. I'll handle it as the "clinic duty" person this week.

@thcipriani Let's start with your approval. Do you approve?

Mon, May 3, 6:04 PM · Patch-For-Review, SRE, SRE-Access-Requests
thcipriani updated the task description for T281564: Requesting access to Deployment shell for derick.
Mon, May 3, 6:02 PM · Patch-For-Review, SRE, SRE-Access-Requests

Sat, May 1

thcipriani closed T279612: Gerrit: default branch for new projects should be "main", a subtask of T254646: Reconsidering how we name things, as Declined.
Sat, May 1, 12:15 AM · User-brennen, MW-1.37-notes (1.37.0-wmf.3; 2021-04-27), MediaWiki-extensions-General, Wikimedia-General-or-Unknown, MediaWiki-General, Patch-For-Review, Voice & Tone
thcipriani closed T279612: Gerrit: default branch for new projects should be "main" as Declined.

Declining this task in favor of T281593: Rename mainline Git branch from "master" to "main" on all WMF-hosted repositories during GitLab migration

Sat, May 1, 12:15 AM · Release-Engineering-Team (Radar), Gerrit

Fri, Apr 30

thcipriani added a comment to T274463: Backups for GitLab.

Frankly, I am not sure I have the resources and knowledge to get into an entirely new LVM snapshotting (and partman) setup (this quarter). I haven't been involved in this ticket at all up to this point.

Fri, Apr 30, 10:53 PM · Data-Persistence-Backup, Patch-For-Review, User-brennen, GitLab (Initialization)
thcipriani added a comment to P15662 (An Untitled Masterwork).

^ because I'm dumb. Although I swear I squinted really hard.

Fri, Apr 30, 12:21 AM
thcipriani created P15662 (An Untitled Masterwork).
Fri, Apr 30, 12:20 AM
thcipriani awarded Deployment Training Graduate to recipient: xSavitar.
Fri, Apr 30, 12:03 AM
thcipriani reassigned T281309: Deployment training request for **xSavitar** from thcipriani to xSavitar.
  1. After training
Fri, Apr 30, 12:03 AM · User-xSavitar, Release-Engineering-Team (Deployment Training Requests)

Thu, Apr 29

thcipriani edited Description on Release-Engineering-Team (Deployment Training Requests).
Thu, Apr 29, 5:58 PM
thcipriani awarded Deployment Training Graduate to recipients: egardner, HMonroy, cmassaro, gengh, kostajh, abi_, Tchanders, STran.
Thu, Apr 29, 2:55 PM
thcipriani updated Deployment Training Graduate flavor text from S.C.A.P.: `sh -c awk | perl`, right? to S.C.A.P.: sh -c awk | perl — right?.
Thu, Apr 29, 2:47 PM
thcipriani updated the badge description for Deployment Training Graduate.
Thu, Apr 29, 2:47 PM
thcipriani updated the badge description for Deployment Training Graduate.
Thu, Apr 29, 2:46 PM
thcipriani updated the badge description for Deployment Training Graduate.
Thu, Apr 29, 2:45 PM
thcipriani created Deployment Training Graduate.
Thu, Apr 29, 2:41 PM

Wed, Apr 28

thcipriani added a comment to T281401: PHP Deprecated: Use of User::isIP was deprecated in MediaWiki 1.35. [Called from ApiVisualEditor::execute].

Adding as blocker for next train per previous discussion with Platform Engineering folks

Wed, Apr 28, 6:49 PM · User-DannyS712, MW-1.37-notes (1.37.0-wmf.4; 2021-05-04), Platform Team Workboards (MW Expedition), MediaWiki-User-management, Wikimedia-production-error
thcipriani added a subtask for T281145: 1.37.0-wmf.4 deployment blockers: T281401: PHP Deprecated: Use of User::isIP was deprecated in MediaWiki 1.35. [Called from ApiVisualEditor::execute].
Wed, Apr 28, 6:48 PM · User-brennen, Release-Engineering-Team (Doing), Release, Train Deployments
thcipriani added a parent task for T281401: PHP Deprecated: Use of User::isIP was deprecated in MediaWiki 1.35. [Called from ApiVisualEditor::execute]: T281145: 1.37.0-wmf.4 deployment blockers.
Wed, Apr 28, 6:48 PM · User-DannyS712, MW-1.37-notes (1.37.0-wmf.4; 2021-05-04), Platform Team Workboards (MW Expedition), MediaWiki-User-management, Wikimedia-production-error
thcipriani created T281401: PHP Deprecated: Use of User::isIP was deprecated in MediaWiki 1.35. [Called from ApiVisualEditor::execute].
Wed, Apr 28, 6:47 PM · User-DannyS712, MW-1.37-notes (1.37.0-wmf.4; 2021-05-04), Platform Team Workboards (MW Expedition), MediaWiki-User-management, Wikimedia-production-error
thcipriani created T281400: TypeError: Argument 1 passed to EditPage::displayViewSourcePage() must implement interface Content, null given.
Wed, Apr 28, 6:33 PM · Patch-For-Review, MediaWiki-Revision-backend, MediaWiki-Page-editing, Platform Team Workboards (Clinic Duty Team), Wikimedia-production-error
thcipriani moved T212101: Lock wait timeout exceeded in UploadFromChunks::updateChunkStatus from Untriaged to Old on the Wikimedia-production-error board.
Wed, Apr 28, 6:24 PM · Structured-Data-Backlog (Current Work), Wikimedia-production-error, Structured Data Engineering, MediaWiki-Uploading
thcipriani added a project to T212101: Lock wait timeout exceeded in UploadFromChunks::updateChunkStatus: Wikimedia-production-error.
Wed, Apr 28, 6:24 PM · Structured-Data-Backlog (Current Work), Wikimedia-production-error, Structured Data Engineering, MediaWiki-Uploading
thcipriani edited projects for T212101: Lock wait timeout exceeded in UploadFromChunks::updateChunkStatus, added: Structured Data Engineering; removed Multimedia.

Still seen as of 1.37.0-wmf.1, happening at the rate of a few 10s of times per hour (max of 30ish)

Wed, Apr 28, 6:23 PM · Structured-Data-Backlog (Current Work), Wikimedia-production-error, Structured Data Engineering, MediaWiki-Uploading
thcipriani moved T281392: pipeline-promote: Add patch author as reviewer to promote patch from Backlog to 2021-04-30 on the Release-Engineering-Team (Yak Shaving 🐃🪒) board.
Wed, Apr 28, 5:37 PM · Release-Engineering-Team (Yak Shaving 🐃🪒)
thcipriani moved T281391: Add local-charts to mw-cli from Backlog to 2021-04-30 on the Release-Engineering-Team (Yak Shaving 🐃🪒) board.
Wed, Apr 28, 5:37 PM · Release-Engineering-Team (Yak Shaving 🐃🪒)
thcipriani moved T245184: Automate scap prep from Backlog to 2021-04-30 on the Release-Engineering-Team (Yak Shaving 🐃🪒) board.
Wed, Apr 28, 5:37 PM · Release-Engineering-Team (Yak Shaving 🐃🪒), Scap
thcipriani moved T225335: Implement pipeline config validation from Backlog to 2021-04-30 on the Release-Engineering-Team (Yak Shaving 🐃🪒) board.
Wed, Apr 28, 5:35 PM · Release-Engineering-Team (Yak Shaving 🐃🪒), Release Pipeline
thcipriani edited projects for T239355: Deprecate phabricator's fixed_settings.yaml (in puppet) and just use phabricator's built in configuration tools, added: Release-Engineering-Team (Seen); removed Release-Engineering-Team (Yak Shaving 🐃🪒).
Wed, Apr 28, 5:34 PM · Release-Engineering-Team (Seen), Security, User-MModell, Phabricator
thcipriani moved T240484: Explore tools for remote pairing from Backlog to 2021-04-30 on the Release-Engineering-Team (Yak Shaving 🐃🪒) board.
Wed, Apr 28, 5:33 PM · Release-Engineering-Team (Yak Shaving 🐃🪒), User-brennen
thcipriani moved T250095: branch.py: Convert deleted wmf branches to tags from Backlog to 2021-04-30 on the Release-Engineering-Team (Yak Shaving 🐃🪒) board.
Wed, Apr 28, 5:31 PM · Patch-For-Review, Release-Engineering-Team (Yak Shaving 🐃🪒), MediaWiki-Release-Tools, User-brennen
thcipriani updated subscribers of T279051: Add tooling to pgp-public-keys.git to make using and maintaining it easier.
Wed, Apr 28, 5:27 PM · Release-Engineering-Team (Yak Shaving 🐃🪒)
thcipriani moved T279051: Add tooling to pgp-public-keys.git to make using and maintaining it easier from Backlog to 2021-04-30 on the Release-Engineering-Team (Yak Shaving 🐃🪒) board.
Wed, Apr 28, 5:27 PM · Release-Engineering-Team (Yak Shaving 🐃🪒)
thcipriani updated subscribers of T281307: Yak:Train stats.

via @LarsWirzenius

  • Number of times rolled back since previous train
Wed, Apr 28, 5:22 PM · Deployments, Release-Engineering-Team (Yak Shaving 🐃🪒)
thcipriani claimed T281309: Deployment training request for **xSavitar**.

Hey @xSavitar you should have an invite to the Google meet on 2021-04-29...I am now going to add a "date I would like to attend" to this form :)

Wed, Apr 28, 4:48 PM · User-xSavitar, Release-Engineering-Team (Deployment Training Requests)
mmodell awarded T281307: Yak:Train stats a Love token.
Wed, Apr 28, 1:41 AM · Deployments, Release-Engineering-Team (Yak Shaving 🐃🪒)
thcipriani updated subscribers of T281307: Yak:Train stats.
  • patch revisions/code review events
  • max patch dependency tree depth/total dependent patches
Wed, Apr 28, 12:43 AM · Deployments, Release-Engineering-Team (Yak Shaving 🐃🪒)

Tue, Apr 27

thcipriani created T281307: Yak:Train stats.
Tue, Apr 27, 8:14 PM · Deployments, Release-Engineering-Team (Yak Shaving 🐃🪒)

Mon, Apr 26

thcipriani closed T263547: Add link to risky change template to deployment blockers tasks as Resolved.
Mon, Apr 26, 9:07 PM · Release-Engineering-Team (Doing)
thcipriani added a comment to D1191: Blocker tasks: add additional links.

@thcipriani Shall I merge and deploy this?

Mon, Apr 26, 7:10 PM
thcipriani updated the diff for D1191: Blocker tasks: add additional links.

Make all links a list

Mon, Apr 26, 6:44 PM
thcipriani requested review of D1191: Blocker tasks: add additional links.
Mon, Apr 26, 6:41 PM
thcipriani assigned T281148: 1.37.0-wmf.7 deployment blockers to mmodell.
Mon, Apr 26, 3:23 PM · Release-Engineering-Team (Doing), Release, Train Deployments
thcipriani assigned T281147: 1.37.0-wmf.6 deployment blockers to hashar.
Mon, Apr 26, 3:23 PM · Release-Engineering-Team (Doing), Release, Train Deployments
thcipriani assigned T281146: 1.37.0-wmf.5 deployment blockers to dancy.
Mon, Apr 26, 3:19 PM · User-brennen, Release-Engineering-Team (Doing), Release, Train Deployments
thcipriani assigned T281145: 1.37.0-wmf.4 deployment blockers to brennen.
Mon, Apr 26, 3:18 PM · User-brennen, Release-Engineering-Team (Doing), Release, Train Deployments
thcipriani created T281168: 1.37.0-wmf.27 deployment blockers.
Mon, Apr 26, 3:15 PM · Release, Train Deployments
thcipriani created T281167: 1.37.0-wmf.26 deployment blockers.
Mon, Apr 26, 3:15 PM · Release, Train Deployments
thcipriani created T281166: 1.37.0-wmf.25 deployment blockers.
Mon, Apr 26, 3:15 PM · Release, Train Deployments