Page MenuHomePhabricator

SLyngshede-WMF (Simon Lyngshede)
User

Today

  • No visible events.

Tomorrow

  • No visible events.

Wednesday

  • No visible events.

User Details

User Since
May 2 2022, 11:51 AM (214 w, 3 h)
Availability
Available
LDAP User
Slyngshede
MediaWiki User
SLyngshede-WMF [ Global Accounts ]

Recent Activity

Wed, Jun 3

SLyngshede-WMF updated the task description for T427836: WE5.2.13 Dumps UA enforcement.
Wed, Jun 3, 9:16 AM · Patch-For-Review, SRE, Traffic

Mon, Jun 1

SLyngshede-WMF added a comment to T427792: Gerrit login denied.

We don't really log a ton in LDAP and most application (not sure how Gerrit does it) queries for the user and then validates the password internally.

Mon, Jun 1, 12:30 PM · Release-Engineering-Team (Doing 😎), Gerrit
SLyngshede-WMF created T427792: Gerrit login denied.
Mon, Jun 1, 10:33 AM · Release-Engineering-Team (Doing 😎), Gerrit

Wed, May 27

SLyngshede-WMF closed T426968: cp6015 network error as Resolved.
Wed, May 27, 9:03 AM · DC-Ops, ops-drmrs
SLyngshede-WMF added a comment to T426968: cp6015 network error.

I've done a few check and there isn't any reason to reimage the host.

Wed, May 27, 9:03 AM · DC-Ops, ops-drmrs

Fri, May 22

SLyngshede-WMF closed T420500: Requesting access to analytics_privatedata_users and SQL Lab for AnnieKim_WMDE as Resolved.
Fri, May 22, 10:24 AM · Patch-For-Review, Data-Engineering-Radar, Data-Engineering, SRE, SRE-Access-Requests
SLyngshede-WMF added a comment to T420500: Requesting access to analytics_privatedata_users and SQL Lab for AnnieKim_WMDE.

@AnnieKim_WMDE you should be getting an email with a temporary password and some instruction.

Fri, May 22, 10:24 AM · Patch-For-Review, Data-Engineering-Radar, Data-Engineering, SRE, SRE-Access-Requests
SLyngshede-WMF added a comment to T420500: Requesting access to analytics_privatedata_users and SQL Lab for AnnieKim_WMDE.

Key has been verified. I'll ping you once I have everything rolled out, shouldn't take long.

Fri, May 22, 8:25 AM · Patch-For-Review, Data-Engineering-Radar, Data-Engineering, SRE, SRE-Access-Requests
SLyngshede-WMF updated the task description for T420500: Requesting access to analytics_privatedata_users and SQL Lab for AnnieKim_WMDE.
Fri, May 22, 8:19 AM · Patch-For-Review, Data-Engineering-Radar, Data-Engineering, SRE, SRE-Access-Requests
SLyngshede-WMF added a comment to T420500: Requesting access to analytics_privatedata_users and SQL Lab for AnnieKim_WMDE.

@Martyn.ranyard is only for the SSH key :-)

Fri, May 22, 8:15 AM · Patch-For-Review, Data-Engineering-Radar, Data-Engineering, SRE, SRE-Access-Requests

Thu, May 21

SLyngshede-WMF created T426968: cp6015 network error.
Thu, May 21, 2:31 PM · DC-Ops, ops-drmrs
SLyngshede-WMF added a comment to T420500: Requesting access to analytics_privatedata_users and SQL Lab for AnnieKim_WMDE.

@Ottomata already approved.

Thu, May 21, 8:53 AM · Patch-For-Review, Data-Engineering-Radar, Data-Engineering, SRE, SRE-Access-Requests
SLyngshede-WMF updated the task description for T420500: Requesting access to analytics_privatedata_users and SQL Lab for AnnieKim_WMDE.
Thu, May 21, 8:52 AM · Patch-For-Review, Data-Engineering-Radar, Data-Engineering, SRE, SRE-Access-Requests
SLyngshede-WMF added a comment to T420500: Requesting access to analytics_privatedata_users and SQL Lab for AnnieKim_WMDE.

@Dzahn if you verified the ssh key out of band, then we can just restore your patch to data.yaml and create the Kerberos principal.
I can merge the patch and to create the principal, if you would just confirm that you verified the ssh key.

Thu, May 21, 8:50 AM · Patch-For-Review, Data-Engineering-Radar, Data-Engineering, SRE, SRE-Access-Requests

Wed, May 20

SLyngshede-WMF reopened T415454: TCP FastOpen not working since at least December 2025 as "Open".

@Cuthead Sorry, I'll just reopen this. I still need to do the second half of the caching servers, those that deals with upload.

Wed, May 20, 2:27 PM · SRE, Traffic

Tue, May 19

SLyngshede-WMF added a comment to T420500: Requesting access to analytics_privatedata_users and SQL Lab for AnnieKim_WMDE.

@AnnieKim_WMDE Hi, did you get the access you needed?

Tue, May 19, 10:50 AM · Patch-For-Review, Data-Engineering-Radar, Data-Engineering, SRE, SRE-Access-Requests
SLyngshede-WMF closed T426561: Requesting access to deployment for dsantamaria as Resolved.
Tue, May 19, 10:47 AM · SRE, SRE-Access-Requests
SLyngshede-WMF closed T356411: Make it clear which 2FA to use as Declined.
Tue, May 19, 9:05 AM · Bitu, Infrastructure-Foundations
SLyngshede-WMF updated the task description for T426561: Requesting access to deployment for dsantamaria.
Tue, May 19, 7:26 AM · SRE, SRE-Access-Requests

Mon, May 18

SLyngshede-WMF updated the task description for T426561: Requesting access to deployment for dsantamaria.
Mon, May 18, 2:52 PM · SRE, SRE-Access-Requests
SLyngshede-WMF claimed T425939: Newly added or suspended keys in Bitu is not reflecting in LDAP.
Mon, May 18, 12:41 PM · Infrastructure-Foundations, Bitu
SLyngshede-WMF changed the status of T426488: Could not resolve hostname bast5004.wikimedia.org: nodename nor servname provided, or not known from Invalid to Resolved.
Mon, May 18, 12:15 PM · Infrastructure-Foundations, SRE
SLyngshede-WMF added a comment to T426488: Could not resolve hostname bast5004.wikimedia.org: nodename nor servname provided, or not known.

Bastion host map has been updated.

Mon, May 18, 12:15 PM · Infrastructure-Foundations, SRE
SLyngshede-WMF closed T426488: Could not resolve hostname bast5004.wikimedia.org: nodename nor servname provided, or not known as Invalid.

That host no longer exists and have been replaced by bast5005.wikimedia.org

Mon, May 18, 12:12 PM · Infrastructure-Foundations, SRE
SLyngshede-WMF claimed T426561: Requesting access to deployment for dsantamaria.

SSH key verified out of band.

Mon, May 18, 8:23 AM · SRE, SRE-Access-Requests
SLyngshede-WMF updated the task description for T426561: Requesting access to deployment for dsantamaria.
Mon, May 18, 8:22 AM · SRE, SRE-Access-Requests
SLyngshede-WMF changed the status of T426561: Requesting access to deployment for dsantamaria from Open to In Progress.
Mon, May 18, 8:07 AM · SRE, SRE-Access-Requests
SLyngshede-WMF updated the task description for T426561: Requesting access to deployment for dsantamaria.
Mon, May 18, 8:07 AM · SRE, SRE-Access-Requests
SLyngshede-WMF updated subscribers of T426561: Requesting access to deployment for dsantamaria.

@thcipriani for your approval.

Mon, May 18, 8:04 AM · SRE, SRE-Access-Requests
SLyngshede-WMF updated the task description for T426561: Requesting access to deployment for dsantamaria.
Mon, May 18, 8:01 AM · SRE, SRE-Access-Requests
SLyngshede-WMF closed T426458: Grant Access to analytics-privatedata-users for zsinger as Resolved.

Hi @ZSinger-WMF access to the wmf group can be requests via https://idm.wikimedia.org/permissions/

Mon, May 18, 7:10 AM · SRE, SRE-Access-Requests
SLyngshede-WMF created T426556: Check home/HDFS leftovers of kgraessle.
Mon, May 18, 6:57 AM · Data-Platform-SRE

Wed, May 13

SLyngshede-WMF added a comment to T415454: TCP FastOpen not working since at least December 2025.

For testing I suggest rolling out to e.g. MAGRU first.
We can then test that cookies get set with

Wed, May 13, 1:05 PM · SRE, Traffic

Mon, May 11

SLyngshede-WMF added a comment to T425890: Degraded RAID on lvs2012.

Puppet currently fails to run and hasn't done so since May 10th, at 21:23

Mon, May 11, 9:05 AM · Traffic, SRE, ops-codfw, DC-Ops
SLyngshede-WMF added a comment to T425890: Degraded RAID on lvs2012.

Memory is also having issues

Mon, May 11, 9:04 AM · Traffic, SRE, ops-codfw, DC-Ops

May 6 2026

SLyngshede-WMF updated the task description for T424686: ulsfo switch work May 2026: Host reimaging.
May 6 2026, 2:54 PM · Infrastructure-Foundations, Traffic, DC-Ops
SLyngshede-WMF updated the task description for T424686: ulsfo switch work May 2026: Host reimaging.
May 6 2026, 2:16 PM · Infrastructure-Foundations, Traffic, DC-Ops
SLyngshede-WMF updated the task description for T424686: ulsfo switch work May 2026: Host reimaging.
May 6 2026, 12:19 PM · Infrastructure-Foundations, Traffic, DC-Ops
SLyngshede-WMF added a comment to T424686: ulsfo switch work May 2026: Host reimaging.

Same issue for cp4052:

May 6 2026, 12:18 PM · Infrastructure-Foundations, Traffic, DC-Ops
SLyngshede-WMF added a comment to T424686: ulsfo switch work May 2026: Host reimaging.

cp4046 refused to be reimaged and seems to be missing some configuration in Netbox from what I can tell. I've pinged @Papaul and asked to have it investigated as I'm not entirely sure how to fix it.

May 6 2026, 11:37 AM · Infrastructure-Foundations, Traffic, DC-Ops
SLyngshede-WMF updated the task description for T424686: ulsfo switch work May 2026: Host reimaging.
May 6 2026, 11:19 AM · Infrastructure-Foundations, Traffic, DC-Ops
SLyngshede-WMF updated the task description for T424686: ulsfo switch work May 2026: Host reimaging.
May 6 2026, 10:18 AM · Infrastructure-Foundations, Traffic, DC-Ops
SLyngshede-WMF added a comment to T424686: ulsfo switch work May 2026: Host reimaging.

Re-image command:

May 6 2026, 9:15 AM · Infrastructure-Foundations, Traffic, DC-Ops
SLyngshede-WMF claimed T424686: ulsfo switch work May 2026: Host reimaging.
May 6 2026, 8:58 AM · Infrastructure-Foundations, Traffic, DC-Ops

May 4 2026

SLyngshede-WMF added a comment to T408892: ULSFO: New switch configuration.

Depooling command output, for the records:

May 4 2026, 2:03 PM · Patch-For-Review, SRE, Infrastructure-Foundations, DC-Ops, netops, ops-ulsfo
SLyngshede-WMF added a comment to T408892: ULSFO: New switch configuration.

Minor error in command, should have been:

May 4 2026, 2:01 PM · Patch-For-Review, SRE, Infrastructure-Foundations, DC-Ops, netops, ops-ulsfo

Apr 29 2026

SLyngshede-WMF added a comment to T424686: ulsfo switch work May 2026: Host reimaging.

Only hosts in this one rack will be touched: https://netbox.wikimedia.org/dcim/racks/34/ but we'll depool the entire site before work starts.

Apr 29 2026, 1:24 PM · Infrastructure-Foundations, Traffic, DC-Ops
SLyngshede-WMF added a subtask for T408892: ULSFO: New switch configuration: T424686: ulsfo switch work May 2026: Host reimaging.
Apr 29 2026, 1:14 PM · Patch-For-Review, SRE, Infrastructure-Foundations, DC-Ops, netops, ops-ulsfo
SLyngshede-WMF added a parent task for T424686: ulsfo switch work May 2026: Host reimaging: T408892: ULSFO: New switch configuration.
Apr 29 2026, 1:14 PM · Infrastructure-Foundations, Traffic, DC-Ops
SLyngshede-WMF added a comment to T408892: ULSFO: New switch configuration.

Depooling command: (depool datacenter and depool dns4003)

Apr 29 2026, 9:37 AM · Patch-For-Review, SRE, Infrastructure-Foundations, DC-Ops, netops, ops-ulsfo

Apr 28 2026

SLyngshede-WMF triaged T424643: Create a #traffic-rate-limit tag as Low priority.

I'll bring the topic up at next traffic team meeting.

Apr 28 2026, 10:43 AM · Project-Admins
SLyngshede-WMF created T424643: Create a #traffic-rate-limit tag.
Apr 28 2026, 10:43 AM · Project-Admins

Apr 23 2026

SLyngshede-WMF updated the task description for T406495: Allow Bitu to link Phabricator account.
Apr 23 2026, 6:48 AM · Phabricator, collaboration-services, VPS-project-Phabricator, Infrastructure-Foundations, Bitu
SLyngshede-WMF closed T406495: Allow Bitu to link Phabricator account as Resolved.

@Dzahn Yes. We'll figure out if we need to write out to a broader group that the feature is available, but the feature is done and deployed.

Apr 23 2026, 6:48 AM · Phabricator, collaboration-services, VPS-project-Phabricator, Infrastructure-Foundations, Bitu
SLyngshede-WMF closed T406495: Allow Bitu to link Phabricator account, a subtask of T394908: Assign WMF-NDA group automatically, as Resolved.
Apr 23 2026, 6:47 AM · Infrastructure-Foundations, Bitu

Apr 21 2026

SLyngshede-WMF closed T411503: x-provenance header: identify WMCS, a subtask of T398919: Epic: API rate limiting dry run (WE5.1.3b), as Resolved.
Apr 21 2026, 10:30 AM · MediaWiki-Platform-Team (Kanban Board), Epic, OKR-Work
SLyngshede-WMF closed T411503: x-provenance header: identify WMCS as Resolved.
Apr 21 2026, 10:30 AM · Traffic
SLyngshede-WMF updated subscribers of T415454: TCP FastOpen not working since at least December 2025.

@Naruse_shiroha we're currently working on another task, related to TCP Fast Open. To make that work, this task will need to be completed first.

Apr 21 2026, 6:46 AM · SRE, Traffic

Apr 20 2026

SLyngshede-WMF added a comment to T419976: Upgrade redis_misc hosts to Debian Trixie (Redis 8.0).

CAS/IDP is now tested against Redis 8 locally. It all works perfectly.

Apr 20 2026, 11:12 AM · Patch-For-Review, Infrastructure-Foundations, ServiceOps new, MediaWiki-Platform-Team (Radar), ServiceOps-Datastores, MW-Interfaces-Team
SLyngshede-WMF added a comment to T419976: Upgrade redis_misc hosts to Debian Trixie (Redis 8.0).

Thank you! I will ping you. Any concerns regarding Redis 8?

Apr 20 2026, 7:47 AM · Patch-For-Review, Infrastructure-Foundations, ServiceOps new, MediaWiki-Platform-Team (Radar), ServiceOps-Datastores, MW-Interfaces-Team

Apr 16 2026

SLyngshede-WMF added a comment to T419976: Upgrade redis_misc hosts to Debian Trixie (Redis 8.0).

For IDP we do not need to migrate data, this is just session storage. The only downside is that people will need to sign back in.

Apr 16 2026, 6:54 AM · Patch-For-Review, Infrastructure-Foundations, ServiceOps new, MediaWiki-Platform-Team (Radar), ServiceOps-Datastores, MW-Interfaces-Team

Apr 8 2026

SLyngshede-WMF claimed T422203: CAS login page overflows on iOS Safari (iPhone 16e).
Apr 8 2026, 7:53 AM · Infrastructure-Foundations, CAS-SSO
SLyngshede-WMF changed the status of T422203: CAS login page overflows on iOS Safari (iPhone 16e) from Open to In Progress.
Apr 8 2026, 7:53 AM · Infrastructure-Foundations, CAS-SSO

Apr 7 2026

SLyngshede-WMF claimed T422203: CAS login page overflows on iOS Safari (iPhone 16e).
Apr 7 2026, 2:31 PM · Infrastructure-Foundations, CAS-SSO

Mar 26 2026

SLyngshede-WMF closed T411584: Refresh trafficserver_backend_requests_seconds histogram as Resolved.
Mar 26 2026, 9:18 AM · Traffic

Mar 18 2026

SLyngshede-WMF closed T418971: ULSFO: Update ULSFO LVS service IP's, a subtask of T418993: Migrating ulsfo to routed Ganeti, as Resolved.
Mar 18 2026, 10:07 AM · Patch-For-Review, collaboration-services, Ganeti, Infrastructure-Foundations, SRE
SLyngshede-WMF closed T418971: ULSFO: Update ULSFO LVS service IP's as Resolved.

@Papaul Done :-)

Mar 18 2026, 10:07 AM · SRE, Infrastructure-Foundations, DC-Ops, netops, ops-ulsfo

Mar 16 2026

SLyngshede-WMF closed T401731: Permission request emails need additional line breaks as Resolved.

This should be fixed, not that we correct add an HTML formatted email to the html mime-type.

Mar 16 2026, 11:27 AM · Infrastructure-Foundations, Bitu
SLyngshede-WMF closed T404494: after logging into Netbox, NDAs see an empty dashboard as Resolved.
Mar 16 2026, 11:23 AM · Regression, Infrastructure-Foundations, netbox

Mar 9 2026

SLyngshede-WMF triaged T419419: Upgrade Apereo CAS to version 7.3 series as Low priority.
Mar 9 2026, 12:56 PM · Infrastructure-Foundations, CAS-SSO
SLyngshede-WMF created T419419: Upgrade Apereo CAS to version 7.3 series.
Mar 9 2026, 12:56 PM · Infrastructure-Foundations, CAS-SSO

Mar 5 2026

SLyngshede-WMF closed T416152: Bitu permission requests should expire after X days as Resolved.
Mar 5 2026, 12:08 PM · Bitu, Infrastructure-Foundations

Mar 4 2026

SLyngshede-WMF closed T418201: wikimedia-l was signed up for a developer account as Resolved.
Mar 4 2026, 11:43 AM · SRE, Bitu, Infrastructure-Foundations

Mar 3 2026

SLyngshede-WMF closed T416565: Bitu group approval emails are hard to read because of an unformatted text/html part as Resolved.
Mar 3 2026, 12:23 PM · Infrastructure-Foundations, Bitu
SLyngshede-WMF closed T372247: Bitu captcha reload button reloads entire web page as Resolved.

Fixed

Mar 3 2026, 12:23 PM · Infrastructure-Foundations, Bitu
SLyngshede-WMF closed T416898: Tell folks to logout & login on gitlab.wikimedia.org after changing their email address as Resolved.
Mar 3 2026, 12:22 PM · Infrastructure-Foundations, Documentation, Bitu
SLyngshede-WMF triaged T418843: Bitu: When expiring a permission request log reason as Medium priority.
Mar 3 2026, 10:46 AM · Infrastructure-Foundations, Bitu
SLyngshede-WMF created T418843: Bitu: When expiring a permission request log reason.
Mar 3 2026, 10:46 AM · Infrastructure-Foundations, Bitu

Mar 2 2026

SLyngshede-WMF changed the status of T418201: wikimedia-l was signed up for a developer account from Open to In Progress.
Mar 2 2026, 3:19 PM · SRE, Bitu, Infrastructure-Foundations
SLyngshede-WMF claimed T411584: Refresh trafficserver_backend_requests_seconds histogram.
Mar 2 2026, 11:22 AM · Traffic
SLyngshede-WMF changed the status of T411584: Refresh trafficserver_backend_requests_seconds histogram from Open to In Progress.
Mar 2 2026, 11:22 AM · Traffic
SLyngshede-WMF added a comment to T411584: Refresh trafficserver_backend_requests_seconds histogram.

Notes to myself, for deployment:

Mar 2 2026, 10:11 AM · Traffic
SLyngshede-WMF added a comment to T418068: Request to deactivate/disable AndreiJirohOnDevsCentral LDAP dev account.

@A_smart_kitten I think that's fair, disabling an account isn't exactly hard.

Mar 2 2026, 8:11 AM · Infrastructure-Foundations, Infrastructure Security, SRE, LDAP-Access-Requests

Feb 26 2026

SLyngshede-WMF added a comment to T418068: Request to deactivate/disable AndreiJirohOnDevsCentral LDAP dev account.

We normally don't disable accounts, just remove any special privileges.

Feb 26 2026, 4:02 PM · Infrastructure-Foundations, Infrastructure Security, SRE, LDAP-Access-Requests
SLyngshede-WMF changed the status of T338214: IDP: add policy to release given name from Open to In Progress.
Feb 26 2026, 9:13 AM · Patch-For-Review, Infrastructure-Foundations, CAS-SSO

Feb 24 2026

SLyngshede-WMF added a comment to T418161: Reimage cp20[43-58] to Trixie.

I'm getting an RAID error

Feb 24 2026, 2:36 PM · Traffic
SLyngshede-WMF claimed T418201: wikimedia-l was signed up for a developer account.

I've disabled the account.

Feb 24 2026, 8:16 AM · SRE, Bitu, Infrastructure-Foundations

Feb 23 2026

SLyngshede-WMF claimed T417946: Workflow for linking Phabricator account to Developer account returns to /permissions/, not /ldapbackend/properties/.
Feb 23 2026, 3:13 PM · Infrastructure-Foundations, Bitu
SLyngshede-WMF changed the status of T416898: Tell folks to logout & login on gitlab.wikimedia.org after changing their email address from Open to In Progress.
Feb 23 2026, 2:02 PM · Infrastructure-Foundations, Documentation, Bitu
SLyngshede-WMF claimed T418040: Inconsistency in messaging and trailing full stops.
Feb 23 2026, 8:08 AM · Infrastructure-Foundations, Bitu

Feb 16 2026

SLyngshede-WMF claimed T416898: Tell folks to logout & login on gitlab.wikimedia.org after changing their email address.
Feb 16 2026, 3:42 PM · Infrastructure-Foundations, Documentation, Bitu

Feb 13 2026

SLyngshede-WMF added a comment to T401832: Upgrade Traffic hosts to trixie.

@BCornwall We currently have two hosts:

Feb 13 2026, 8:06 AM · Traffic

Feb 10 2026

SLyngshede-WMF added a comment to T270233: Can't login into Gerrit with a Wikimedia Developer account with non-unique email address.

@Tgr do we want to do any more work on this task? If not I'll go a head and close it.

Feb 10 2026, 1:50 PM · Infrastructure-Foundations, Bitu, Gerrit
SLyngshede-WMF closed T406455: Upgrade Apereo CAS to version 7.2 as Resolved.
Feb 10 2026, 1:46 PM · Patch-For-Review, Infrastructure-Foundations, CAS-SSO

Feb 9 2026

SLyngshede-WMF changed the status of T416152: Bitu permission requests should expire after X days from Open to In Progress.
Feb 9 2026, 3:23 PM · Bitu, Infrastructure-Foundations

Feb 6 2026

SLyngshede-WMF changed the status of T416565: Bitu group approval emails are hard to read because of an unformatted text/html part from Open to In Progress.

Oh, yeah that look annoying.

Feb 6 2026, 12:11 PM · Infrastructure-Foundations, Bitu
SLyngshede-WMF added a subtask for T406495: Allow Bitu to link Phabricator account: T416668: Phabricator OAuth2 token for IDM.
Feb 6 2026, 10:25 AM · Phabricator, collaboration-services, VPS-project-Phabricator, Infrastructure-Foundations, Bitu
SLyngshede-WMF added a subtask for T411775: Phabricator OAuth2 token for IDM-Test: T416668: Phabricator OAuth2 token for IDM.
Feb 6 2026, 10:25 AM · Essential-Work, Release-Engineering-Team (Doing 😎), Phabricator, Infrastructure-Foundations, Bitu
SLyngshede-WMF added parent tasks for T416668: Phabricator OAuth2 token for IDM: T406495: Allow Bitu to link Phabricator account, T411775: Phabricator OAuth2 token for IDM-Test.
Feb 6 2026, 10:25 AM · Essential-Work, Release-Engineering-Team (Doing 😎), Phabricator, Infrastructure-Foundations, Bitu
SLyngshede-WMF created T416668: Phabricator OAuth2 token for IDM.
Feb 6 2026, 10:24 AM · Essential-Work, Release-Engineering-Team (Doing 😎), Phabricator, Infrastructure-Foundations, Bitu