User Details
User Details
- User Since
- Aug 31 2020, 5:40 PM (310 w, 4 d)
- Availability
- Available
- LDAP User
- LSobanski
- MediaWiki User
- LSobanski (WMF) [ Global Accounts ]
Yesterday
Yesterday
LSobanski moved T378769: scap / puppet dependency issue on reimaged phabricator hosts from Incoming to Backlog on the Collaboration-Services board.
LSobanski placed T378769: scap / puppet dependency issue on reimaged phabricator hosts up for grabs.
Confirmed with @Arnoldokoth that this is still a problem. I think there's more value in pursuing single-method deployment or migration to Docker than there is in fixing this, leaving it around as Low priority.
LSobanski moved T434744: Failed email communication for an User account from Backlog to Incoming on the Infrastructure-Foundations board.
LSobanski added a comment to T425441: gitlab behind CDN.
Calling this out explicitly so it doesn't get lost in the list of changes: @ABran-WMF disabled the legacy nftables throttling on the replicas as it was causing envoy timeouts, see https://gerrit.wikimedia.org/r/c/operations/puppet/+/1325454.
Wed, Aug 12
Wed, Aug 12
LSobanski removed projects from T255733: Forward emails addressed to privacy@wikidata to privacy@wikimedia: Infrastructure-Foundations, SRE.
LSobanski removed a project from T431826: July 2026 Bookworm/Trixie reboots: Data Platform SRE: Infrastructure-Foundations.
LSobanski removed a project from T303725: Extend NEL headers to sites not fronted by CDN: Collaboration-Services.
No longer applicable for GitLab, untagging Collab.
LSobanski removed a project from T347895: Redirect DSG to Codex's Style Guide : Collaboration-Services.
Untagging Collab, please add us back when this is ready for our action.
LSobanski removed a project from T393376: Automatically abandon old changes after some time: Collaboration-Services.
LSobanski moved T378769: scap / puppet dependency issue on reimaged phabricator hosts from Consultation to Incoming on the Collaboration-Services board.
LSobanski moved T417139: Investigate DNS race condition from Consultation to Incoming on the Collaboration-Services board.
LSobanski updated subscribers of T417139: Investigate DNS race condition.
@ABran-WMF can this be closed now?
LSobanski moved T430775: Validate Gerrit backup recoverability after the fileset exclusions from Backlog to Incoming on the Collaboration-Services board.
LSobanski moved T433926: Backup Gerrit with LVM snapshots and Bacula pre/post job hooks from Backlog to Incoming on the Collaboration-Services board.
LSobanski updated the task description for T387831: Standardize failover procedures for Collab services.
LSobanski moved T429636: create test instance for releases-jenkins from Work in Progress to Up Next on the Collaboration-Services board.
LSobanski closed T431582: contint1003 is missing docker-buildx / auth to registry fails, causing blubber-based CI pipelines to fail as Resolved.
Optimistically resolving.
We won't be working on this.
LSobanski moved T431003: zuul-client encrypt fails to retrieve public key from Work in Progress to Backlog on the Collaboration-Services board.
LSobanski changed the status of T431003: zuul-client encrypt fails to retrieve public key, a subtask of T430479: Zuul executor can not reach WMCS OpenStack API, from Open to Stalled.
LSobanski changed the status of T431003: zuul-client encrypt fails to retrieve public key from Open to Stalled.
LSobanski moved T433916: Enable cumin hostfile backend on cloudcumin hosts from Backlog to Incoming on the Infrastructure-Foundations board.
LSobanski moved T433980: PCC: no nodes found for class: Class/Role::Jenkins from Backlog to Incoming on the Infrastructure-Foundations board.
LSobanski moved T434068: ulsfo: upgrade switches to SR-Linux 26.7 from Backlog to Incoming on the Infrastructure-Foundations board.
LSobanski moved T434070: codfw: upgrade Nokia E/F switches to SR-Linux 26.7 from Backlog to Incoming on the Infrastructure-Foundations board.
LSobanski moved T434517: Quick all-drive wipe option durinng provisioning from Backlog to Incoming on the Infrastructure-Foundations board.
LSobanski moved T434519: Fleet-wide firmware details reporting from Backlog to Incoming on the Infrastructure-Foundations board.
LSobanski triaged T434268: pki1002 became unresponsive causing several hosts to alert on failed puppet runs. as Medium priority.
LSobanski changed the status of T434268: pki1002 became unresponsive causing several hosts to alert on failed puppet runs. from Open to In Progress.
LSobanski changed the status of T434268: pki1002 became unresponsive causing several hosts to alert on failed puppet runs., a subtask of T342892: Q1:rack/setup/install pki1002, from Open to In Progress.
LSobanski updated subscribers of T434268: pki1002 became unresponsive causing several hosts to alert on failed puppet runs..
@MoritzMuehlenhoff, can you suggest a time for a depool and firmware upgrade?
LSobanski moved T434631: Integrate Bookworm 12.15 point update from Backlog to Incoming on the Infrastructure-Foundations board.
LSobanski moved T430938: Superset data access request for abibendall from Backlog to Awaiting Input on the Infrastructure-Foundations board.
LSobanski moved T408704: offline rackspace wikitech-static, online aws wikitech-static from Backlog to Awaiting Input on the Infrastructure-Foundations board.
LSobanski added a comment to T408704: offline rackspace wikitech-static, online aws wikitech-static.
@RobH Any luck with this?
LSobanski changed the status of T418012: eqiad row A/B switch refresh prep from Open to In Progress.
LSobanski changed the status of Restricted Task, a subtask of T426720: May 2026 SRE reboots, from Open to In Progress.
LSobanski changed the status of Restricted Task, a subtask of T426720: May 2026 SRE reboots, from Open to In Progress.
LSobanski lowered the priority of T433171: translatewiki.net: translation support for https://gerrit.wikimedia.org/r/operations/software/mailman-templates may be dropped due to inactivity from High to Medium.
We'll have to look into the best way to set up automated packaging, this would likely involve migrating the package to GitLab. I'll get back to you with a plan in the foreseeable future.
Tue, Aug 11
Tue, Aug 11
LSobanski added a comment to T177826: Upgrade CI Jenkins ssh key to ecdsa .
@hashar any updates on this one?
The host has been rebooted since (uptime is 31 days), @Jhancock.wm could you confirm is the warning light is still present?
LSobanski added a comment to T409903: Bitergia crawler bot runs into errors collection GitLab data.
@Aklapper could you take a look?
LSobanski moved T417996: Fix up Gerrit sshd.idleTimeout from Awaiting Input to Backlog on the Collaboration-Services board.
LSobanski changed the status of T422070: GitlabPackagePullerFailedOnRun - apt-staging2001:9100 from Open to Stalled.
Stalled until Nat is available to comment.
LSobanski added a comment to T430900: Enable Zuul OpenTelemetry tracing.
We now have large hosts available for Zuul in eqiad.
LSobanski moved T434133: gerrit reviewer-bot should trust global SSH known_hosts from Incoming to Backlog on the Collaboration-Services board.
LSobanski moved T434261: upgrade doc hosts to trixie from Incoming to Backlog on the Collaboration-Services board.
LSobanski triaged T434151: OOUI PHP demos page on doc.wikimedia.org does not load due to old PHP version as Low priority.
LSobanski added a comment to T433171: translatewiki.net: translation support for https://gerrit.wikimedia.org/r/operations/software/mailman-templates may be dropped due to inactivity.
@siebrand with the additional information, is this still high priority and at risk of removal from your side?
LSobanski added a comment to T402300: Add blacklist/whitelist for alerts that don’t need triaging.
Hi, are there any plans to work on this anytime soon? It would be very helpful in cleaning up the alert triage board.
LSobanski triaged T433988: Deploying Phab/Phorge in devtools to new Trixie instance does not restart PHP 8.4 as High priority.
Thu, Aug 6
Thu, Aug 6
LSobanski removed a project from T425083: archiva1002 has stale jobs in /var/cache/archiva that uses all the disk space: Collaboration-Services.
I'm not aware of Collab's involvement with Archiva other than past discussions about migrating to Gitlab. Removing our team tag, please re-add it if there is something we can help with.
LSobanski moved T434003: PuppetFailure - phab1005 from Incoming to Work in Progress on the Collaboration-Services board.
Wed, Aug 5
Wed, Aug 5
LSobanski updated subscribers of T433980: PCC: no nodes found for class: Class/Role::Jenkins.
cc @Dzahn
Mon, Aug 3
Mon, Aug 3
LSobanski lowered the priority of T402396: Phab Aphlict Notification Servers config shows Connection error from Medium to Low.
LSobanski moved T433268: Zuul failover process from Incoming to Backlog on the Collaboration-Services board.
LSobanski added a comment to T432642: eqiad row A&B host migration details request for Collaboration Services.
@RobH what's the next expected step with this task?
LSobanski moved T433589: helmfile prints broken helm get command from Incoming to Backlog on the Collaboration-Services board.
LSobanski triaged T433588: helmfile apply with new values*.yaml file did not deploy new k8s pods as High priority.
I don't see Collab working on this any time soon.
LSobanski removed a project from T433239: Clean up puppet repo from parsoidtest* and testreduce*: Infrastructure-Foundations.
LSobanski triaged T433810: Flapping SystemdUnitFailed: generate_vrts_aliases.service on mx-in2001 as Medium priority.
LSobanski lowered the priority of T433830: apt.wikimedia.org should be available over IPv6 from Medium to Low.
LSobanski added a comment to T433316: eqiad/codfw: 2 VM request for codesearch.
Approved.
LSobanski added a comment to T433239: Clean up puppet repo from parsoidtest* and testreduce*.
Untagging Infrastructure-Foundations, please add us back if needed.
LSobanski updated subscribers of T433810: Flapping SystemdUnitFailed: generate_vrts_aliases.service on mx-in2001.
LSobanski updated subscribers of T279108: Introduce a Front-end Build Step for MediaWiki Skins and Extensions.
@MGoncalves-WMF could I ask you to clarify what is the ask for SRE here?
Wed, Jul 29
Wed, Jul 29
LSobanski updated subscribers of T357756: Cookbook sre.hardware.upgrade-firmware fails to get firmwares from Dell's website.
Untagging Infrastructure-Foundations. @wiki_willy could you take a look at updating the documentation mentioned by Jaime?
LSobanski lowered the priority of T344972: sre.ganeti.makevm: Create machine types from Medium to Low.