In T347623#9322202, @LSobanski wrote:

@BCornwall For operations/software/varnish, looks like it should just be archived and not migrated? Let me know if that's the case.

Mon, Nov 13, 5:17 PM · Patch-For-Review, GitLab (Project Migration), Traffic

ssingh awarded T351084: Alert in need of triage: PuppetConstantChange (instance pybal-test2003:9100) a Orange Medal token.

Mon, Nov 13, 4:50 PM · Traffic

BCornwall closed T351084: Alert in need of triage: PuppetConstantChange (instance pybal-test2003:9100) as Resolved.

Mon, Nov 13, 4:48 PM · Traffic

Thu, Nov 9

BCornwall updated the task description for T347623: Migrate Traffic repositories from Gerrit to Gitlab.

Thu, Nov 9, 11:28 PM · Patch-For-Review, GitLab (Project Migration), Traffic

BCornwall updated the task description for T347623: Migrate Traffic repositories from Gerrit to Gitlab.

Thu, Nov 9, 10:35 PM · Patch-For-Review, GitLab (Project Migration), Traffic

BCornwall updated the task description for T347623: Migrate Traffic repositories from Gerrit to Gitlab.

Thu, Nov 9, 8:18 PM · Patch-For-Review, GitLab (Project Migration), Traffic

BCornwall removed a project from T347623: Migrate Traffic repositories from Gerrit to Gitlab: SRE.

Thu, Nov 9, 8:11 PM · Patch-For-Review, GitLab (Project Migration), Traffic

BCornwall updated the task description for T347623: Migrate Traffic repositories from Gerrit to Gitlab.

Thu, Nov 9, 6:43 PM · Patch-For-Review, GitLab (Project Migration), Traffic

BCornwall removed a project from T342154: Upgrade Traffic hosts to bookworm: SRE.

Thu, Nov 9, 5:28 PM · Patch-For-Review, Traffic

Wed, Nov 8

BCornwall added a comment to T347623: Migrate Traffic repositories from Gerrit to Gitlab.

Yes, indeed! Thanks for pointing that out.

Wed, Nov 8, 8:49 PM · Patch-For-Review, GitLab (Project Migration), Traffic

BCornwall updated the task description for T347623: Migrate Traffic repositories from Gerrit to Gitlab.

Wed, Nov 8, 8:38 PM · Patch-For-Review, GitLab (Project Migration), Traffic

BCornwall updated the task description for T342154: Upgrade Traffic hosts to bookworm.

Wed, Nov 8, 8:37 PM · Patch-For-Review, Traffic

BCornwall updated the task description for T342154: Upgrade Traffic hosts to bookworm.

Wed, Nov 8, 7:52 PM · Patch-For-Review, Traffic

Nov 2 2023

BCornwall updated the image for Traffic-Icebox from F41433993: profile to F41433997: profile.

Nov 2 2023, 8:04 PM

BCornwall updated the image for Traffic-Icebox from F36992599: profile to F41433993: profile.

Nov 2 2023, 8:01 PM

BCornwall removed a project from T346305: Move purged repository from Gerrit to GitLab: SRE.

Nov 2 2023, 7:59 PM · GitLab (Project Migration), Traffic

BCornwall removed a project from T350396: Refactoring and some other work on purged: SRE.

Nov 2 2023, 7:59 PM · Traffic

BCornwall moved T270618: Create Generalised blocking strategy from Icebox-Temp to Radar/Not for service by Traffic on the Traffic board.

Nov 2 2023, 3:58 PM · Traffic, Infrastructure-Foundations, netops

BCornwall edited projects for T270618: Create Generalised blocking strategy, added: Traffic; removed Traffic-Icebox, SRE.

Nov 2 2023, 3:58 PM · Traffic, Infrastructure-Foundations, netops

BCornwall moved T341548: Investigate ATS/Varnish serving stall/cached Zuul status json from Backlog to Radar/Not for service by Traffic on the Traffic board.

Nov 2 2023, 3:46 PM · SRE, Traffic, Continuous-Integration-Infrastructure, Release-Engineering-Team

BCornwall edited projects for T341548: Investigate ATS/Varnish serving stall/cached Zuul status json , added: Traffic; removed Traffic-Icebox.

Nov 2 2023, 3:45 PM · SRE, Traffic, Continuous-Integration-Infrastructure, Release-Engineering-Team

BCornwall moved T117618: Add restrictive CSP to upload.wikimedia.org from Icebox-Temp to Backlog on the Traffic board.

Nov 2 2023, 12:01 AM · Traffic, Patch-Needs-Improvement, ContentSecurityPolicy, WMF-General-or-Unknown, Security-Team

BCornwall edited projects for T117618: Add restrictive CSP to upload.wikimedia.org, added: Traffic; removed Traffic-Icebox, SRE.

Nov 2 2023, 12:01 AM · Traffic, Patch-Needs-Improvement, ContentSecurityPolicy, WMF-General-or-Unknown, Security-Team

Nov 1 2023

BCornwall reopened T177742: Investigate Chrony as a replacement for ISC ntpd as "Open".

Looks like the desire to move to chrony is still there as it was recently discussed in traffic's circle

Nov 1 2023, 11:55 PM · Traffic, User-MoritzMuehlenhoff

BCornwall moved T177742: Investigate Chrony as a replacement for ISC ntpd from Icebox-Temp to Backlog on the Traffic board.

Nov 1 2023, 11:55 PM · Traffic, User-MoritzMuehlenhoff

BCornwall closed T150673: Thumb API: Varnish / CDN questions as Invalid.

Closing as this was not actionable. For the future, please contact the team at https://wikitech.wikimedia.org/wiki/SRE/Traffic for any questions.

Nov 1 2023, 11:39 PM · Traffic-Icebox, Platform Team Legacy (Designing), Services (designing), SRE, RESTBase-API, Multimedia

BCornwall closed T150673: Thumb API: Varnish / CDN questions, a subtask of T66214: Define an official thumb API, as Invalid.

Nov 1 2023, 11:38 PM · serviceops-radar, API Platform, Parsoid (Tracking), TechCom-RFC (TechCom-RFC-Closed), Platform Team Legacy (Watching / External), Product-Infrastructure-Team-Backlog-Deprecated, Services (watching), Reading Epics (Thumbnails), Wikipedia-Android-App-Backlog, Reading-Admin, Commons, Epic, Multimedia, MediaWiki-File-management

BCornwall removed projects from T156462: Framework to transfer files over the LAN: Traffic-Icebox, SRE.

Nov 1 2023, 11:32 PM · DBA

BCornwall closed T175636: prometheus -> grafana stats for per-numa-node meminfo as Resolved.

Nov 1 2023, 11:32 PM · Traffic-Icebox, observability, SRE

BCornwall removed projects from T169765: pybal should automatically reconnect to etcd: Traffic-Icebox, SRE.

Untagging traffic as we've agreed on not adding any new functionality in pybal. This will still be tracked in the collection of issues for the pybal project, however.

Nov 1 2023, 11:31 PM · Traffic, PyBal

BCornwall closed T177742: Investigate Chrony as a replacement for ISC ntpd as Invalid.

Since we're using systemd's timesyncd nowadays, so this isn't relevant any more. If I'm wrong, please do re-open.

Nov 1 2023, 11:30 PM · Traffic, User-MoritzMuehlenhoff

BCornwall added a comment to T183554: Unified certs bloat reduction?.

@BBlack Is this something we still want to pursue? I'd fight for moving this discussion to e.g. email or some other discussion medium where there could be some engagement and leaving actionables for phab.

Nov 1 2023, 11:27 PM · Traffic-Icebox, SRE

BCornwall removed a project from T231086: Picture from Commons not found from Singapore: Traffic-Icebox.

Nov 1 2023, 11:25 PM · SRE-Sprint-Week-Sustainability-March2023, Data-Persistence, Sustainability (Incident Followup), Structured-Data-Backlog, Structured Data Engineering, Multimedia, MW-1.34-notes (1.34.0-wmf.21; 2019-09-03), Patch-For-Review, Commons, MediaWiki-File-management, SRE-swift-storage

BCornwall closed T238085: Depooling single text caching server in esams had a disproportionate performance impact as Invalid.

Closing due to age and apparent non-recurrence since then. Please re-open if this is still an issue. Thanks!

Nov 1 2023, 11:19 PM · Traffic-Icebox, SRE

BCornwall changed the status of T238305: Servers freezing across the caching cluster from Open to Stalled.

@Vgutierrez I'm guessing this is no longer an issue?

Nov 1 2023, 11:17 PM · Traffic-Icebox, SRE

BCornwall closed T242952: traffic_server crash upon Lua reload: attempt to concatenate a table value as Invalid.

Closing due to age and lack of response. If this is still occurring let's reopen.

Nov 1 2023, 11:17 PM · Traffic-Icebox, SRE

BCornwall closed T241233: ats-be: consider increasing accept threads or moving accept from dedicated thread to workers as Declined.

Considering this is four years old and hasn't been visited, this isn't worth keeping around. If we notice such a thing again and want to improve it we can re-open

Nov 1 2023, 11:15 PM · Traffic-Icebox, SRE

BCornwall closed T246902: switch to irate() instead of rate() for traffic graphs as Invalid.

Thanks for creating this ticket. Unfortunately, this is unable to be serviced due to insufficient information. Please do re-open if it can be given. Thanks!

Nov 1 2023, 11:08 PM · Traffic-Icebox, SRE

BCornwall placed T218618: Add no-transform to Cache-Control header up for grabs.

Nov 1 2023, 11:02 PM · Patch-For-Review, Traffic, WMF-Legal, Privacy

BCornwall moved T277553: varnishkafka / ATSkafka should support setting the kafka message timestamp from Icebox-Temp to Backlog on the Traffic board.

Nov 1 2023, 11:01 PM · Data-Engineering, Traffic

BCornwall lowered the priority of T247618: Track WMF owned non-canonical domains from Medium to Low.

Nov 1 2023, 11:00 PM · Traffic

BCornwall moved T247618: Track WMF owned non-canonical domains from Some old column to Backlog on the Traffic board.

Nov 1 2023, 11:00 PM · Traffic

BCornwall closed T248938: ATS ts_lua coredumps on config reload as Resolved.

Since the patch has long since been merged and we're well upgraded, assuming this is fixed.

Nov 1 2023, 10:59 PM · Traffic-Icebox, SRE

BCornwall changed the status of T273737: Get traffic team green light for Cloud NAT to wikis change, a subtask of T209011: Change routing to ensure that traffic originating from Cloud VPS is seen as non-private IPs by Wikimedia wikis, from Open to Stalled.

Nov 1 2023, 10:52 PM · Patch-Needs-Improvement, cloud-services-team, Cloud-VPS

BCornwall changed the status of T273737: Get traffic team green light for Cloud NAT to wikis change from Open to Stalled.

@BBlack is this something we still want to pursue?

Nov 1 2023, 10:52 PM · cloud-services-team, Traffic-Icebox, Cloud-VPS

BCornwall closed T252993: prometheus-trafficserver-exporter: InsecureRequestWarning as Declined.

This warning is no long longer applicable since we've moved away from ats-tls. For good measure I verified that the error message does not manifest in any of the cp instances any more.

Nov 1 2023, 8:39 PM · Traffic-Icebox, observability, SRE

BCornwall moved T270618: Create Generalised blocking strategy from Revive/Active? to Roadmap on the Traffic-Icebox board.

Nov 1 2023, 8:34 PM · Traffic, Infrastructure-Foundations, netops

BCornwall moved T270391: varnish filtering: should we automatically update public_cloud_nets from Icebox-Temp to Radar/Not for service by Traffic on the Traffic board.

Nov 1 2023, 8:31 PM · Traffic, Infrastructure-Foundations, User-jbond, netops

BCornwall edited projects for T270391: varnish filtering: should we automatically update public_cloud_nets , added: Traffic; removed Traffic-Icebox, SRE.

Nov 1 2023, 8:31 PM · Traffic, Infrastructure-Foundations, User-jbond, netops

BCornwall added a comment to T270618: Create Generalised blocking strategy.

Thank you for all the work on this ticket and for creating it. I notice that this is a very broad topic and think it would be better if we close this and create smaller tickets with more focused scope.

Nov 1 2023, 8:28 PM · Traffic, Infrastructure-Foundations, netops

BCornwall edited projects for T350179: Reimage cookbook on new eqiad hosts stuck at PXE booting, added: DC-Ops; removed SRE.

Nov 1 2023, 7:01 PM · SRE-swift-storage, ops-codfw, DC-Ops, ops-eqiad

BCornwall updated the task description for T349244: Q1:Install cp11[00-15] and rotate into production.

Nov 1 2023, 6:01 PM · ops-eqiad, DC-Ops, Traffic, SRE

BCornwall updated the task description for T349244: Q1:Install cp11[00-15] and rotate into production.

Nov 1 2023, 4:51 PM · ops-eqiad, DC-Ops, Traffic, SRE