Page MenuHomePhabricator
Feed All Stories

Sep 16 2020

gerritbot added a comment to T255835: Make pipelinelib able to update deployment chart image tags.

Change 622231 merged by jenkins-bot:
[integration/pipelinelib@master] Enable deployment-charts update for published image

Sep 16 2020, 6:21 PM · Patch-For-Review, Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1)), Release Pipeline, Release-Engineering-Team (Pipeline)
jbolorinos-ctr closed T261879: Monthly convert other amount orphan text , a subtask of T261698: 2020-09-02 en6C pre-test: mobile large batch, as Declined.
Sep 16 2020, 6:21 PM · Wikimedia-Fundraising-Banners
jbolorinos-ctr closed T261879: Monthly convert other amount orphan text as Declined.

Closing as Declined, since this is a non-issue

Sep 16 2020, 6:21 PM · Wikimedia-Fundraising-Banners
gerritbot added a comment to T247441: move 20 new codfw parsoid servers (parse2*) into production.

Change 579026 abandoned by Dzahn:
[operations/puppet@production] move 20 new codfw parsoid servers into production

Sep 16 2020, 6:20 PM · serviceops, Operations
ppelberg moved T223499: Write query for Editing Team to access contributors makeup from Backlog to Analytics on the Editing-team (Tracking) board.
Sep 16 2020, 6:18 PM · Product-Analytics (Kanban), Editing-team (Tracking)
ppelberg edited projects for T223499: Write query for Editing Team to access contributors makeup, added: Editing-team (Tracking); removed VisualEditor.
Sep 16 2020, 6:18 PM · Product-Analytics (Kanban), Editing-team (Tracking)
Reedy added a comment to T263045: Favicon not appearing.

FWIW, it's more than just the favicon. These also 404

Sep 16 2020, 6:18 PM · Platform Team Sprints Board (Sprint 4), Patch-For-Review, Platform Team Workboards (Green), Platform Team Initiatives (API Gateway)
jijiki triaged T261009: Reproduce opcache corruptions in production as Low priority.
Sep 16 2020, 6:18 PM · User-jijiki, serviceops, Operations
Jdlrobson updated subscribers of T263047: Uncaught TypeError: Cannot read property 'node' of undefined.
Sep 16 2020, 6:18 PM · MW-1.36-notes (1.36.0-wmf.10; 2020-09-22), JavaScript, User-brennen, Regression, Wikimedia-production-error, Performance-Team, MediaWiki-extensions-NavigationTiming
RhinosF1 triaged T263047: Uncaught TypeError: Cannot read property 'node' of undefined as Unbreak Now! priority.

Blocker ---> UBN!

Sep 16 2020, 6:18 PM · MW-1.36-notes (1.36.0-wmf.10; 2020-09-22), JavaScript, User-brennen, Regression, Wikimedia-production-error, Performance-Team, MediaWiki-extensions-NavigationTiming
Jdlrobson updated the task description for T263047: Uncaught TypeError: Cannot read property 'node' of undefined.
Sep 16 2020, 6:18 PM · MW-1.36-notes (1.36.0-wmf.10; 2020-09-22), JavaScript, User-brennen, Regression, Wikimedia-production-error, Performance-Team, MediaWiki-extensions-NavigationTiming
jijiki changed the status of T261009: Reproduce opcache corruptions in production , a subtask of T253673: Avoid php-opcache corruption in WMF production, from Open to Stalled.
Sep 16 2020, 6:18 PM · User-jijiki, Patch-For-Review, Sustainability (Incident Followup), Performance-Team, serviceops
jijiki changed the status of T261009: Reproduce opcache corruptions in production from Open to Stalled.

TL;DR: we were unable to reproduce a corruption in this iterartion

Sep 16 2020, 6:17 PM · User-jijiki, serviceops, Operations
Ottomata added a comment to T226986: Client side error logging production launch.

Right, but I asked originally which we should do, host at same wiki domain at /beacon, or use a separate domain, and I was told to use a separate domain.

Sep 16 2020, 6:17 PM · Analytics-Radar, MW-1.35-notes (1.35.0-wmf.24; 2020-03-17), Performance-Team (Radar), Desktop Improvements, Patch-For-Review, observability, Wikimedia-Logstash, User-fgiunchedi, Better Use Of Data, Product-Infrastructure-Team-Backlog, Epic
Jdlrobson added a parent task for T263047: Uncaught TypeError: Cannot read property 'node' of undefined: T257977: 1.36.0-wmf.9 deployment blockers.
Sep 16 2020, 6:17 PM · MW-1.36-notes (1.36.0-wmf.10; 2020-09-22), JavaScript, User-brennen, Regression, Wikimedia-production-error, Performance-Team, MediaWiki-extensions-NavigationTiming
Jdlrobson added a subtask for T257977: 1.36.0-wmf.9 deployment blockers: T263047: Uncaught TypeError: Cannot read property 'node' of undefined.
Sep 16 2020, 6:17 PM · Patch-For-Review, User-brennen, Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1)), Release, Train Deployments
Ottomata added a comment to T226986: Client side error logging production launch.

Also relevant: T262996: Blocking all third-party storage access requests ?

Sep 16 2020, 6:17 PM · Analytics-Radar, MW-1.35-notes (1.35.0-wmf.24; 2020-03-17), Performance-Team (Radar), Desktop Improvements, Patch-For-Review, observability, Wikimedia-Logstash, User-fgiunchedi, Better Use Of Data, Product-Infrastructure-Team-Backlog, Epic
jlinehan added a comment to T226986: Client side error logging production launch.

Huh, I'm pretty sure I discussed this with bblack and/or traffic team when we were first setting up eventgate-analtyics-external, and they preferred that the intake service got its own unique URL, rather than serving it in the wiki domains.

Sep 16 2020, 6:16 PM · Analytics-Radar, MW-1.35-notes (1.35.0-wmf.24; 2020-03-17), Performance-Team (Radar), Desktop Improvements, Patch-For-Review, observability, Wikimedia-Logstash, User-fgiunchedi, Better Use Of Data, Product-Infrastructure-Team-Backlog, Epic
gerritbot added a project to T262986: Follow refs aren't getting unique ids: Patch-For-Review.
Sep 16 2020, 6:16 PM · Parsoid
gerritbot added a comment to T262986: Follow refs aren't getting unique ids.

Change 627891 had a related patch set uploaded (by Sbailey; owner: Sbailey):
[mediawiki/services/parsoid@master] WIP adding extra key component to follow id's to avoid duplication

Sep 16 2020, 6:16 PM · Parsoid
gerritbot added a comment to T255835: Make pipelinelib able to update deployment chart image tags.

Change 624972 merged by Dzahn:
[operations/puppet@production] ci/pipeline/builder.pp: Add ruamel package

Sep 16 2020, 6:15 PM · Patch-For-Review, Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1)), Release Pipeline, Release-Engineering-Team (Pipeline)
Jdlrobson added a project to T263047: Uncaught TypeError: Cannot read property 'node' of undefined: Regression.

This is a new client-side error that has occurred with the current release relating to T259784. Possibly a deployment blocker?

Sep 16 2020, 6:15 PM · MW-1.36-notes (1.36.0-wmf.10; 2020-09-22), JavaScript, User-brennen, Regression, Wikimedia-production-error, Performance-Team, MediaWiki-extensions-NavigationTiming
EMartin added a comment to T262825: Enable Adyen forms for New Zealand and Australia.

NZ = CC (Visa, MC, AMEX) and Paypal
AU = CC (Visa, MC, Amex, JCB) and Paypal

Sep 16 2020, 6:14 PM · MW-1.36-notes (1.36.0-wmf.10; 2020-09-22), Fundraising Sprint 🐍 is not a valid zipcode, Fundraising-Backlog
Ottomata added a comment to T226986: Client side error logging production launch.

Huh, I'm pretty sure I discussed this with bblack and/or traffic team when we were first setting up eventgate-analtyics-external, and they preferred that the intake service got its own unique URL, rather than serving it in the wiki domains.

Sep 16 2020, 6:14 PM · Analytics-Radar, MW-1.35-notes (1.35.0-wmf.24; 2020-03-17), Performance-Team (Radar), Desktop Improvements, Patch-For-Review, observability, Wikimedia-Logstash, User-fgiunchedi, Better Use Of Data, Product-Infrastructure-Team-Backlog, Epic
ACraze created P12613 Article Topic KF Pipeline draft.
Sep 16 2020, 6:14 PM · articlequality-modeling, Machine Learning Platform
Stashbot added a comment to T262207: Deploy new search location and DOM order to officewiki and testwiki.

Mentioned in SAL (#wikimedia-operations) [2020-09-16T18:14:12Z] <catrope@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Enable Vector search in header on testwiki and officewiki (T262207) (duration: 01m 04s)

Sep 16 2020, 6:14 PM · Desktop Improvements, Readers-Web-Backlog (Kanbanana-FY-2020-21)
brennen moved T262454: RevisionAccessException: Can't find revision 174575271 from Backlog to Logs/Train on the User-brennen board.
Sep 16 2020, 6:13 PM · User-brennen, Parsing-Team--ARCHIVED, Parsoid, Wikimedia-production-error
brennen added a project to T262454: RevisionAccessException: Can't find revision 174575271: User-brennen.
Sep 16 2020, 6:13 PM · User-brennen, Parsing-Team--ARCHIVED, Parsoid, Wikimedia-production-error
Cmjohnson added a comment to T260181: (Need By: 2020-09-30) rack/setup/install frmx1001 & frdata1002.

racked

Sep 16 2020, 6:12 PM · Operations, fundraising-tech-ops
daniel added a comment to T262961: PageConfigFactory: Can't find revision [revId].

We are also seeing quite a few of those with "Can't find revision 0". Perhaps 0 should be handled as a special case.

Sep 16 2020, 6:12 PM · User-brennen, Parsoid, Wikimedia-production-error
Joe added a comment to T263043: [Bug] The feed/featured endpoint is broken.

for the record, I just confirmed: eqiad gives a correct result as well:

Sep 16 2020, 6:12 PM · Operations, serviceops, Wikifeeds, Product-Infrastructure-Team-Backlog
Cmjohnson updated the task description for T260181: (Need By: 2020-09-30) rack/setup/install frmx1001 & frdata1002.
Sep 16 2020, 6:12 PM · Operations, fundraising-tech-ops
gerritbot added a comment to T262637: Failed assertion in TableFixups handler.

Change 627566 merged by jenkins-bot:
[mediawiki/services/parsoid@master] Fix crashers in TableFixups handler + document unhandled scenarios

Sep 16 2020, 6:12 PM · Parsing-Active-Work, Parsoid, Wikimedia-production-error
gerritbot added a comment to T263025: substr() expects parameter 2 to be integer, null given.

Change 627566 merged by jenkins-bot:
[mediawiki/services/parsoid@master] Fix crashers in TableFixups handler + document unhandled scenarios

Sep 16 2020, 6:12 PM · Parsing-Active-Work, Parsoid, Wikimedia-production-error
Cmjohnson added a comment to T260817: (Need By: 2020-09-15) rack/setup/install db1150 (see note on hostname).

racked

Sep 16 2020, 6:12 PM · Operations, DBA, ops-eqiad, DC-Ops
Cmjohnson updated the task description for T260817: (Need By: 2020-09-15) rack/setup/install db1150 (see note on hostname).
Sep 16 2020, 6:11 PM · Operations, DBA, ops-eqiad, DC-Ops
Maintenance_bot removed a project from T261439: Missing spacing between : and text on payments wiki page: Patch-For-Review.
Sep 16 2020, 6:11 PM · fundraising sprint Theme songs for programming languages, MW-1.36-notes (1.36.0-wmf.10; 2020-09-22), Fundraising Sprint 🐍 is not a valid zipcode, Fundraising Sprint Raw data never hurt anyone, Fundraising-Backlog
Pchelolo added a comment to T262315: RestBase Sunset .

I think this is dependent on T262319 and probably needs to wait until after it's done.

Sep 16 2020, 6:11 PM · Code-Health, Platform Engineering Roadmap, Platform Engineering Roadmap Decision Making
Kaartic updated the task description for T263046: Page content service renders Graph:Chart with spurious '\n'.
Sep 16 2020, 6:11 PM · Product-Infrastructure-Team-Backlog, Page Content Service
Maintenance_bot removed a project from T262207: Deploy new search location and DOM order to officewiki and testwiki: Patch-For-Review.
Sep 16 2020, 6:11 PM · Desktop Improvements, Readers-Web-Backlog (Kanbanana-FY-2020-21)
gerritbot added a comment to T262900: Rebuilding l10n cache fails for train.

Change 627791 merged by jenkins-bot:
[mediawiki/core@REL1_34] Fix failure of rebuildLocalisationCache.php due to RL hook

Sep 16 2020, 6:11 PM · MW-1.35-notes, MW-1.34-notes, Patch-For-Review, MW-1.36-notes (1.36.0-wmf.9; 2020-09-15), Platform Team Workboards (Clinic Duty Team), User-brennen, MediaWiki-extensions-Gadgets, Wikimedia-production-error
Maintenance_bot removed a project from T262396: API Gateway doesn't respect mwdebug headers: Patch-For-Review.
Sep 16 2020, 6:10 PM · Platform Team Initiatives (API Gateway), Platform Team Workboards (Green)
Maintenance_bot removed a project from T249172: Error from line 99 of "PF_CreateProperty.php": Call to a member function getDatatypeLabels() on null: Patch-For-Review.
Sep 16 2020, 6:10 PM · affects-translatewiki.net, MediaWiki-extensions-Page_Forms
Jdlrobson updated the task description for T263047: Uncaught TypeError: Cannot read property 'node' of undefined.
Sep 16 2020, 6:10 PM · MW-1.36-notes (1.36.0-wmf.10; 2020-09-22), JavaScript, User-brennen, Regression, Wikimedia-production-error, Performance-Team, MediaWiki-extensions-NavigationTiming
Jdlrobson created T263047: Uncaught TypeError: Cannot read property 'node' of undefined.
Sep 16 2020, 6:10 PM · MW-1.36-notes (1.36.0-wmf.10; 2020-09-22), JavaScript, User-brennen, Regression, Wikimedia-production-error, Performance-Team, MediaWiki-extensions-NavigationTiming
Kaartic created T263046: Page content service renders Graph:Chart with spurious '\n'.
Sep 16 2020, 6:09 PM · Product-Infrastructure-Team-Backlog, Page Content Service
DStrine added a comment to T262909: New 2020 English thank you email.

@Pcoombe @MBeat33 @spatton can we get a confirmation that this is good to go to prod?

Sep 16 2020, 6:09 PM · Fundraising Sprint 🐍 is not a valid zipcode, FR-AutoTY-Email, Fundraising-Backlog
DStrine updated subscribers of T262825: Enable Adyen forms for New Zealand and Australia.

@EMartin could you help remind us of the payment types currently available in NZ and AU through ingenico? I can't seem to find that info in asana. the EN6C stuff kinda gets blended together.

Sep 16 2020, 6:06 PM · MW-1.36-notes (1.36.0-wmf.10; 2020-09-22), Fundraising Sprint 🐍 is not a valid zipcode, Fundraising-Backlog
matmarex edited projects for T263041: OperationError: The operation failed for an operation-specific reason in generateRandomSessionId , added: Analytics-EventLogging; removed MediaWiki-Interface (jQuery-Tablesorter).
Sep 16 2020, 6:06 PM · Analytics-Radar, Product-Infrastructure-Data, Event-Platform, JavaScript, Analytics-EventLogging, Wikimedia-production-error
Joe claimed T263043: [Bug] The feed/featured endpoint is broken.

The revert solved the issue for now. Still, we need to figure out what was going wrong, most apparently in the wikifeeds -> restbase -> aqs link when going through the proxy.

Sep 16 2020, 6:05 PM · Operations, serviceops, Wikifeeds, Product-Infrastructure-Team-Backlog
ReleaseTaggerBot added a project to T263034: PHP Notice: Trying to get property 'textContent' of non-object : MW-1.36-notes (1.36.0-wmf.9; 2020-09-15).
Sep 16 2020, 6:04 PM · MW-1.36-notes (1.36.0-wmf.10; 2020-09-22), User-brennen, Readers-Web-Backlog (Kanbanana-FY-2020-21), Wikimedia-production-error, MobileFrontend
ReleaseTaggerBot edited projects for T261439: Missing spacing between : and text on payments wiki page, added: MW-1.36-notes (1.36.0-wmf.10; 2020-09-22); removed MW-1.36-notes (1.36.0-wmf.8; 2020-09-08).
Sep 16 2020, 6:04 PM · fundraising sprint Theme songs for programming languages, MW-1.36-notes (1.36.0-wmf.10; 2020-09-22), Fundraising Sprint 🐍 is not a valid zipcode, Fundraising Sprint Raw data never hurt anyone, Fundraising-Backlog
gerritbot added a comment to T262207: Deploy new search location and DOM order to officewiki and testwiki.

Change 627884 merged by jenkins-bot:
[operations/mediawiki-config@master] Enable Vector search in header on officewiki and testwiki

Sep 16 2020, 6:03 PM · Desktop Improvements, Readers-Web-Backlog (Kanbanana-FY-2020-21)
MSantos lowered the priority of T263043: [Bug] The feed/featured endpoint is broken from Unbreak Now! to High.

Keeping this alive until we can figure out the root cause. But this should not be broken anymore.

Sep 16 2020, 6:03 PM · Operations, serviceops, Wikifeeds, Product-Infrastructure-Team-Backlog
jlinehan added a comment to T226986: Client side error logging production launch.

DNS is relatively quick and well-cached on-device, local network, and in middleware networks. Starting to establish more than one primary connection on a majority of page views is something we phased out 5+ years ago and would be great not to bring back without further research and consideration first.

The latency of events is indeed not critical, but there is a performance cost. It's all happening on the same device and network, consuming limited battery and network resources.

Sep 16 2020, 6:01 PM · Analytics-Radar, MW-1.35-notes (1.35.0-wmf.24; 2020-03-17), Performance-Team (Radar), Desktop Improvements, Patch-For-Review, observability, Wikimedia-Logstash, User-fgiunchedi, Better Use Of Data, Product-Infrastructure-Team-Backlog, Epic
apaskulin updated subscribers of T263045: Favicon not appearing.

@hnowlan Does this look like a routing issue?

Sep 16 2020, 6:01 PM · Platform Team Sprints Board (Sprint 4), Patch-For-Review, Platform Team Workboards (Green), Platform Team Initiatives (API Gateway)
RobH added a comment to T261791: Telia IC-361191 patch .

Telia Implementation Team,
We ended up having to swap the optic on our end of the link, as its TX out was not acceptable.  Its now showing a much better TX light out (-5) at our dmarc panel.  Can you investigate and report back you RX of our light?
Additionally, we are RX light from Telia, but only at -33, so unclear what is wrong on that end.  Please confirm you are sending light at approx "Tx Power:  0.65160 mW (-1.86019 dBm)"?  If so, I'll have to open a ticket with Equinix Ashburn staff to trace the link and report where we're seeing the failure.
Please advise,

Sep 16 2020, 6:00 PM · Operations, netops, DC-Ops, ops-eqiad
Stashbot added a comment to T263034: PHP Notice: Trying to get property 'textContent' of non-object .

Mentioned in SAL (#wikimedia-operations) [2020-09-16T18:00:09Z] <brennen@deploy1001> Synchronized php-1.36.0-wmf.9/extensions/MobileFrontend: Backport: [[gerrit:627793|Check $coords matched some nodes before comparing contents (T263034)]] (duration: 01m 06s)

Sep 16 2020, 6:00 PM · MW-1.36-notes (1.36.0-wmf.10; 2020-09-22), User-brennen, Readers-Web-Backlog (Kanbanana-FY-2020-21), Wikimedia-production-error, MobileFrontend
dr0ptp4kt added a comment to T260330: RFC: PHP microservice for containerized shell execution.

First of all, cool stuff!

Sep 16 2020, 6:00 PM · MW-on-K8s, Patch-For-Review, TechCom-RFC, serviceops, Operations
alexhollender added a comment to T262472: Show language links from other tabs than the article tab.

Should the link always go to the article tab? Or should the history tab point to the history tab of another language?

@Johan I think this is the main question. Can you frame this request from a user need / workflow perspective? It may help clarify some of the open questions.

Sep 16 2020, 5:59 PM · Desktop Improvements, Wikidata, MediaWiki-General
JTannerWMF moved T262066: Make it possible to tell if Reply Tool is open from browser tab's name from Backlog to FY2020-21 on the Editing-team (Tracking) board.
Sep 16 2020, 5:59 PM · Editing-team (Tracking), DiscussionTools
JTannerWMF added a project to T262066: Make it possible to tell if Reply Tool is open from browser tab's name: Editing-team (Tracking).
Sep 16 2020, 5:58 PM · Editing-team (Tracking), DiscussionTools
gerritbot added a comment to T261439: Missing spacing between : and text on payments wiki page.

Change 627888 merged by jenkins-bot:
[mediawiki/extensions/DonationInterface@master] Remove colon from amount header

Sep 16 2020, 5:58 PM · fundraising sprint Theme songs for programming languages, MW-1.36-notes (1.36.0-wmf.10; 2020-09-22), Fundraising Sprint 🐍 is not a valid zipcode, Fundraising Sprint Raw data never hurt anyone, Fundraising-Backlog
DLynch added a comment to T262066: Make it possible to tell if Reply Tool is open from browser tab's name.

Should we bother? Tabs are short. I currently can't see the end of the title for any of the (only!) five tabs open in the window I'm writing this in. If you put something at the start, it'd mean I couldn't see the actual topic of the page...

Sep 16 2020, 5:58 PM · Editing-team (Tracking), DiscussionTools
Jdlrobson moved T262093: MoveLeadParagraphTransformInfobox should be rewritten to be more similar to mobile apps from Incoming to Triaged but Future on the Readers-Web-Backlog board.
Sep 16 2020, 5:58 PM · Readers-Web-Backlog, Patch-For-Review, MobileFrontend
Jdlrobson assigned T262433: Remove WikipediaPortal instrumentation to ovasileva.
Sep 16 2020, 5:58 PM · Product-Analytics, Product-Infrastructure-Data, Readers-Web-Backlog
Jdlrobson moved T262617: Minerva Selenium test for talk page creation was disabled (Can't call getText on element with selector ".section-heading" because element wasn't found) from Incoming to Triaged but Future on the Readers-Web-Backlog board.
Sep 16 2020, 5:58 PM · MinervaNeue, ci-test-error, Readers-Web-Backlog, User-zeljkofilipin, MW-1.36-notes (1.36.0-wmf.11; 2020-09-29)
RobH added a comment to T261791: Telia IC-361191 patch .

I've been working with Chris on this today, and after testing, it was determined our optic in xe-3/3/7 was not outputting correctly. It measured a -1.x output from the module, but a patch plugged in saw it in the teens and above. Swapping the optic brings it back down to an output at our dmarc of roughly -5, which is more like the incoming light on our other links.

Sep 16 2020, 5:57 PM · Operations, netops, DC-Ops, ops-eqiad
AntiCompositeNumber changed the status of T122220: Enable optional two-factor authentication for OTRS from Stalled to Open.
Sep 16 2020, 5:56 PM · Security, OTRS
apaskulin updated the task description for T263045: Favicon not appearing.
Sep 16 2020, 5:54 PM · Platform Team Sprints Board (Sprint 4), Patch-For-Review, Platform Team Workboards (Green), Platform Team Initiatives (API Gateway)
Krinkle added a comment to T226986: Client side error logging production launch.

DNS is relatively quick and well-cached on-device, local network, and in middleware networks. Starting to establish more than one primary connection on a majority of page views is something we phased out 5+ years ago and would be great not to bring back without further research and consideration first.

Sep 16 2020, 5:53 PM · Analytics-Radar, MW-1.35-notes (1.35.0-wmf.24; 2020-03-17), Performance-Team (Radar), Desktop Improvements, Patch-For-Review, observability, Wikimedia-Logstash, User-fgiunchedi, Better Use Of Data, Product-Infrastructure-Team-Backlog, Epic
faidon added a comment to T261145: Enable access for wmcs-admins to run wmcs-prefixed cookbooks on cumin hosts.

Hey - this was brought to my attention, and we discussed it today at the I/F meeting. The outcome of our conversation was that @Volans and @jbond will do a final review pass and merge r621343 ~by the end of this week.

Sep 16 2020, 5:53 PM · SRE-Access-Requests, Data-Services, Operations, cloud-services-team (Kanban)
Joe added a comment to T263043: [Bug] The feed/featured endpoint is broken.

The configuration is exactly the same for staging and eqiad/codfw right now, so I'm not sure what's going on here. I'll have to dig into it further.

Sep 16 2020, 5:52 PM · Operations, serviceops, Wikifeeds, Product-Infrastructure-Team-Backlog
SBisson moved T260391: Outline style broken in RTL language from Code Review to Dev on the Inuka-Team (Kanban) board.
Sep 16 2020, 5:52 PM · Inuka-Team (Kanban), KaiOS-Wikipedia-app (Language)
apaskulin created T263045: Favicon not appearing.
Sep 16 2020, 5:51 PM · Platform Team Sprints Board (Sprint 4), Patch-For-Review, Platform Team Workboards (Green), Platform Team Initiatives (API Gateway)
srishakatux awarded T262383: Organize project showcase a Barnstar token.
Sep 16 2020, 5:48 PM · Developer-Advocacy (Jul-Sep 2020), Outreachy (Round 20), Google-Summer-of-Code (2020)
Mholloway added a comment to T263043: [Bug] The feed/featured endpoint is broken.

For the record, the service doesn't seem to be having any trouble in staging:

Sep 16 2020, 5:48 PM · Operations, serviceops, Wikifeeds, Product-Infrastructure-Team-Backlog
mmodell moved T211904: Set up data storage to collect loosely structured data from CI from INBOX to New Work on the Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1)) board.
Sep 16 2020, 5:48 PM · Release-Engineering-Team-TODO (2020-10-01 to 2020-12-31 (Q2)), Release-Engineering-Team (CI & Testing services), Elasticsearch, Continuous-Integration-Infrastructure
mmodell claimed T211904: Set up data storage to collect loosely structured data from CI.
Sep 16 2020, 5:47 PM · Release-Engineering-Team-TODO (2020-10-01 to 2020-12-31 (Q2)), Release-Engineering-Team (CI & Testing services), Elasticsearch, Continuous-Integration-Infrastructure
Trizek-WMF claimed T246939: Scale: streamlined configuration.

I'm going to review this task in order to review our plans there.

Sep 16 2020, 5:46 PM · Growth-Team, Growth-Scaling
thcipriani closed T250223: Make `scap sync` prompt before proceeding as Resolved.
Sep 16 2020, 5:45 PM · Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1)), Scap
jlinehan added a comment to T226986: Client side error logging production launch.

For EventLogging, we specifically moved away from separate domains to using /beacon so that the majority of non-deferred events that are sent off during user interactions do require separate connections to be established etc. It has been a while since we last quantified the benefits of this choice, so it's certainly worth revisiting.

Sep 16 2020, 5:45 PM · Analytics-Radar, MW-1.35-notes (1.35.0-wmf.24; 2020-03-17), Performance-Team (Radar), Desktop Improvements, Patch-For-Review, observability, Wikimedia-Logstash, User-fgiunchedi, Better Use Of Data, Product-Infrastructure-Team-Backlog, Epic
thcipriani moved T262516: Unable to push repository to remote, hostname is inaccessible from INBOX to New Work on the Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1)) board.
Sep 16 2020, 5:45 PM · Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1)), Release-Engineering-Team (CI & Testing services), User-brennen, GitLab-Test
CDanis added a comment to T226986: Client side error logging production launch.

Great, thank you! That was my thinking as well, but I wanted to confirm.

Sep 16 2020, 5:43 PM · Analytics-Radar, MW-1.35-notes (1.35.0-wmf.24; 2020-03-17), Performance-Team (Radar), Desktop Improvements, Patch-For-Review, observability, Wikimedia-Logstash, User-fgiunchedi, Better Use Of Data, Product-Infrastructure-Team-Backlog, Epic
jlinehan added a comment to T226986: Client side error logging production launch.

@CDanis this should be fine, the errors are fire-and-forget so this shouldn't cause any slowdown e.g. increased RTT waiting for a response, and there is no timing or anything that depends on this. I can't see any issue that would result, the DNS routing should be totally opaque.

Sep 16 2020, 5:43 PM · Analytics-Radar, MW-1.35-notes (1.35.0-wmf.24; 2020-03-17), Performance-Team (Radar), Desktop Improvements, Patch-For-Review, observability, Wikimedia-Logstash, User-fgiunchedi, Better Use Of Data, Product-Infrastructure-Team-Backlog, Epic
Krinkle added a comment to T226986: Client side error logging production launch.

For EventLogging, we specifically moved away from separate domains to using /beacon so that the majority of non-deferred events that are sent off during user interactions don't require separate connections to be established etc. It has been a while since we last quantified the benefits of this choice, so it's certainly worth revisiting.

Sep 16 2020, 5:42 PM · Analytics-Radar, MW-1.35-notes (1.35.0-wmf.24; 2020-03-17), Performance-Team (Radar), Desktop Improvements, Patch-For-Review, observability, Wikimedia-Logstash, User-fgiunchedi, Better Use Of Data, Product-Infrastructure-Team-Backlog, Epic
JTannerWMF moved T250768: [SPIKE] How will the New Discussion Tool be made to support preloaded discussion templates from Upcoming to Ready for Development on the Editing-team (FY2020-21 Kanban Board) board.
Sep 16 2020, 5:42 PM · Editing-team (FY2020-21 Kanban Board), DiscussionTools, OWC2020 (New Discussion 1.0)
Framawiki updated the task description for T263044: From, To, CC fields are no longer visible.
Sep 16 2020, 5:42 PM · OTRS
Framawiki created T263044: From, To, CC fields are no longer visible.
Sep 16 2020, 5:41 PM · OTRS
Pavithraes closed T262383: Organize project showcase as Resolved.
Sep 16 2020, 5:41 PM · Developer-Advocacy (Jul-Sep 2020), Outreachy (Round 20), Google-Summer-of-Code (2020)
Pavithraes closed T262383: Organize project showcase, a subtask of T241016: Coordinate Wikimedia's participation in Google Summer of Code 2020 and Outreachy Round 20, as Resolved.
Sep 16 2020, 5:41 PM · Developer-Advocacy (Oct-Dec 2020), Outreachy (Round 20), Google-Summer-of-Code (2020), Epic
gerritbot added a comment to T263034: PHP Notice: Trying to get property 'textContent' of non-object .

Change 627793 merged by jenkins-bot:
[mediawiki/extensions/MobileFrontend@wmf/1.36.0-wmf.9] Check $coords matched some nodes before comparing contents

Sep 16 2020, 5:40 PM · MW-1.36-notes (1.36.0-wmf.10; 2020-09-22), User-brennen, Readers-Web-Backlog (Kanbanana-FY-2020-21), Wikimedia-production-error, MobileFrontend
Pavithraes added a comment to T262383: Organize project showcase.

Showcase done!

Sep 16 2020, 5:40 PM · Developer-Advocacy (Jul-Sep 2020), Outreachy (Round 20), Google-Summer-of-Code (2020)
Yaron_Koren committed rEPFMc41128bcbd89: Use smwfContLang() for SMW 3.2+ (authored by Yaron_Koren).
Use smwfContLang() for SMW 3.2+
Sep 16 2020, 5:40 PM
hashar added a project to T263008: Gerrit out of heap: git-protocol-v2.

That might be related to the deployment of git-protocol-v2 on clients. For CI that was T256844 done on August 18th and 19th:

Sep 16 2020, 5:40 PM · Release-Engineering-Team-TODO (2020-10-01 to 2020-12-31 (Q2)), git-protocol-v2, Release-Engineering-Team (Development services), Gerrit
gerritbot added a comment to T112747: Devise a generic way for theme-agnostic stylesheets to adapt to the current theme.

Change 434214 merged by jenkins-bot:
[mediawiki/skins/Vector@master] Implement mediawiki.skin.variables.less for Vector

Sep 16 2020, 5:40 PM · MW-1.36-notes (1.36.0-wmf.10; 2020-09-22), Performance-Team (Radar), Patch-For-Review, UI-Standardization, UI-Standardization-Kanban, Front-end-Standards-Group, MediaWiki-ResourceLoader, OOUI
Yaron_Koren added a comment to T249172: Error from line 99 of "PF_CreateProperty.php": Call to a member function getDatatypeLabels() on null.

@KBailly - thanks for the suggested fix! I just checked in a fix based on this, which should hopefully work across different SMW versions. I haven't tested it, but hopefully things are working better now.

Sep 16 2020, 5:39 PM · affects-translatewiki.net, MediaWiki-extensions-Page_Forms
Joe added a comment to T263043: [Bug] The feed/featured endpoint is broken.
Sep 16 2020, 5:38 PM · Operations, serviceops, Wikifeeds, Product-Infrastructure-Team-Backlog
MSantos added a comment to T263043: [Bug] The feed/featured endpoint is broken.
Sep 16 2020, 5:38 PM · Operations, serviceops, Wikifeeds, Product-Infrastructure-Team-Backlog
thcipriani moved T262987: Migrate termbox to pipelineLib CI from INBOX to New Work on the Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1)) board.
Sep 16 2020, 5:36 PM · Wikidata-Termbox, Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1)), Release-Engineering-Team (Pipeline)