Page MenuHomePhabricator

Pchelolo
User

Projects (7)

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Saturday

  • Clear sailing ahead.

User Details

User Since
Jun 24 2015, 10:23 AM (191 w, 1 d)
Availability
Available
LDAP User
Unknown
MediaWiki User
Pchelolo [ Global Accounts ]

Recent Activity

Today

Pchelolo added a comment to T216069: Flaky quibble-vendor-mysql-hhvm-docker test in Jenkins.

Thank you a lot @hashar . I guess this ticket can be closed, however I have a last question - do you think we could somehow improve quibble to output this info without the need to place *cough* console.log()?

Thu, Feb 21, 7:01 PM · Core Platform Team Kanban (Blocked Externally), Services (blocked), Analytics, EventBus, MediaWiki-Core-Testing, Release-Engineering-Team, Jenkins, Quibble
Pchelolo added a comment to T216726: Edits to Flow pages result in a page-links-change event with no performer.

I'm not sure how Flow works internally, which hooks are called and why doesn't it set a user, better to ask Community-Tech ?

Thu, Feb 21, 6:00 PM · EventBus, Analytics, Internet-Archive, MediaWiki-extensions-WikimediaEvents, Wikimedia-General-or-Unknown, The-Wikipedia-Library
Pchelolo triaged T214099: Stress test Parsoid's HTTP API as High priority.

Parsoid was in a bit of trouble again today. At 02:44 XioNoX: depool eqsin, so all the mobile traffic for Chinese wiki started hitting RESTBase. Since Chinese has variants, RB started requesting Parsoid to transform HTML into correct variant. As the transformation request rate reached roughly 40 r/s, Parsoid started experiencing troubles, alerting and timing out.

Thu, Feb 21, 4:07 AM · Services (watching), Parsoid-Web-API, Parsoid

Yesterday

Pchelolo created T216636: Consider deprecating session editing API in RESTBase.
Wed, Feb 20, 5:44 PM · Core Platform Team Backlog (Later), Services (designing), VisualEditor, RESTBase
Pchelolo added a comment to T216069: Flaky quibble-vendor-mysql-hhvm-docker test in Jenkins.

I have tried to resubmit the change: https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/EventBus/+/491014/ with no luck.

Wed, Feb 20, 3:57 PM · Core Platform Team Kanban (Blocked Externally), Services (blocked), Analytics, EventBus, MediaWiki-Core-Testing, Release-Engineering-Team, Jenkins, Quibble
Pchelolo claimed T212335: EventBus or CirrusSearch: DomainException from line 353 of /srv/mediawiki/php-1.33.0-wmf.9/vendor/firebase/php-jwt/src/JWT.php: Unknown JSON error: 5.

This is a bug in EventBus. Serializing the events for sending is protected with a try-catch, it logs an error and drops the job if it's not serializable. However, in this case, it fails in a different place - each job is signed via JWT so that it could be checked in a later point and verified that Mediawiki is the entity actually sending the job. That signing procedure internally requires serialization as well apparently and it's not protected with try-catch.

Wed, Feb 20, 1:44 AM · Patch-For-Review, Core Platform Team Kanban (Doing), Services (doing), EventBus, Analytics, Core Platform Team (Security, stability, performance and scalability (TEC1)), WMF-JobQueue, CirrusSearch, Wikimedia-production-error
Pchelolo created T216584: Consider deprecating and removing public data-parsoid REST endpoint.
Wed, Feb 20, 1:04 AM · Core Platform Team Backlog (Later), Services (designing), RESTBase

Tue, Feb 19

Pchelolo created T216567: EventBusRCFeedFormatter should clean up events from nulls.
Tue, Feb 19, 10:33 PM · Patch-For-Review, Core Platform Team (Modern Event Platform (TEC2)), Core Platform Team Backlog (Later), Analytics, Services (next), EventBus
Pchelolo added a comment to T214093: Modern Event Platform: Schema Guidelines and Conventions.

Rejecting events that haven't lowercased the headers is another option, albeit not as user-friendly.

Tue, Feb 19, 9:39 PM · Patch-For-Review, Product-Analytics, Core Platform Team Backlog (Watching / External), Core Platform Team (Modern Event Platform (TEC2)), Goal, Services (watching), Analytics-EventLogging, EventBus, Analytics-Kanban
Pchelolo added a comment to T214093: Modern Event Platform: Schema Guidelines and Conventions.

EventGate, so that all parts of the system have a standard representation of the headers.

Tue, Feb 19, 9:33 PM · Patch-For-Review, Product-Analytics, Core Platform Team Backlog (Watching / External), Core Platform Team (Modern Event Platform (TEC2)), Goal, Services (watching), Analytics-EventLogging, EventBus, Analytics-Kanban
Pchelolo added a comment to T216184: Eventstreams build is broken.

It's still undecided what to do with package-lock (T179229), so maybe let's just freeze the verison?

Tue, Feb 19, 8:30 PM · Patch-For-Review, Analytics-Kanban, Operations, Wikimedia-Stream, Analytics, Services (watching)
Pchelolo added a comment to T216184: Eventstreams build is broken.

KafkaSSE requires ^2.3.4.

Tue, Feb 19, 7:58 PM · Patch-For-Review, Analytics-Kanban, Operations, Wikimedia-Stream, Analytics, Services (watching)
Pchelolo edited projects for T216069: Flaky quibble-vendor-mysql-hhvm-docker test in Jenkins, added: Services (blocked), Core Platform Team Kanban (Blocked Externally); removed Services (watching), Core Platform Team Backlog (Watching / External).

This is getting in our way since we can't merge an otherwise ready patchset

Tue, Feb 19, 4:07 PM · Core Platform Team Kanban (Blocked Externally), Services (blocked), Analytics, EventBus, MediaWiki-Core-Testing, Release-Engineering-Team, Jenkins, Quibble

Fri, Feb 15

Pchelolo added a comment to T215956: Consider stashing data-parsoid for VE .

I don't think complicating Varnish logic worths here, I don't see how UA is better than a query parameter regarding DDOs. We can mitigate the DDOS possibility by setting Varnish max-age grace_ttl smaller then Cassandra stashing TTL for the VE requests and using 'must-revalidate'.

Fri, Feb 15, 8:34 PM · Operations, Traffic, User-Eevans, User-mobrovac, Core Platform Team Backlog (Designing), Parsoid, VisualEditor, RESTBase, Services (designing)
Pchelolo edited projects for T216249: page-links-change stream doesn't capture links on page deletion, added: Services (watching); removed Services.

Indeed, haven't thought about that. On page deletion no LinksUpdate is scheduled, LinksDeletionUpdate is used instead which doesn't call a hook we use to construct the event.

Fri, Feb 15, 6:27 PM · Patch-For-Review, Services (watching), EventBus, Research, Analytics, The-Wikipedia-Library
Pchelolo updated the task description for T216191: Replace Istanbul with nyc.
Fri, Feb 15, 12:26 AM · Core Platform Team Kanban (Doing), Services (next)

Thu, Feb 14

Pchelolo assigned T216203: RESTBase content-negotiation tests are broken to holger.knust.

@ssastry ye, it's a set of integration tests running against life Parsoid in the beta cluster. I think using
'nock' is a good approach, with an option to quickly update the nocks once a new major version of Parsoid format is deployed and quickly updating the expected/supported format versions.

Thu, Feb 14, 11:23 PM · RESTBase, Parsoid, Services (later)
Pchelolo created T216203: RESTBase content-negotiation tests are broken.
Thu, Feb 14, 11:14 PM · RESTBase, Parsoid, Services (later)
Pchelolo added a comment to T216191: Replace Istanbul with nyc.

Removed the linked patch next to mobileapps, which was unrelated unless I'm missing something.

Thu, Feb 14, 10:27 PM · Core Platform Team Kanban (Doing), Services (next)
Pchelolo created T216191: Replace Istanbul with nyc.
Thu, Feb 14, 10:22 PM · Core Platform Team Kanban (Doing), Services (next)
Pchelolo closed T214706: Surface link changes as a stream as Resolved.

MW train has been deployed, so the events are available for all wikis. The final piece is adding the stream to the documentation, but apparently, it's blocked now by T216184.

Thu, Feb 14, 8:50 PM · Core Platform Team Kanban (Done with CPT), Services (done), MW-1.33-notes (1.33.0-wmf.17; 2019-02-12), Core Platform Team (Modern Event Platform (TEC2)), EventBus, Wikidata, Analytics, Research
Pchelolo closed T214706: Surface link changes as a stream, a subtask of T115119: Create a feed or log of changed links on Wikimedia projects, as Resolved.
Thu, Feb 14, 8:50 PM · Internet-Archive, MediaWiki-extensions-WikimediaEvents, Wikimedia-General-or-Unknown, The-Wikipedia-Library
Pchelolo created T216184: Eventstreams build is broken.
Thu, Feb 14, 8:48 PM · Patch-For-Review, Analytics-Kanban, Operations, Wikimedia-Stream, Analytics, Services (watching)
Pchelolo triaged T216163: Add monolog adapters for Eventbus as Normal priority.
Thu, Feb 14, 5:59 PM · Patch-For-Review, Core Platform Team Kanban (Doing), Services (doing), Analytics-EventLogging, EventBus, Analytics

Wed, Feb 13

Pchelolo created T215987: Verify that hit/miss stats in WebRequest are correct.
Wed, Feb 13, 1:18 AM · Traffic, Operations, Core Platform Team Backlog (Later), Analytics, Services (blocked), RESTBase

Tue, Feb 12

Pchelolo added a comment to T207329: Clear watchlist on enwiki only removes 50 items at a time.

So, in kafka we have:

{"database": "enwiki", "mediawiki_signature": "97c895ef8e934b335f74b4d8d57d5b7bebd1de16dd68d88f76479c826f4a9bf9", "meta": {"domain": "en.wikipedia.org", "dt": "2019-02-12T22:12:43+00:00", "id": "51840dae-2f13-11e9-881a-aa00006e80dc", "request_id": "XGNE2gpAIHsAABGqlmYAAAAV", "schema_uri": "mediawiki/job/2", "topic": "mediawiki.job.clearUserWatchlist", "uri": "https://en.wikipedia.org/wiki/Special:EditWatchlist/clear"}, "page_namespace": -1, "page_title": "Special:EditWatchlist/clear", "params": {"maxWatchlistId": 214224212, "requestId": "XGNE2gpAIHsAABGqlmYAAAAV", "userId": 10774019}, "sha1": "32624f411d5070eacbfe3d0aab95b55a60748a6f", "type": "clearUserWatchlist"}
Tue, Feb 12, 10:45 PM · Core Platform Team (Security, stability, performance and scalability (TEC1)), Growth-Team, MW-1.33-notes (1.33.0-wmf.1; 2018-10-23), Core Platform Team Kanban (Blocked Externally), Services (blocked), Patch-For-Review, Analytics, EventBus, WMF-JobQueue, MediaWiki-Watchlist
Pchelolo updated subscribers of T215960: Simplify MCS storage model.
Tue, Feb 12, 8:00 PM · User-Eevans, Core Platform Team Backlog (Designing), Reading-Infrastructure-Team-Backlog, Services (designing), RESTBase
Pchelolo created T215960: Simplify MCS storage model.
Tue, Feb 12, 7:59 PM · User-Eevans, Core Platform Team Backlog (Designing), Reading-Infrastructure-Team-Backlog, Services (designing), RESTBase
Pchelolo created T215956: Consider stashing data-parsoid for VE .
Tue, Feb 12, 7:35 PM · Operations, Traffic, User-Eevans, User-mobrovac, Core Platform Team Backlog (Designing), Parsoid, VisualEditor, RESTBase, Services (designing)
Pchelolo added a comment to T214545: Emit synthetic mediawiki.revision-score events for both datacenters.

Hmm.... Just brainstorming here...

Tue, Feb 12, 7:21 PM · Scoring-platform-team (Current), Analytics, ORES
Pchelolo updated the task description for T210460: Eliminate usage of mocha-eslint.
Tue, Feb 12, 7:02 PM · Patch-For-Review, User-Clarakosi, Core Platform Team Backlog (Later), Services (later)
Pchelolo updated the task description for T210460: Eliminate usage of mocha-eslint.
Tue, Feb 12, 6:56 PM · Patch-For-Review, User-Clarakosi, Core Platform Team Backlog (Later), Services (later)
Pchelolo updated the task description for T210460: Eliminate usage of mocha-eslint.
Tue, Feb 12, 6:56 PM · Patch-For-Review, User-Clarakosi, Core Platform Team Backlog (Later), Services (later)
Pchelolo closed T211765: 504 from /api/rest_v1/page/random/summary as Resolved.

Seems like the things has calmed down. Even though we were not able to figure out the core reason, it seems by now we never will. Closing the ticket.

Tue, Feb 12, 6:55 PM · Core Platform Team Kanban (Done with CPT), Services (done), Reading-Infrastructure-Team-Backlog, Mobile-Content-Service, RESTBase
Pchelolo added a comment to T209732: Wire ORES recent_score events into Hadoop.

I'm trying to get alternative solutions because I would honestly hate emitting a heartbeat event.

Tue, Feb 12, 6:36 PM · Services (watching), Patch-For-Review, Scoring-platform-team (Current), Analytics, ORES
Pchelolo added a comment to T214545: Emit synthetic mediawiki.revision-score events for both datacenters.

If one of the topics in a stream has no data for a given hour, we can't tell if that is because of an upstream (producer related) error/delay, or if there is simply no data in that topic for that hour.

Tue, Feb 12, 6:30 PM · Scoring-platform-team (Current), Analytics, ORES
Pchelolo added a comment to T214545: Emit synthetic mediawiki.revision-score events for both datacenters.

So in this case we have all the events in eqiad, and some rogue events in codfw. Is it possible to consume from 2 topics in the job and rely on mirror maker to deliver codfw events? We could quite safely ignore the codfw events, there should be a negligible number of them.

Tue, Feb 12, 6:20 PM · Scoring-platform-team (Current), Analytics, ORES
Pchelolo added a project to T209732: Wire ORES recent_score events into Hadoop: Services (watching).
Tue, Feb 12, 3:58 PM · Services (watching), Patch-For-Review, Scoring-platform-team (Current), Analytics, ORES
Pchelolo added a comment to T209732: Wire ORES recent_score events into Hadoop.

There's one more issue that's not being addressed here. The precaching config does not have all the models available for the wiki, so the revision-score event only contains a subset of everything ORES can calculate. There are actually 3 separate sets of models ORES calculates for different purposes T201868#4802296 . I guess you'd want to archive all the models? Can we in that case finally merge all the configs and merge the changeprop and job queue ores pre-calculations?

Tue, Feb 12, 3:56 PM · Services (watching), Patch-For-Review, Scoring-platform-team (Current), Analytics, ORES
Pchelolo added a comment to T214545: Emit synthetic mediawiki.revision-score events for both datacenters.

ORES change propagation is configured to mostly go through one datacenter

Tue, Feb 12, 3:48 PM · Scoring-platform-team (Current), Analytics, ORES

Mon, Feb 11

Pchelolo committed rMSCDbdb474087cb5: Update change-propagation to 638142a (authored by Pchelolo).
Update change-propagation to 638142a
Mon, Feb 11, 11:48 PM
Pchelolo committed rMSCD6ac1c192801c: Update change-propagation to eb1d7c9 (authored by Pchelolo).
Update change-propagation to eb1d7c9
Mon, Feb 11, 11:48 PM
Pchelolo added a comment to T207329: Clear watchlist on enwiki only removes 50 items at a time.

Sorry, got out of my radar somehow. After the latest deploy ^^ this has to work properly.

Mon, Feb 11, 8:08 PM · Core Platform Team (Security, stability, performance and scalability (TEC1)), Growth-Team, MW-1.33-notes (1.33.0-wmf.1; 2018-10-23), Core Platform Team Kanban (Blocked Externally), Services (blocked), Patch-For-Review, Analytics, EventBus, WMF-JobQueue, MediaWiki-Watchlist
Pchelolo added a comment to T213077: Migrate Kartotherian/Tilerator to Node 10.

Maps will go on k8s eventually afaik, but it's an independent issue. Node 6 support ends in April even for security updates and that is the primary reason for the move.

Mon, Feb 11, 7:07 PM · Maps (Kartotherian), Epic, Reading-Infrastructure-Team-Backlog

Fri, Feb 8

Pchelolo added a comment to T208251: Modern Event Platform: Stream Intake Service: EventGate security review.

Since we will (probably? for now?) only be producing new schemas to EventGate, I think it would be fine to add this to our meta field. Thoughts?

Fri, Feb 8, 6:28 PM · Analytics-Kanban, Patch-For-Review, Security-Team-Review-Active, Security-Team, Core Platform Team Backlog (Watching / External), Services (watching), Analytics-EventLogging, EventBus, Analytics
Pchelolo added a comment to T206889: Develop a library for JSON schema backwards incompatibility detection.

That I already have, just need to revert a couple of commits that went too far.

Fri, Feb 8, 5:11 PM · Core Platform Team Backlog (Watching / External), Core Platform Team (Modern Event Platform (TEC2)), Services (watching), Analytics-EventLogging, EventBus, Analytics
Pchelolo changed the status of T206889: Develop a library for JSON schema backwards incompatibility detection from Open to Stalled.

Although, I'm not sure if we should bother using CI to enforce JSONSchema restraints. If we can, that's awesome, but I wouldn't make it a priority. Good guidelines and schema review should be enough I think.

Fri, Feb 8, 4:59 PM · Core Platform Team Backlog (Watching / External), Core Platform Team (Modern Event Platform (TEC2)), Services (watching), Analytics-EventLogging, EventBus, Analytics
Pchelolo changed the status of T206889: Develop a library for JSON schema backwards incompatibility detection, a subtask of T206814: CI Support for Schema Registry, from Open to Stalled.
Fri, Feb 8, 4:59 PM · Core Platform Team Backlog (Watching / External), Core Platform Team (Modern Event Platform (TEC2)), Services (watching), Analytics-EventLogging, EventBus, Analytics
Pchelolo added a comment to T206889: Develop a library for JSON schema backwards incompatibility detection.

Hm... After hacking this around a little bit more, I think creating something general-purpose was actually a bad idea. JSON schema is much too powerful for us and what we really need is something very specific for us making sure nobody uses features of the schema we do not want people to use. As an example, json schema supports declarations like type: [ 'string', 'number' ] - which means the property could be either a string or a number. That would clearly break hadoop refinery, so we want to disallow this feature.

Fri, Feb 8, 3:22 AM · Core Platform Team Backlog (Watching / External), Core Platform Team (Modern Event Platform (TEC2)), Services (watching), Analytics-EventLogging, EventBus, Analytics

Thu, Feb 7

Pchelolo added a comment to T210651: Switch all PDF render traffic to new Proton service.

To achieve point 1, we need to

    • Refactor PDF module in RESTBase only to proxy traffic to Proton and remove the capability of split traffic, plus simplify the config.
  • See whether we would still need a js module for it, or it's possible to achieve the same result with a template-based module with no JS.
Thu, Feb 7, 10:09 PM · Reading-Infrastructure-Team-Backlog, Core Platform Team Backlog (Later), Services (next), Readers-Web-Backlog (Tracking), Proton
Pchelolo assigned T210651: Switch all PDF render traffic to new Proton service to holger.knust.
Thu, Feb 7, 10:05 PM · Reading-Infrastructure-Team-Backlog, Core Platform Team Backlog (Later), Services (next), Readers-Web-Backlog (Tracking), Proton
Pchelolo added a comment to T215557: Remove electron pdf endpoint backend in RESTBase.

Ouch... Somehow missed that one.

Thu, Feb 7, 10:03 PM · Services (next), Proton
Pchelolo merged T215557: Remove electron pdf endpoint backend in RESTBase into T210651: Switch all PDF render traffic to new Proton service.
Thu, Feb 7, 10:02 PM · Reading-Infrastructure-Team-Backlog, Core Platform Team Backlog (Later), Services (next), Readers-Web-Backlog (Tracking), Proton
Pchelolo merged task T215557: Remove electron pdf endpoint backend in RESTBase into T210651: Switch all PDF render traffic to new Proton service.
Thu, Feb 7, 10:02 PM · Services (next), Proton
Pchelolo triaged T215557: Remove electron pdf endpoint backend in RESTBase as Normal priority.
Thu, Feb 7, 9:41 PM · Services (next), Proton
Pchelolo edited projects for T215539: Node.js 10 changes encoding for at least one Georgian character, added: Services (watching); removed Services.

So, %u10DE is 'GEORGIAN LETTER PAR' and it's supported from Unicode v1.1.0. The %u1C9E is GEORGIAN MTAVRULI CAPITAL LETTER PAR and it's only supported from Unicode v11.0 which was released in June 2018.

Thu, Feb 7, 9:15 PM · Services (watching), I18n, Reading-Infrastructure-Team-Backlog
Pchelolo added a comment to T214706: Surface link changes as a stream.

We're getting closer. The last part of the puzzle would be to emit the event publically via event streams. In order to do that, we need to add the mediawiki.page-links-change topic to the list of exposed topics in puppet for production and for deployment-prep

Thu, Feb 7, 8:55 PM · Core Platform Team Kanban (Done with CPT), Services (done), MW-1.33-notes (1.33.0-wmf.17; 2019-02-12), Core Platform Team (Modern Event Platform (TEC2)), EventBus, Wikidata, Analytics, Research

Wed, Feb 6

Pchelolo added a comment to T214080: Rewrite Avro schemas (ApiAction, CirrusSearchRequestSet) as JSONSchema and produce to EventGate.

If we were to use Monolog, we'd likely want to do it with the aim of converting all existent EventBus events to use it as well.

Wed, Feb 6, 9:16 PM · Patch-For-Review, Services (watching), Discovery, Analytics-EventLogging, EventBus, Analytics
Pchelolo added a comment to T208361: Make schemas use required $schema property with absolute path (not absolute URL) to the schema.

Interesting.. I will have to read this first before voicing an opinion. Not sure how likely this would become a standard.

Wed, Feb 6, 8:55 PM · Analytics, Core Platform Team Backlog (Later), Services (later), Analytics-EventLogging, EventBus
Pchelolo added a comment to T209110: Logging for the session storage service.

In node we have an implementation of bynuan -> syslog adapter and it has a bit of a different mapping. It's not used yet, but this seems to conform to most of the mappings other node packages do. (Not saying we need to do what node does, just adding 2 cents of info)

Wed, Feb 6, 8:51 PM · Patch-For-Review, User-Clarakosi, Core Platform Team Backlog (Next), Core Platform Team (Session Management Service (CDP2)), User-Eevans
Pchelolo added a comment to T206889: Develop a library for JSON schema backwards incompatibility detection.

With JSON, consumers don't really 'read data' with the schema. The schema allows us to ensure that the data the consumers get will be backwards compatible; meaning old consumer code will be able to read data produced with the new schema.

Wed, Feb 6, 4:01 PM · Core Platform Team Backlog (Watching / External), Core Platform Team (Modern Event Platform (TEC2)), Services (watching), Analytics-EventLogging, EventBus, Analytics

Tue, Feb 5

Pchelolo updated subscribers of T215339: No jobs running on beta cluster.

cc @Joe

Tue, Feb 5, 11:52 PM · Services (next), Beta-Cluster-Infrastructure
Pchelolo added a comment to T214974: Popups build failing consistently for a week.

If the endpoint logic has changed in the summary endpoint wouldn't the summary be outdated?

Tue, Feb 5, 7:30 PM · Readers-Web-Backlog (Readers-Web-Kanbanana-Board-2018-19-Q3), MW-1.33-notes (1.33.0-wmf.16; 2019-02-05), Patch-For-Review, Reading-Infrastructure-Team-Backlog, Reference Previews, Browser-Tests, Page-Previews
Pchelolo added a comment to T214974: Popups build failing consistently for a week.

(unless Core Platform wants it for their own purposes). Something to chat about in the biweekly sync meeting.

Tue, Feb 5, 7:25 PM · Readers-Web-Backlog (Readers-Web-Kanbanana-Board-2018-19-Q3), MW-1.33-notes (1.33.0-wmf.16; 2019-02-05), Patch-For-Review, Reading-Infrastructure-Team-Backlog, Reference Previews, Browser-Tests, Page-Previews
Pchelolo added a project to T186993: Beta Cluster search box displays unexisting pages as results: Services (next).
curl -XPOST http://deployment-jobrunner03.deployment-prep.eqiad.wmflabs:9005/rpc/RunSingleJob.php
Tue, Feb 5, 6:35 PM · Discovery-Search (Current work), Services (next), MediaWiki-Search, Beta-Cluster-Infrastructure
Pchelolo closed T214982: Investigate precaching blip (ChangeProp?) during Jan 30th ORES deployment as Resolved.

The blip and ORES deploy seem to be unrelated and just coincided in time.

Tue, Feb 5, 6:20 PM · Services (done), ChangeProp, Wikimedia-Incident, ORES, Scoring-platform-team
Pchelolo added a comment to T210910: Jobs for otrs-wiki are slower than expected to process.

We have analytics by job type but not by wiki

Tue, Feb 5, 5:21 PM · Core Platform Team, Core Platform Team Kanban (Blocked Externally), WMF-JobQueue
Pchelolo added a comment to T214706: Surface link changes as a stream.

We have discovered that we would need to update LinkUpdates class in the core to support this functionality, so it will take a little bit more time then we anticipated, but we're making progress.

Tue, Feb 5, 4:48 PM · Core Platform Team Kanban (Done with CPT), Services (done), MW-1.33-notes (1.33.0-wmf.17; 2019-02-12), Core Platform Team (Modern Event Platform (TEC2)), EventBus, Wikidata, Analytics, Research

Mon, Feb 4

Pchelolo created T215222: Recommendation API translation endpoint stopped working.
Mon, Feb 4, 11:38 PM · Core Platform Team (Security, stability, performance and scalability (TEC1)), Core Platform Team Backlog (Watching / External), Services (watching), Recommendation-API, Research
Pchelolo edited projects for T214874: Investigate a Hyperswitch frontend for ORES, added: Services (designing); removed Services.

I'm not particularly sure what do you mean and want to achieve. Putting ORES behind RESTBase without using storage (as a simple proxy) will not really free up any resourses on ORES side. Do you mean you want reads of pre-computed scores to not touch ORES at all?

Mon, Feb 4, 4:34 PM · Services (designing), Scoring-platform-team, ORES
Pchelolo closed T204296: EventBus should not use service container in application logic as Declined.

Given that all the code is actually called from hooks, which are static entry points, this is not actually a real issue.

Mon, Feb 4, 4:33 PM · Core Platform Team Backlog (Later), User-Clarakosi, good first bug, Services (later), Analytics, EventBus
Pchelolo reassigned T204295: EventBus should make better use of DI from Pchelolo to holger.knust.
Mon, Feb 4, 4:30 PM · Patch-For-Review, Analytics, Core Platform Team Backlog (Later), good first bug, Services (later), EventBus
Pchelolo assigned T204296: EventBus should not use service container in application logic to holger.knust.
Mon, Feb 4, 12:02 AM · Core Platform Team Backlog (Later), User-Clarakosi, good first bug, Services (later), Analytics, EventBus
Pchelolo assigned T211125: Move service-runner to new logging infrastructure to holger.knust.

We need to locally test whether the bynuan-syslog-udp actually works and modify it to add the @cee annotation. Then we can proceed with testing in beta cluster.

Mon, Feb 4, 12:01 AM · Core Platform Team Backlog (Later), Services (next), service-runner, Wikimedia-Logstash, Operations

Sun, Feb 3

Pchelolo assigned T204575: Convert all hooks to EventFactory to holger.knust.
Sun, Feb 3, 11:58 PM · Patch-For-Review, Core Platform Team Backlog (Later), Analytics, good first bug, EventBus, Services (later)
Pchelolo assigned T203617: Use hot-shots native childClient in service-runner makeChild to holger.knust.
Sun, Feb 3, 11:55 PM · Core Platform Team Backlog (Later), good first bug, Services (later), service-runner

Wed, Jan 30

Pchelolo added a project to T214982: Investigate precaching blip (ChangeProp?) during Jan 30th ORES deployment: Services.
Wed, Jan 30, 7:55 PM · Services (done), ChangeProp, Wikimedia-Incident, ORES, Scoring-platform-team

Fri, Jan 25

Pchelolo added a comment to T214706: Surface link changes as a stream.

How should we handle the situation with long list of links? Is that really a problem?

Fri, Jan 25, 10:00 PM · Core Platform Team Kanban (Done with CPT), Services (done), MW-1.33-notes (1.33.0-wmf.17; 2019-02-12), Core Platform Team (Modern Event Platform (TEC2)), EventBus, Wikidata, Analytics, Research
Pchelolo added a comment to T214706: Surface link changes as a stream.
Are links url encoded? (we probably want them to be so).
Fri, Jan 25, 8:01 PM · Core Platform Team Kanban (Done with CPT), Services (done), MW-1.33-notes (1.33.0-wmf.17; 2019-02-12), Core Platform Team (Modern Event Platform (TEC2)), EventBus, Wikidata, Analytics, Research
Pchelolo added a comment to T214706: Surface link changes as a stream.

@Pchelolo yes, replacing "properties" with "links" should do it. I don't think we need the full list of links, just the changes.

Fri, Jan 25, 7:32 PM · Core Platform Team Kanban (Done with CPT), Services (done), MW-1.33-notes (1.33.0-wmf.17; 2019-02-12), Core Platform Team (Modern Event Platform (TEC2)), EventBus, Wikidata, Analytics, Research
Pchelolo added a comment to T214706: Surface link changes as a stream.

@bmansurov look at the event schema for properties change I've linked, it contains all of the metadata you need and it's generated from the same hook. Will such a schema work for you if we replace removed_properties with removed_links and added_properties with added_links? We can also emit the full list of links before the edit and after the edit and let clients do the diff. In general, we can get any metadata you can imagine.

Fri, Jan 25, 7:26 PM · Core Platform Team Kanban (Done with CPT), Services (done), MW-1.33-notes (1.33.0-wmf.17; 2019-02-12), Core Platform Team (Modern Event Platform (TEC2)), EventBus, Wikidata, Analytics, Research
Pchelolo edited projects for T214706: Surface link changes as a stream, added: Services (blocked); removed Services.

Moving to services-blocked until Research comes up with the schema for the event.

Fri, Jan 25, 7:05 PM · Core Platform Team Kanban (Done with CPT), Services (done), MW-1.33-notes (1.33.0-wmf.17; 2019-02-12), Core Platform Team (Modern Event Platform (TEC2)), EventBus, Wikidata, Analytics, Research
Pchelolo added a comment to T214706: Surface link changes as a stream.

The task at hand is very easy. There's LinksUpdateComplete hook in MW core, it gets the LinksUpdate which contains the list of external links and methods to get links insertions and removals. Writing code in EventBus extension to use the hook is simple. The important part of the work is for you to come up with the schema for the event you want to get. We already have an event for page properties change. I would assume your event will be quite similar. If you create the schema, I can write the producer code or point you where to write it.

Fri, Jan 25, 7:00 PM · Core Platform Team Kanban (Done with CPT), Services (done), MW-1.33-notes (1.33.0-wmf.17; 2019-02-12), Core Platform Team (Modern Event Platform (TEC2)), EventBus, Wikidata, Analytics, Research

Wed, Jan 23

Pchelolo added a comment to T206889: Develop a library for JSON schema backwards incompatibility detection.

Hmmm you seem to assume we control all the producers, but I'm not sure that will be true for this new system. Since it will also replace EventLogging, this might not be the case.

Wed, Jan 23, 7:29 PM · Core Platform Team Backlog (Watching / External), Core Platform Team (Modern Event Platform (TEC2)), Services (watching), Analytics-EventLogging, EventBus, Analytics
Pchelolo added a comment to T206889: Develop a library for JSON schema backwards incompatibility detection.

The topic appears to be deeper than I thought. Please read https://docs.confluent.io/current/schema-registry/docs/avro.html for the context.

Wed, Jan 23, 6:57 PM · Core Platform Team Backlog (Watching / External), Core Platform Team (Modern Event Platform (TEC2)), Services (watching), Analytics-EventLogging, EventBus, Analytics
Pchelolo moved T214446: EventBus mediawiki extension should support multiple 'event service' endpoints from Backlog to watching on the Services board.
Wed, Jan 23, 5:27 PM · Analytics-Kanban, Services (watching), Patch-For-Review, EventBus, Analytics
Pchelolo added a comment to T213371: Document and possibly fine-tune how Proton interacts with Varnish.

Does that also go for errors? (Especially when rendering takes too long and gets aborted by the service, or abandoned by Varnish.)

Wed, Jan 23, 5:38 AM · Readers-Web-Backlog (Tracking), Services (watching), serviceops, Traffic, Reading-Infrastructure-Team-Backlog, Operations, Proton

Jan 22 2019

Pchelolo moved T213566: Transferring data from Hadoop to production MySQL database from Backlog to watching on the Services board.
Jan 22 2019, 6:47 PM · serviceops, Core Platform Team Backlog (Watching / External), Services (watching), User-Marostegui, Operations, Article-Recommendation, Analytics, Research
Pchelolo added a comment to T206889: Develop a library for JSON schema backwards incompatibility detection.

There's already json-schema-compatibility lib on npm, but there's always some libs with a similar name to anything we could imagine, so jsonschema-compatibility is fine by me.

Jan 22 2019, 6:33 PM · Core Platform Team Backlog (Watching / External), Core Platform Team (Modern Event Platform (TEC2)), Services (watching), Analytics-EventLogging, EventBus, Analytics
Pchelolo added a comment to T206889: Develop a library for JSON schema backwards incompatibility detection.

Before we begin, some bike-shedding needs to be done.

Jan 22 2019, 6:23 PM · Core Platform Team Backlog (Watching / External), Core Platform Team (Modern Event Platform (TEC2)), Services (watching), Analytics-EventLogging, EventBus, Analytics
Pchelolo added a comment to T204031: Deploy regular running of wikidata constraint checks using the job queue.

Change-Prop now has a separate rule for this job, so it doesn't interfere with low-traffic jobs. The concurrency is set to 30, which should be enough, however after deploying 100% we need to monitor the lag and increase concurrency if we see the job is steadily lagging.

Jan 22 2019, 5:32 PM · User-Addshore, Wikidata-Campsite (Wikidata-Campsite-Iteration-∞), Patch-For-Review, Wikimedia-Site-requests, Core Platform Team Backlog (Watching / External), Services (watching), WMF-JobQueue, wikidata-tech-focus, Wikibase-Quality-Constraints, Wikibase-Quality, Wikidata
Pchelolo added a comment to T204031: Deploy regular running of wikidata constraint checks using the job queue.

Default low volume queue concurrency is 50 per https://github.com/wikimedia/mediawiki-services-change-propagation-jobqueue-deploy/blob/master/scap/vars.yaml#L101

So getting this to 100% without hitting the limit should be no problem.

Jan 22 2019, 4:24 PM · User-Addshore, Wikidata-Campsite (Wikidata-Campsite-Iteration-∞), Patch-For-Review, Wikimedia-Site-requests, Core Platform Team Backlog (Watching / External), Services (watching), WMF-JobQueue, wikidata-tech-focus, Wikibase-Quality-Constraints, Wikibase-Quality, Wikidata

Jan 17 2019

Pchelolo created T214103: Instrument Parsoid language variant conversions.
Jan 17 2019, 10:34 PM · Patch-For-Review, Services (watching), Parsoid
Pchelolo added a project to T214099: Stress test Parsoid's HTTP API: Services (watching).
Jan 17 2019, 10:32 PM · Services (watching), Parsoid-Web-API, Parsoid
Pchelolo created T214094: RESTBase should not respect Accept-Language for content version upgrades.
Jan 17 2019, 9:44 PM · Wikimedia-Incident, Core Platform Team Backlog (Next), Services (next), RESTBase
Pchelolo moved T214080: Rewrite Avro schemas (ApiAction, CirrusSearchRequestSet) as JSONSchema and produce to EventGate from Backlog to watching on the Services board.
Jan 17 2019, 9:41 PM · Patch-For-Review, Services (watching), Discovery, Analytics-EventLogging, EventBus, Analytics
Pchelolo closed T214056: ensure_content_type version checking fails if actual version patch number >=10 as Resolved.

Fixed and deployed.

Jan 17 2019, 8:04 PM · Reading-Infrastructure-Team-Backlog, RESTBase
Pchelolo added a comment to T206789: Modern Event Platform: Schema Registry: Implementation.

Should we create a new schema repo now for analytics purposes, or should we just use mediawiki/event-schemas for now and create a new repo later when it is time?

Jan 17 2019, 5:01 PM · Core Platform Team Backlog (Watching / External), Core Platform Team (Modern Event Platform (TEC2)), Services (watching), Analytics-EventLogging, EventBus, Analytics
Pchelolo added a comment to T213362: Limit what URLs Proton can access.

Regarding stronger CSP, we might need a bit of an investigation. We definitely do not want the CSP to vary by user agent, so we need to look how narrow we can make the CSP without breaking anything. I think wikidomain + *.wikimedia.org + wikidata (just in case) should work well. I'll look into it.

Jan 17 2019, 3:03 AM · Patch-For-Review, Reading-Infrastructure-Team-Backlog (Kanban), Security, Core Platform Team Backlog (Watching / External), Services (watching), Proton

Jan 16 2019

Pchelolo committed rMSRD5ba7582e10d6: Decrease number of workers to 2 per node (authored by Pchelolo).
Decrease number of workers to 2 per node
Jan 16 2019, 11:53 PM