Pchelolo
User

Projects (7)

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Tuesday

  • Clear sailing ahead.

User Details

User Since
Jun 24 2015, 10:23 AM (164 w, 4 d)
Availability
Available
LDAP User
Unknown
MediaWiki User
Pchelolo [ Global Accounts ]

Recent Activity

Yesterday

Pchelolo renamed T201868: Merge ORES precaching with ORESFetchScoreJob from Merge ORES precaching to Merge ORES precaching with ORESFetchScoreJob.
Sat, Aug 18, 1:07 AM · ORES, Services (designing), Scoring-platform-team
Pchelolo added a watcher for WMF-JobQueue: Pchelolo.
Sat, Aug 18, 12:55 AM
Pchelolo added a comment to T202179: RecordLintJob is sometimes too big.

Do you have a copy of the JSON?

Sat, Aug 18, 12:55 AM · Core-Platform-Team (CPT-Q1-Jul-Sep-2018), Patch-For-Review, MediaWiki-extensions-Linter, WMF-JobQueue, Parsoid, Services (watching)
Pchelolo added a comment to T201868: Merge ORES precaching with ORESFetchScoreJob.
What JobQueue request is a subset of what CP requests to cache. Can we request all from the JobQueue?

The models and wikis that have ores ext. enabled. $wgOresModels and $wgOresUiEnabled has the data

Sat, Aug 18, 12:30 AM · ORES, Services (designing), Scoring-platform-team
Pchelolo added a comment to T201869: ORES hooks.

Ok, how about:

/**
  * Called after a RevisionRecord ORES score was saved to the database.
  *
  * @param RevisionRecord $revision the RevisionRecord that has been scored. 
  * @param array $scores scores in the form returned by ORES service. 
  * For the response schema see https://ores.wikimedia.org/v3/scores/enwiki/?model_info=score_schema
  */
ORESRevisionRecordScoreSaved( RevisionRecord $revision, array $scores )
Sat, Aug 18, 12:24 AM · Analytics, ORES, Services (designing), Scoring-platform-team

Fri, Aug 17

Pchelolo created T202179: RecordLintJob is sometimes too big.
Fri, Aug 17, 11:10 PM · Core-Platform-Team (CPT-Q1-Jul-Sep-2018), Patch-For-Review, MediaWiki-extensions-Linter, WMF-JobQueue, Parsoid, Services (watching)
Pchelolo added a comment to T202107: Job queue should not overload the DB servers when there is replication lag.

One thing that's probably happening (and the new metric will allow us to prove that) is that when DB becomes slow, and the jobs start executing slower, all the high-traffic jobs, that run close to the concurrency limit reach the max concurrency and the lag starts to accumulate in Kafka.

Fri, Aug 17, 7:17 PM · Patch-For-Review, ChangeProp, Services, Availability
Pchelolo added a comment to T202107: Job queue should not overload the DB servers when there is replication lag.

As a start, I propose to vastly decrease the default limit, fine-tune jobs that don't fit and look if anything changes - that's much easier then implementing the global limit, can be done within a day and will give us additional data points.

Fri, Aug 17, 6:29 PM · Patch-For-Review, ChangeProp, Services, Availability
Pchelolo edited projects for T201974: Deprecation of API "action=query&prop=revisions&!rvslots", added: Services (doing); removed Services.

Will deploy RESTBase first thing on Monday, no Friday deploys :)

Fri, Aug 17, 4:39 PM · Services (doing), Parsoid, ChangeProp, Reading-Infrastructure-Team-Backlog, MediaWiki-API, Core-Platform-Team
Pchelolo added a comment to T202107: Job queue should not overload the DB servers when there is replication lag.

I think I've found the correct configuration file now, at mediawiki/services/change-propagation/jobqueue-deploy/scap/vars.yaml .

Fri, Aug 17, 6:26 AM · Patch-For-Review, ChangeProp, Services, Availability
Pchelolo added a comment to T202107: Job queue should not overload the DB servers when there is replication lag.

Just one very primary thought:

Fri, Aug 17, 1:46 AM · Patch-For-Review, ChangeProp, Services, Availability

Thu, Aug 16

Pchelolo updated the task description for T201974: Deprecation of API "action=query&prop=revisions&!rvslots".
Thu, Aug 16, 8:54 PM · Services (doing), Parsoid, ChangeProp, Reading-Infrastructure-Team-Backlog, MediaWiki-API, Core-Platform-Team
Pchelolo updated the task description for T201974: Deprecation of API "action=query&prop=revisions&!rvslots".
Thu, Aug 16, 8:53 PM · Services (doing), Parsoid, ChangeProp, Reading-Infrastructure-Team-Backlog, MediaWiki-API, Core-Platform-Team
Pchelolo added a comment to T201974: Deprecation of API "action=query&prop=revisions&!rvslots".

I believe it doesn't request MW API directly, however, RESTBase does. Will fix it shortly.

Thu, Aug 16, 8:33 PM · Services (doing), Parsoid, ChangeProp, Reading-Infrastructure-Team-Backlog, MediaWiki-API, Core-Platform-Team

Mon, Aug 13

Pchelolo added a comment to T186748: New service request: chromium-render/deploy.

Gotcha, is there an estimated date for deployment @Pchelolo?

Mon, Aug 13, 9:47 PM · Patch-For-Review, Readers-Web-Kanbanana-Board, Services (blocked), Service-deployment-requests, Readers-Web-Backlog, Proton, Electron-PDFs, Operations
Pchelolo added a comment to T186748: New service request: chromium-render/deploy.

The service is not yet deployed, so let's wait a little bit. before closing it. more things might come up that would deserve to be a subtask of this ticket.

Mon, Aug 13, 7:45 PM · Patch-For-Review, Readers-Web-Kanbanana-Board, Services (blocked), Service-deployment-requests, Readers-Web-Backlog, Proton, Electron-PDFs, Operations
Pchelolo added a project to T201869: ORES hooks: Analytics.
Mon, Aug 13, 7:32 PM · Analytics, ORES, Services (designing), Scoring-platform-team
Pchelolo renamed T201869: ORES hooks from O to ORES hooks.
Mon, Aug 13, 7:29 PM · Analytics, ORES, Services (designing), Scoring-platform-team
Pchelolo created T201869: ORES hooks.
Mon, Aug 13, 7:20 PM · Analytics, ORES, Services (designing), Scoring-platform-team
Pchelolo created T201868: Merge ORES precaching with ORESFetchScoreJob.
Mon, Aug 13, 7:20 PM · ORES, Services (designing), Scoring-platform-team

Thu, Aug 9

Pchelolo added a comment to T197000: Modify revision-score schema so that model probabilities won't conflict.

Let's get back on track.

Thu, Aug 9, 7:42 PM · Scoring-platform-team, Analytics-Kanban, Patch-For-Review, User-Ladsgroup, Services (watching), ORES, Analytics, EventBus

Wed, Aug 8

Pchelolo added a comment to T197000: Modify revision-score schema so that model probabilities won't conflict.

And also, looking into native ORES response, like https://ores.wikimedia.org/v3/scores/enwiki/854077897 the only issue I see is that the scores are prefixed with rev_id. Remove rev_id wrapping and I don't see any obvious conflicts.

Wed, Aug 8, 8:51 PM · Scoring-platform-team, Analytics-Kanban, Patch-For-Review, User-Ladsgroup, Services (watching), ORES, Analytics, EventBus
Pchelolo added a comment to T197000: Modify revision-score schema so that model probabilities won't conflict.

Ok, I revoke the idea of having this in ores - @Halfak said that within an API version regardless of the model version they maintain backward compatibility for output formats - so if the model version change, the client written for the previous model version won't break. This makes it easier to create a robust reformatter and put it into change-prop

Wed, Aug 8, 8:41 PM · Scoring-platform-team, Analytics-Kanban, Patch-For-Review, User-Ladsgroup, Services (watching), ORES, Analytics, EventBus
Pchelolo added a comment to T197000: Modify revision-score schema so that model probabilities won't conflict.

After a quick h-o with @Ottomata and @JAllemandou we've understood that the /precache endpoint used to produce these is kinda private, used only by change-prop, so we're free to change the format it emits in whatever way we want.

Wed, Aug 8, 8:08 PM · Scoring-platform-team, Analytics-Kanban, Patch-For-Review, User-Ladsgroup, Services (watching), ORES, Analytics, EventBus
Pchelolo committed rMSCD82a2208753c5: Only rerender mobile-sections for wikipedia. (authored by Pchelolo).
Only rerender mobile-sections for wikipedia.
Wed, Aug 8, 5:43 PM
Pchelolo committed rMSCDf0246f715554: Only rerender mobile-sections for wikipedia. (authored by Pchelolo).
Only rerender mobile-sections for wikipedia.
Wed, Aug 8, 5:43 PM
Pchelolo created T201526: Simplify change-propagation configuration.
Wed, Aug 8, 4:20 PM · Dependency-Tracking, Services (designing), User-mobrovac
Pchelolo added a comment to T201103: Reconsider use of RESTBase k-r-v storage for mobileapps.

Duh, thank you for pointing out the obvious. Somehow I originally read Petr's comment the other way round - that 73% of requests reach RESTBase, but now I realise that's not the case.

Wed, Aug 8, 2:50 PM · Patch-For-Review, Reading-Infrastructure-Team-Backlog, Services (designing), RESTBase, Cassandra, User-Eevans
Pchelolo added a comment to T201068: Modern Event Platform: Scalable Event Intake.

Implementing a new event in the current EventBus system made me think about a fairly random idea. We have a set of well-defined interfaces within MediaWiki, like RevisionRecored, User etc. Most of the events we will be "intaking" directly from MediaWiki will eventually have these MW interfaces recorded - some events will include info about the revision, some about the user, some about a particular revision slot etc.

Wed, Aug 8, 2:03 AM · Services (watching), Analytics-EventLogging, EventBus, Analytics, Analytics-Kanban

Tue, Aug 7

Pchelolo assigned T201158: Have a Grafana dashboard for Proton to pmiazga.
Tue, Aug 7, 11:05 PM · monitoring, Proton, Services (watching)
Pchelolo added a comment to T201158: Have a Grafana dashboard for Proton.

By simply exporting one from beta cluster grafana and importing it into production grafana I've created this https://grafana.wikimedia.org/dashboard/db/proton?orgId=1

Tue, Aug 7, 11:04 PM · monitoring, Proton, Services (watching)
Pchelolo added a comment to T201305: ThumbnailRender jobs not including the width in the fetch URL.

Does this failure happen on every job run or just some fraction of the attempts?

Tue, Aug 7, 6:04 PM · MW-1.32-release-notes (WMF-deploy-2018-08-21 (1.32.0-wmf.18)), Patch-For-Review, MediaWiki-File-management, Multimedia, WMF-JobQueue, Commons, Services (watching)
Pchelolo added a comment to T201062: Load change tags into the Analytics Data Lake on a daily basis.

The proposed schema falls into the revision hierarchy, so it will inherit from the revision-create schema in order to follow our guidelines. Apart from that, it will contain the new list of tags and the prior_state object with an old list of tags, again, because that's how we do it in other *-change events.

Tue, Aug 7, 5:11 PM · MW-1.32-release-notes (WMF-deploy-2018-08-21 (1.32.0-wmf.18)), Patch-For-Review, Services (watching), EventBus, Product-Analytics, Analytics
Pchelolo claimed T201062: Load change tags into the Analytics Data Lake on a daily basis.

revisions belonging to restored pages emit new revision-create events when the page is restored?!?

Tue, Aug 7, 2:52 PM · MW-1.32-release-notes (WMF-deploy-2018-08-21 (1.32.0-wmf.18)), Patch-For-Review, Services (watching), EventBus, Product-Analytics, Analytics
Pchelolo closed T201372: Identify the source of queries with consistency ALL as Invalid.
Tue, Aug 7, 12:39 AM · Services (next), Cassandra, RESTBase
Pchelolo created T201372: Identify the source of queries with consistency ALL.
Tue, Aug 7, 12:00 AM · Services (next), Cassandra, RESTBase

Mon, Aug 6

Pchelolo created T201363: RESTBase should report what exactly was not found for 404.
Mon, Aug 6, 10:11 PM · Services (later), Easy, RESTBase
Pchelolo merged T199527: Storage for mobile-html endpoint into T201103: Reconsider use of RESTBase k-r-v storage for mobileapps.
Mon, Aug 6, 8:48 PM · Patch-For-Review, Reading-Infrastructure-Team-Backlog, Services (designing), RESTBase, Cassandra, User-Eevans
Pchelolo merged task T199527: Storage for mobile-html endpoint into T201103: Reconsider use of RESTBase k-r-v storage for mobileapps.
Mon, Aug 6, 8:48 PM · Reading-Infrastructure-Team-Backlog, Services (designing), Page Content Service, Reading Epics (Platform JS CSS and HTML consolidation)
Pchelolo added a comment to T201103: Reconsider use of RESTBase k-r-v storage for mobileapps.

Although, these calculations are try for mobile-sections that will likely be replaced with mobile-html very soon, and the latency calculations for the new endpoint will probably be different.

Mon, Aug 6, 7:30 PM · Patch-For-Review, Reading-Infrastructure-Team-Backlog, Services (designing), RESTBase, Cassandra, User-Eevans
Pchelolo added a comment to T201103: Reconsider use of RESTBase k-r-v storage for mobileapps.

Given that p95 latency for MCS generating the mobile-sections from scratch is between 500 ms and 1 second, only 5% of the requests not served by varnish with result in client-side latency, so, 64500 reqs per day giving us the SLA that 98% of the overall requests will be served way within 1 second latency. Given that for mobile clients the network delay is probably way more important in driving up the overall page load latency, I believe in might be a fair tradeoff to stop pre-generating mobile content.

Mon, Aug 6, 7:29 PM · Patch-For-Review, Reading-Infrastructure-Team-Backlog, Services (designing), RESTBase, Cassandra, User-Eevans
Pchelolo added a comment to T201103: Reconsider use of RESTBase k-r-v storage for mobileapps.

A little bit more data: according to webrequest logs mobile-sections-lead was requested 4.808.026 times on 2018/08/03. According to RESTBase graphs, on the same day the average rate of requests reaching RESTbase was 15/s, which gives us 1.296.000 Varnish cache-misses giving the hit ratio of 0.73

Mon, Aug 6, 7:23 PM · Patch-For-Review, Reading-Infrastructure-Team-Backlog, Services (designing), RESTBase, Cassandra, User-Eevans
Pchelolo added a comment to T201103: Reconsider use of RESTBase k-r-v storage for mobileapps.

Right, that model is clearly not tenable on the long run, either. The next question would be then what percentage of the objects stored in restbase ever get re-read before they expire/are regenerated.

Mon, Aug 6, 7:11 PM · Patch-For-Review, Reading-Infrastructure-Team-Backlog, Services (designing), RESTBase, Cassandra, User-Eevans
Pchelolo added a comment to T201305: ThumbnailRender jobs not including the width in the fetch URL.

Where did you find out the reason is specifically that the width is not included in the final request URI? I can't find this info anywhere

Mon, Aug 6, 6:34 PM · MW-1.32-release-notes (WMF-deploy-2018-08-21 (1.32.0-wmf.18)), Patch-For-Review, MediaWiki-File-management, Multimedia, WMF-JobQueue, Commons, Services (watching)
Pchelolo added a comment to T199101: Validate swagger definitions and test them against a set of responses from the services.

I'm not sure if it should have it, if you look at the swagger UI the row for that parameter doesn't have a name and it looks weird, so maybe it should?

Mon, Aug 6, 5:47 PM · Services (watching), Epic, Page Content Service, Mobile-Content-Service, Reading-Infrastructure-Team-Backlog

Thu, Aug 2

Pchelolo added a project to T105887: CirrusSearch generates PHP notices when server is down: Services (watching).

Just started happening again recently with a fairly high rate: https://logstash.wikimedia.org/goto/b78e539d56b4286f3096b061d2ebbc51

Thu, Aug 2, 10:53 PM · Patch-For-Review, Discovery-Search (Current work), Services (watching), CirrusSearch, Discovery
Pchelolo added a comment to T201103: Reconsider use of RESTBase k-r-v storage for mobileapps.

One other reason for using the k-r-v pattern is that mobile content consists of a significant number of chunks - previously those were mobile-sections-lead and mobile-sections-remaining, now with PCS it's mobile-html, metadata, media, references etc. Since they all are fetched lazily in different times, in the perfect world the user would expect to get the version of references that correspond exactly to the render of the content they've been reading, so we also have the grace period when we need older renders here.

Thu, Aug 2, 9:44 PM · Patch-For-Review, Reading-Infrastructure-Team-Backlog, Services (designing), RESTBase, Cassandra, User-Eevans
Pchelolo added projects to T201103: Reconsider use of RESTBase k-r-v storage for mobileapps: Services (designing), Reading-Infrastructure-Team-Backlog.
Thu, Aug 2, 9:29 PM · Patch-For-Review, Reading-Infrastructure-Team-Backlog, Services (designing), RESTBase, Cassandra, User-Eevans
Pchelolo added a comment to T201063: Modern Event Platform: Schema Registry.
  • As an engineer I want each schema/(schema revision) to have a unique ID in a form of a publically accessible URI
  • As an engineer I want to be able to reuse and reference schemas from one another using the aforementioned ID in order to avoid copy-pasting the code.
Thu, Aug 2, 9:29 PM · Services (watching), Analytics-EventLogging, EventBus, Analytics, Analytics-Kanban
Pchelolo added a subtask for T201068: Modern Event Platform: Scalable Event Intake: T120242: Reliable (atomic) MediaWiki event production.
Thu, Aug 2, 9:15 PM · Services (watching), Analytics-EventLogging, EventBus, Analytics, Analytics-Kanban
Pchelolo added a parent task for T120242: Reliable (atomic) MediaWiki event production: T201068: Modern Event Platform: Scalable Event Intake.
Thu, Aug 2, 9:14 PM · EventBus, Analytics, Services (later)
Pchelolo added a comment to T201068: Modern Event Platform: Scalable Event Intake.
  • As an engineer, I want to be able to guarantee production of the event and be able to retry until the event is indeed produced T120242
Thu, Aug 2, 9:14 PM · Services (watching), Analytics-EventLogging, EventBus, Analytics, Analytics-Kanban
Pchelolo moved T185233: Modern Event Platform from Inbox to External Goals on the Core Platform Team Goals board.
Thu, Aug 2, 9:12 PM · Core Platform Team Goals, Goal, Services (watching), Analytics-EventLogging, EventBus, Analytics, Analytics-Kanban
Pchelolo added projects to T185233: Modern Event Platform: Goal, Core Platform Team Goals.
Thu, Aug 2, 9:12 PM · Core Platform Team Goals, Goal, Services (watching), Analytics-EventLogging, EventBus, Analytics, Analytics-Kanban
Pchelolo merged T199172: Modern Event Platform Specification (TEC2) into T185233: Modern Event Platform.
Thu, Aug 2, 9:11 PM · Core Platform Team Goals, Goal, Services (watching), Analytics-EventLogging, EventBus, Analytics, Analytics-Kanban
Pchelolo merged task T199172: Modern Event Platform Specification (TEC2) into T185233: Modern Event Platform.
Thu, Aug 2, 9:11 PM · Goal, Core Platform Team Goals
Pchelolo added a comment to T199172: Modern Event Platform Specification (TEC2).

Ye, @CCicalese_WMF was creating them for each goad the Core Platform team is a part of. I'll merge

Thu, Aug 2, 9:10 PM · Goal, Core Platform Team Goals
Pchelolo added a comment to T199172: Modern Event Platform Specification (TEC2).

I believe we could either merge this with the parent or use this one for our part of the work (which is still unclear what exactly that part will be)

Thu, Aug 2, 9:06 PM · Goal, Core Platform Team Goals
Pchelolo added a parent task for T199172: Modern Event Platform Specification (TEC2): T185233: Modern Event Platform.
Thu, Aug 2, 9:06 PM · Goal, Core Platform Team Goals
Pchelolo added a subtask for T185233: Modern Event Platform: T199172: Modern Event Platform Specification (TEC2).
Thu, Aug 2, 9:06 PM · Core Platform Team Goals, Goal, Services (watching), Analytics-EventLogging, EventBus, Analytics, Analytics-Kanban
Pchelolo added a project to T195066: Split examples away from service-template-node: Easy.
Thu, Aug 2, 8:53 PM · Easy, service-template-node, Services (later)
Pchelolo added a comment to T186748: New service request: chromium-render/deploy.

https://github.com/wikimedia/restbase/pull/1043

Thu, Aug 2, 7:17 PM · Patch-For-Review, Readers-Web-Kanbanana-Board, Services (blocked), Service-deployment-requests, Readers-Web-Backlog, Proton, Electron-PDFs, Operations
Pchelolo added a comment to T186748: New service request: chromium-render/deploy.

Ping @mobrovac. Have you made any progress on the RESTBase module that will split traffic between the two backend services?

Thu, Aug 2, 6:24 PM · Patch-For-Review, Readers-Web-Kanbanana-Board, Services (blocked), Service-deployment-requests, Readers-Web-Backlog, Proton, Electron-PDFs, Operations
Pchelolo added a watcher for Dependency-Tracking: Pchelolo.
Thu, Aug 2, 3:47 PM

Wed, Aug 1

Pchelolo accepted D1091: Set timestamps in last-event-id +1 millisecond to avoid duplicate messages on reconnect.
Wed, Aug 1, 5:59 PM
Pchelolo accepted D1090: Add useTimestampForId option.
Wed, Aug 1, 2:26 PM

Tue, Jul 31

Pchelolo added a comment to T199433: Redesign EventStreams for better multi-dc support.

The message timestamp should be set by the producer (is EventBus doing this? it should), and it should correspond to meta.dt

Tue, Jul 31, 8:22 PM · Analytics-Kanban, Patch-For-Review, Wikimedia-Incident, Services (watching), Analytics, EventBus, Wikimedia-Stream
Pchelolo added a comment to T199433: Redesign EventStreams for better multi-dc support.

If a message arrives late, there are scenarios where a consumer will get a lot of extra messages

Tue, Jul 31, 8:10 PM · Analytics-Kanban, Patch-For-Review, Wikimedia-Incident, Services (watching), Analytics, EventBus, Wikimedia-Stream
Pchelolo added a comment to T199101: Validate swagger definitions and test them against a set of responses from the services.

Looks like the JSON output in https://en.wikipedia.org/api/rest_v1/?spec doesn't include any of the definitions.

Tue, Jul 31, 7:23 PM · Services (watching), Epic, Page Content Service, Mobile-Content-Service, Reading-Infrastructure-Team-Backlog
Pchelolo moved T200594: Add client identifier to requests sent from Kartotherian to WDQS from Backlog to watching on the Services board.
Tue, Jul 31, 7:16 PM · Services (watching), Maps-Sprint, Reading-Infrastructure-Team-Backlog, Wikidata, Maps (Kartotherian), Wikidata-Query-Service
Pchelolo added a comment to T199443: Remove `kafka-mirror` unit from main kafka cluster.

Ye, I just didn't really know what exactly that is and in the heat of the outage I was a bit confused.

Tue, Jul 31, 6:52 PM · Services (watching), EventBus, Analytics
Pchelolo added a comment to T199433: Redesign EventStreams for better multi-dc support.

What's exactly the benefit of providing the exact offset? The timestamp has millisecond resolution and in practice, our topics have low enough traffic for a millisecond timestamps to be a very definitive id for a particular message.

Tue, Jul 31, 6:45 PM · Analytics-Kanban, Patch-For-Review, Wikimedia-Incident, Services (watching), Analytics, EventBus, Wikimedia-Stream
Pchelolo added projects to T199270: deployment-tin:/srv/mediawiki-staging/wmf-config/event-schemas is out of sync: Services (watching), Analytics.

In production, the event-schemas are deployed automatically as soon as a patch is merged in gerrit in this repo. I don't have any idea why that shouldn't be done the same way in labs. @Ottomata was setting up this repo, so pinging him

Tue, Jul 31, 2:27 PM · Analytics, Services (watching), Beta-Cluster-Infrastructure

Mon, Jul 30

Pchelolo closed T197254: Re-enable cross DC mirroring of job and change-prop Kafka topics over TLS as Resolved.

Seems like this was done. Resolving.

Mon, Jul 30, 8:45 PM · Patch-For-Review, Analytics-Kanban, Services (watching), Analytics
Pchelolo closed T197254: Re-enable cross DC mirroring of job and change-prop Kafka topics over TLS, a subtask of T196081: Enable TLS and authorization for cross DC MirrorMaker, as Resolved.
Mon, Jul 30, 8:45 PM · Patch-For-Review, Analytics-Kanban, Services (watching), Analytics
Pchelolo added a comment to T200374: Update indirect dependency on github.com/gwicke/kad.git.

And transferred to wikimedia group.

Mon, Jul 30, 8:38 PM · Services (later), service-runner
Pchelolo closed T200282: Page previews sometimes shows a vandalized older revision of article as Declined.

Hm.. I've looked into Kafka topics that should've triggered the update, but the topics have already rolled over, so there's no way of knowing whether the message was missed or something else happened.

Mon, Jul 30, 8:37 PM · Reading-Infrastructure-Team-Backlog, Services, Mobile-Content-Service
Pchelolo edited projects for T200215: Create kafka topic for mjolinr bulk daemon and decide on cluster, added: Services (watching); removed Services.
Mon, Jul 30, 8:14 PM · Patch-For-Review, EventBus, Services (watching), Operations, Analytics, Discovery-Search (Current work)
Pchelolo closed T188164: Popups don‘t support language variant conversion and {{lang}} template as Resolved.

Everything is done here on the API side and on the popups side. For example, on sr.wikipedia.org the content of the preview respects user's variant settings.

Mon, Jul 30, 8:06 PM · Epic, Services (watching), Parsoid, Readers-Web-Backlog (Tracking), Reading-Infrastructure-Team-Backlog, Mobile-Content-Service, MediaWiki-Language-converter, Chinese-Sites, Page-Previews
Pchelolo closed T159985: Implement language variant support in the REST API as Resolved.

RESTBase API now supports language variants, but the actual converters are enabled only on a subset of wikis. However, nothing else needs to be done on the API side.

Mon, Jul 30, 8:02 PM · Readers-Web-Backlog (Tracking), Patch-For-Review, MediaWiki-Language-converter, Parsing-Team, Reading Epics (Platform JS CSS and HTML consolidation), Services (blocked), RESTBase-API, Chinese-Sites, Wikipedia-Android-App-Backlog
Pchelolo closed T159985: Implement language variant support in the REST API, a subtask of T190689: FY17/18 Q4 Program 7 Services Goal: Language variants support, as Resolved.
Mon, Jul 30, 8:02 PM · Patch-For-Review, Services (doing), Goal, RESTBase-Cassandra, RESTBase-API, RESTBase, Cassandra
Pchelolo closed T198465: Enable language variants support for summary as Resolved.

The support was deployed. Resolving.

Mon, Jul 30, 8:00 PM · Services (doing), RESTBase-API, RESTBase
Pchelolo closed T198465: Enable language variants support for summary, a subtask of T190689: FY17/18 Q4 Program 7 Services Goal: Language variants support, as Resolved.
Mon, Jul 30, 8:00 PM · Patch-For-Review, Services (doing), Goal, RESTBase-Cassandra, RESTBase-API, RESTBase, Cassandra

Jul 19 2018

Pchelolo updated the task description for T198465: Enable language variants support for summary.
Jul 19 2018, 1:05 PM · Services (doing), RESTBase-API, RESTBase
Pchelolo moved T199992: Javanese OCR installation steps for Wikisource from Backlog to watching on the Services board.
Jul 19 2018, 12:57 PM · ProofreadPage, I18n, Wikisource

Jul 18 2018

Pchelolo added a comment to T199428: Puppetize dev cluster change-prop installation.

each of the two CP instances needs to have a distinctive set of rules

Jul 18 2018, 8:25 AM · Wikimedia-Incident, ChangeProp, Services (later)

Jul 13 2018

Pchelolo closed T148645: Content service doesn't handle URL fragments when redirecting as Resolved.

Now it does.

Jul 13 2018, 12:21 PM · Services (done), RESTBase-API, Reading-Infrastructure-Team-Backlog, Android-app-Bugs, RESTBase, Wikipedia-Android-App-Backlog, Mobile-Content-Service
Pchelolo triaged T199527: Storage for mobile-html endpoint as Normal priority.
Jul 13 2018, 12:00 PM · Reading-Infrastructure-Team-Backlog, Services (designing), Page Content Service, Reading Epics (Platform JS CSS and HTML consolidation)
Pchelolo added a comment to T199491: Expose /page/mobile-html endpoint via RESTBase.

Is this html optimized for mobile reading use-cases? If so, why not /page/mobile-html? Or even /page/html/Bla?mobule=true?

Jul 13 2018, 8:30 AM · Services (done), Reading-Infrastructure-Team-Backlog (Kanban), Page Content Service, Reading Epics (Platform JS CSS and HTML consolidation)

Jul 12 2018

Pchelolo added a comment to T198619: Send the Accept-Language header with RESTBase API request for page preview requests.

I can see that the a header is set to sr on Cerbian wiki - bravo, that unblocks us from deploying the language variants for the summary endpoint and if I change my preferences I can see sr-ec and sr-el. Thank you, I think this could be resolved.

Jul 12 2018, 3:56 PM · Chinese-Sites, MW-1.32-release-notes (WMF-deploy-2018-07-10 (1.32.0-wmf.12)), Readers-Web-Kanbanana-Board, Services (blocked), Readers-Web-Backlog, Page-Previews
Pchelolo renamed T199444: After switchover to codfw Job queue ChangeProp logged KafkaConsumer is not connected from After switchover to codfw ChangeProp logged KafkaConsumer is not connected to After switchover to codfw Job queue ChangeProp logged KafkaConsumer is not connected.
Jul 12 2018, 1:50 PM · Wikimedia-Incident, Services (later), EventBus, WMF-JobQueue, Analytics
Pchelolo created T199444: After switchover to codfw Job queue ChangeProp logged KafkaConsumer is not connected.
Jul 12 2018, 1:50 PM · Wikimedia-Incident, Services (later), EventBus, WMF-JobQueue, Analytics
Pchelolo created T199443: Remove `kafka-mirror` unit from main kafka cluster.
Jul 12 2018, 1:45 PM · Services (watching), EventBus, Analytics
Pchelolo created T199441: Document the process for hard-deleting topics in kafka.
Jul 12 2018, 1:42 PM · User-Elukey, Analytics, Wikimedia-Incident, EventBus, Operations, Services (watching)
Pchelolo created T199433: Redesign EventStreams for better multi-dc support.
Jul 12 2018, 12:07 PM · Analytics-Kanban, Patch-For-Review, Wikimedia-Incident, Services (watching), Analytics, EventBus, Wikimedia-Stream
Pchelolo created T199432: Consider disabling automatic topic creation in main-kafka.
Jul 12 2018, 12:00 PM · ChangeProp, EventBus, WMF-JobQueue, Services (designing), Analytics
Pchelolo added a project to T199428: Puppetize dev cluster change-prop installation: Wikimedia-Incident.
Jul 12 2018, 11:55 AM · Wikimedia-Incident, ChangeProp, Services (later)
Pchelolo added a project to T199427: Separate dev Change-Prop from production Kafka cluster: Wikimedia-Incident.
Jul 12 2018, 11:55 AM · Analytics, Wikimedia-Incident, ChangeProp, Operations, Services (designing)
Pchelolo created T199431: Consider the possibility of separating ChangeProp and JobQueue on Kafka level.
Jul 12 2018, 11:54 AM · Analytics, Wikimedia-Incident, Services (designing), ChangeProp, MediaWiki-JobQueue, Operations
Pchelolo created T199428: Puppetize dev cluster change-prop installation.
Jul 12 2018, 11:37 AM · Wikimedia-Incident, ChangeProp, Services (later)