Page MenuHomePhabricator

Pchelolo
User

Projects (7)

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Sunday

  • Clear sailing ahead.

User Details

User Since
Jun 24 2015, 10:23 AM (199 w, 2 d)
Availability
Available
LDAP User
Unknown
MediaWiki User
Pchelolo [ Global Accounts ]

Recent Activity

Yesterday

Pchelolo added a comment to T221368: cdnPurge and other jobs fail completely to execute.

The use of an invalid title here was intentional, although that was with the idea that it would never make it into the queue. Recent work has removed the mandatory existence of a title parameter. Any jobs passing them through the main signature as before are normalized to set the title as a regular params key.

Thu, Apr 18, 3:16 PM · MW-1.34-notes (1.34.0-wmf.3; 2019-04-30), Core Platform Team Kanban (Done with CPT), Services (done), Core Platform Team (Security, stability, performance and scalability (TEC1)), WMF-JobQueue, Performance-Team, MediaWiki-JobQueue, Wikimedia-production-error
Pchelolo added a comment to T221368: cdnPurge and other jobs fail completely to execute.

This is caused by https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/500171/ and specifically https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/500171/14/includes/jobqueue/Job.php where it sets the default title to Title::makeTitle( NS_SPECIAL, '').

Thu, Apr 18, 2:27 PM · MW-1.34-notes (1.34.0-wmf.3; 2019-04-30), Core Platform Team Kanban (Done with CPT), Services (done), Core Platform Team (Security, stability, performance and scalability (TEC1)), WMF-JobQueue, Performance-Team, MediaWiki-JobQueue, Wikimedia-production-error

Wed, Apr 17

Pchelolo added a comment to T220661: EventGate service runner worker occasionally killed, usually during higher load.

Agreed, let's do it!

Wed, Apr 17, 2:54 PM · Analytics-Kanban, Patch-For-Review, Services (watching), EventBus, Analytics

Mon, Apr 15

Pchelolo added a comment to T221031: Create new mobile storage tables.

Let's first execute in deployment-prep and follow into production after we merge/deploy https://github.com/wikimedia/restbase/pull/1117 in beta to verify all good and correct?

Mon, Apr 15, 8:40 PM · Core Platform Team Kanban (Done with CPT), Services (done), Core Platform Team (RESTBase Split (CDP2)), User-Eevans, Reading-Infrastructure-Team-Backlog, RESTBase
Pchelolo created T221031: Create new mobile storage tables.
Mon, Apr 15, 7:45 PM · Core Platform Team Kanban (Done with CPT), Services (done), Core Platform Team (RESTBase Split (CDP2)), User-Eevans, Reading-Infrastructure-Team-Backlog, RESTBase

Sun, Apr 14

Pchelolo claimed T220010: Remove listing endpoints from REST API.

needed to do it before moving to key-value refactoring.
PR: https://github.com/wikimedia/restbase/pull/1115

Sun, Apr 14, 5:47 PM · Core Platform Team Kanban (Done with CPT), Services (done), Core Platform Team (RESTBase Split (CDP2)), RESTBase

Fri, Apr 12

Pchelolo added a comment to T220661: EventGate service runner worker occasionally killed, usually during higher load.

@akosiaris no, spanning up a new worker takes no time, the problem here is actually hilling old worker.

Fri, Apr 12, 2:47 PM · Analytics-Kanban, Patch-For-Review, Services (watching), EventBus, Analytics

Thu, Apr 11

Pchelolo added a comment to T214094: RESTBase should not respect Accept-Language for content version upgrades.

oh yes, it totally is a followup. Thank you.

Thu, Apr 11, 9:14 PM · Wikimedia-Incident, Core Platform Team Backlog (Next), Services (next), RESTBase
Pchelolo added a comment to T220725: Factor lib/kafka.js out of eventgate and change-propagation into its own library.

I've also had an idea to create a limited concurrency consumer for change-prop use-case, eg T206186

Thu, Apr 11, 6:15 PM · Core Platform Team (Modern Event Platform (TEC2)), Core Platform Team Backlog (Next), Services (next), EventBus, Analytics

Wed, Apr 10

Pchelolo added a comment to T220661: EventGate service runner worker occasionally killed, usually during higher load.

Hm, the sendmsg that happened before a 5-second delay was for port 9125, which is statsd_exporter.

Wed, Apr 10, 9:44 PM · Analytics-Kanban, Patch-For-Review, Services (watching), EventBus, Analytics
Pchelolo added a comment to T220661: EventGate service runner worker occasionally killed, usually during higher load.

These 2 heartbeats are more than 10s apart:

Wed, Apr 10, 9:33 PM · Analytics-Kanban, Patch-For-Review, Services (watching), EventBus, Analytics
Pchelolo added a comment to T210651: Switch all PDF render traffic to new Proton service.

We have been splitting the traffic (thus load testing Proton on real traffic) for a long time now, so the switch by now is only switching the content that's actually served to the clients. I do not think it worths making a multi-stage deployment here.

Wed, Apr 10, 7:51 PM · Reading-Infrastructure-Team-Backlog, Core Platform Team Backlog (Later), Services (next), Readers-Web-Backlog (Tracking), Proton
Pchelolo added a comment to T219148: Use PHP7 to run all async jobs.

However, I agree that enabling jobs in production might be premature, we can probably start experimenting in beta cluster. However, we'd need to resolve T215339 ASAP

Wed, Apr 10, 6:46 PM · Patch-For-Review, Core Platform Team Backlog (Watching / External), User-jijiki, Services (watching), Operations, serviceops
Pchelolo added a comment to T219148: Use PHP7 to run all async jobs.

A job doesn't offer a way with retrying when they fail.

Wed, Apr 10, 6:42 PM · Patch-For-Review, Core Platform Team Backlog (Watching / External), User-jijiki, Services (watching), Operations, serviceops
Pchelolo added a comment to T219883: Specify file format for API test definitions.

A couple of thouths

Wed, Apr 10, 3:30 PM · Core Platform Team Kanban (Doing), Code-Health, Core Platform Team (Code Health (TEC13))

Tue, Apr 9

Pchelolo updated the task description for T218218: Make RESTBase spec standard compliant and switch to OpenAPI 3.0.
Tue, Apr 9, 7:51 PM · Patch-For-Review, Services (doing), Core Platform Team Kanban (Doing), Core Platform Team (RESTBase Split (CDP2)), RESTBase, RESTBase-API, serviceops, Operations
Pchelolo edited projects for T220477: Eventbus errors: Failed processing event: Failed validating at path rev_id, added: Services (doing); removed Services.

Sorry about that. Fixed by above patch.

Tue, Apr 9, 4:43 PM · MW-1.33-notes (1.33.0-wmf.25; 2019-04-09), Core Platform Team (Security, stability, performance and scalability (TEC1)), Core Platform Team Kanban (Done with CPT), Services (done), EventBus, Analytics, Operations

Fri, Apr 5

Mill <mill@mail.com> committed rMSCDc4d28d0dfdff: xybaaaaaaaaaaa (authored by Pchelolo).
xybaaaaaaaaaaa
Fri, Apr 5, 10:36 PM
Pchelolo added a comment to T220221: Recommendation API end point has disappeared after the upgrade.

Oh hell @bmansurov we do have x-amples tests... The patch will enable them.

Fri, Apr 5, 8:34 PM · Core Platform Team Kanban (Done with CPT), Services (done), Core Platform Team (RESTBase Split (CDP2)), RESTBase-API, RESTBase
Pchelolo added a comment to T220221: Recommendation API end point has disappeared after the upgrade.

As a followup - should we enable some x-amples checks for this endpoint?

Fri, Apr 5, 8:17 PM · Core Platform Team Kanban (Done with CPT), Services (done), Core Platform Team (RESTBase Split (CDP2)), RESTBase-API, RESTBase
fgiunchedi awarded T211125: Move service-runner to new logging infrastructure a Love token.
Fri, Apr 5, 9:33 AM · Patch-For-Review, Core Platform Team Kanban (Done with CPT), Services (done), service-runner, Wikimedia-Logstash, Operations

Thu, Apr 4

Pchelolo updated subscribers of T219923: Move graphoid logging to new logging pipeline.

Apparently graphoid is still using service::node::config and not the config template in the deployment repo. Given that graphoid will be switched to k8s soon, should we just postpone this until the switch, move graphoid to deployment-repo config or do the puppet work to enable rsyslog in service::node::config? What do you think @akosiaris @fgiunchedi @mobrovac ?

Thu, Apr 4, 8:09 PM · Core Platform Team Kanban (Blocked Externally), Services (blocked), Core Platform Team (Security, stability, performance and scalability (TEC1)), service-runner, Wikimedia-Logstash, Operations
Pchelolo added a comment to T211125: Move service-runner to new logging infrastructure.

ChangeProp and JobQueue ChangeProp has been moved to the new logging infra as well.

Thu, Apr 4, 6:00 PM · Patch-For-Review, Core Platform Team Kanban (Done with CPT), Services (done), service-runner, Wikimedia-Logstash, Operations
Pchelolo closed T220128: Reset 2FA for Horizon for user ppchelko as Resolved.

Oh, awesome. Thank you!

Thu, Apr 4, 5:07 PM · wikitech.wikimedia.org, Operations
Pchelolo added a comment to T220128: Reset 2FA for Horizon for user ppchelko.

Unfortunately, no.

Thu, Apr 4, 4:58 PM · wikitech.wikimedia.org, Operations
Pchelolo created T220128: Reset 2FA for Horizon for user ppchelko.
Thu, Apr 4, 4:50 PM · wikitech.wikimedia.org, Operations
Pchelolo created T220127: Reuse JobExecutor within a JobRunner.
Thu, Apr 4, 4:45 PM · Patch-For-Review, Core Platform Team (Security, stability, performance and scalability (TEC1)), Core Platform Team Backlog (Next), Services (next), WMF-JobQueue, MediaWiki-JobQueue
Pchelolo committed rMSCDf69dc9c1a73f: Update change-propagation to e133710 (authored by Pchelolo).
Update change-propagation to e133710
Thu, Apr 4, 3:01 PM
Pchelolo updated subscribers of T220034: Node.js composition layer for Suggested Edits suggestions.

This feature is very similar to what Recommendation-API is doing. Might be worth talking to Research and @bmansurov in particular.

Thu, Apr 4, 2:39 PM · Core Platform Team Backlog (Watching / External), Services (watching), Reading-Infrastructure-Team-Backlog, WikimediaEditorTasks

Wed, Apr 3

Pchelolo added a comment to T220037: RefreshLinksJob::runForTitle: transaction round 'RefreshLinksJob::run' already started on commons.

The patch above should fix it.

Wed, Apr 3, 8:38 PM · Core Platform Team Kanban (Done with CPT), Services (done), MW-1.33-notes (1.33.0-wmf.24; 2019-04-02), Core Platform Team (Security, stability, performance and scalability (TEC1)), Analytics, EventBus
Pchelolo added a comment to T215960: Simplify MCS storage model.

PR: https://github.com/wikimedia/restbase/pull/1106

Wed, Apr 3, 7:49 PM · Core Platform Team Kanban (Doing), Services (doing), Core Platform Team (RESTBase Split (CDP2)), User-Eevans, Reading-Infrastructure-Team-Backlog, RESTBase
Pchelolo added a project to T216636: Consider deprecating section editing API in RESTBase: Core Platform Team (RESTBase Split (CDP2)).
Wed, Apr 3, 4:10 PM · Core Platform Team (RESTBase Split (CDP2)), Core Platform Team Backlog (Later), Services (designing), VisualEditor, RESTBase
Pchelolo added a project to T220010: Remove listing endpoints from REST API: Core Platform Team Backlog.
Wed, Apr 3, 4:09 PM · Core Platform Team Kanban (Done with CPT), Services (done), Core Platform Team (RESTBase Split (CDP2)), RESTBase
Pchelolo created T220010: Remove listing endpoints from REST API.
Wed, Apr 3, 4:05 PM · Core Platform Team Kanban (Done with CPT), Services (done), Core Platform Team (RESTBase Split (CDP2)), RESTBase
Pchelolo edited projects for T215956: Consider stashing data-parsoid for VE , added: Core Platform Team (RESTBase Split (CDP2)); removed Traffic.
Wed, Apr 3, 2:51 PM · Core Platform Team (RESTBase Split (CDP2)), Operations, User-Eevans, User-mobrovac, Core Platform Team Backlog (Designing), Parsoid, VisualEditor, RESTBase, Services (designing)
Pchelolo added a project to T215960: Simplify MCS storage model: Core Platform Team (RESTBase Split (CDP2)).
Wed, Apr 3, 2:50 PM · Core Platform Team Kanban (Doing), Services (doing), Core Platform Team (RESTBase Split (CDP2)), User-Eevans, Reading-Infrastructure-Team-Backlog, RESTBase

Tue, Apr 2

Pchelolo committed rMSCD661225d8ba63: Use rsyslog for logging. (authored by Pchelolo).
Use rsyslog for logging.
Tue, Apr 2, 8:29 PM
Pchelolo created T219928: Move AQS logging to new logging pipeline.
Tue, Apr 2, 7:31 PM · Analytics, Core Platform Team Backlog (Watching / External), Services (watching), service-runner, Wikimedia-Logstash, Operations
Pchelolo created T219927: Move parsoid logging to new logging pipeline.
Tue, Apr 2, 7:30 PM · Parsoid, Core Platform Team Backlog (Watching / External), Services (watching), service-runner, Wikimedia-Logstash, Operations
Pchelolo created T219926: Move recommendation-api logging to new logging pipeline.
Tue, Apr 2, 7:28 PM · Recommendation-API, Core Platform Team Backlog (Watching / External), Services (watching), service-runner, Wikimedia-Logstash, Operations
Pchelolo created T219925: Move proton logging to new logging pipeline.
Tue, Apr 2, 7:27 PM · Reading-Infrastructure-Team-Backlog, Core Platform Team Backlog (Watching / External), Services (watching), service-runner, Wikimedia-Logstash, Operations
Pchelolo created T219924: Move mobile apps logging to new logging pipeline.
Tue, Apr 2, 7:26 PM · Reading-Infrastructure-Team-Backlog, Core Platform Team Backlog (Watching / External), Services (watching), service-runner, Wikimedia-Logstash, Operations
Pchelolo created T219923: Move graphoid logging to new logging pipeline.
Tue, Apr 2, 7:25 PM · Core Platform Team Kanban (Blocked Externally), Services (blocked), Core Platform Team (Security, stability, performance and scalability (TEC1)), service-runner, Wikimedia-Logstash, Operations
Pchelolo created T219922: Move eventstreams logging to new logging pipeline.
Tue, Apr 2, 7:23 PM · Analytics, Core Platform Team Backlog (Watching / External), Services (watching), service-runner, Wikimedia-Logstash, Operations
Pchelolo updated the task description for T219921: Move cxserver logging to new logging pipeline.
Tue, Apr 2, 7:22 PM · Patch-For-Review, CX-cxserver, Core Platform Team Backlog (Watching / External), Services (watching), service-runner, Wikimedia-Logstash, Operations
Pchelolo created T219921: Move cxserver logging to new logging pipeline.
Tue, Apr 2, 7:21 PM · Patch-For-Review, CX-cxserver, Core Platform Team Backlog (Watching / External), Services (watching), service-runner, Wikimedia-Logstash, Operations
Pchelolo reassigned T219919: Move citoid logging to new logging pipeline from Pchelolo to Mvolz.
Tue, Apr 2, 7:19 PM · Citoid, Core Platform Team Backlog (Watching / External), Services (watching), service-runner, Wikimedia-Logstash, Operations
Pchelolo created T219919: Move citoid logging to new logging pipeline.
Tue, Apr 2, 7:19 PM · Citoid, Core Platform Team Backlog (Watching / External), Services (watching), service-runner, Wikimedia-Logstash, Operations
Pchelolo claimed T211125: Move service-runner to new logging infrastructure.
Tue, Apr 2, 7:17 PM · Patch-For-Review, Core Platform Team Kanban (Done with CPT), Services (done), service-runner, Wikimedia-Logstash, Operations
Pchelolo added a comment to T211125: Move service-runner to new logging infrastructure.

I have deployed a new pipeline for RESTBase in production and it all looks great. Next step - convert other services. I will try it out on change-prop and create subtasks for individual services.

Tue, Apr 2, 7:09 PM · Patch-For-Review, Core Platform Team Kanban (Done with CPT), Services (done), service-runner, Wikimedia-Logstash, Operations
Pchelolo added a comment to T219738: PHP Warning: Array key should be either a string or an integer.
If you could verify on Beta prior to deployment, however, that would be helpful.
Tue, Apr 2, 7:05 PM · Core Platform Team (Security, stability, performance and scalability (TEC1)), Core Platform Team Kanban (Done with CPT), MW-1.33-notes (1.33.0-wmf.25; 2019-04-09), Beta-Cluster-reproducible, Analytics, EventBus, Wikimedia-production-error
Pchelolo added a comment to T218218: Make RESTBase spec standard compliant and switch to OpenAPI 3.0.

The new UI has been deployed. Next step here - explore the new features in openAPI 3.0, see what we can start using, converting the specs into 3.0.

Tue, Apr 2, 6:04 PM · Patch-For-Review, Services (doing), Core Platform Team Kanban (Doing), Core Platform Team (RESTBase Split (CDP2)), RESTBase, RESTBase-API, serviceops, Operations
Pchelolo added a comment to T219738: PHP Warning: Array key should be either a string or an integer.

The https://gerrit.wikimedia.org/r/500363 fixes it. Don't want to self-merge my own patch though.

Tue, Apr 2, 5:50 PM · Core Platform Team (Security, stability, performance and scalability (TEC1)), Core Platform Team Kanban (Done with CPT), MW-1.33-notes (1.33.0-wmf.25; 2019-04-09), Beta-Cluster-reproducible, Analytics, EventBus, Wikimedia-production-error
Pchelolo created T219900: Evaluate url-template package for use in hyperswitch.
Tue, Apr 2, 5:14 PM · Core Platform Team Backlog (Next), Services (next), Core Platform Team (RESTBase Split (CDP2)), RESTBase
Pchelolo updated the task description for T218218: Make RESTBase spec standard compliant and switch to OpenAPI 3.0.
Tue, Apr 2, 4:40 PM · Patch-For-Review, Services (doing), Core Platform Team Kanban (Doing), Core Platform Team (RESTBase Split (CDP2)), RESTBase, RESTBase-API, serviceops, Operations

Sun, Mar 31

Pchelolo added a comment to T219737: Ability to create blocks broken.

Thank you for catching this early and sorry for this.

Sun, Mar 31, 7:50 PM · Core Platform Team (Security, stability, performance and scalability (TEC1)), Core Platform Team Kanban (Done with CPT), MW-1.33-notes (1.33.0-wmf.25; 2019-04-09), Beta-Cluster-reproducible, EventBus, Analytics

Fri, Mar 29

Pchelolo added a comment to T219148: Use PHP7 to run all async jobs.

If I understand correctly, in order to switch a particular job execution to PHP7 all we need to do is to add Cookie: PHP_ENGINE=php7 header to the request.

Fri, Mar 29, 5:31 PM · Patch-For-Review, Core Platform Team Backlog (Watching / External), User-jijiki, Services (watching), Operations, serviceops
Pchelolo added a project to T219148: Use PHP7 to run all async jobs: Services (watching).
Fri, Mar 29, 5:12 PM · Patch-For-Review, Core Platform Team Backlog (Watching / External), User-jijiki, Services (watching), Operations, serviceops
Pchelolo moved T219520: Replace online validator with swagger-cli from Inbox to Later on the Core Platform Team Backlog board.
Fri, Mar 29, 4:29 PM · Core Platform Team Backlog (Later), Services (later), Core Platform Team (RESTBase Split (CDP2)), RESTBase-API, RESTBase
Pchelolo added a comment to T219548: restbase-mod-table-* simplification and improvements.

I think I have failed to describe the details of the basis of the reasoning behind this leaving a lot of room for confusion. I'll try to fix this mistake.

Fri, Mar 29, 1:41 PM · Core Platform Team Backlog (Designing), Services (designing), Core Platform Team (RESTBase Split (CDP2)), RESTBase
Pchelolo added a project to T219556: Create schema[12]00[12] (schema.svc.{eqiad,codfw}.wmnet): Core Platform Team (Modern Event Platform (TEC2)).
Fri, Mar 29, 12:07 PM · Analytics-Kanban, Patch-For-Review, Core Platform Team Backlog (Watching / External), Core Platform Team (Modern Event Platform (TEC2)), Services (watching), Operations, vm-requests, EventBus, Analytics
Pchelolo moved T219556: Create schema[12]00[12] (schema.svc.{eqiad,codfw}.wmnet) from Backlog to watching on the Services board.
Fri, Mar 29, 12:07 PM · Analytics-Kanban, Patch-For-Review, Core Platform Team Backlog (Watching / External), Core Platform Team (Modern Event Platform (TEC2)), Services (watching), Operations, vm-requests, EventBus, Analytics
Pchelolo moved T219552: Schema Registry HTTP Service from Backlog to watching on the Services board.
Fri, Mar 29, 12:06 PM · Analytics-Kanban, Patch-For-Review, Core Platform Team (Modern Event Platform (TEC2)), Services (watching), Core Platform Team Backlog (Watching / External), EventBus, Analytics

Thu, Mar 28

Pchelolo created T219548: restbase-mod-table-* simplification and improvements.
Thu, Mar 28, 7:35 PM · Core Platform Team Backlog (Designing), Services (designing), Core Platform Team (RESTBase Split (CDP2)), RESTBase
Pchelolo closed T219159: Partition htmlCacheUpdate job topic as Resolved.

We have deployed the partitioner for the htmlCacheUpdate job and it's not running in production. We have created some lag in the process, but it should clear out soon.

Thu, Mar 28, 2:48 PM · Core Platform Team Kanban (Done with CPT), Services (done), Analytics, WMF-JobQueue, EventBus

Wed, Mar 27

Pchelolo committed rMSCP460c938357dd: Support templates in partitioned topics names (authored by Pchelolo).
Support templates in partitioned topics names
Wed, Mar 27, 8:00 PM
Pchelolo committed rMSCPdbdce749932a: Support templates in partitioned topics names (authored by Pchelolo).
Support templates in partitioned topics names
Wed, Mar 27, 6:58 PM
Pchelolo created T219427: Use service-runner provided test server in service-template.
Wed, Mar 27, 5:44 PM · Core Platform Team Backlog (Later), Services (later), service-template-node
Pchelolo created T219425: preq emits unhandled rejection on socket timeout.
Wed, Mar 27, 5:21 PM · Core Platform Team Backlog (Later), Services (later), RESTBase
Pchelolo updated the task description for T219385: Remove SIG* listeners in service runner on stop.
Wed, Mar 27, 2:05 PM · Core Platform Team Backlog (Later), Services (next), service-runner
Pchelolo created T219386: Use service-runner test service in change-prop tests.
Wed, Mar 27, 2:03 PM · Core Platform Team Backlog (Later), ChangeProp, Services (later)
Pchelolo created T219385: Remove SIG* listeners in service runner on stop.
Wed, Mar 27, 1:59 PM · Core Platform Team Backlog (Later), Services (next), service-runner

Tue, Mar 26

Pchelolo added a comment to T216567: EventBusRCFeedFormatter should clean up events from nulls.

After the patch was deployed we do not have nulls in recent change schema anymore, however we still can not declare victory and get rid of all of the polymorphic types in the schema. The log_params can be either an object or an array and, judging by the code, it can actually be a non-empty array in rare cases. Not sure what to do about that.

Tue, Mar 26, 5:52 PM · MW-1.33-notes (1.33.0-wmf.22; 2019-03-19), Patch-For-Review, Core Platform Team (Modern Event Platform (TEC2)), Core Platform Team Backlog (Later), Analytics, Services (next), EventBus
Pchelolo added a comment to T219159: Partition htmlCacheUpdate job topic.

Actually, the existing topic need to be left alone, but 2 new topics 8 partitions each needs to be created:

Tue, Mar 26, 1:45 PM · Core Platform Team Kanban (Done with CPT), Services (done), Analytics, WMF-JobQueue, EventBus

Mon, Mar 25

Pchelolo closed T218260: Decrease timeout for EventBus extension for analytics events, a subtask of T218255: Enabling api-request eventgate to group1 caused minor service disruptions , as Resolved.
Mon, Mar 25, 7:01 PM · EventBus, Analytics, Patch-For-Review, Services (doing), Core Platform Team Kanban (Doing), Core Platform Team (Security, stability, performance and scalability (TEC1)), serviceops, Wikimedia-Incident, Operations
Pchelolo closed T218260: Decrease timeout for EventBus extension for analytics events as Resolved.

Merged and deployed as a part of SWAT. Resolving.

Mon, Mar 25, 7:01 PM · Core Platform Team Kanban (Done with CPT), Services (done), Analytics-Kanban, Analytics, EventBus
Pchelolo reassigned T218218: Make RESTBase spec standard compliant and switch to OpenAPI 3.0 from holger.knust to Clarakosi.

For step 2 we need to switch hyperswitch to upstream swagger.

Mon, Mar 25, 4:06 PM · Patch-For-Review, Services (doing), Core Platform Team Kanban (Doing), Core Platform Team (RESTBase Split (CDP2)), RESTBase, RESTBase-API, serviceops, Operations
Pchelolo added a comment to T219159: Partition htmlCacheUpdate job topic.

@Ottomata yes, but not just yet, we still need to prepare the patches etc.

Mon, Mar 25, 2:28 PM · Core Platform Team Kanban (Done with CPT), Services (done), Analytics, WMF-JobQueue, EventBus
Pchelolo updated the task description for T219159: Partition htmlCacheUpdate job topic.
Mon, Mar 25, 2:08 PM · Core Platform Team Kanban (Done with CPT), Services (done), Analytics, WMF-JobQueue, EventBus
Pchelolo created T219159: Partition htmlCacheUpdate job topic.
Mon, Mar 25, 2:07 PM · Core Platform Team Kanban (Done with CPT), Services (done), Analytics, WMF-JobQueue, EventBus

Fri, Mar 22

Pchelolo moved T218812: Provide the ability to have time-delayed or time-offset jobs in the job queue from next to watching on the Services board.
Fri, Mar 22, 11:28 AM · TechCom-RFC, Core Platform Team Backlog (Designing), Core Platform Team (Modern Event Platform (TEC2)), Services (watching), serviceops, Analytics, ChangeProp, EventBus, WMF-JobQueue, Community-Tech

Thu, Mar 21

Pchelolo committed rMSCD7bdc068c5bb8: Update change-propagation to c3d6639 (authored by Pchelolo).
Update change-propagation to c3d6639
Thu, Mar 21, 2:53 PM
Pchelolo added a comment to T218812: Provide the ability to have time-delayed or time-offset jobs in the job queue.

There is already an ability to execute jobs after a delay or at more-or-less specific time, but it's really not something we want to build on.

Thu, Mar 21, 12:55 PM · TechCom-RFC, Core Platform Team Backlog (Designing), Core Platform Team (Modern Event Platform (TEC2)), Services (watching), serviceops, Analytics, ChangeProp, EventBus, WMF-JobQueue, Community-Tech
Pchelolo closed T218396: Make change-prop tests independent of Kafka and Redis as Resolved.

Now it's ready - CP tests are independent of both Kafka and Redis.

Thu, Mar 21, 10:59 AM · Core Platform Team Kanban (Done with CPT), Services (done), Release Pipeline, serviceops, ChangeProp
Pchelolo closed T218396: Make change-prop tests independent of Kafka and Redis, a subtask of T213193: Migrate changeprop to kubernetes, as Resolved.
Thu, Mar 21, 10:59 AM · Patch-For-Review, Services (watching), Release-Engineering-Team (Next), Release Pipeline, serviceops, ChangeProp
Pchelolo committed rMSCDd2ec6849cbfc: Change enable_blacklist to disable_blacklist. (authored by Pchelolo).
Change enable_blacklist to disable_blacklist.
Thu, Mar 21, 12:18 AM

Mar 20 2019

Pchelolo added a comment to T210651: Switch all PDF render traffic to new Proton service.

mediawiki-vagrant should also be updated to support new proton role.

Mar 20 2019, 6:46 PM · Reading-Infrastructure-Team-Backlog, Core Platform Team Backlog (Later), Services (next), Readers-Web-Backlog (Tracking), Proton
Pchelolo reopened T218396: Make change-prop tests independent of Kafka and Redis as "Open".

Oh, no, not resolving yet. Next step - mock redis.

Mar 20 2019, 2:16 PM · Core Platform Team Kanban (Done with CPT), Services (done), Release Pipeline, serviceops, ChangeProp
Pchelolo reopened T218396: Make change-prop tests independent of Kafka and Redis, a subtask of T213193: Migrate changeprop to kubernetes, as Open.
Mar 20 2019, 2:16 PM · Patch-For-Review, Services (watching), Release-Engineering-Team (Next), Release Pipeline, serviceops, ChangeProp
Pchelolo closed T218396: Make change-prop tests independent of Kafka and Redis as Resolved.

The PR has been merged, resolving

Mar 20 2019, 2:14 PM · Core Platform Team Kanban (Done with CPT), Services (done), Release Pipeline, serviceops, ChangeProp
Pchelolo closed T218396: Make change-prop tests independent of Kafka and Redis, a subtask of T213193: Migrate changeprop to kubernetes, as Resolved.
Mar 20 2019, 2:14 PM · Patch-For-Review, Services (watching), Release-Engineering-Team (Next), Release Pipeline, serviceops, ChangeProp

Mar 19 2019

Pchelolo added a comment to T218252: [Bug] Sporadic 503 errors when editing.

Can this be resolved?

Mar 19 2019, 2:27 PM · Services, Wikimedia-production-error, Readers-Web-Backlog (Tracking), VisualEditor, Operations
Pchelolo closed T218274: `rev_parent_id` and `rev_content_changed` are missing in event.mediawiki_revision_tags_change as Resolved.

The rev_content_changed has been removed from the schema and after the train we will ensure rev_parent_id is present in all the events. Resolving.

Mar 19 2019, 2:25 PM · Core Platform Team Kanban (Done with CPT), Services (done), MW-1.33-notes (1.33.0-wmf.22; 2019-03-19), Product-Analytics, Analytics

Mar 18 2019

Pchelolo added a comment to T218274: `rev_parent_id` and `rev_content_changed` are missing in event.mediawiki_revision_tags_change.

I think that the schema is incorrect here.

Mar 18 2019, 3:40 PM · Core Platform Team Kanban (Done with CPT), Services (done), MW-1.33-notes (1.33.0-wmf.22; 2019-03-19), Product-Analytics, Analytics
Pchelolo added a comment to T211125: Move service-runner to new logging infrastructure.

After enabling logging over syslog for RESTBase in deployment-prep, we have identified a number of disparities between node services and, for example, mediawiki.

Mar 18 2019, 3:08 PM · Patch-For-Review, Core Platform Team Kanban (Done with CPT), Services (done), service-runner, Wikimedia-Logstash, Operations

Mar 15 2019

Pchelolo renamed T218396: Make change-prop tests independent of Kafka and Redis from Make change-prop tests undefended of Kafka and Redis to Make change-prop tests independent of Kafka and Redis.
Mar 15 2019, 12:48 PM · Core Platform Team Kanban (Done with CPT), Services (done), Release Pipeline, serviceops, ChangeProp
Pchelolo created T218396: Make change-prop tests independent of Kafka and Redis.
Mar 15 2019, 12:47 PM · Core Platform Team Kanban (Done with CPT), Services (done), Release Pipeline, serviceops, ChangeProp

Mar 14 2019

Pchelolo assigned T218218: Make RESTBase spec standard compliant and switch to OpenAPI 3.0 to holger.knust.

Verified that we can work with swagger-ui 3+ once we make the spec standard-compliant. Let's begin with modifying the specs.

Mar 14 2019, 8:13 PM · Patch-For-Review, Services (doing), Core Platform Team Kanban (Doing), Core Platform Team (RESTBase Split (CDP2)), RESTBase, RESTBase-API, serviceops, Operations
Pchelolo added a comment to T218260: Decrease timeout for EventBus extension for analytics events.

I wonder if we should also use ?hasty=true mode for mediawiki 'analytics' events? This would use a non-ACKed producer and not ever block the MW waiting for a response.

Mar 14 2019, 1:42 PM · Core Platform Team Kanban (Done with CPT), Services (done), Analytics-Kanban, Analytics, EventBus
Pchelolo assigned T218275: Vagrant restbase can't launch: statsd.childClient is not a function to holger.knust.

Oh, we have made use of the hot-shots internal childClient method, but forgot there's a debugging LogStatsD. Need to fix this in service-runner and make sure RESTBase starts if we configure metrics.type to 'log'.

Mar 14 2019, 1:37 PM · Core Platform Team Kanban (Done with CPT), Services (done), service-runner, RESTBase, MediaWiki-Vagrant