Page MenuHomePhabricator

mobrovac (Marko Obrovac)
Spy

Projects (46)

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Friday

  • Clear sailing ahead.

User Details

User Since
Dec 16 2014, 7:40 PM (235 w, 9 h)
Availability
Available
IRC Nick
mobrovac
LDAP User
Mobrovac
MediaWiki User
Mobrovac [ Global Accounts ]

Recent Activity

Yesterday

mobrovac committed rMSRD09404fb95330: Update recommendation-api to 9603d42 (authored by mobrovac).
Update recommendation-api to 9603d42
Tue, Jun 18, 3:52 PM
mobrovac edited projects for T225983: Recommendation API: cannot build a deploy repo, added: Services (watching); removed Services.

I have just built the deploy repo (cf above patch). Have you rebuilt your node module deps before building the deploy repo?

Tue, Jun 18, 3:22 PM · Services (watching), Patch-For-Review, Recommendation-API

Sat, Jun 15

mobrovac updated subscribers of T225283: MCS/PCS endpoints not available for ~300 wikis.

@mobrovac Thx, so I see that this concerns 307 web sites and for us, as around 20 are meta web sites that we don't want to scrape anyway, this is around 280 wikis we hardly can scrape.

Sat, Jun 15, 7:21 AM · RESTBase-API, Core Platform Team Backlog (Later), Services (later), Mobile-Content-Service, Reading-Infrastructure-Team-Backlog
mobrovac added a comment to T225283: MCS/PCS endpoints not available for ~300 wikis.

BTW, it.wikibooks.org seems to be also impacted. Do we have a list somewhere of all the wikis where the mobile API endpoints are not "properly" available?

Sat, Jun 15, 7:06 AM · RESTBase-API, Core Platform Team Backlog (Later), Services (later), Mobile-Content-Service, Reading-Infrastructure-Team-Backlog

Fri, Jun 14

mobrovac edited projects for T225733: Expose new talk endpoint via RESTBase, added: Services (next), Core Platform Team Backlog (Next); removed Services.
Fri, Jun 14, 6:54 AM · Core Platform Team Backlog (Next), Services (next), Reading-Infrastructure-Team-Backlog, Wikipedia-iOS-App-Backlog

Thu, Jun 13

Ottomata awarded T225711: Have service-template-node forward the request ID a Burninate token.
Thu, Jun 13, 1:32 PM · Core Platform Team Kanban (Doing), Services (doing), service-template-node
mobrovac added a parent task for T225711: Have service-template-node forward the request ID: T201409: Harmonise the identification of requests across our stack.
Thu, Jun 13, 10:45 AM · Core Platform Team Kanban (Doing), Services (doing), service-template-node
mobrovac added a subtask for T201409: Harmonise the identification of requests across our stack: T225711: Have service-template-node forward the request ID.
Thu, Jun 13, 10:45 AM · MW-1.34-notes (1.34.0-wmf.6; 2019-05-21), MW-1.33-notes (1.33.0-wmf.17; 2019-02-12), Patch-For-Review, Core Platform Team Backlog (Designing), User-CDanis, TechCom-RFC (TechCom-Approved), Performance-Team (Radar), Operations, Services (designing), User-mobrovac, Traffic
mobrovac triaged T225711: Have service-template-node forward the request ID as Normal priority.
Thu, Jun 13, 10:44 AM · Core Platform Team Kanban (Doing), Services (doing), service-template-node
mobrovac created T225707: Upgrade python-service-checker across the fleet.
Thu, Jun 13, 10:26 AM · Core Platform Team Backlog (Watching / External), SCB, Services (watching), Operations, serviceops
mobrovac updated subscribers of T225664: Internal deployment of open_nsfw-- image scoring service.
Thu, Jun 13, 7:28 AM · Services (watching), serviceops, Service-deployment-requests, Operations
mobrovac edited projects for T225664: Internal deployment of open_nsfw-- image scoring service, added: serviceops, Services (watching); removed Services.
Thu, Jun 13, 7:27 AM · Services (watching), serviceops, Service-deployment-requests, Operations
mobrovac renamed T225680: Migrate Proton to k8s from Migrate chromium-render to k8s to Migrate Proton to k8s.
Thu, Jun 13, 7:23 AM · Core Platform Team Backlog (Next), Services (next), Patch-For-Review, Proton, Release Pipeline, Reading-Infrastructure-Team-Backlog
mobrovac added a comment to T170455: Extract the feed endpoints from PCS into a new wikifeeds service.

@mobrovac The Beta Cluster sites also require HTTPS and throw 403 otherwise -- try curl -d "action=query&meta=siteinfo" http://en.wikipedia.beta.wmflabs.org/w/api.php, for example.

Thu, Jun 13, 7:21 AM · Wikifeeds, Patch-For-Review, Reading-Infrastructure-Team-Backlog (Kanban), Page Content Service
mobrovac closed T225681: Migrate trending-edits to k8s as Invalid.

As of T180384: Turn off Trending Service the trending edits service is no longer a production service.

Thu, Jun 13, 7:19 AM · Patch-For-Review, Trending-Service, Release Pipeline
mobrovac closed T225681: Migrate trending-edits to k8s, a subtask of T198901: Migrate production services to kubernetes using the pipeline, as Invalid.
Thu, Jun 13, 7:19 AM · Release-Engineering-Team-TODO, Core Platform Team Backlog (Watching / External), Epic, Services (watching), Operations, Release Pipeline

Wed, Jun 12

mobrovac added a comment to T225329: preq provides no useful diagnostic info with 504 internal_http_error.

This is the fault of the error-handling code in the service template. PR #122 should fix this.

Wed, Jun 12, 4:22 PM · Core Platform Team Kanban (Doing), Services (doing), Reading-Infrastructure-Team-Backlog
mobrovac closed T225579: RESTBase doesn't start - No storage group configured for localhost as Resolved.

Great to hear!

Wed, Jun 12, 6:37 AM · Core Platform Team Kanban (Done with CPT), Services (done), RESTBase
mobrovac triaged T225579: RESTBase doesn't start - No storage group configured for localhost as Normal priority.

We have recently introduced storage groups for the SQLite back-end but haven't updated the example config, sorry about that! What you need to do is to add the following under the table configuration:

Wed, Jun 12, 5:51 AM · Core Platform Team Kanban (Done with CPT), Services (done), RESTBase
mobrovac added a comment to T170455: Extract the feed endpoints from PCS into a new wikifeeds service.

I created a new beta cluster instance, deployment-wikifeeds01, proxied to https://wikifeeds-beta.wmflabs.org; however, most endpoints are not working due to ca-certificates not being present in the production image variant as discussed on https://github.com/wikimedia/service-template-node/pull/120.

Wed, Jun 12, 4:43 AM · Wikifeeds, Patch-For-Review, Reading-Infrastructure-Team-Backlog (Kanban), Page Content Service

Tue, Jun 11

mobrovac edited projects for T225516: Page summary may not be purged/regenerated after revert, added: Core Platform Team (Security, stability, performance and scalability (TEC1)); removed Core Platform Team (Code Health (TEC13)).
Tue, Jun 11, 3:20 PM · Core Platform Team (Security, stability, performance and scalability (TEC1)), Core Platform Team Kanban (Doing), Services (doing), ChangeProp, Page Content Service, Reading-Infrastructure-Team-Backlog

Mon, Jun 10

mobrovac closed T225384: Article "Roll tud Kembre" is not available on br.wikipedia.org mobile as Declined.

This is a huge bot-edited gallery page. For performance reasons we don't support such requests (as it takes more than 120 seconds for Parsoid to render it).

Mon, Jun 10, 5:43 PM · Services (done), Performance, RESTBase-API

Sat, Jun 8

mobrovac claimed T225329: preq provides no useful diagnostic info with 504 internal_http_error.
Sat, Jun 8, 9:51 AM · Core Platform Team Kanban (Doing), Services (doing), Reading-Infrastructure-Team-Backlog
mobrovac triaged T225329: preq provides no useful diagnostic info with 504 internal_http_error as Normal priority.

This is the fault of the error-handling code in the service template. PR #122 should fix this.

Sat, Jun 8, 9:50 AM · Core Platform Team Kanban (Doing), Services (doing), Reading-Infrastructure-Team-Backlog
mobrovac removed a project from T225283: MCS/PCS endpoints not available for ~300 wikis: Parsoid.
Sat, Jun 8, 9:27 AM · RESTBase-API, Core Platform Team Backlog (Later), Services (later), Mobile-Content-Service, Reading-Infrastructure-Team-Backlog
mobrovac added a comment to T225283: MCS/PCS endpoints not available for ~300 wikis.

@mobrovac We're only actually using mobile-sections in MWOffliner. So the mobile-sections endpoint is our "priority" :)

Sat, Jun 8, 9:26 AM · RESTBase-API, Core Platform Team Backlog (Later), Services (later), Mobile-Content-Service, Reading-Infrastructure-Team-Backlog
mobrovac added projects to T225323: HTTPS request to the MW API fails: "unable to get local issuer certificate": Services (designing), Core Platform Team Backlog (Designing).

Yup, this is due to the missing ca-cetrificates package. It really depends on a per-service basis: if and only if the service is meant to communicate with external sources, then the package should be installed. In the case of the service template, I think we should install it only for the development and test images, but not the production one in an effort to lock down services using the blubber file as a template.

Sat, Jun 8, 9:19 AM · Core Platform Team Backlog (Designing), Services (designing), service-template-node, Reading-Infrastructure-Team-Backlog, Release Pipeline (Blubber)
mobrovac closed T225030: Expose mathoid warnings via restbase as Resolved.

All of the formulae have been rechecked, so warnings should now be emitted for all requests. Since we updated Mathoid to the latest code, I have also regenerated all of the renders to match the current expectations.

Sat, Jun 8, 9:08 AM · Core Platform Team Kanban (Done with CPT), Services (done), Kubernetes, Mathoid, RESTBase
mobrovac closed T225030: Expose mathoid warnings via restbase, a subtask of T197842: Deprecate texvc commands conflicting with LaTeX commands used in common packages, as Resolved.
Sat, Jun 8, 9:08 AM · MW-1.32-notes (WMF-deploy-2018-07-10 (1.32.0-wmf.12)), Patch-For-Review, Math

Fri, Jun 7

mobrovac edited projects for T225283: MCS/PCS endpoints not available for ~300 wikis, added: Services (later), Core Platform Team Backlog (Later), RESTBase-API; removed Services.

Yes, we could, but likely with an ETA of 2 months. When you say MCS, does that include all of MCS-backed end points?

Fri, Jun 7, 3:25 PM · RESTBase-API, Core Platform Team Backlog (Later), Services (later), Mobile-Content-Service, Reading-Infrastructure-Team-Backlog

Thu, Jun 6

mobrovac edited projects for T225228: Add standard Blubber config, added: Services (next), Core Platform Team Backlog (Next); removed Services, Core Platform Team Backlog.
Thu, Jun 6, 5:09 PM · Core Platform Team Backlog (Next), Services (next), service-template-node
mobrovac added a comment to T225217: VE is removing spaces (dirty diffs) on some wikis (wikitech, officewiki).

Officewiki si a private wiki, and we don't have RESTBase set up for private wikis.

Thu, Jun 6, 5:08 PM · User-Ryasmeen, Patch-For-Review, Parsoid-Edit-Support, VisualEditor
mobrovac closed T225064: post merge builds in citoid are failing as Resolved.

Image building is now working, so resolving. I created T225236: Figure out how to test Citoid with Zotero in the pipeline where we can discuss how to properly test Citoid with Zotero inside CI.

Thu, Jun 6, 5:06 PM · Core Platform Team Kanban (Done with CPT), Services (done), Release Pipeline, Citoid
mobrovac created T225236: Figure out how to test Citoid with Zotero in the pipeline.
Thu, Jun 6, 5:05 PM · serviceops, Core Platform Team Backlog (Watching / External), Services (watching), Citoid, Release Pipeline
mobrovac added a comment to T225064: post merge builds in citoid are failing.

Nice, thank you for the explanation :-] Left to figure out in a different task is how to test Citoid together with Zotero, but I guess that is for another task.

Thu, Jun 6, 2:48 PM · Core Platform Team Kanban (Done with CPT), Services (done), Release Pipeline, Citoid
mobrovac triaged T225064: post merge builds in citoid are failing as High priority.
Thu, Jun 6, 1:00 PM · Core Platform Team Kanban (Done with CPT), Services (done), Release Pipeline, Citoid
mobrovac added a comment to T225030: Expose mathoid warnings via restbase.

The first part of the issue has been fixed; Mathoid's code is up to date now. However, the results will only be publicly visible for new formulae. I'll run a dump of all of the formulae in storage next week.

Thu, Jun 6, 10:57 AM · Core Platform Team Kanban (Done with CPT), Services (done), Kubernetes, Mathoid, RESTBase
mobrovac added a comment to T225064: post merge builds in citoid are failing.

Can we investigate why the test failed on post merge but NOT when the patch has been proposed?

Thu, Jun 6, 9:31 AM · Core Platform Team Kanban (Done with CPT), Services (done), Release Pipeline, Citoid
mobrovac added a comment to T225097: "JobExecutor not loaded" error for BounceHandlerJob on wikitech.wikimedia.org.

I think the root cause is the same as T208922: PHP Fatal Error: Class undefined: JobExecutor (jobrunners try to run labswiki jobs), namely T208922#4766050 (global config problems when spawning inter-wiki jobs). It's just that now we detect the case when JobExecutor is not loaded instead of bluntly crashing.

Thu, Jun 6, 7:25 AM · Core Platform Team Backlog (Next), Services (next), MediaWiki-extensions-BounceHandler, WMF-JobQueue, wikitech.wikimedia.org, Wikimedia-production-error
mobrovac added a comment to T224754: Deploy caption addition/suggestion endpoints to production.

Updated target launch date to June 17 to reflect that deployments are off next week due to the SRE offsite.

Thu, Jun 6, 7:11 AM · Core Platform Team Backlog (Next), Services (next), Recommendation-API, Reading-Infrastructure-Team-Backlog (Kanban), WikimediaEditorTasks
mobrovac added a comment to T225064: post merge builds in citoid are failing.

Could it be that Citoid can't talk to Zotero any more?

Thu, Jun 6, 7:07 AM · Core Platform Team Kanban (Done with CPT), Services (done), Release Pipeline, Citoid
mobrovac added a comment to T225064: post merge builds in citoid are failing.

Thank you, @thcipriani for the investigation. In the above patch I updated the deps that were known to cause issues with 504s, but the build still fails. Could it be that Citoid can't talk to Zotero any more?

Thu, Jun 6, 7:05 AM · Core Platform Team Kanban (Done with CPT), Services (done), Release Pipeline, Citoid

Wed, Jun 5

Restricted Application added a project to T225005: Replace and expand codfw kafka main hosts (kafka200[123]) with kafka-main200[12345]: Analytics.
Wed, Jun 5, 10:37 AM · Services (watching), Core Platform Team Backlog (Watching / External), Analytics, EventBus, Patch-For-Review, User-herron, Operations
mobrovac added a comment to T225029: How to test Math check endpoint via swagger.

I am not sure I understand your problem. When you open the Math docs section, there is a Try it out button. Once you press it and enter the formula to check, click on Execute and the full curl command is displayed, together with the request URL and the response returned by the REST API.

Wed, Jun 5, 10:35 AM · Mathoid, RESTBase-API
Physikerwelt awarded T225030: Expose mathoid warnings via restbase a Like token.
Wed, Jun 5, 9:57 AM · Core Platform Team Kanban (Done with CPT), Services (done), Kubernetes, Mathoid, RESTBase
mobrovac claimed T225030: Expose mathoid warnings via restbase.
Wed, Jun 5, 9:26 AM · Core Platform Team Kanban (Done with CPT), Services (done), Kubernetes, Mathoid, RESTBase
mobrovac added projects to T225030: Expose mathoid warnings via restbase: Services (doing), Core Platform Team Kanban (Doing), Kubernetes.

There's something weird in the Mathoid deployment here. When I issue the same request from inside production directly to Mathoid, the warnings are not returned either:

Wed, Jun 5, 9:26 AM · Core Platform Team Kanban (Done with CPT), Services (done), Kubernetes, Mathoid, RESTBase
mobrovac updated subscribers of T225064: post merge builds in citoid are failing.
Wed, Jun 5, 9:03 AM · Core Platform Team Kanban (Done with CPT), Services (done), Release Pipeline, Citoid

Tue, Jun 4

mobrovac added a comment to T220401: Introduce kask session storage service to kubernetes.

[...] In fact, some numbers I 've heard (I have no actual proof) place sessions at <10% of the total Mainstash (which says however nothing about the rate of requests for sessions).

Tue, Jun 4, 10:45 AM · Patch-For-Review, Core Platform Team Backlog (Next), Core Platform Team (Session Management Service (CDP2)), Services (next), User-Eevans, Release Pipeline, Operations, serviceops, Release-Engineering-Team
mobrovac added projects to T224920: Evaluate whether to create a RESTBase-backed JSON endpoint for image metadata: Services (designing), Core Platform Team Backlog (Designing).

This is an interesting idea. The issue here, though, is: how can updates to such metadata be triggered?

Tue, Jun 4, 10:40 AM · Core Platform Team Backlog (Designing), Services (designing), Page Content Service, Reading-Infrastructure-Team-Backlog
mobrovac edited projects for T224917: Machine vision image metadata service, added: Services (watching), serviceops, Release Pipeline; removed Services.
Tue, Jun 4, 10:36 AM · Release Pipeline, serviceops, Services (watching), Operations, Reading-Infrastructure-Team-Backlog, Service-deployment-requests
mobrovac added a comment to T210651: Switch all PDF render traffic to new Proton service.

The RESTBase switch has been deployed. Proton is now used for all PDF requests.

Tue, Jun 4, 8:14 AM · User-notice, Patch-For-Review, Reading-Infrastructure-Team-Backlog, Core Platform Team Backlog (Later), Services (next), Readers-Web-Backlog (Tracking), Proton
mobrovac updated the task description for T210651: Switch all PDF render traffic to new Proton service.
Tue, Jun 4, 8:14 AM · User-notice, Patch-For-Review, Reading-Infrastructure-Team-Backlog, Core Platform Team Backlog (Later), Services (next), Readers-Web-Backlog (Tracking), Proton

Sat, Jun 1

mobrovac edited projects for T224754: Deploy caption addition/suggestion endpoints to production, added: Services (next), Core Platform Team Backlog (Next); removed Services.

The new proposed end points LGTM.

Sat, Jun 1, 10:03 AM · Core Platform Team Backlog (Next), Services (next), Recommendation-API, Reading-Infrastructure-Team-Backlog (Kanban), WikimediaEditorTasks
mobrovac added a comment to T197009: MCS should respect Accept-Language header for MW API requests.

Hmm. For RESTBase-stored endpoints (I think, currently, that includes /page/summary and /page/mobile-sections from those in the description), won't this result in RB-stored content containing arbitrary variants (i.e., for any given document, the variant requested by the user who requested the copy that was then stored)? I think we need to provide for variant-specific storage before we can really do this.

Sat, Jun 1, 9:51 AM · Wikifeeds, Wikipedia-Android-App-Backlog, Reading-Infrastructure-Team-Backlog (Kanban), Patch-For-Review, Mobile-Content-Service

Fri, May 31

mobrovac added a parent task for T220170: Address Database infrastructure blockers on datacenter switchover & multi-dc deployment: T88445: MediaWiki active/active datacenter investigation and work (tracking).
Fri, May 31, 11:47 AM · Goal, DBA
mobrovac added a subtask for T88445: MediaWiki active/active datacenter investigation and work (tracking): T220170: Address Database infrastructure blockers on datacenter switchover & multi-dc deployment.
Fri, May 31, 11:47 AM · Core Platform Team (Multi-DC (TEC1)), User-mobrovac, Services (designing), Core Platform Team Backlog (Epic), Performance-Team (Radar), Availability (MediaWiki-MultiDC), Epic
mobrovac added a parent task for T224422: Implement logic to filter bogus GTIDs: T221159: FY18/19 TEC1.6 Q4: Replace the usage of GTID_WAIT with pt-heartbeat in MW.
Fri, May 31, 4:12 AM · Patch-For-Review, Performance-Team, Core Platform Team Backlog (Watching / External), Services (watching), Core Platform Team (Multi-DC (TEC1)), MediaWiki-Database
mobrovac added a subtask for T221159: FY18/19 TEC1.6 Q4: Replace the usage of GTID_WAIT with pt-heartbeat in MW: T224422: Implement logic to filter bogus GTIDs.
Fri, May 31, 4:12 AM · Performance-Team (Radar), User-mobrovac, Services (watching), Goal, Core Platform Team Backlog (Watching / External), MediaWiki-Database, Core Platform Team (Multi-DC (TEC1)), DBA
mobrovac removed a subtask for T224422: Implement logic to filter bogus GTIDs: T221159: FY18/19 TEC1.6 Q4: Replace the usage of GTID_WAIT with pt-heartbeat in MW.
Fri, May 31, 4:12 AM · Patch-For-Review, Performance-Team, Core Platform Team Backlog (Watching / External), Services (watching), Core Platform Team (Multi-DC (TEC1)), MediaWiki-Database
mobrovac removed a parent task for T221159: FY18/19 TEC1.6 Q4: Replace the usage of GTID_WAIT with pt-heartbeat in MW: T224422: Implement logic to filter bogus GTIDs.
Fri, May 31, 4:12 AM · Performance-Team (Radar), User-mobrovac, Services (watching), Goal, Core Platform Team Backlog (Watching / External), MediaWiki-Database, Core Platform Team (Multi-DC (TEC1)), DBA

Thu, May 30

mobrovac updated the task description for T220449: Split RESTBase in two services: storage service and API router/proxy.
Thu, May 30, 8:36 AM · User-mobrovac, serviceops, Epic, RESTBase, Core Platform Team (RESTBase Split (CDP2)), Core Platform Team Kanban (Doing), Services (doing)
mobrovac closed T220761: Determine the names of the RESTBase front- and back-end services as Resolved.

We have settled on restrouter and restbase for simplicity.

Thu, May 30, 8:35 AM · Core Platform Team Kanban (Done with CPT), Services (done), RESTBase, Core Platform Team (RESTBase Split (CDP2))
mobrovac closed T220761: Determine the names of the RESTBase front- and back-end services, a subtask of T220449: Split RESTBase in two services: storage service and API router/proxy, as Resolved.
Thu, May 30, 8:35 AM · User-mobrovac, serviceops, Epic, RESTBase, Core Platform Team (RESTBase Split (CDP2)), Core Platform Team Kanban (Doing), Services (doing)
mobrovac closed T220461: Simplify storage semantics as Resolved.

Both Parsoid and MCS storage are now using only binary key/value buckets for their storage needs and key_rev_value and multi_bucket are not used anymore, so this task is now complete.

Thu, May 30, 8:34 AM · Core Platform Team Kanban (Done with CPT), Services (done), RESTBase, Core Platform Team (RESTBase Split (CDP2))
mobrovac closed T220461: Simplify storage semantics, a subtask of T220449: Split RESTBase in two services: storage service and API router/proxy, as Resolved.
Thu, May 30, 8:34 AM · User-mobrovac, serviceops, Epic, RESTBase, Core Platform Team (RESTBase Split (CDP2)), Core Platform Team Kanban (Doing), Services (doing)
mobrovac closed T215956: Consider stashing data-parsoid for VE as Resolved.

Everything here has now been completed \o/ Resolving.

Thu, May 30, 8:32 AM · User-Ryasmeen, Core Platform Team Kanban (Done with CPT), Services (done), Core Platform Team (RESTBase Split (CDP2)), User-Eevans, User-mobrovac, Parsoid, VisualEditor, RESTBase
mobrovac closed T215956: Consider stashing data-parsoid for VE , a subtask of T220461: Simplify storage semantics, as Resolved.
Thu, May 30, 8:32 AM · Core Platform Team Kanban (Done with CPT), Services (done), RESTBase, Core Platform Team (RESTBase Split (CDP2))
mobrovac closed T223998: Remove old (a.k.a NG) Parsoid tables as Resolved.

The corresponding keyspaces have been dropped. Resolving.

Thu, May 30, 8:31 AM · Core Platform Team Kanban (Done with CPT), Services (done), Core Platform Team (RESTBase Split (CDP2)), Cassandra, RESTBase-Cassandra, RESTBase
mobrovac closed T223998: Remove old (a.k.a NG) Parsoid tables, a subtask of T215956: Consider stashing data-parsoid for VE , as Resolved.
Thu, May 30, 8:31 AM · User-Ryasmeen, Core Platform Team Kanban (Done with CPT), Services (done), Core Platform Team (RESTBase Split (CDP2)), User-Eevans, User-mobrovac, Parsoid, VisualEditor, RESTBase
mobrovac closed T174982: Sourcemap is incorrect in RESTBase help page as Resolved.

We have switched to OpenAPI v3 (together with the accompanying swagger-ui library update), so this should not be an issue any more. Please reopen if that's not the case.

Thu, May 30, 7:51 AM · Core Platform Team Kanban (Done with CPT), Services (done), RESTBase-API, RESTBase
mobrovac closed T174982: Sourcemap is incorrect in RESTBase help page, a subtask of T218218: Make RESTBase spec standard compliant and switch to OpenAPI 3.0, as Resolved.
Thu, May 30, 7:51 AM · Core Platform Team Kanban (Done with CPT), Services (done), Core Platform Team (Security, stability, performance and scalability (TEC1)), RESTBase, RESTBase-API, serviceops, Operations
mobrovac closed T217725: Selected response type in REST BASE page does not match the info sent in request, resulting in 406 error as Resolved.

We have switched to the new swagger-ui version and OpenAPI v3. If you perceive the problem again, please reopen.

Thu, May 30, 7:49 AM · Core Platform Team Kanban (Done with CPT), Services (done), RESTBase-API, RESTBase
mobrovac closed T217725: Selected response type in REST BASE page does not match the info sent in request, resulting in 406 error, a subtask of T218218: Make RESTBase spec standard compliant and switch to OpenAPI 3.0, as Resolved.
Thu, May 30, 7:49 AM · Core Platform Team Kanban (Done with CPT), Services (done), Core Platform Team (Security, stability, performance and scalability (TEC1)), RESTBase, RESTBase-API, serviceops, Operations
mobrovac closed T218218: Make RESTBase spec standard compliant and switch to OpenAPI 3.0 as Resolved.

This has now been deployed.

Thu, May 30, 7:48 AM · Core Platform Team Kanban (Done with CPT), Services (done), Core Platform Team (Security, stability, performance and scalability (TEC1)), RESTBase, RESTBase-API, serviceops, Operations
mobrovac closed T218218: Make RESTBase spec standard compliant and switch to OpenAPI 3.0, a subtask of T217881: Decide whether to keep violating OpenAPI/Swagger specification in our REST services, as Resolved.
Thu, May 30, 7:48 AM · Core Platform Team Kanban (Done with CPT), Services (done), TechCom, RESTBase-API, serviceops, Operations
mobrovac updated the task description for T223976: Decommission restbase10(0[7-9]|1[0-5]).
Thu, May 30, 5:39 AM · Patch-For-Review, Cassandra, RESTBase, Core Platform Team (Security, stability, performance and scalability (TEC1)), Core Platform Team Kanban (Doing), Services (doing), Operations
mobrovac reopened T223976: Decommission restbase10(0[7-9]|1[0-5]) as "Open".
Thu, May 30, 5:38 AM · Patch-For-Review, Cassandra, RESTBase, Core Platform Team (Security, stability, performance and scalability (TEC1)), Core Platform Team Kanban (Doing), Services (doing), Operations
mobrovac reopened T223976: Decommission restbase10(0[7-9]|1[0-5]), a subtask of T208087: Replace remaining Samsung SSDs, as Open.
Thu, May 30, 5:38 AM · Patch-For-Review, Services (doing), Core Platform Team Kanban (Doing), Core Platform Team (Security, stability, performance and scalability (TEC1)), User-Eevans, Cassandra
mobrovac updated subscribers of T223976: Decommission restbase10(0[7-9]|1[0-5]).
Thu, May 30, 5:34 AM · Patch-For-Review, Cassandra, RESTBase, Core Platform Team (Security, stability, performance and scalability (TEC1)), Core Platform Team Kanban (Doing), Services (doing), Operations
mobrovac placed T223976: Decommission restbase10(0[7-9]|1[0-5]) up for grabs.
Thu, May 30, 5:34 AM · Patch-For-Review, Cassandra, RESTBase, Core Platform Team (Security, stability, performance and scalability (TEC1)), Core Platform Team Kanban (Doing), Services (doing), Operations

Wed, May 29

mobrovac updated the task description for T223976: Decommission restbase10(0[7-9]|1[0-5]).
Wed, May 29, 8:44 PM · Patch-For-Review, Cassandra, RESTBase, Core Platform Team (Security, stability, performance and scalability (TEC1)), Core Platform Team Kanban (Doing), Services (doing), Operations
mobrovac merged T224623: Upgrade RESTBase cluster to Stretch into T224553: Migrate remaining Restbase servers to Stretch.
Wed, May 29, 8:23 PM · RESTBase-Cassandra, Cassandra, RESTBase, Services (next), Core Platform Team (Security, stability, performance and scalability (TEC1)), Core Platform Team Backlog (Next), Operations
mobrovac merged task T224623: Upgrade RESTBase cluster to Stretch into T224553: Migrate remaining Restbase servers to Stretch.
Wed, May 29, 8:22 PM · Core Platform Team, RESTBase, Cassandra
mobrovac added projects to T224554: Migrate Restbase-dev cluster to Stretch: Core Platform Team Backlog (Next), Core Platform Team (Security, stability, performance and scalability (TEC1)), RESTBase, Cassandra, Services (next).

For restbase-dev1006 there is T224260: restbase-dev1006 has a broken disk, so that would need to be resolved first (and AFAIK it's likely we'll need to end up re-imaging the machine anyway).

Wed, May 29, 12:11 PM · Services (next), Cassandra, RESTBase, Core Platform Team (Security, stability, performance and scalability (TEC1)), Core Platform Team Backlog (Next), Operations
mobrovac added projects to T224553: Migrate remaining Restbase servers to Stretch: Core Platform Team Backlog (Next), Core Platform Team (Security, stability, performance and scalability (TEC1)), Services (next), RESTBase, Cassandra, RESTBase-Cassandra.

Agreed. We can start coordinating once T208087: Replace remaining Samsung SSDs is done. That includes T223976: Decommission restbase10(0[7-9]|1[0-5]) but also T222960: Fix restbase1017's physical rack.

Wed, May 29, 12:06 PM · RESTBase-Cassandra, Cassandra, RESTBase, Services (next), Core Platform Team (Security, stability, performance and scalability (TEC1)), Core Platform Team Backlog (Next), Operations
mobrovac moved T147137: RFC: JSON validation from Under discussion to Backlog on the TechCom-RFC board.

Moving back to backlog due to inactivity.

Wed, May 29, 11:48 AM · MediaWiki-extensions-CollaborationKit, Multimedia, TechCom-RFC
mobrovac moved T212521: RFC: Let's stop running QUnit unit tests as integration tests from Under discussion to Backlog on the TechCom-RFC board.

Moving to backlog until @Jdlrobson is back.

Wed, May 29, 11:42 AM · TechCom-RFC, Patch-For-Review, User-Jdlrobson
mobrovac updated the task description for T223953: Deploy the RESTBase front-end service (RESTRouter) to Kubernetes.
Wed, May 29, 9:57 AM · Patch-For-Review, Core Platform Team Kanban (Doing), Services (doing), Release Pipeline, Kubernetes, Core Platform Team (RESTBase Split (CDP2)), serviceops, Operations, Service-deployment-requests
mobrovac edited projects for T218218: Make RESTBase spec standard compliant and switch to OpenAPI 3.0, added: Core Platform Team (Security, stability, performance and scalability (TEC1)); removed Patch-For-Review, Core Platform Team (RESTBase Split (CDP2)).
Wed, May 29, 8:15 AM · Core Platform Team Kanban (Done with CPT), Services (done), Core Platform Team (Security, stability, performance and scalability (TEC1)), RESTBase, RESTBase-API, serviceops, Operations
mobrovac added a comment to T218218: Make RESTBase spec standard compliant and switch to OpenAPI 3.0.

Last step: deployment

Wed, May 29, 8:14 AM · Core Platform Team Kanban (Done with CPT), Services (done), Core Platform Team (Security, stability, performance and scalability (TEC1)), RESTBase, RESTBase-API, serviceops, Operations
mobrovac changed the status of T218218: Make RESTBase spec standard compliant and switch to OpenAPI 3.0 from Stalled to Open.
Wed, May 29, 8:14 AM · Core Platform Team Kanban (Done with CPT), Services (done), Core Platform Team (Security, stability, performance and scalability (TEC1)), RESTBase, RESTBase-API, serviceops, Operations
mobrovac changed the status of T218218: Make RESTBase spec standard compliant and switch to OpenAPI 3.0, a subtask of T217881: Decide whether to keep violating OpenAPI/Swagger specification in our REST services, from Stalled to Open.
Wed, May 29, 8:14 AM · Core Platform Team Kanban (Done with CPT), Services (done), TechCom, RESTBase-API, serviceops, Operations

Tue, May 28

mobrovac committed rDEPLOYCHARTSe44578a85032: RESTRouter: Add initial Helm chart (authored by mobrovac).
RESTRouter: Add initial Helm chart
Tue, May 28, 4:12 PM
mobrovac added a comment to T224487: Make RESTBase take full request template for Parsoid requests.

We can also just add the header, since it is ignored by Parsoid/JS any way

Tue, May 28, 3:45 PM · Core Platform Team Backlog (Designing), Core Platform Team (RESTBase Split (CDP2)), Services (next), RESTBase

Mon, May 27

mobrovac edited projects for T224425: MW Job consumers sometimes pause for several minutes, added: Services (next), Core Platform Team Backlog (Next), Core Platform Team (Security, stability, performance and scalability (TEC1)); removed Services.
Mon, May 27, 3:47 PM · Core Platform Team (Security, stability, performance and scalability (TEC1)), Core Platform Team Backlog (Next), Services (next), WMF-JobQueue, Discovery-Search (Current work)
mobrovac added a comment to T224406: Incorrect icinga settings for mobrovac.

@mobrovac can you retry actions on the Icinga UI?

Mon, May 27, 2:30 PM · Core Platform Team Backlog (Watching / External), Services (watching), Operations, Icinga
mobrovac added a comment to T224406: Incorrect icinga settings for mobrovac.

@mobrovac

  • Regarding the notification AFAICT the RESTBase alerts notify the team-services group (services@). I don't see that alias defined in our exim configuration, so probably is managed by OIT. Could you check with them if that is still valid and includes the right people?
Mon, May 27, 11:57 AM · Core Platform Team Backlog (Watching / External), Services (watching), Operations, Icinga
mobrovac added a comment to T224406: Incorrect icinga settings for mobrovac.

When was the last time this worked for you? modules/icinga/files/cgi.cfg has your shell user name, but it would need to be set to your cn:, i.e. "Mobrovac".

Mon, May 27, 11:54 AM · Core Platform Team Backlog (Watching / External), Services (watching), Operations, Icinga
mobrovac added a comment to T220402: Introduce wikidata termbox SSR to kubernetes.

Should we be using http rather than https internally?

Mon, May 27, 11:41 AM · Patch-For-Review, Core Platform Team Backlog (Watching / External), Services (watching), Wikidata-Termbox-Hike, Wikidata, Release Pipeline, Operations, serviceops, Release-Engineering-Team