Page MenuHomePhabricator

Modify PipelineLib to work with WMF chart museum
Closed, ResolvedPublic

Description

With changes made in T253843: Move helm chart repository out of git, PipelineLib configs that reference a chart by the old releases.wikimedia.org URL are no longer working. We should modify PipelineLib to add https://helm-charts.wikimedia.org/ as a chart repository at setup and correct any existing .pipeline/config.yaml files.

Event Timeline

Change 623478 had a related patch set uploaded (by Jeena Huneidi; owner: Jeena Huneidi):
[integration/pipelinelib@master] Add Helm chart repo to pipeline

https://gerrit.wikimedia.org/r/623478

Change 623479 had a related patch set uploaded (by Jeena Huneidi; owner: Jeena Huneidi):
[blubber@master] .pipeline/config.yaml: Update chart object

https://gerrit.wikimedia.org/r/623479

Change 623480 had a related patch set uploaded (by Jeena Huneidi; owner: Jeena Huneidi):
[mediawiki/services/mathoid@master] .pipeline/helm.yaml: Update chart object

https://gerrit.wikimedia.org/r/623480

I was discussing with @WDoranWMF and @AMooney about knowledge sharing on the mathoid deployments. Either coincidentally or on purpose, I was asked to review the mathoid change on Gerrit. Thus I am asking the possible very stupid question if the problem that restbase seems not to use the latest mathoid version.

BTW: Which row in the skill matrix indicates that someone understands how something like mathoid is deployed. I was guessing that @hashar knows how this is done, but he is not on the list.

Just a drive-by reply...

BTW: Which row in the skill matrix indicates that someone understands how something like mathoid is deployed. I was guessing that @hashar knows how this is done, but he is not on the list.

That's Core Platform Team's skill matrix, which Antoine is not a member of. The Release Engineering Team has it's own at https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Skill_matrix . See the "Deployment Pipeline" category.

Change 623478 merged by jenkins-bot:
[integration/pipelinelib@master] Add Helm chart repo to pipeline

https://gerrit.wikimedia.org/r/623478

@Physikerwelt sorry you got added to the change. You were added by reviewer-bot automatically, I assume since you tend to make changes to mathoid. I'll reply to your comment on [T207535#6421053]. As far as using the latest mathoid version, I'm not sure about restbase, but for CI, I've made it the default in my change to use the latest mathoid chart. If that's not desired please let me know and we can go back to using the previously specified version.

Change 623479 merged by jenkins-bot:
[blubber@master] .pipeline/config.yaml: Update chart object

https://gerrit.wikimedia.org/r/623479

Change 623480 merged by jenkins-bot:
[mediawiki/services/mathoid@master] .pipeline/helm.yaml: Update chart object

https://gerrit.wikimedia.org/r/623480

BTW: Which row in the skill matrix indicates that someone understands how something like mathoid is deployed. I was guessing that @hashar knows how this is done, but he is not on the list.

Hello, I might have setup the original deployment of mathoid on the deployment-prep cluster but that was ages ago and using a vastly different system. I guess the maintenance of services on deployment-prep is now handled directly by the service owner (which would be WMF Core Platform Team, with release engineering (the team I am part of) assisting for the infrastructure. In our team @jeena is definitely an expert on the matter, if not THE expert :]

@hashar thank you for the clarification.
However, I need to understand what needs to be done to influence the rendering in production, e.g., making \oint less bold (T207535). This has been a problem for quite a while. Naively I think this involves two steps:

  1. I need to figure out where the RestBase production configuration is stored and which server is eventually used by restbase for the math rendering. (I would be guessing that it is just mathoid.svc.(codfw|eqiad).wmnet here it would be really interesting to figure out the version via curl http://mathoid.svc.codfw.wmnet:10042/_info from a machine connected to the respective network.
  2. This particular server should be updated to the latest mathoid version (optimally automatically whenever a change was merged). Here I hope to get support from someone who has the permissions and knowledge to configure the deployment pipelines accordingly.