Page MenuHomePhabricator

Convert EasyTimeline extension to use Shellbox
Open, Needs TriagePublic

Description

The Timeline extension shells out to a Perl script, which invokes ploticus. EasyTimeline.pl is a 5k-line Perl script, one question is whether we should stick that in the Shellbox container or send it as part of each request as a script.

Also the fonts are currently in the operations/mediawiki-config/fonts repository, it's unclear whether all of them are needed, or just the ones configured in https://noc.wikimedia.org/conf/highlight.php?file=timeline.php


  • Review charts
  • shellbox-timeline namespaces in k8s
  • shellbox-timeline accounts in k8s.
  • shellbox-timeline puppet private tokens.
  • Generate TLS certificates
  • Review helmfile.d files:
  • LVS setup
  • DNS for LVS records
  • Discovery DNS
  • Monitoring dashboard
  • Integration and Acceptance tests

Event Timeline

Change 714883 had a related patch set uploaded (by Legoktm; author: Legoktm):

[mediawiki/extensions/timeline@master] [WIP] Migrate to BoxedCommand, copy structure from Score

https://gerrit.wikimedia.org/r/714883

Change 714885 had a related patch set uploaded (by Legoktm; author: Legoktm):

[mediawiki/libs/Shellbox@master] [WIP] pipeline: Add configuration for Timeline image

https://gerrit.wikimedia.org/r/714885

Change 714885 merged by jenkins-bot:

[mediawiki/libs/Shellbox@master] pipeline: Add configuration for Timeline image

https://gerrit.wikimedia.org/r/714885

Change 716048 had a related patch set uploaded (by Legoktm; author: Legoktm):

[labs/private@master] Add k8s users/tokens for shellbox-{syntaxhighlight,timeline}

https://gerrit.wikimedia.org/r/716048

Change 716051 had a related patch set uploaded (by Legoktm; author: Legoktm):

[operations/puppet@production] Add k8s tokens/users for shellbox-{syntaxhighlight,timeline}

https://gerrit.wikimedia.org/r/716051

Change 716048 merged by Legoktm:

[labs/private@master] Add k8s users/tokens for shellbox-{syntaxhighlight,timeline}

https://gerrit.wikimedia.org/r/716048

Change 716051 merged by Legoktm:

[operations/puppet@production] Add k8s users/tokens for shellbox-{syntaxhighlight,timeline}

https://gerrit.wikimedia.org/r/716051

Change 716055 had a related patch set uploaded (by Legoktm; author: Legoktm):

[operations/deployment-charts@master] admin: Add namespace for shellbox-timeline

https://gerrit.wikimedia.org/r/716055

Change 716055 merged by jenkins-bot:

[operations/deployment-charts@master] admin: Add namespace for shellbox-timeline

https://gerrit.wikimedia.org/r/716055

Change 716063 had a related patch set uploaded (by Legoktm; author: Legoktm):

[operations/deployment-charts@master] Add helmfile.d for shellbox-timeline

https://gerrit.wikimedia.org/r/716063

Change 716063 merged by jenkins-bot:

[operations/deployment-charts@master] Add helmfile.d for shellbox-timeline

https://gerrit.wikimedia.org/r/716063

Change 721904 had a related patch set uploaded (by Legoktm; author: Legoktm):

[operations/puppet@production] Add LVS for new Shellboxes: media, syntaxhighlight & timeline

https://gerrit.wikimedia.org/r/721904

Change 721905 had a related patch set uploaded (by Legoktm; author: Legoktm):

[operations/puppet@production] service: Switch new Shellboxes to lvs_setup

https://gerrit.wikimedia.org/r/721905

Change 721906 had a related patch set uploaded (by Legoktm; author: Legoktm):

[operations/puppet@production] service: Switch new Shellboxes to monitoring_setup

https://gerrit.wikimedia.org/r/721906

Change 721908 had a related patch set uploaded (by Legoktm; author: Legoktm):

[operations/dns@master] Add *.svc.{codfw,eqiad}.wmnet entries for new Shellboxes

https://gerrit.wikimedia.org/r/721908

Change 721907 had a related patch set uploaded (by Legoktm; author: Legoktm):

[operations/puppet@production] service: Switch new Shellboxes to production

https://gerrit.wikimedia.org/r/721907

Change 721909 had a related patch set uploaded (by Legoktm; author: Legoktm):

[operations/dns@master] Add new Shellboxes to discovery

https://gerrit.wikimedia.org/r/721909

Change 714883 merged by jenkins-bot:

[mediawiki/extensions/timeline@master] Migrate to BoxedCommand, copy structure from Score

https://gerrit.wikimedia.org/r/714883

Change 721908 merged by Legoktm:

[operations/dns@master] Add *.svc.{codfw,eqiad}.wmnet entries for new Shellboxes

https://gerrit.wikimedia.org/r/721908

Change 721904 merged by Legoktm:

[operations/puppet@production] Add LVS for new Shellboxes: media, syntaxhighlight & timeline

https://gerrit.wikimedia.org/r/721904

Change 721905 merged by Legoktm:

[operations/puppet@production] service: Switch new Shellboxes to lvs_setup

https://gerrit.wikimedia.org/r/721905

Change 721906 merged by Legoktm:

[operations/puppet@production] service: Switch new Shellboxes to monitoring_setup

https://gerrit.wikimedia.org/r/721906

Change 721907 merged by Legoktm:

[operations/puppet@production] service: Switch new Shellboxes to production

https://gerrit.wikimedia.org/r/721907

Change 721909 merged by Legoktm:

[operations/dns@master] Add new Shellboxes to discovery

https://gerrit.wikimedia.org/r/721909

Change 722736 had a related patch set uploaded (by Legoktm; author: Legoktm):

[operations/puppet@production] services_proxy: Add envoy proxies for new Shellboxes

https://gerrit.wikimedia.org/r/722736

Change 722737 had a related patch set uploaded (by Legoktm; author: Legoktm):

[operations/mediawiki-config@master] ProductionServices: Add new Shellboxes

https://gerrit.wikimedia.org/r/722737

Change 722736 merged by Legoktm:

[operations/puppet@production] services_proxy: Add envoy proxies for new Shellboxes

https://gerrit.wikimedia.org/r/722736

Change 722737 merged by jenkins-bot:

[operations/mediawiki-config@master] ProductionServices: Add new Shellboxes

https://gerrit.wikimedia.org/r/722737

Change 723651 had a related patch set uploaded (by Legoktm; author: Legoktm):

[operations/mediawiki-config@master] Set $wgTimelineFonts and send all Timeline generation to Shellbox

https://gerrit.wikimedia.org/r/723651

Change 723651 merged by jenkins-bot:

[operations/mediawiki-config@master] Set $wgTimelineFonts and send all Timeline generation to Shellbox

https://gerrit.wikimedia.org/r/723651

Mentioned in SAL (#wikimedia-operations) [2021-09-27T21:18:55Z] <legoktm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Set $wgTimelineFonts and send all Timeline generation to Shellbox (T289226) (1/2) (duration: 00m 56s)

Mentioned in SAL (#wikimedia-operations) [2021-09-27T21:20:10Z] <legoktm@deploy1002> Synchronized wmf-config/CommonSettings.php: Set $wgTimelineFonts and send all Timeline generation to Shellbox (T289226) (2/2) (duration: 00m 56s)

Change 725097 had a related patch set uploaded (by Legoktm; author: Legoktm):

[operations/deployment-charts@master] Throw more resources at shellbox-timeline

https://gerrit.wikimedia.org/r/725097

Change 725097 merged by jenkins-bot:

[operations/deployment-charts@master] Throw more resources at shellbox-timeline

https://gerrit.wikimedia.org/r/725097

This is done \o/, just some cleanup left to do before resolving it.

Refs T216318, where I had submitted a patch (see changeset 6) to implement width and height attributes, with a sidecar file for faster subsequent retrievals of their values.

Maybe someone would be interested in rebasing it…