Page MenuHomePhabricator

Convert EasyTimeline extension to use Shellbox
Closed, ResolvedPublic

Description

The Timeline extension shells out to a Perl script, which invokes ploticus. EasyTimeline.pl is a 5k-line Perl script, one question is whether we should stick that in the Shellbox container or send it as part of each request as a script.

Also the fonts are currently in the operations/mediawiki-config/fonts repository, it's unclear whether all of them are needed, or just the ones configured in https://noc.wikimedia.org/conf/highlight.php?file=timeline.php


  • Review charts
  • shellbox-timeline namespaces in k8s
  • shellbox-timeline accounts in k8s.
  • shellbox-timeline puppet private tokens.
  • Generate TLS certificates
  • Review helmfile.d files:
  • LVS setup
  • DNS for LVS records
  • Discovery DNS
  • Monitoring dashboard
  • Integration and Acceptance tests

Event Timeline

Change 714883 had a related patch set uploaded (by Legoktm; author: Legoktm):

[mediawiki/extensions/timeline@master] [WIP] Migrate to BoxedCommand, copy structure from Score

https://gerrit.wikimedia.org/r/714883

Change 714885 had a related patch set uploaded (by Legoktm; author: Legoktm):

[mediawiki/libs/Shellbox@master] [WIP] pipeline: Add configuration for Timeline image

https://gerrit.wikimedia.org/r/714885

Change 714885 merged by jenkins-bot:

[mediawiki/libs/Shellbox@master] pipeline: Add configuration for Timeline image

https://gerrit.wikimedia.org/r/714885

Change 716048 had a related patch set uploaded (by Legoktm; author: Legoktm):

[labs/private@master] Add k8s users/tokens for shellbox-{syntaxhighlight,timeline}

https://gerrit.wikimedia.org/r/716048

Change 716051 had a related patch set uploaded (by Legoktm; author: Legoktm):

[operations/puppet@production] Add k8s tokens/users for shellbox-{syntaxhighlight,timeline}

https://gerrit.wikimedia.org/r/716051

Change 716048 merged by Legoktm:

[labs/private@master] Add k8s users/tokens for shellbox-{syntaxhighlight,timeline}

https://gerrit.wikimedia.org/r/716048

Change 716051 merged by Legoktm:

[operations/puppet@production] Add k8s users/tokens for shellbox-{syntaxhighlight,timeline}

https://gerrit.wikimedia.org/r/716051

Change 716055 had a related patch set uploaded (by Legoktm; author: Legoktm):

[operations/deployment-charts@master] admin: Add namespace for shellbox-timeline

https://gerrit.wikimedia.org/r/716055

Change 716055 merged by jenkins-bot:

[operations/deployment-charts@master] admin: Add namespace for shellbox-timeline

https://gerrit.wikimedia.org/r/716055

Change 716063 had a related patch set uploaded (by Legoktm; author: Legoktm):

[operations/deployment-charts@master] Add helmfile.d for shellbox-timeline

https://gerrit.wikimedia.org/r/716063

Change 716063 merged by jenkins-bot:

[operations/deployment-charts@master] Add helmfile.d for shellbox-timeline

https://gerrit.wikimedia.org/r/716063

Change 721904 had a related patch set uploaded (by Legoktm; author: Legoktm):

[operations/puppet@production] Add LVS for new Shellboxes: media, syntaxhighlight & timeline

https://gerrit.wikimedia.org/r/721904

Change 721905 had a related patch set uploaded (by Legoktm; author: Legoktm):

[operations/puppet@production] service: Switch new Shellboxes to lvs_setup

https://gerrit.wikimedia.org/r/721905

Change 721906 had a related patch set uploaded (by Legoktm; author: Legoktm):

[operations/puppet@production] service: Switch new Shellboxes to monitoring_setup

https://gerrit.wikimedia.org/r/721906

Change 721908 had a related patch set uploaded (by Legoktm; author: Legoktm):

[operations/dns@master] Add *.svc.{codfw,eqiad}.wmnet entries for new Shellboxes

https://gerrit.wikimedia.org/r/721908

Change 721907 had a related patch set uploaded (by Legoktm; author: Legoktm):

[operations/puppet@production] service: Switch new Shellboxes to production

https://gerrit.wikimedia.org/r/721907

Change 721909 had a related patch set uploaded (by Legoktm; author: Legoktm):

[operations/dns@master] Add new Shellboxes to discovery

https://gerrit.wikimedia.org/r/721909

Change 714883 merged by jenkins-bot:

[mediawiki/extensions/timeline@master] Migrate to BoxedCommand, copy structure from Score

https://gerrit.wikimedia.org/r/714883

Change 721908 merged by Legoktm:

[operations/dns@master] Add *.svc.{codfw,eqiad}.wmnet entries for new Shellboxes

https://gerrit.wikimedia.org/r/721908

Change 721904 merged by Legoktm:

[operations/puppet@production] Add LVS for new Shellboxes: media, syntaxhighlight & timeline

https://gerrit.wikimedia.org/r/721904

Change 721905 merged by Legoktm:

[operations/puppet@production] service: Switch new Shellboxes to lvs_setup

https://gerrit.wikimedia.org/r/721905

Change 721906 merged by Legoktm:

[operations/puppet@production] service: Switch new Shellboxes to monitoring_setup

https://gerrit.wikimedia.org/r/721906

Change 721907 merged by Legoktm:

[operations/puppet@production] service: Switch new Shellboxes to production

https://gerrit.wikimedia.org/r/721907

Change 721909 merged by Legoktm:

[operations/dns@master] Add new Shellboxes to discovery

https://gerrit.wikimedia.org/r/721909

Change 722736 had a related patch set uploaded (by Legoktm; author: Legoktm):

[operations/puppet@production] services_proxy: Add envoy proxies for new Shellboxes

https://gerrit.wikimedia.org/r/722736

Change 722737 had a related patch set uploaded (by Legoktm; author: Legoktm):

[operations/mediawiki-config@master] ProductionServices: Add new Shellboxes

https://gerrit.wikimedia.org/r/722737

Change 722736 merged by Legoktm:

[operations/puppet@production] services_proxy: Add envoy proxies for new Shellboxes

https://gerrit.wikimedia.org/r/722736

Change 722737 merged by jenkins-bot:

[operations/mediawiki-config@master] ProductionServices: Add new Shellboxes

https://gerrit.wikimedia.org/r/722737

Change 723651 had a related patch set uploaded (by Legoktm; author: Legoktm):

[operations/mediawiki-config@master] Set $wgTimelineFonts and send all Timeline generation to Shellbox

https://gerrit.wikimedia.org/r/723651

Change 723651 merged by jenkins-bot:

[operations/mediawiki-config@master] Set $wgTimelineFonts and send all Timeline generation to Shellbox

https://gerrit.wikimedia.org/r/723651

Mentioned in SAL (#wikimedia-operations) [2021-09-27T21:18:55Z] <legoktm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Set $wgTimelineFonts and send all Timeline generation to Shellbox (T289226) (1/2) (duration: 00m 56s)

Mentioned in SAL (#wikimedia-operations) [2021-09-27T21:20:10Z] <legoktm@deploy1002> Synchronized wmf-config/CommonSettings.php: Set $wgTimelineFonts and send all Timeline generation to Shellbox (T289226) (2/2) (duration: 00m 56s)

Change 725097 had a related patch set uploaded (by Legoktm; author: Legoktm):

[operations/deployment-charts@master] Throw more resources at shellbox-timeline

https://gerrit.wikimedia.org/r/725097

Change 725097 merged by jenkins-bot:

[operations/deployment-charts@master] Throw more resources at shellbox-timeline

https://gerrit.wikimedia.org/r/725097

This is done \o/, just some cleanup left to do before resolving it.

Refs T216318, where I had submitted a patch (see changeset 6) to implement width and height attributes, with a sidecar file for faster subsequent retrievals of their values.

Maybe someone would be interested in rebasing it…

Pppery subscribed.

This is done \o/, just some cleanup left to do before resolving it.

Has that cleanup happened yet?

@Legoktm: Per emails from Sep18 and Oct20 and https://www.mediawiki.org/wiki/Bug_management/Assignee_cleanup , I am resetting the assignee of this task because there has not been progress lately (please correct me if I am wrong!). Resetting the assignee avoids the impression that somebody is already working on this task. It also allows others to potentially work towards fixing this task. Please claim this task again when you plan to work on it (via Add Action...Assign / Claim in the dropdown menu) - it would be welcome. Thanks for your understanding!

matmarex assigned this task to Legoktm.
matmarex subscribed.

Merged on Jun 28, 2023.