Page MenuHomePhabricator
Create Task
Maniphest T368600

[KR] WE6.3 Introduce a sustainability scoring system for the Toolforge platform
Closed, ResolvedPublic
Actions

Description

This task is to track the hypothesis tasks for the WE6.3 KR (see https://meta.wikimedia.org/wiki/Wikimedia_Foundation_Annual_Plan/2024-2025/Product_%26_Technology_OKRs)

Related Objects
Search...

StatusSubtypeAssignedTask
 ResolvedLucasWerkmeisterT320140 Migrate wd-shex-infer from Toolforge GridEngine to Toolforge Kubernetes
 Resolved• matmarexT319707 Migrate dtcheck from Toolforge GridEngine to Toolforge Kubernetes
 ResolvedLegoktmT320062 Migrate steve-adder from Toolforge GridEngine to Toolforge Kubernetes
 ResolvedLegoktmT320011 Migrate rfa-voting-history from Toolforge GridEngine to Toolforge Kubernetes
 In ProgressdcaroT194332 [builds-api,components-api,webservice,jobs-api] Make Toolforge a proper platform as a service with push-to-deploy and build packs
 ResolveddcaroT393564 [Hypothesis] WE6.3.10 start a beta for the push-to-deploy features
 ResolvedkomlaT368600 [KR] WE6.3 Introduce a sustainability scoring system for the Toolforge platform
 ResolveddcaroT368601 [Hypothesis] WE6.3.1 Consulting Toolforge roots/maintainers
 ResolveddcaroT368602 [Hypothesis] WE6.3.2 Create "standard" tool (Sample Complex Tool, SCT) to measure the number of steps for a deployment
 ResolveddcaroT370176 [sct.backend] Create skeleton fastapi API
 ResolveddcaroT370178 [sct.frontend] Create skeleton node + Vue.js application
 ResolveddcaroT370317 [sct.backend] Create trove database
 ResolveddcaroT370321 [sct.backend] Create worker and connect to redis
 ResolveddcaroT370323 [sct.backend] Transform the "/" API reply to json
 ResolveddcaroT370324 [sct.frontend] Show the backend status
 ResolveddcaroT372478 [sct.frontend] show the current deployment stats
 ResolveddcaroT375199 [Hypothesis] WE6.3.4 If we enable the automatic deployment of a minimal tool, we will be able to evaluate the end to end flow and set the groundwork for adding support for more complex tools and deployment flows.
 ResolveddcaroT362051 [components-api] First iteration of the component API
 ResolveddcaroT362066 [components-api] Develop the webhook mechanism to trigger a deployment
 OpenNoneT362071 [components-api] Add source polling build trigger
 ResolvedRaymond_NdibeT362072 [components-api] Add support for port/healthcheck for continuous jobs in tool config/depolyment
 ResolveddcaroT362076 [components-api] Add support for pre-built images (ex. python3.11, to refine)
 OpenNoneT362075 [components-api] add order to the components deployment
 ResolveddcaroT362224 Decision request - What to use for toolforge components api task execution
 In ProgressRaymond_NdibeT362077 [components-api] Add webservice support
 In ProgressFeatureRaymond_NdibeT348755 [jobs-api,webservice] Run webservices via the jobs framework
 ResolvedFeatureRaymond_NdibeT341066 [jobs-api,jobs-cli] Support multiple replicas of continuous jobs
 ResolvedFeatureRaymond_NdibeT348758 [jobs-api,jobs-cli] Support services in jobs
 ResolveddcaroT359804 [jobs-api] Refactor before webservice support
 ResolveddcaroT359806 [jobs-api] Remove flask-restful
 ResolvedRaymond_NdibeT359808 [jobs-api] Split the API, core, and storage and runtime modules
 ResolveddcaroT359650 [jobs-api] Create storage layer, and save business models in persistent storage
 ResolvedBUG REPORTdcaroT429231 [jobs-cli] emits a warning to re-create valid jobs
 DeclinedNoneT358815 [jobs-api] separate jobs-framework k8s object templates from code
 ResolvedRaymond_NdibeT390135 [jobs-api] Split the core layer and create the core models
 DeclinedNoneT360016 [jobs-api,buildservice-api,envvars-api] evaluate crossplane for composite objects creation and maintenance
 ResolvedRaymond_NdibeT385904 [jobs-api] move jobs.toolforge.org/* labels to annotations
 ResolvedRaymond_NdibeT390136 [jobs-api] Split the `*Job` API models into three
 ResolvedRaymond_NdibeT390137 [jobs-api] Introduce deprecation metrics
 OpenNoneT390138 [jobs-api] Generate the openapi definition from the code
 ResolvedtaaviT401113 [jobs-api] Migrate to FastAPI
 ResolvedRaymond_NdibeT362520 [maintain-kubeusers] Increment default services quota
 ResolvedRaymond_NdibeT359649 [jobs-api,infra] upgrade all the existing toolforge jobs to the latest job version
 ResolvedFeatureRaymond_NdibeT362621 Support HTTP health checks in jobs framework
 ResolvedFeatureRaymond_NdibeT335592 [jobs-api,jobs-cli] Support job health checks
 InvalidRaymond_NdibeT388088 [jobs-api] add -l|--last to toolforge jobs logs ...
 InvalidRaymond_NdibeT388090 [jobs-api] jobs-api should be able to read webservices started with toolforge webservice
 DuplicateRaymond_NdibeT388091 [jobs-api] add toolforge jobs shell feature
 DuplicateRaymond_NdibeT388092 allow exposing continuous jobs to the internet via `toolname.toolforge.org`, just like webservice
 InvalidRaymond_NdibeT392717 [jobs-api] check for diff in services when running diff_with_running_job
 ResolvedRaymond_NdibeT415322 [jobs-api] Use the same images as webservice
 ResolvedRaymond_NdibeT409191 [jobs-api] Investigate if we can reuse the 'web' flavour pre-built images as regular images
 OpenRaymond_NdibeT428898 [jobs-cli, jobs-api] support --webservice option
 ResolvedRaymond_NdibeT431403 image-config: add webservice-defaults to standard images
 DuplicateRaymond_NdibeT431410 jobs-api, jobs-cli: support --webservice option in toolforge jobs run
 OpenRaymond_NdibeT431563 [webservice-runner] Add pre-flight validity checks to the `webservice-runner` script in webservice images
 ResolvedRaymond_NdibeT431417 webservice-cli: detect conflict with HTTPRoutes created by the jobs framework
 OpenRaymond_NdibeT433355 [components-api] add job publish support
 ResolvedRaymond_NdibeT423410 [jobs-cli] support publishing continuous job to the internet
 ResolvedRaymond_NdibeT423408 [jobs-api] support exposing continuous jobs to the internet
 ResolveddcaroT430071 [jobs-api] Refactor k8s object creation to have per-job-type functions
 ResolveddcaroT362082 [components-api] Add minimal cli with build-only features
 ResolvedSlst2020T362069 [components-api] Get a skeleton of API webservice and implement `/tool/<toolname>/deploy` with single continuous job deployment only
 ResolveddcaroT362070 [components-api] Get a minimal version of the config with build-only data
 ResolvedSlst2020T363346 [jobs-api, jobs-cli] Prefix all endpoints with `/tool/<toolname>`
 ResolvedSlst2020T363808 [builds-api, builds-cli] Prefix all endpoints with `/tool/<toolname>`
 ResolveddcaroT368909 [toolforge,replica_cnf] Use tool-prefixed urls for envvars
 ResolvedSlst2020T363809 [envvars-api, envvars-cli] Prefix all endpoints with `/tool/<toolname>`
 InvaliddcaroT379053 [components-api] Use an asynchronous toolforge client to interact with toolforge
 ResolveddcaroT379092 [components-api] Add functional tests for the components api
 ResolvedSlst2020T379091 [components-cli] Create cli with subcommand
 ResolveddcaroT384203 [components-cli,lima-kilo] deploy compontents-cli on lima-kilo by default
 ResolvedSlst2020T379093 [components-api] Add endpoint to delete a deployment
 ResolveddcaroT380283 [components-api] Limit the amount of deployments to (say) 25
 ResolveddcaroT384634 [components-api] Trigger builds on every deploy
 ResolveddcaroT388830 [components-api] use the component name for the image instead of the default tool
 ResolveddcaroT388706 [builds-api] Limit the amount of running builds
 ResolvedNoneT388644 [components-api] allow stopping a deployment that's running
 ResolveddcaroT388643 [components-api] restrict running deployments to 1
 ResolvedSlst2020T376896 [Hypotesis] 6.3.5 Obtain a shortlist of categories for the Toolforge sustainability scoring framework

Event Timeline

dcaro created this task.Jun 27 2024, 9:39 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJun 27 2024, 9:39 AM
dcaro triaged this task as High priority.Jun 27 2024, 9:46 AM
dcaro updated the task description. (Show Details)Jun 27 2024, 10:09 AM
dcaro added a project: cloud-services-team (FY2024/2025-Q1-Q2).
Maryann-Onyinye subscribed.Jun 28 2024, 12:28 PM
Raymond_Ndibe subscribed.Jul 1 2024, 1:40 PM
dcaro moved this task from Backlog to Ready to be worked on on the Toolforge board.Jul 2 2024, 1:56 PM
dcaro changed the status of subtask T368602: [Hypothesis] WE6.3.2 Create "standard" tool (Sample Complex Tool, SCT) to measure the number of steps for a deployment from Open to In Progress.Jul 15 2024, 12:41 PM
dcaro changed the status of subtask T368601: [Hypothesis] WE6.3.1 Consulting Toolforge roots/maintainers from Open to In Progress.
dcaro closed subtask T368602: [Hypothesis] WE6.3.2 Create "standard" tool (Sample Complex Tool, SCT) to measure the number of steps for a deployment as Resolved.Sep 10 2024, 9:19 AM
dcaro changed the status of subtask T375199: [Hypothesis] WE6.3.4 If we enable the automatic deployment of a minimal tool, we will be able to evaluate the end to end flow and set the groundwork for adding support for more complex tools and deployment flows. from Open to In Progress.Oct 8 2024, 8:39 AM
Slst2020 closed subtask T368601: [Hypothesis] WE6.3.1 Consulting Toolforge roots/maintainers as Resolved.Oct 10 2024, 12:31 PM
Slst2020 changed the status of subtask T376896: [Hypotesis] 6.3.5 Obtain a shortlist of categories for the Toolforge sustainability scoring framework from Open to In Progress.Oct 10 2024, 12:41 PM
dcaro changed the status of subtask T376896: [Hypotesis] 6.3.5 Obtain a shortlist of categories for the Toolforge sustainability scoring framework from In Progress to Stalled.Oct 29 2024, 1:07 PM
Slst2020 changed the status of subtask T376896: [Hypotesis] 6.3.5 Obtain a shortlist of categories for the Toolforge sustainability scoring framework from Stalled to In Progress.Nov 8 2024, 10:35 AM
dcaro closed subtask T375199: [Hypothesis] WE6.3.4 If we enable the automatic deployment of a minimal tool, we will be able to evaluate the end to end flow and set the groundwork for adding support for more complex tools and deployment flows. as Resolved.Jan 14 2025, 1:43 PM
Slst2020 closed subtask T376896: [Hypotesis] 6.3.5 Obtain a shortlist of categories for the Toolforge sustainability scoring framework as Resolved.Jan 15 2025, 8:23 AM
fnegri edited projects, added: cloud-services-team (FY2024/2025-Q3-Q4); removed: cloud-services-team (FY2024/2025-Q1-Q2).Feb 5 2025, 6:18 PM
dcaro moved this task from Ready to be worked on to Toolforge iteration 17 on the Toolforge board.Feb 25 2025, 3:22 PM
dcaro edited projects, added: Toolforge (Toolforge iteration 17); removed: Toolforge.
dcaro edited projects, added: Toolforge (Toolforge iteration 18); removed: Toolforge (Toolforge iteration 17).Feb 25 2025, 3:29 PM
dcaro edited projects, added: Toolforge (Toolforge iteration 19); removed: Toolforge (Toolforge iteration 18).Mar 18 2025, 3:56 PM
dcaro updated Other Assignee, added: komla; removed: Slst2020.Mar 31 2025, 4:28 PM
dcaro changed the task status from Open to In Progress.May 14 2025, 2:08 PM
dcaro reassigned this task from dcaro to komla.
dcaro updated Other Assignee, added: dcaro; removed: komla.
dcaro moved this task from Next Up to In Progress on the Toolforge (Toolforge iteration 19) board.
dcaro edited projects, added: Toolforge (Toolforge iteration 20); removed: Toolforge (Toolforge iteration 19).May 14 2025, 2:30 PM
dcaro moved this task from Next Up to In Progress on the Toolforge (Toolforge iteration 20) board.
dcaro edited projects, added: Toolforge (Toolforge iteration 21); removed: Toolforge (Toolforge iteration 20).Jun 11 2025, 10:39 AM
dcaro moved this task from Next Up to In Progress on the Toolforge (Toolforge iteration 21) board.
dcaro edited projects, added: Toolforge (Toolforge iteration 22); removed: Toolforge (Toolforge iteration 21).Jul 14 2025, 9:48 AM
dcaro moved this task from Next Up to In Progress on the Toolforge (Toolforge iteration 22) board.
komla added a comment.Jul 15 2025, 6:08 AM

WIP for the wiki page is here. Currently in draft.

fnegri moved this task from Backlog to In progress on the cloud-services-team (FY2024/2025-Q3-Q4) board.Jul 15 2025, 1:34 PM
fnegri edited projects, added: cloud-services-team (FY2025/2026-Q1-Q2); removed: cloud-services-team (FY2024/2025-Q3-Q4).Jul 15 2025, 1:40 PM
fnegri moved this task from Backlog to In progress on the cloud-services-team (FY2025/2026-Q1-Q2) board.Jul 15 2025, 1:47 PM
dcaro edited projects, added: Toolforge (Toolforge iteration 23); removed: Toolforge (Toolforge iteration 22).Aug 5 2025, 3:45 PM
dcaro moved this task from Next Up to In Progress on the Toolforge (Toolforge iteration 23) board.
dcaro edited projects, added: Toolforge (Toolforge iteration 24); removed: Toolforge (Toolforge iteration 23).Aug 27 2025, 9:43 AM
dcaro moved this task from Next Up to In Progress on the Toolforge (Toolforge iteration 24) board.
komla added a comment.Sep 11 2025, 8:42 PM

This has been transferred to Wikitech

komla added a comment.Sep 29 2025, 2:42 AM

Emails out to admins

komla added a comment.Oct 23 2025, 5:18 AM

I followed up on this.

dcaro edited projects, added: Toolforge (Toolforge iteration 25); removed: Toolforge (Toolforge iteration 24).Oct 30 2025, 8:42 AM
dcaro moved this task from Next Up to In Progress on the Toolforge (Toolforge iteration 25) board.
fnegri moved this task from FY2025/2026-Q1-Q2 to FY2025/2026-Q3-Q4 on the cloud-services-team board.Jan 5 2026, 5:55 PM
fnegri edited projects, added: cloud-services-team (FY2025/2026-Q3-Q4); removed: cloud-services-team (FY2025/2026-Q1-Q2).
fnegri moved this task from Backlog to In progress on the cloud-services-team (FY2025/2026-Q3-Q4) board.Jan 5 2026, 6:52 PM
dcaro updated Other Assignee, removed: dcaro.Mar 3 2026, 2:10 PM
dcaro edited projects, added: Toolforge (Toolforge iteration 26); removed: Toolforge (Toolforge iteration 25).Mar 5 2026, 9:35 AM
dcaro moved this task from Next Up to In Progress on the Toolforge (Toolforge iteration 26) board.
taavi edited projects, added: Toolforge; removed: Toolforge (Toolforge iteration 26).Apr 9 2026, 3:31 PM
dcaro closed this task as Resolved.Jun 17 2026, 3:28 PM
dcaro added a subscriber: aputhin.

Closing this, as this is to keep track of a KR than already passed, @aputhin feel free to reopen/etc.
Maybe @komla is still working on this? (might be good to add a summary of what was done)

komla added a comment.Jun 17 2026, 8:29 PM

As shared, this will be revisited, but initial assessment over the three main categories of Observability, Platform Access & Deployment and Source Code Availability is shared here

fnegri moved this task from In progress to Done on the cloud-services-team (FY2025/2026-Q3-Q4) board.Jul 13 2026, 3:05 PM
Restricted Application added a project: tools-platform-team. · View Herald TranscriptJul 13 2026, 3:05 PM
dcaro moved this task from Backlog to Done on the tools-platform-team board.Tue, Jul 21, 7:58 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits