Page MenuHomePhabricator
Create Task
Maniphest T423408

[jobs-api] support exposing continuous jobs to the internet
Closed, ResolvedPublic
Actions

Description

this should be done using httproutes and services like is currently being done in webservice-cli

MR: https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/262 (not sure why the bot did not add it :/)

Remember to add a note to the changelog when deployed.

Related Objects
Search...

StatusSubtypeAssignedTask
 ResolvedkomlaT368600 [KR] WE6.3 Introduce a sustainability scoring system for the Toolforge platform
 ResolveddcaroT375199 [Hypothesis] WE6.3.4 If we enable the automatic deployment of a minimal tool, we will be able to evaluate the end to end flow and set the groundwork for adding support for more complex tools and deployment flows.
 ResolvedLucasWerkmeisterT320140 Migrate wd-shex-infer from Toolforge GridEngine to Toolforge Kubernetes
 Resolved• matmarexT319707 Migrate dtcheck from Toolforge GridEngine to Toolforge Kubernetes
 ResolvedLegoktmT320062 Migrate steve-adder from Toolforge GridEngine to Toolforge Kubernetes
 ResolvedLegoktmT320011 Migrate rfa-voting-history from Toolforge GridEngine to Toolforge Kubernetes
 In ProgressdcaroT194332 [builds-api,components-api,webservice,jobs-api] Make Toolforge a proper platform as a service with push-to-deploy and build packs
 ResolveddcaroT362051 [components-api] First iteration of the component API
 ResolveddcaroT393564 [Hypothesis] WE6.3.10 start a beta for the push-to-deploy features
 In ProgressRaymond_NdibeT362077 [components-api] Add webservice support
 OpenRaymond_NdibeT433355 [components-api] add job publish support
 ResolvedRaymond_NdibeT362072 [components-api] Add support for port/healthcheck for continuous jobs in tool config/depolyment
 OpenNoneT401102 Prebuilt webservice containers should not log to NFS by default
 OpenNoneT311917 [webservice,toolforge-cli] Make `webservice shell` a standalone tool
 In ProgressFeatureRaymond_NdibeT348755 [jobs-api,webservice] Run webservices via the jobs framework
 ResolvedFeatureRaymond_NdibeT341066 [jobs-api,jobs-cli] Support multiple replicas of continuous jobs
 ResolvedFeatureRaymond_NdibeT348758 [jobs-api,jobs-cli] Support services in jobs
 ResolveddcaroT359804 [jobs-api] Refactor before webservice support
 ResolveddcaroT359806 [jobs-api] Remove flask-restful
 ResolvedRaymond_NdibeT359808 [jobs-api] Split the API, core, and storage and runtime modules
 ResolveddcaroT359650 [jobs-api] Create storage layer, and save business models in persistent storage
 ResolvedBUG REPORTdcaroT429231 [jobs-cli] emits a warning to re-create valid jobs
 DeclinedNoneT358815 [jobs-api] separate jobs-framework k8s object templates from code
 ResolvedRaymond_NdibeT390135 [jobs-api] Split the core layer and create the core models
 DeclinedNoneT360016 [jobs-api,buildservice-api,envvars-api] evaluate crossplane for composite objects creation and maintenance
 ResolvedRaymond_NdibeT385904 [jobs-api] move jobs.toolforge.org/* labels to annotations
 ResolvedRaymond_NdibeT390136 [jobs-api] Split the `*Job` API models into three
 ResolvedRaymond_NdibeT390137 [jobs-api] Introduce deprecation metrics
 OpenNoneT390138 [jobs-api] Generate the openapi definition from the code
 ResolvedtaaviT401113 [jobs-api] Migrate to FastAPI
 ResolvedRaymond_NdibeT362520 [maintain-kubeusers] Increment default services quota
 ResolvedRaymond_NdibeT359649 [jobs-api,infra] upgrade all the existing toolforge jobs to the latest job version
 ResolvedFeatureRaymond_NdibeT362621 Support HTTP health checks in jobs framework
 ResolvedFeatureRaymond_NdibeT335592 [jobs-api,jobs-cli] Support job health checks
 InvalidRaymond_NdibeT388088 [jobs-api] add -l|--last to toolforge jobs logs ...
 InvalidRaymond_NdibeT388090 [jobs-api] jobs-api should be able to read webservices started with toolforge webservice
 DuplicateRaymond_NdibeT388091 [jobs-api] add toolforge jobs shell feature
 DuplicateRaymond_NdibeT388092 allow exposing continuous jobs to the internet via `toolname.toolforge.org`, just like webservice
 InvalidRaymond_NdibeT392717 [jobs-api] check for diff in services when running diff_with_running_job
 ResolvedRaymond_NdibeT415322 [jobs-api] Use the same images as webservice
 ResolvedRaymond_NdibeT409191 [jobs-api] Investigate if we can reuse the 'web' flavour pre-built images as regular images
 OpenRaymond_NdibeT428898 [jobs-cli, jobs-api] support --webservice option
 ResolvedRaymond_NdibeT423410 [jobs-cli] support publishing continuous job to the internet
 ResolvedRaymond_NdibeT423408 [jobs-api] support exposing continuous jobs to the internet
 ResolveddcaroT430071 [jobs-api] Refactor k8s object creation to have per-job-type functions
 ResolvedRaymond_NdibeT431403 image-config: add webservice-defaults to standard images
 DuplicateRaymond_NdibeT431410 jobs-api, jobs-cli: support --webservice option in toolforge jobs run
 OpenRaymond_NdibeT431563 [webservice-runner] Add pre-flight validity checks to the `webservice-runner` script in webservice images
 ResolvedRaymond_NdibeT431417 webservice-cli: detect conflict with HTTPRoutes created by the jobs framework

Event Timeline

Raymond_Ndibe created this task.Apr 15 2026, 11:55 AM
Restricted Application removed a project: Patch-For-Review. · View Herald TranscriptApr 15 2026, 11:55 AM
aputhin moved this task from Backlog to Todos on the tools-platform-team board.Apr 29 2026, 2:09 PM
fnegri removed a project: cloud-services-team (FY2025/2026-Q3-Q4).Apr 29 2026, 2:54 PM
aputhin changed the task status from Open to In Progress.May 21 2026, 4:11 PM
aputhin moved this task from Todos to In progress on the tools-platform-team board.
Raymond_Ndibe moved this task from In progress to In review on the tools-platform-team board.Jun 2 2026, 3:34 PM
aputhin edited projects, added: Toolforge (Push-to-Deploy); removed: Toolforge.Jun 3 2026, 2:03 PM
dcaro edited parent tasks, added: T348755: [jobs-api,webservice] Run webservices via the jobs framework; removed: T388092: allow exposing continuous jobs to the internet via `toolname.toolforge.org`, just like webservice.Jun 17 2026, 3:38 PM
dcaro edited parent tasks, added: T423410: [jobs-cli] support publishing continuous job to the internet; removed: T348755: [jobs-api,webservice] Run webservices via the jobs framework.Jun 17 2026, 3:58 PM
dcaro created subtask T430071: [jobs-api] Refactor k8s object creation to have per-job-type functions.Jun 24 2026, 4:44 PM
dcaro changed the status of subtask T430071: [jobs-api] Refactor k8s object creation to have per-job-type functions from Open to In Progress.Jun 24 2026, 5:00 PM
dcaro changed the status of subtask T430071: [jobs-api] Refactor k8s object creation to have per-job-type functions from In Progress to Open.
aputhin triaged this task as High priority.Jun 25 2026, 2:02 PM
Raymond_Ndibe mentioned this in T388092: allow exposing continuous jobs to the internet via `toolname.toolforge.org`, just like webservice.Jul 7 2026, 10:44 AM
Raymond_Ndibe mentioned this in T431410: jobs-api, jobs-cli: support --webservice option in toolforge jobs run.Jul 7 2026, 10:57 AM
aputhin moved this task from Backlog to Stable release on the Toolforge (Push-to-Deploy) board.Jul 8 2026, 11:50 AM
aputhin changed the task status from In Progress to Stalled.Jul 8 2026, 2:21 PM
Raymond_Ndibe mentioned this in T428898: [jobs-cli, jobs-api] support --webservice option.Jul 8 2026, 2:33 PM
dcaro closed subtask T430071: [jobs-api] Refactor k8s object creation to have per-job-type functions as Resolved.Mon, Jul 20, 12:34 PM
dcaro changed the task status from Stalled to In Progress.Mon, Jul 20, 3:22 PM
dcaro moved this task from In review to In progress on the tools-platform-team board.
dcaro updated the task description. (Show Details)Mon, Jul 20, 3:41 PM
Raymond_Ndibe moved this task from In progress to In review on the tools-platform-team board.Mon, Jul 27, 3:56 PM
dcaro added a parent task: T433355: [components-api] add job publish support.Tue, Jul 28, 9:54 AM
dcaro updated the task description. (Show Details)Thu, Jul 30, 8:57 AM
dcaro updated the task description. (Show Details)
CodeReviewBot added a comment.Thu, Jul 30, 2:04 PM

raymond-ndibe merged https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/262

global: add publish option to expose job to the internet

CodeReviewBot added a project: Patch-For-Review.Thu, Jul 30, 2:08 PM

group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce opened https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1352

jobs-api: bump to 0.0.554-20260730140452-efcd2c9e

CodeReviewBot added a comment.Thu, Jul 30, 2:46 PM

raymond-ndibe merged https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1352

jobs-api: bump to 0.0.554-20260730140452-efcd2c9e

Raymond_Ndibe closed this task as Resolved.Mon, Aug 3, 2:14 AM
Raymond_Ndibe moved this task from In review to Done on the tools-platform-team board.
dcaro reopened this task as In Progress.Mon, Aug 3, 9:18 AM
dcaro moved this task from Done to In progress on the tools-platform-team board.

Forgot to add the changelog

Raymond_Ndibe added a comment.Wed, Aug 5, 4:57 AM
In T423408#12177977, @dcaro wrote:

Forgot to add the changelog

updated the documentation to add --publish support, also added some of the things we are mixing in the docs.
updated the changelog too.

Raymond_Ndibe closed this task as Resolved.Wed, Aug 5, 4:58 AM
Raymond_Ndibe moved this task from In progress to Done on the tools-platform-team board.
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits