Page MenuHomePhabricator
Create Task
Maniphest T267374

[tbs.beta] Create a toolforge build service beta release
Closed, ResolvedPublic
Actions

Description

For proof of concept and to start getting user feedback, setup a minimal build service deployment on tools.

User stories:
https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Ongoing_Efforts/Toolforge_Build_Service/Overview#Beta_user_stories

Related Objects
Search...

View Standalone Graph
This task is connected to more than 200 other tasks. Only direct parents and subtasks are shown here. Use View Standalone Graph to show more of the graph.
StatusSubtypeAssignedTask
· · ·
In ProgressdcaroT194332 [builds-api,components-api,webservice,jobs-api] Make Toolforge a proper platform as a service with push-to-deploy and build packs
ResolveddcaroT267374 [tbs.beta] Create a toolforge build service beta release
ResolveddcaroT293644 [tbs] Create a subcommand for the toolforge cli to trigger a build
ResolveddcaroT293667 Add documentation on the buildpack POC
ResolveddcaroT265685 [tbs] Set up CI for cloud/toolforge/buildpacks repository
ResolveddcaroT265691 [tbs.maintaindbusers] Update maintain-dbusers to create an envvar with replica.my.cnf to be used by buildpack images
ResolveddcaroT265781 [tbs] Upgrade Toolforge buildpacks to api 0.8 (latest)
ResolvedRaymond_NdibeT316231 [tbs.cli.build-logs] Show a warning to the user if it’s not admin saying that they will not be able to read the logs
ResolveddcaroT316228 [tbs.cli] Define the process to build and deploy the CLI on toolforge bastions
ResolvedSlst2020T316226 [tbs.cli]: toolforge build-show shows unknown for steps that are actually ok
ResolvedSlst2020T316222 [tbs.cli]: Create reasonable defaults for the build command (so the users have to add only the minimum needed info)
DuplicateNoneT267062 Allow Toolforge users to manually start/restart/stop buildpack based web servers
DuplicateNoneT297089 [tbs.docs] Create user documentation (to be expanded)
ResolveddcaroT296947 [toolforge.buildservice] Add CI checks
DuplicateNoneT297088 [tbs.docs] Create admin documentation (to be expanded)
ResolvedRaymond_NdibeT316332 [tbs.buildpack-admission-controller] Ensure we use the deploy.sh standard
ResolvedRaymond_NdibeT316335 [tbs.registry-admission-webhook] Ensure we use the deploy.sh standard
ResolvedRaymond_NdibeT316530 [tbs.harbor] Upgrade harbor to 2.5.*
ResolveddcaroT316541 [tbs.harbor] Rebuild toolsbeta-harborweb-2 with debian 11(bullseye)
ResolvedfnegriT316658 [tbs.devenv] Francesco to setup the development environment
ResolvedRaymond_NdibeT316657 [tbs.devenv] Raymond to setup the development environment
ResolvedSlst2020T316656 [tbs.devenv] Slavina to setup the development environment
ResolvedSlst2020T318656 [tbs][cli] Error when there's no 'steps' in the status
ResolvedKHernandez-WMFT320424 [tbs] Add project documentation to wikitech wiki
ResolvedRaymond_NdibeT320522 [buildpack-admission-controller] Rename the toolforge deployment envirnoment to tools
ResolvedkomlaT321162 [buildservice] allow running deploy.sh without passing a parameter
ResolvedRaymond_NdibeT321188 [tbs] fix/improve the updating of the buildpack/tekton images in the local repo
ResolvedSlst2020T322190 [tbs][cli] When a pipelinerun is created, it has no 'status' so we should not break on it
ResolveddcaroT322412 [tbs][buildpack-admission-controller] fix deploy on toolsbeta/tools
ResolveddcaroT322413 [tbs][buildpack-admission-controller] use git hash and timestamp for docker image tag
ResolveddcaroT324314 [harbor] puppet onlyif not working
ResolvedRaymond_NdibeT324785 get buildpack-admission-controller to work in development
ResolveddcaroT324704 Develop user stories for Toolforge Build Service.
ResolvedfnegriT324814 tbs: user-story 1 - I'm able to use the service using its documentation
ResolvedRaymond_NdibeT324827 tbs: user-story 3 - I want to cancel the build using the toolforge build cancel feature
ResolveddcaroT324833 tbs: user-story 5 - I want to check the status of a given build using the toolforge build show feature.
ResolveddcaroT324830 tbs: user-story 4 - I want to check the status of the last build using the toolforge build show feature
ResolveddcaroT324823 tbs: user-story 2 - Feature: I can start a new build from a git url
ResolvedRaymond_NdibeT323555 [tbs][cli] Implement the global --verbose flag as an env var
ResolvedRaymond_NdibeT323700 [toolforge-cli][build] show fails if the pipelinerun has no 'status'
ResolveddcaroT324834 tbs: user-story 6 - I want to start a webservice with the image I built earlier.
ResolvedRaymond_NdibeT293645 [tbs.webservice] Modify the webservice cli to allow the deployment of custom images from harbor
ResolvedRaymond_NdibeT316327 [tbs] Deploy on tools
ResolvedNoneT265681 [tbs.tools] Deploy a tool using a buildpack-based image on Toolforge
ResolveddcaroT324835 tbs: user-story 7 - I want to list all the tool builds.
ResolvedRaymond_NdibeT324837 tbs: user-story 8 - I want to delete builds.
ResolvedRaymond_NdibeT325160 tbs: user-story 9: I want to know when the service is down
ResolveddcaroT325166 tbs: user-story 10: I want to know how to manage the service
ResolveddcaroT325172 [builds-api,harbor,builds-builder] user-story 11: I want to know how to debug the service
ResolveddcaroT325180 tbs: user-story 12: I want to easily run the tests for each of the codebases
ResolveddcaroT325187 tbs: user-story 13: I want to avoid getting bugs inadvertently into the codebases
OpenNoneT325207 [builds-cli,builds-api,builds-builder,jobs-cli,josb-api] user-story 14: I want have some certainty that the service is secure
ResolveddcaroT330102 Decision request - What buildpacks to allow and include for toolforge build service beta
ResolveddcaroT331323 [tbs] Everybody has deployed every component once in toolsbeta
ResolvedRaymond_NdibeT334566 [toolforge-cli.build] show only the status line instead of the whole tasks unless --verbose is passed
ResolvedRaymond_NdibeT334586 [toolforge-cli.webservice] Set a default value for the buildservice-image parameter of the buildservice type
ResolveddcaroT336360 [maintain-harbor] Ensure that the created repos have a policy rule to retain only the 5 latest pushed images
ResolveddcaroT335249 Toolforge Build Service Beta Rollout To Selected Users
· · ·

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
dcaro removed a subtask: T324816: tbs: user-story 1 - Create a tutorial (step-by-step) on how to deploy a tool using toolforge buildservice.Dec 9 2022, 9:43 AM
dcaro added a subtask: T324823: tbs: user-story 2 - Feature: I can start a new build from a git url.Dec 9 2022, 10:06 AM
dcaro added a subtask: T324827: tbs: user-story 3 - I want to cancel the build using the toolforge build cancel feature.Dec 9 2022, 10:27 AM
dcaro added a subtask: T324830: tbs: user-story 4 - I want to check the status of the last build using the toolforge build show feature.Dec 9 2022, 10:38 AM
dcaro added a subtask: T324833: tbs: user-story 5 - I want to check the status of a given build using the toolforge build show feature..Dec 9 2022, 10:45 AM
dcaro added a subtask: T324834: tbs: user-story 6 - I want to start a webservice with the image I built earlier..Dec 9 2022, 10:49 AM
dcaro added a subtask: T324835: tbs: user-story 7 - I want to list all the tool builds..Dec 9 2022, 10:54 AM
dcaro added a subtask: T324837: tbs: user-story 8 - I want to delete builds..Dec 9 2022, 10:58 AM
dcaro updated the task description. (Show Details)Dec 9 2022, 11:01 AM
Raymond_Ndibe changed the status of subtask T324785: get buildpack-admission-controller to work in development from Open to In Progress.Dec 12 2022, 1:56 PM
dcaro edited parent tasks, added: T194332: [builds-api,components-api,webservice,jobs-api] Make Toolforge a proper platform as a service with push-to-deploy and build packs; removed: T265684: Figure out CI solution for building buildpack-based images for Toolforge.Dec 13 2022, 5:54 PM
Raymond_Ndibe closed subtask T324785: get buildpack-admission-controller to work in development as Resolved.Dec 13 2022, 8:32 PM
Raymond_Ndibe closed subtask T293645: [tbs.webservice] Modify the webservice cli to allow the deployment of custom images from harbor as Resolved.
Slst2020 changed the status of subtask T323555: [tbs][cli] Implement the global --verbose flag as an env var from In Progress to Open.Dec 14 2022, 10:47 AM
dcaro added a subtask: T325160: tbs: user-story 9: I want to know when the service is down.Dec 14 2022, 1:49 PM
dcaro added a subtask: T325166: tbs: user-story 10: I want to know how to manage the service.Dec 14 2022, 2:05 PM
dcaro added a subtask: T325172: [builds-api,harbor,builds-builder] user-story 11: I want to know how to debug the service.Dec 14 2022, 2:46 PM
dcaro added a subtask: T325180: tbs: user-story 12: I want to easily run the tests for each of the codebases.Dec 14 2022, 3:29 PM
dcaro added a subtask: T325187: tbs: user-story 13: I want to avoid getting bugs inadvertently into the codebases.Dec 14 2022, 3:57 PM
dcaro added a subtask: T325189: tbs: user-story 13: Add ci to the buildservice repo.
dcaro removed a subtask: T325189: tbs: user-story 13: Add ci to the buildservice repo.Dec 14 2022, 3:58 PM
dcaro added a subtask: T325192: tbs: user-story 13: Add ci to the buildpack-admission-controller repo.Dec 14 2022, 3:59 PM
dcaro removed a subtask: T325192: tbs: user-story 13: Add ci to the buildpack-admission-controller repo.
dcaro added a subtask: T325194: tbs: user-story 13: Add ci to the toolforge-cli repo.Dec 14 2022, 4:03 PM
dcaro added a subtask: T325207: [builds-cli,builds-api,builds-builder,jobs-cli,josb-api] user-story 14: I want have some certainty that the service is secure.Dec 14 2022, 4:59 PM
dcaro updated the task description. (Show Details)Dec 14 2022, 6:58 PM
dcaro removed a subtask: T325194: tbs: user-story 13: Add ci to the toolforge-cli repo.Dec 15 2022, 4:59 PM
dcaro closed subtask T324704: Develop user stories for Toolforge Build Service. as Resolved.Dec 17 2022, 11:03 AM
dcaro mentioned this in T324704: Develop user stories for Toolforge Build Service..Dec 17 2022, 11:06 AM
KHernandez-WMF closed subtask T320424: [tbs] Add project documentation to wikitech wiki as Resolved.Dec 20 2022, 2:19 PM
fnegri edited projects, added cloud-services-team (FY2022/2023-Q3); removed cloud-services-team (Kanban).Jan 18 2023, 6:32 PM
KHernandez-WMF closed subtask T321162: [buildservice] allow running deploy.sh without passing a parameter as Resolved.Jan 23 2023, 7:07 PM
dcaro changed the task status from Open to In Progress.Jan 31 2023, 9:57 AM
dcaro moved this task from Backlog to In progress on the cloud-services-team (FY2022/2023-Q3) board.
• aborrero mentioned this in T320178: Migrate wmcz from Toolforge GridEngine to Toolforge Kubernetes.Feb 15 2023, 2:10 PM
dcaro mentioned this in T330102: Decision request - What buildpacks to allow and include for toolforge build service beta.Feb 20 2023, 5:59 PM
dcaro added a subtask: T330102: Decision request - What buildpacks to allow and include for toolforge build service beta.
dcaro moved this task from Backlog to Epics on the Toolforge Build Service board.Feb 28 2023, 10:47 AM
dcaro closed subtask T324833: tbs: user-story 5 - I want to check the status of a given build using the toolforge build show feature. as Resolved.Mar 6 2023, 2:49 PM
dcaro closed subtask T324835: tbs: user-story 7 - I want to list all the tool builds. as Resolved.Mar 6 2023, 2:59 PM
dcaro closed subtask T330102: Decision request - What buildpacks to allow and include for toolforge build service beta as Resolved.Mar 10 2023, 1:24 PM
dcaro changed the status of subtask T324823: tbs: user-story 2 - Feature: I can start a new build from a git url from Open to In Progress.Mar 13 2023, 10:48 AM
dcaro changed the status of subtask T324823: tbs: user-story 2 - Feature: I can start a new build from a git url from In Progress to Stalled.Mar 13 2023, 3:41 PM
dcaro changed the status of subtask T323555: [tbs][cli] Implement the global --verbose flag as an env var from Open to In Progress.Mar 13 2023, 4:29 PM
Raymond_Ndibe changed the status of subtask T323555: [tbs][cli] Implement the global --verbose flag as an env var from In Progress to Stalled.Mar 13 2023, 4:38 PM
dcaro changed the status of subtask T323555: [tbs][cli] Implement the global --verbose flag as an env var from Stalled to In Progress.Mar 14 2023, 10:01 AM
Raymond_Ndibe closed subtask T323555: [tbs][cli] Implement the global --verbose flag as an env var as Resolved.Mar 15 2023, 1:45 AM
Raymond_Ndibe closed subtask T324837: tbs: user-story 8 - I want to delete builds. as Resolved.Mar 15 2023, 9:08 PM
Raymond_Ndibe changed the status of subtask T316327: [tbs] Deploy on tools from Open to In Progress.Mar 17 2023, 2:10 AM
Raymond_Ndibe changed the status of subtask T316327: [tbs] Deploy on tools from In Progress to Stalled.
Raymond_Ndibe changed the status of subtask T316327: [tbs] Deploy on tools from Stalled to In Progress.Mar 27 2023, 4:05 PM
Raymond_Ndibe changed the status of subtask T316327: [tbs] Deploy on tools from In Progress to Stalled.Mar 28 2023, 1:10 PM
Raymond_Ndibe changed the status of subtask T316327: [tbs] Deploy on tools from Stalled to Open.Mar 28 2023, 10:49 PM
Raymond_Ndibe changed the status of subtask T316327: [tbs] Deploy on tools from Open to Stalled.Mar 28 2023, 10:57 PM
Raymond_Ndibe closed subtask T316327: [tbs] Deploy on tools as Resolved.Apr 3 2023, 11:03 PM
Raymond_Ndibe closed subtask T324823: tbs: user-story 2 - Feature: I can start a new build from a git url as Resolved.Apr 4 2023, 1:15 AM
Raymond_Ndibe closed subtask T324827: tbs: user-story 3 - I want to cancel the build using the toolforge build cancel feature as Resolved.Apr 4 2023, 1:25 AM
Raymond_Ndibe changed the status of subtask T324830: tbs: user-story 4 - I want to check the status of the last build using the toolforge build show feature from Open to In Progress.Apr 6 2023, 5:40 AM
Raymond_Ndibe changed the status of subtask T324830: tbs: user-story 4 - I want to check the status of the last build using the toolforge build show feature from In Progress to Stalled.
dcaro changed the status of subtask T324834: tbs: user-story 6 - I want to start a webservice with the image I built earlier. from Open to In Progress.Apr 11 2023, 1:48 PM
dcaro changed the status of subtask T265681: [tbs.tools] Deploy a tool using a buildpack-based image on Toolforge from Duplicate to Resolved.
dcaro closed subtask T324834: tbs: user-story 6 - I want to start a webservice with the image I built earlier. as Resolved.Apr 11 2023, 2:50 PM
dcaro changed the status of subtask T324830: tbs: user-story 4 - I want to check the status of the last build using the toolforge build show feature from Stalled to In Progress.
dcaro removed a subtask: T334565: [toolforge-cli.build] Differenciate between verbose and debug.Apr 12 2023, 10:33 AM
fnegri moved this task from FY2022/2023-Q3 to FY2022/2023-Q4 on the cloud-services-team board.Apr 12 2023, 2:34 PM
fnegri edited projects, added cloud-services-team (FY2022/2023-Q4); removed cloud-services-team (FY2022/2023-Q3).
fnegri moved this task from Backlog to Planned Goals on the cloud-services-team (FY2022/2023-Q4) board.Apr 12 2023, 2:36 PM
fnegri raised the priority of this task from Medium to High.Apr 12 2023, 2:51 PM
fnegri changed the status of subtask T331323: [tbs] Everybody has deployed every component once in toolsbeta from Open to In Progress.Apr 14 2023, 3:53 PM
dcaro changed the status of subtask T334566: [toolforge-cli.build] show only the status line instead of the whole tasks unless --verbose is passed from Open to In Progress.Apr 17 2023, 9:39 AM
dcaro changed the status of subtask T334586: [toolforge-cli.webservice] Set a default value for the buildservice-image parameter of the buildservice type from Open to In Progress.
Raymond_Ndibe closed subtask T334586: [toolforge-cli.webservice] Set a default value for the buildservice-image parameter of the buildservice type as Resolved.Apr 18 2023, 12:09 AM
Raymond_Ndibe closed subtask T334566: [toolforge-cli.build] show only the status line instead of the whole tasks unless --verbose is passed as Resolved.
fnegri added a project: Goal.Apr 19 2023, 2:27 PM
fnegri moved this task from Planned Goals to In progress on the cloud-services-team (FY2022/2023-Q4) board.Apr 19 2023, 2:29 PM
dcaro closed subtask T331323: [tbs] Everybody has deployed every component once in toolsbeta as Resolved.Apr 24 2023, 1:52 PM
dcaro closed subtask T324830: tbs: user-story 4 - I want to check the status of the last build using the toolforge build show feature as Resolved.May 8 2023, 1:36 PM
Raymond_Ndibe changed the status of subtask T325160: tbs: user-story 9: I want to know when the service is down from Open to In Progress.May 9 2023, 11:42 PM
Raymond_Ndibe closed subtask T325160: tbs: user-story 9: I want to know when the service is down as Resolved.May 10 2023, 5:09 PM
dcaro changed the status of subtask T336360: [maintain-harbor] Ensure that the created repos have a policy rule to retain only the 5 latest pushed images from Open to In Progress.May 11 2023, 8:00 AM
dcaro changed the status of subtask T336360: [maintain-harbor] Ensure that the created repos have a policy rule to retain only the 5 latest pushed images from In Progress to Stalled.May 11 2023, 4:32 PM
dcaro closed subtask T336360: [maintain-harbor] Ensure that the created repos have a policy rule to retain only the 5 latest pushed images as Resolved.May 12 2023, 3:32 PM
fnegri closed subtask T324814: tbs: user-story 1 - I'm able to use the service using its documentation as Resolved.May 23 2023, 2:07 PM
dcaro closed subtask T265685: [tbs] Set up CI for cloud/toolforge/buildpacks repository as Resolved.May 24 2023, 12:57 PM
KHernandez-WMF changed the status of subtask T296947: [toolforge.buildservice] Add CI checks from Duplicate to Resolved.May 29 2023, 5:50 PM
dcaro changed the status of subtask T265691: [tbs.maintaindbusers] Update maintain-dbusers to create an envvar with replica.my.cnf to be used by buildpack images from Open to In Progress.Jul 3 2023, 4:47 PM
• aborrero reopened subtask T321188: [tbs] fix/improve the updating of the buildpack/tekton images in the local repo as Open.Jul 19 2023, 11:56 AM
• aborrero closed subtask T321188: [tbs] fix/improve the updating of the buildpack/tekton images in the local repo as Resolved.Jul 20 2023, 3:33 PM
fnegri edited projects, added cloud-services-team (FY2023/2024-Q1-Q2); removed cloud-services-team (FY2022/2023-Q4).Jul 26 2023, 3:56 PM
fnegri moved this task from Backlog to Planned Goals on the cloud-services-team (FY2023/2024-Q1-Q2) board.
fnegri moved this task from Planned Goals to In progress on the cloud-services-team (FY2023/2024-Q1-Q2) board.Aug 7 2023, 2:53 PM
dcaro closed subtask T325187: tbs: user-story 13: I want to avoid getting bugs inadvertently into the codebases as Resolved.Aug 8 2023, 9:57 AM
dcaro closed subtask T325180: tbs: user-story 12: I want to easily run the tests for each of the codebases as Resolved.
dcaro closed subtask T265691: [tbs.maintaindbusers] Update maintain-dbusers to create an envvar with replica.my.cnf to be used by buildpack images as Resolved.Sep 1 2023, 7:28 AM
dcaro added a subtask: T335249: Toolforge Build Service Beta Rollout To Selected Users.Oct 2 2023, 8:06 AM
dcaro closed subtask T335249: Toolforge Build Service Beta Rollout To Selected Users as Resolved.Oct 4 2023, 4:09 PM
taavi closed this task as Resolved.Dec 12 2023, 7:17 PM
fnegri moved this task from In progress to Done on the cloud-services-team (FY2023/2024-Q1-Q2) board.Dec 19 2023, 1:49 PM
dcaro closed subtask T325166: tbs: user-story 10: I want to know how to manage the service as Resolved.Jan 10 2024, 11:35 AM
dcaro closed subtask T325172: [builds-api,harbor,builds-builder] user-story 11: I want to know how to debug the service as Resolved.Nov 27 2024, 10:30 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits