Page MenuHomePhabricator
Create Task
Maniphest T356262

[jobs-cli,builds-cli,toolforge-cli,webservice] Consolidate the Toolforge CLIs
Open, Stalled, HighPublic
Actions

Description

See https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T348749_Toolforge_CLI_consolidation

Related Objects
Search...

StatusSubtypeAssignedTask
 ResolvedRaymond_NdibeT359641 [infra,k8s] Upgrade Toolforge Kubernetes to version 1.27
Restricted Task
 ResolvedSlst2020T327025 [infra,k8s] Upgrade Toolforge Kubernetes to version 1.26
 Resolved• aborreroT316107 [infra,k8s] Upgrade Toolforge Kubernetes to version 1.25
 Resolved• aborreroT307651 Upgrade Toolforge Kubernetes to version 1.24
 ResolvedNoneT360699 Toolsbeta: migrate to Debian Bullseye or later
 ResolvedtaaviT311897 [infra] Toolforge: migrate to Debian Bullseye or later
 ResolvedtaaviT314665 Toolforge: Replace all bastion with grid-less bookworm based bastion hosts
 ResolveddschwenT319953 Migrate panoviewer from Toolforge GridEngine to Toolforge Kubernetes
 OpenNoneT321919 Figure out and document how to call the Kubernetes API as your tool user from inside a pod
 StalleddcaroT356377 [toolforge] simplify calling the different toolforge apis from within the containers
 StalledFeatureNoneT309308 [jobs-cli,toolforge-cli] Add tfj as a shortcut for toolforge-jobs command
 StalledNoneT356262 [jobs-cli,builds-cli,toolforge-cli,webservice] Consolidate the Toolforge CLIs
 OpenNoneT356261 [toolforge-cli,jobs-cli,builds-cli,envvars-cli] Explore OpenAPI SDK tooling for client consolidation
 OpenNoneT398651 [toolforge-cli-gen] review the https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-gen-cli client as potential consolidation
 ResolvedSlst2020T354745 [jobs-api,buildservice-api,envvars-api] Investigate ways to present our multiple Openapi definitions to a future consolidated CLI client
 ResolvedSlst2020T358100 [toolforge API] expose all backend APIs OpenAPI specs
 Resolved• aborreroT356523 [jobs-api] introduce OpenAPI to jobs framework
 ResolvedSlst2020T362299 [api-gateway] Add a python server to serve consolidated openapi docs

Event Timeline

Slst2020 created this task.Jan 31 2024, 10:48 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJan 31 2024, 10:48 AM
Slst2020 added subtasks: T356261: [toolforge-cli,jobs-cli,builds-cli,envvars-cli] Explore OpenAPI SDK tooling for client consolidation, T354745: [jobs-api,buildservice-api,envvars-api] Investigate ways to present our multiple Openapi definitions to a future consolidated CLI client.Jan 31 2024, 10:49 AM
dcaro edited projects, added Toolforge (Toolforge iteration 05); removed Toolforge (Toolforge iteration 04).Feb 6 2024, 5:42 PM
dcaro triaged this task as High priority.Feb 7 2024, 10:10 AM
dcaro added a parent task: T356377: [toolforge] simplify calling the different toolforge apis from within the containers.Feb 19 2024, 4:13 PM
dcaro edited projects, added Toolforge (Toolforge iteration 06); removed Toolforge (Toolforge iteration 05).Feb 21 2024, 10:11 AM
dcaro added a parent task: T309308: [jobs-cli,toolforge-cli] Add tfj as a shortcut for toolforge-jobs command.Mar 5 2024, 1:50 PM
dcaro renamed this task from Consolidate the Toolforge CLIs to [jobs-cli,builds-cli,toolforge-cli,webservice] Consolidate the Toolforge CLIs.Mar 5 2024, 3:57 PM
dcaro edited projects, added Toolforge (Toolforge iteration 07); removed Toolforge (Toolforge iteration 06).Mar 5 2024, 5:13 PM
Slst2020 changed the status of subtask T356261: [toolforge-cli,jobs-cli,builds-cli,envvars-cli] Explore OpenAPI SDK tooling for client consolidation from Open to In Progress.Mar 8 2024, 1:15 PM
dcaro mentioned this in T327280: [jobs-cli,jobs-api] make API and CLI key/values coherent.Mar 11 2024, 2:29 PM
dcaro edited projects, added Toolforge (Toolforge iteration 08); removed Toolforge (Toolforge iteration 07).Apr 3 2024, 4:16 PM
dcaro mentioned this in T362082: [components-api] Add minimal cli with build-only features.Apr 8 2024, 1:57 PM
dcaro edited projects, added Toolforge (Toolforge iteration 09); removed Toolforge (Toolforge iteration 08).Apr 17 2024, 7:49 AM
dcaro changed the task status from Open to Stalled.Apr 30 2024, 1:30 PM
dcaro moved this task from Next Up to Blocked/Paused on the Toolforge (Toolforge iteration 09) board.
Slst2020 closed subtask T354745: [jobs-api,buildservice-api,envvars-api] Investigate ways to present our multiple Openapi definitions to a future consolidated CLI client as Resolved.May 15 2024, 11:38 AM
dcaro moved this task from Blocked/Paused to Next Up on the Toolforge (Toolforge iteration 09) board.May 22 2024, 12:52 PM
dcaro edited projects, added Toolforge (Toolforge iteration 10); removed Toolforge (Toolforge iteration 09).May 22 2024, 4:41 PM
dcaro edited projects, added Toolforge (Toolforge iteration 11); removed Toolforge (Toolforge iteration 10).Jun 4 2024, 2:57 PM
dcaro assigned this task to Slst2020.Jul 2 2024, 1:33 PM
dcaro edited projects, added Toolforge (Toolforge iteration 12); removed Toolforge (Toolforge iteration 11).Jul 2 2024, 1:59 PM
dcaro edited projects, added Toolforge (Toolforge iteration 13); removed Toolforge (Toolforge iteration 12).Jul 17 2024, 11:23 AM
dcaro edited projects, added Toolforge (Toolforge iteration 14); removed Toolforge (Toolforge iteration 13).Aug 5 2024, 7:40 AM
dcaro moved this task from Toolforge iteration 14 to Ready to be worked on on the Toolforge board.Sep 25 2024, 8:00 AM
dcaro edited projects, added Toolforge; removed Toolforge (Toolforge iteration 14).
Slst2020 removed Slst2020 as the assignee of this task.Jan 14 2025, 10:00 AM
Restricted Application added a project: cloud-services-team. · View Herald TranscriptJan 14 2025, 10:00 AM
Addshore subscribed.Jan 16 2025, 1:56 PM
Addshore added a comment.Apr 8 2025, 3:44 PM

Generally speaking, https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-gen-cli is a consolidation of CLIs, currently build, envvars and jobs, (pending webservice and components api rewrites).

This was based on the decision at https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Decision_record_T348749_Toolforge_CLI_consolidation
However after checking in with the team a few months back, the decision switched to having Go as a primary language for a CLI, rather than python (likely due to growing usage in other toolforge things)

Aklapper changed the status of subtask T356261: [toolforge-cli,jobs-cli,builds-cli,envvars-cli] Explore OpenAPI SDK tooling for client consolidation from In Progress to Open.Apr 11 2025, 10:20 PM
dcaro mentioned this in T336052: toolforge-cli: Allow configuring description for external subcommands.Apr 16 2025, 2:34 PM
dcaro mentioned this in T398485: [components-api,beta] CI pipelines should wait until Toolforge deployment is 100% successful.Jul 3 2025, 1:03 PM
fnegri moved this task from Inbox to Epics on the cloud-services-team board.Sep 5 2025, 8:41 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits