Page MenuHomePhabricator
Create Task
Maniphest T316228

[tbs.cli] Define the process to build and deploy the CLI on toolforge bastions
Closed, ResolvedPublic
Actions

Description

We want to define and document the process for manual deployment, not automate it (unless it's very easy).

The current docs on how to build the debian package are:
https://gerrit.wikimedia.org/r/plugins/gitiles/cloud/toolforge/toolforge-cli/+/refs/heads/main

The only docs I've found are:
https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Services#apt_repository

Though it does not say how to add a package, the standard way I think is:

  • ssh to the tools-services* VM
  • sudo -i
  • aptly repo add <repo_name> <path_to_package>
  • aptly publish --skip-signing update <repo_name>

Where the repo_name is one of:

  • stretch-tools
  • buster-tools
  • stretch-toolsbeta
  • buster-toolsbeta

This task is to verify the flow, and document it in the README file or similar.

Details

ProjectBranchLines +/-Subject
cloud/toolforge/toolforge-climain+5 -0docs: added how to upload the package
cloud/toolforge/toolforge-climain+62 -1package: Added script to build a debian package locally
Customize query in gerrit

Related Objects
Search...

Event Timeline

dcaro triaged this task as High priority.Aug 25 2022, 2:47 PM
dcaro created this task.
dcaro added a project: Toolforge Build Service.
dcaro added a parent task: T194332: [Epic] Make Toolforge a proper platform as a service with push-to-deploy and build packs.
• taavi added a subscriber: • taavi.Aug 25 2022, 2:49 PM

This is already automated, although not as a cookbook. See the wmcs-package-build.py script stored in the Puppet repository.

dcaro added a comment.Aug 25 2022, 2:55 PM
In T316228#8185492, @taavi wrote:

This is already automated, although not as a cookbook. See the wmcs-package-build.py script stored in the Puppet repository.

True!
I remember that the last time I tried that script (>1year ago) it failed, I vaguely remember several issues, something about trying to build the package remotely, signing and such, I don't remember the details but I had to do it manually instead for some reason.

We might want to fix/verify and move that as a cookbook at some point :)
A bit off-scope for this task though.

dcaro edited parent tasks, added: T267374: [tbs.beta] Create a toolforge build service beta release; removed: T194332: [Epic] Make Toolforge a proper platform as a service with push-to-deploy and build packs.Aug 26 2022, 9:15 AM
dcaro claimed this task.Aug 31 2022, 8:55 AM
dcaro changed the task status from Open to In Progress.Aug 31 2022, 8:55 AM
dcaro moved this task from To refine to Doing on the User-dcaro board.
dcaro moved this task from Backlog to To be Discussed on the Toolforge Build Service board.Aug 31 2022, 8:55 AM
gerritbot added a comment.Aug 31 2022, 10:14 AM

Change 828489 had a related patch set uploaded (by David Caro; author: David Caro):

[cloud/toolforge/toolforge-cli@main] package: Added script to build a debian package locally

https://gerrit.wikimedia.org/r/828489

gerritbot added a project: Patch-For-Review.Aug 31 2022, 10:14 AM
dcaro edited projects, added Toolforge Build Service (Iteration 00); removed Toolforge Build Service.Sep 1 2022, 7:31 AM
dcaro moved this task from Next Up to In Progress on the Toolforge Build Service (Iteration 00) board.
dcaro moved this task from In Progress to In Review on the Toolforge Build Service (Iteration 00) board.
gerritbot added a comment.Sep 5 2022, 4:50 PM

Change 828489 merged by jenkins-bot:

[cloud/toolforge/toolforge-cli@main] package: Added script to build a debian package locally

https://gerrit.wikimedia.org/r/828489

dcaro mentioned this in rCTTC274c5f175d1d: package: Added script to build a debian package locally.Sep 5 2022, 5:03 PM
gerritbot added a comment.Sep 7 2022, 2:52 PM

Change 830648 had a related patch set uploaded (by David Caro; author: David Caro):

[cloud/toolforge/toolforge-cli@main] docs: added how to upload the package

https://gerrit.wikimedia.org/r/830648

dcaro changed the task status from In Progress to Stalled.Sep 9 2022, 1:31 PM
dcaro moved this task from Doing to Blocked on the User-dcaro board.
dcaro moved this task from Iteration 00 to Iteration 01 on the Toolforge Build Service board.Sep 27 2022, 8:24 AM
dcaro edited projects, added Toolforge Build Service (Iteration 01); removed Toolforge Build Service (Iteration 00).
KHernandez-WMF moved this task from Next Up to In Review on the Toolforge Build Service (Iteration 01) board.Sep 27 2022, 12:38 PM
• bd808 moved this task from Inbox to Doing on the cloud-services-team (Kanban) board.Sep 27 2022, 9:24 PM
gerritbot added a comment.Oct 3 2022, 1:03 PM

Change 830648 merged by jenkins-bot:

[cloud/toolforge/toolforge-cli@main] docs: added how to upload the package

https://gerrit.wikimedia.org/r/830648

dcaro mentioned this in rCTTC55ed6060d6d3: docs: added how to upload the package.Oct 3 2022, 1:27 PM
Raymond_Ndibe moved this task from In Review to Done on the Toolforge Build Service (Iteration 01) board.Oct 3 2022, 9:29 PM
dcaro closed this task as Resolved.Oct 4 2022, 9:18 AM
dcaro moved this task from Blocked to Done on the User-dcaro board.
Content licensed under Creative Commons Attribution-ShareAlike 3.0 (CC-BY-SA) unless otherwise noted; code licensed under GNU General Public License (GPL) or other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL