Page MenuHomePhabricator
Create Task
Maniphest T363415

upgrade deployment servers to bullseye / add bullseye support to puppet role
Open, In Progress, Needs TriagePublic
Actions

Description

The puppet role deployment_server should have support for bullseye, for usage at least in cloud VPS projects and also generally to get rid of deployment hosts on buster in testing and production.

Currently when trying it on a bullseye VM the issues include:

  • E: Unable to locate package python-redis
  • E: Unable to locate package python-gitdb
  • E: Package 'python-git' has no installation candidate

My subteam would like this for cloud VPS devtools project to resolve T360964 but I assume the production deployment servers should also be upgraded. And they are also still on buster so we couldn't copy production.

I am currently unsure if this ticket should only be about adding support to the puppet role or if it should also include actual upgrade of the production machines using it. serviceops, any opinion?

Details

SubjectRepoBranchLines +/-
cloud/devtools: replace deploy-1004 with deploy-1006operations/puppetproduction+6 -6
devtools: remove gervert from deployed repos in cloud VPSoperations/puppetproduction+0 -2
mediawiki/geoip: make loading geoip data from puppetserver optionaloperations/puppetproduction+8 -3
deployment_server: stop including redis::client::pythonoperations/puppetproduction+0 -1
deployment_server: stop installing python-gitdb, python-gitoperations/puppetproduction+0 -5
redis: use python3-redis to support bullseyeoperations/puppetproduction+5 -1
Customize query in gerrit

Related Objects
Search...

Event Timeline

Dzahn created this task.Wed, Apr 24, 9:03 PM
Dzahn added a parent task: T360964: replace buster machines in devtools project.
gerritbot added a comment.Wed, Apr 24, 9:21 PM

Change #1023954 had a related patch set uploaded (by Dzahn; author: Dzahn):

[operations/puppet@production] redis: use python3-redis to support bullseye

https://gerrit.wikimedia.org/r/1023954

gerritbot added a project: Patch-For-Review.Wed, Apr 24, 9:21 PM
gerritbot added a comment.Wed, Apr 24, 9:30 PM

Change #1023955 had a related patch set uploaded (by Dzahn; author: Dzahn):

[operations/puppet@production] deployment_server: add bullseye support, python3 package names

https://gerrit.wikimedia.org/r/1023955

gerritbot added a comment.Thu, Apr 25, 4:12 PM

Change #1023954 merged by Dzahn:

[operations/puppet@production] redis: use python3-redis to support bullseye

https://gerrit.wikimedia.org/r/1023954

gerritbot added a comment.Thu, Apr 25, 4:42 PM

Change #1024447 had a related patch set uploaded (by Dzahn; author: Dzahn):

[operations/puppet@production] deployment_server: stop including redis::client::python

https://gerrit.wikimedia.org/r/1024447

Dzahn changed the task status from Open to In Progress.Fri, Apr 26, 10:52 PM
Dzahn claimed this task.
andrea.denisse unsubscribed.Fri, Apr 26, 11:32 PM
gerritbot added a comment.Tue, Apr 30, 5:16 PM

Change #1023955 merged by Dzahn:

[operations/puppet@production] deployment_server: stop installing python-gitdb, python-git

https://gerrit.wikimedia.org/r/1023955

gerritbot added a comment.Tue, Apr 30, 6:21 PM

Change #1024447 merged by Dzahn:

[operations/puppet@production] deployment_server: stop including redis::client::python

https://gerrit.wikimedia.org/r/1024447

Maintenance_bot removed a project: Patch-For-Review.Tue, Apr 30, 6:30 PM
Dzahn added a comment.EditedWed, May 1, 10:27 PM

A list of errors that show up with a fresh deployment server on bullseye so far:

error: E: Unable to locate package python-redis
fix: stop including redis::client::python ✅

error: E: Unable to locate package python-gitdb
fix: stop installing python-gitdb, python-git ✅

error: E: Package 'python-git' has no installation candidate
fix: stop installing python-gitdb, python-git ✅

error: Scap::Source[releng/jenkins-deploy] - /usr/bin/scap deploy --init' returned 1 -
fix: manual: cd /srv/deployment/releng/jenkins-deploy/ ; scap deploy --init -Dblock_deployments:False

error: Scap::Source[integration/docroot] - /usr/bin/scap deploy --init' returned 1 -
fix: manual: cd /srv/deployment/integration/docroot/ ; scap deploy --init -Dblock_deployments:False

error: Scap::Source[phabricator/deployment] - /usr/bin/scap deploy --init' returned 1 -
fix: manual: cd /srv/deployment/phabricator/deployment ; scap deploy --init -Dblock_deployments:False

error: Scap_source[gervert/deploy] - /usr/bin/scap deploy --init' returned 1 -
error: RuntimeError: Did not find a file named gerrit in search path: ['/srv/deployment/gervert/deploy/scap', '/etc/dsh/group'] ✗

fix: cd /etc/dsh/group ; sudo touch gerrit (?)
error: 22:22:21 No targets selected, check limits and dsh_targets ✗
fix: ? ✗

error: systemd[1]: Starting "Mw-cgroup"... /sys/fs/cgroup/memory/release_agent: Permission denied.. Failed to start "Mw-cgroup".
fix: reboot the VM to apply grub config change -> T363957 ✅

error: Geoip::Data::Puppet/File[/usr/share/GeoIP]: Failed to generate additional resources using 'eval_generate': Error 500 on SERVER: Server Error: Not authorized to call search on /file_metadata/volatile/GeoIP
fix: ? ✗

Dzahn mentioned this in T325228: Migrate Dumps Snapshot hosts from Buster to Bullseye.Wed, May 1, 10:41 PM
Dzahn closed subtask T363957: deployment_server bullseye - mw-cgroup.service: Failed as Resolved.Wed, May 1, 10:51 PM
gerritbot added a comment.Wed, May 1, 11:44 PM

Change #1026193 had a related patch set uploaded (by Dzahn; author: Dzahn):

[operations/puppet@production] mediawiki/geoip: make it optional to load geoip data from puppetserver

https://gerrit.wikimedia.org/r/1026193

gerritbot added a project: Patch-For-Review.Wed, May 1, 11:44 PM
Dzahn mentioned this in T257317: scap deploy --init on deployment server fails on first puppet run.Wed, May 1, 11:51 PM
Dzahn added a subtask: T257317: scap deploy --init on deployment server fails on first puppet run.
Dzahn added a subscriber: hashar.Thu, May 2, 12:21 AM

The gervert issue (can't find gerrit dsh group) appears to come from https://gerrit.wikimedia.org/r/c/operations/software/gerrit/tools/gervert/deploy/+/978528/1/scap/scap.cfg @hashar

gerritbot added a comment.Thu, May 2, 12:27 AM

Change #1026198 had a related patch set uploaded (by Dzahn; author: Dzahn):

[operations/puppet@production] devtools: remove gervert from deployed repos in cloud VPS

https://gerrit.wikimedia.org/r/1026198

gerritbot added a comment.Thu, May 2, 5:01 PM

Change #1026198 merged by Dzahn:

[operations/puppet@production] devtools: remove gervert from deployed repos in cloud VPS

https://gerrit.wikimedia.org/r/1026198

gerritbot added a comment.Thu, May 2, 10:46 PM

Change #1026698 had a related patch set uploaded (by Dzahn; author: Dzahn):

[operations/puppet@production] cloud/devtools: replace deploy-1004 with deploy-1006

https://gerrit.wikimedia.org/r/1026698

gerritbot added a comment.Thu, May 2, 10:59 PM

Change #1026698 merged by Dzahn:

[operations/puppet@production] cloud/devtools: replace deploy-1004 with deploy-1006

https://gerrit.wikimedia.org/r/1026698

Stashbot mentioned this in T360964: replace buster machines in devtools project.Thu, May 2, 11:10 PM

Mentioned in SAL (#wikimedia-cloud) [2024-05-02T23:10:29Z] <mutante> replacing deploy-1004 (buster) with deploy-1006 (bullseye) as new deployment server in both repo and Horizon hiera T360964 T363415

Stashbot mentioned this in T360470: Update devtools project puppetmaster.Thu, May 2, 11:52 PM

Mentioned in SAL (#wikimedia-cloud) [2024-05-02T23:52:24Z] <mutante> switching puppetmaster for deploy-1006 back to local project puppetmaster; rm -rf /var/lib/puppet/ssl that still referred to puppetmaster-1001, signing new request on puppetmaster-1003 T360470 T363415

Dzahn edited projects, added collaboration-services; removed Patch-For-Review.Fri, May 3, 7:04 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL