Page MenuHomePhabricator
Create Task
Maniphest T95545

Migrate all debian-glue jobs to Jessie slaves
Closed, ResolvedPublic
Actions

Description

The Jenkins debian-glue jobs are used to magically create Debian packages out of Gerrit a patchset thanks to the jenkins-debian-glue scripts. They magically create cow images for the targetted distribution but are missing the apt.wikimedia.org configuration.

@akosiaris provided a puppet class ( https://gerrit.wikimedia.org/r/#/c/194471/ ) which creates cow images for all distributions we care about. That let us switch easily between them by simply setting the DIST env variable. Thus, we can have all debian-glue jobs to be solely on Jessie instances.

The new puppet role is role::package::builder. It is to be applied on Jessie CI slaves, we have to make sure the extended disk space is mounted under /mnt and pbuilder default dir pointed to it.

Details

ProjectBranchLines +/-Subject
operations/puppetproduction+60 -44contint: move package_builder setup to its own class
integration/configmaster+1 -1Migrate all debian-glue jobs to Jessie slaves
operations/puppetproduction+12 -0contint: make Jessie slaves package builders
Customize query in gerrit

Related Objects
Search...

StatusSubtypeAssignedTask
 ResolvedhasharT95545 Migrate all debian-glue jobs to Jessie slaves
 ResolvedhasharT94836 Create CI slaves using Debian Jessie
 DuplicateNoneT94840 Jessie puppet self instance has puppet erroring out ( Could not find dependency File[/etc/ldap/ldap.conf] )
 ResolvedAndrewT94834 role::puppet::self broken on new labs instances
 ResolvedhasharT94999 Jessie has no install candidate for openjdk-6-jdk
 ResolvedhasharT95000 Update puppet for packages having different names in Jessie
 ResolvedhasharT95003 Use systemd for xvfb service on Debian/Jessie
 ResolvedfaidonT95002 Provide Jessie package to fullfil Mediawiki::Packages requirement
 ResolvedDzahnT102623 Mediawiki font packages: switch to Jessie
 ResolvedfgiunchediT103328 Investigate Ubuntu fork of ttf-indic-fonts and bring it in Jessie
 ResolvedMoritzMuehlenhoffT103325 Investigate usage of ttf-ubuntu-font-family which is not available on Jessie
 ResolvedfaidonT103315 Jessie does not have libmemcached10
 ResolvedfaidonT103322 Jessie does not have libvips15
 ResolvedAndrewT95006 Upload jenkins-debian-glue for Jessie on apt.wikimedia.org
 DeclinedhasharT95008 Build Debian package ruby-jsduck for Jessie
 ResolvedAndrewT102108 New jessie instance can't attach to puppet due to wrong certname
 ResolvedAndrewT102193 Add exception-handling to puppet signer
 ResolvedcorenT75592 Debian Jessie image for Labs
 ResolvedcorenT87309 No init script for idmapd on labs jessie instances
 ResolvedhasharT103600 On Jessie CI slaves, install ruby2.1 instead of ruby1.9.3
 ResolvedhasharT103976 Install etcd on Jessie CI slaves
 ResolvedMoritzMuehlenhoffT102106 Update jenkins-debian-glue packages on Jessie to v0.13.0
 ResolvedhasharT134881 Migrate Differential job beta-build-deb to Jessie permanent slaves

Event Timeline

hashar created this task.Apr 9 2015, 2:20 PM
hashar raised the priority of this task from to Needs Triage.
hashar updated the task description. (Show Details)
hashar added a project: Continuous-Integration-Infrastructure.
hashar added subscribers: hashar, akosiaris.
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptApr 9 2015, 2:20 PM
hashar added a subtask: T95006: Upload jenkins-debian-glue for Jessie on apt.wikimedia.org.Apr 9 2015, 2:21 PM
hashar added a subtask: T94836: Create CI slaves using Debian Jessie.
gerritbot added a subscriber: gerritbot.Apr 9 2015, 2:21 PM

Change 203073 had a related patch set uploaded (by Hashar):
contint: make Jessie slaves package builders

https://gerrit.wikimedia.org/r/203073

gerritbot added a project: Patch-For-Review.Apr 9 2015, 2:21 PM
Andrew closed subtask T95006: Upload jenkins-debian-glue for Jessie on apt.wikimedia.org as Resolved.Apr 10 2015, 4:09 PM
hashar added a comment.Apr 10 2015, 5:02 PM

I have applied labels DebianJessie and DebianGlue on the sole Jessie CI slave we have for now. Will let us tie the debian-glue jobs to Jessie.

Krinkle triaged this task as Medium priority.Apr 14 2015, 1:39 AM
Krinkle moved this task from Untriaged to Backlog on the Continuous-Integration-Infrastructure board.
Krinkle set Security to None.
gerritbot added a comment.Apr 28 2015, 2:55 PM

Change 203073 merged by Alexandros Kosiaris:
contint: make Jessie slaves package builders

https://gerrit.wikimedia.org/r/203073

hashar mentioned this in rOPUP9a74cfc868f0: contint: make Jessie slaves package builders.Apr 28 2015, 2:56 PM
hashar added a subtask: T102106: Update jenkins-debian-glue packages on Jessie to v0.13.0.Jun 11 2015, 9:13 AM

Having jenkins-debian-glue to v0.13.0 would be ideal T102106

hashar closed subtask T102106: Update jenkins-debian-glue packages on Jessie to v0.13.0 as Resolved.Jul 23 2015, 3:52 PM
hashar changed the status of subtask T94836: Create CI slaves using Debian Jessie from Open to Stalled.Oct 6 2015, 12:37 PM
hashar lowered the priority of this task from Medium to Low.Oct 28 2015, 1:56 PM
hashar closed subtask T94836: Create CI slaves using Debian Jessie as Resolved.May 9 2016, 3:21 PM
Stashbot added a subscriber: Stashbot.May 9 2016, 3:26 PM

Mentioned in SAL [2016-05-09T15:26:28Z] <hashar> Creating integration-slave-jessie-1001 T95545

gerritbot added a comment.May 9 2016, 3:55 PM

Change 286873 had a related patch set uploaded (by Hashar):
contint: move package_builder setup to its own class

https://gerrit.wikimedia.org/r/286873

hashar claimed this task.May 9 2016, 3:56 PM
hashar moved this task from Backlog to In-progress on the Continuous-Integration-Infrastructure board.
hashar added a comment.May 9 2016, 9:12 PM

The Jessie permanent slaves integration-slave-jessie-1001 and integration-slave-jessie-1002 are passing puppet and have the same role::ci::labs::slave puppet class as the other instances. So we can start migrating ;-)

gerritbot added a comment.May 9 2016, 9:13 PM

Change 287649 had a related patch set uploaded (by Hashar):
Migrate all debian-glue jobs to Jessie slaves

https://gerrit.wikimedia.org/r/287649

Stashbot added a comment.May 10 2016, 1:33 PM

Mentioned in SAL [2016-05-10T13:33:26Z] <hashar> Migrating all debian glue jobs to Jessie permanent slaves T95545

hashar closed this task as Resolved.May 10 2016, 1:37 PM
gerritbot added a comment.May 10 2016, 1:39 PM

Change 287649 merged by jenkins-bot:
Migrate all debian-glue jobs to Jessie slaves

https://gerrit.wikimedia.org/r/287649

hashar mentioned this in T134881: Migrate Differential job beta-build-deb to Jessie permanent slaves.May 10 2016, 1:44 PM
hashar created subtask T134881: Migrate Differential job beta-build-deb to Jessie permanent slaves.
hashar closed subtask T134881: Migrate Differential job beta-build-deb to Jessie permanent slaves as Resolved.May 10 2016, 2:27 PM
gerritbot added a comment.May 11 2016, 1:13 PM

Change 286873 merged by Faidon Liambotis:
contint: move package_builder setup to its own class

https://gerrit.wikimedia.org/r/286873

hashar mentioned this in rOPUP43026d792ad9: contint: move package_builder setup to its own class.May 11 2016, 1:17 PM
hashar mentioned this in rOPUP46fc6fe40841: contint: move package_builder setup to its own class.Jun 17 2016, 6:09 PM
hashar mentioned this in rOPUP5dad188c7a97: contint: move package_builder setup to its own class.
Content licensed under Creative Commons Attribution-ShareAlike 4.0 (CC-BY-SA) unless otherwise noted; code licensed under GNU General Public License (GPL) or other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL