hashar (Antoine "hashar" Musso (WMF))
WMF Software developer - Release Engineering

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Thursday

  • Clear sailing ahead.

User Details

User Since
Oct 3 2014, 2:31 PM (155 w, 4 d)
Availability
Available
IRC Nick
hashar
LDAP User
Hashar
MediaWiki User
Unknown

https://www.mediawiki.org/wiki/User:Hashar

Based in Nantes, France CET/CEST (UTC+1, UTC+2)

Main IRC channel is #wikimedia-releng

antoine-approve

Recent Activity

Today

hashar closed T175864: CI: operations-dns-lint broken due to missing Maxmind DB file as Resolved.

Apparently that was transient or puppet was not willing to cooperate. Faidon / Alexandros verified my proposed patch and none of us could reproduce the issue. It is all fine now.

Tue, Sep 26, 1:06 PM · Release-Engineering-Team (Kanban), Patch-For-Review, Operations, DNS, Continuous-Integration-Infrastructure, Traffic
hashar closed T173999: CI job debian-glue-non-voting: add support for BACKPORTS=yes as Resolved.

So BACKPORTS was shallowed by sudo. I have adjusted the sudo policy in Horizon to env_keep =BACKPORTS. As a result the D02backports hook manage to inject the backports repository and runs apt-get update as expected.

Tue, Sep 26, 9:29 AM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Config
hashar reopened T173999: CI job debian-glue-non-voting: add support for BACKPORTS=yes as "Open".

I am not sure what is going on since the hook on the machine looks like:

Tue, Sep 26, 8:36 AM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Config
hashar added a comment to T175002: db1009 (m5, used primarily for cloud services) unresponsive for minutes.

I'm wondering if this is related:

https://phabricator.wikimedia.org/T170492#3579682

I think @hashar issues a command that tried to purge all nodepool managed instances simultaneously as noted in https://phabricator.wikimedia.org/T170492#3579592 and at least rabbitmq choked but possibly nova being under seige was the root cause of that

ping @Andrew

Tue, Sep 26, 8:02 AM · Patch-For-Review, DBA, cloud-services-team

Yesterday

hashar archived Continuous-Integration-Infrastructure (phase-out-trusty).
Mon, Sep 25, 4:45 PM
hashar closed T175696: Remove trusty from Nodepool, WMCS, and clean out puppet as Resolved.
Mon, Sep 25, 4:45 PM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure (phase-out-trusty)
hashar closed T174972: Package php modules for Zend 5.5 on Jessie, a subtask of T161882: Migrate PHP5.5 jobs from Trusty to Jessie, as Resolved.
Mon, Sep 25, 7:48 AM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure (phase-out-trusty)
hashar closed T174972: Package php modules for Zend 5.5 on Jessie as Resolved.

\O/

Mon, Sep 25, 7:48 AM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure (phase-out-trusty)

Sat, Sep 23

hashar added a comment to T135187: Make a table of access levels per service RelEng maintains per person.

@greg from a previous comment:

Sat, Sep 23, 8:02 AM · Release-Engineering-Team (Backlog), User-greg

Fri, Sep 22

hashar closed T171441: Create Phabricator project for mediawiki/extensions/Wigo3 as Declined.
Fri, Sep 22, 10:01 PM · Project-Admins
hashar added a comment to T176518: Requesting access to stat1005 for Slaporte.

Note the public key is used on labs and IIRC access to production requires a different ssh key.

Fri, Sep 22, 9:14 PM · Patch-For-Review, Operations, Ops-Access-Requests
hashar added a comment to T174972: Package php modules for Zend 5.5 on Jessie.

The instances provision fine using apt.wikimedia.org. The last two patches would let us resolve this task once for good.

Fri, Sep 22, 9:02 PM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure (phase-out-trusty)
hashar added a comment to T176514: Find inactive gerrit repos.

The community metrics are provided with the help of Bitergia ( https://bitergia.com/ ).

Fri, Sep 22, 7:39 PM · Analytics-Tech-community-metrics, Cleanup
hashar added a comment to T176314: Replace salt on integration and deployment-prep projects.

I have filled this task for what it is: replace salt on integration and beta. There is no evilness intended!

Fri, Sep 22, 5:29 PM · Patch-For-Review, Continuous-Integration-Infrastructure, Beta-Cluster-Infrastructure, Technical-Debt, Operations-Software-Development
hashar triaged T176267: Upgrade docker on integration-slave-docker-* as Normal priority.
Fri, Sep 22, 9:29 AM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure
hashar moved T176267: Upgrade docker on integration-slave-docker-* from Blocked (externally) to Done (within RelEng) on the Release-Engineering-Team (Kanban) board.
Fri, Sep 22, 9:29 AM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure
hashar moved T176267: Upgrade docker on integration-slave-docker-* from In-progress to Blocked (externally) on the Release-Engineering-Team (Kanban) board.
Fri, Sep 22, 9:29 AM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure
hashar claimed T176267: Upgrade docker on integration-slave-docker-*.
Fri, Sep 22, 9:29 AM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure
hashar moved T176267: Upgrade docker on integration-slave-docker-* from Backlog to In-progress on the Release-Engineering-Team (Kanban) board.
Fri, Sep 22, 9:29 AM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure

Thu, Sep 21

hashar added a comment to T174972: Package php modules for Zend 5.5 on Jessie.

Update: php-defaults / php-redis got build with php5.5 and uploaded to component/ci. Luasandbox is next.

Thu, Sep 21, 4:13 PM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure (phase-out-trusty)
hashar added a comment to T176267: Upgrade docker on integration-slave-docker-*.

So the slaves have docker-engine

$ apt-cache policy docker-engine
docker-engine:
  Installed: 1.12.6-0~debian-jessie
  Candidate: 1.12.6-0~debian-jessie
  Version table:
 *** 1.12.6-0~debian-jessie 0
       1001 http://apt.wikimedia.org/wikimedia/ jessie-wikimedia/thirdparty amd64 Packages
        100 /var/lib/dpkg/status
Thu, Sep 21, 3:00 PM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure
hashar added a comment to T175293: Provision Docker >= 17.05 on contint1001.
contint1001:~$ apt-cache policy docker-ce
docker-ce:
  Installed: 17.06.2~ce-0~debian
  Candidate: 17.06.2~ce-0~debian
  Version table:
 *** 17.06.2~ce-0~debian 0
       1001 http://apt.wikimedia.org/wikimedia/ jessie-wikimedia/thirdparty/ci amd64 Packages
        100 /var/lib/dpkg/status
contint1001:~$ docker --version
Docker version 17.06.2-ce, build cec0b72
Thu, Sep 21, 2:32 PM · Patch-For-Review, Operations, Release-Engineering-Team (Kanban), Release Pipeline
hashar closed T176394: Determine rough plan to migrate out of Nodepool as Resolved.

Was merely to copy paste from an etherpad.

Thu, Sep 21, 9:04 AM · Release-Engineering-Team, Continuous-Integration-Infrastructure
hashar created T176394: Determine rough plan to migrate out of Nodepool.
Thu, Sep 21, 9:04 AM · Release-Engineering-Team, Continuous-Integration-Infrastructure

Wed, Sep 20

hashar added a comment to T175712: Install cumin in the WMCS infrastructure.

As a side effect, Beta-Cluster-Infrastructure and Continuous-Integration-Infrastructure would need a way to have a per project cumin master. We don't have access to the WMCS salt master.

The instances are:

deployment-salt02.deployment-prep.eqiad.wmflabs
integration-saltmaster.integration.eqiad.wmflabs

@hashar I think this is unrelated with this task. My understanding is that those two WMCS projects have their own salt master internal to the project that they self-administer. Nothing forbid to keep it that way, and replacing the global WMCS salt master with cumin doesn't affect those in any way AFAIK.
I agree that it would be nice to have a simple way to install a cumin master inside a labs project, I can look into it once the goal-related work will be completed.
Feel free to open a dedicated task for it.

Wed, Sep 20, 1:17 PM · Cloud-VPS, Operations-Software-Development
hashar created T176314: Replace salt on integration and deployment-prep projects.
Wed, Sep 20, 1:16 PM · Patch-For-Review, Continuous-Integration-Infrastructure, Beta-Cluster-Infrastructure, Technical-Debt, Operations-Software-Development
hashar added a comment to T175712: Install cumin in the WMCS infrastructure.

As a side effect, Beta-Cluster-Infrastructure and Continuous-Integration-Infrastructure would need a way to have a per project cumin master. We don't have access to the WMCS salt master.

The instances are:

deployment-salt02.deployment-prep.eqiad.wmflabs
integration-saltmaster.integration.eqiad.wmflabs

what does integration (CI) use salt for?

Wed, Sep 20, 9:29 AM · Cloud-VPS, Operations-Software-Development

Tue, Sep 19

hashar added a parent task for T175293: Provision Docker >= 17.05 on contint1001: T176267: Upgrade docker on integration-slave-docker-*.
Tue, Sep 19, 9:07 PM · Patch-For-Review, Operations, Release-Engineering-Team (Kanban), Release Pipeline
hashar added a subtask for T176267: Upgrade docker on integration-slave-docker-*: T175293: Provision Docker >= 17.05 on contint1001.
Tue, Sep 19, 9:07 PM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure
hashar created T176267: Upgrade docker on integration-slave-docker-*.
Tue, Sep 19, 9:07 PM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure

Mon, Sep 18

hashar added a comment to T175950: Fix the project namespace at be.wiktionary.org.

After running namespaceDupes:

id=2276 ns=0 dbk=Вікіслоўнік:Партал_супольнасці *** dest title exists and --add-prefix not specified
id=1671 ns=0 dbk=Вікіслоўнік:Стварэнне_артыкулаў *** dest title exists and --add-prefix not specified
id=3973 ns=0 dbk=Вікіслоўнік:Шаблон *** dest title exists and --add-prefix not specified
3 pages to fix, 0 were resolvable.
Mon, Sep 18, 1:25 PM · Wikimedia-maintenance-script-run, User-MarcoAurelio, Wikimedia-Site-requests
hashar added a comment to T127292: [Task] Move DataTypes repository from Github to gerrit.

On behalf of @Ladsgroup , I have created https://gerrit.wikimedia.org/r/#/admin/projects/mediawiki/extensions/DataTypes owned by group wikidata.

Mon, Sep 18, 10:31 AM · Patch-For-Review, User-Ladsgroup, Wikidata-Sprint-2016-04-12, Wikidata-Sprint-2016-03-01, Gerrit, Wikidata
hashar reopened T167845: Migrate zuul-server behind systemd service as "Open".

contint-admins can not interact with the zuul service anymore since that now requires sudo/root.

Mon, Sep 18, 8:45 AM · Release-Engineering-Team (Watching / External), Patch-For-Review, Zuul, Continuous-Integration-Infrastructure, Operations

Sat, Sep 16

hashar added a comment to T175920: Improve unit testing for CheckUser.

CI does:

  • clone mediawiki
  • maintenance/install.php
  • tweak LocalSettings.php to enable extensions
  • maintenance/update.php (which creates the extension database tables)
  • run phpunit
Sat, Sep 16, 6:52 AM · User-Huji, CheckUser
hashar awarded T175920: Improve unit testing for CheckUser a 100 token.
Sat, Sep 16, 6:43 AM · User-Huji, CheckUser

Fri, Sep 15

mmodell awarded T145772: Error: Couldn't find trailer dictionary a Barnstar token.
Fri, Sep 15, 4:39 PM · OCG-General, Math, Wikimedia-log-errors
hashar added a comment to T175966: CI docker build should use an apt cache.

The wikimedia-jessie base image is generated via bootstrap-vz with:

plugins:
  minimize_size:
    apt:
      autoclean: true
      languages: [none]
      gzip_indexes: true
      autoremove_suggests: true
    dpkg:
      locales: []
      exclude_docs: true
Fri, Sep 15, 9:44 AM · Continuous-Integration-Infrastructure (shipyard)
hashar edited projects for T175764: integration-slave-jessie-1003 (and others?) missing jsduck executable, added: Release-Engineering-Team (Kanban); removed Patch-For-Review.
Fri, Sep 15, 8:26 AM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure

Thu, Sep 14

hashar created T175968: CI docker build should use a git cache.
Thu, Sep 14, 10:14 PM · Continuous-Integration-Infrastructure (shipyard)
hashar edited Description on Continuous-Integration-Infrastructure (shipyard).
Thu, Sep 14, 9:55 PM
hashar set the image for Continuous-Integration-Infrastructure (shipyard) to F9541309: profile.
Thu, Sep 14, 9:53 PM
hashar updated the task description for T175966: CI docker build should use an apt cache.
Thu, Sep 14, 9:48 PM · Continuous-Integration-Infrastructure (shipyard)
hashar created T175966: CI docker build should use an apt cache.
Thu, Sep 14, 9:47 PM · Continuous-Integration-Infrastructure (shipyard)
hashar created Continuous-Integration-Infrastructure (shipyard).
Thu, Sep 14, 4:58 PM
hashar added a comment to T175898: Checkuser on IP ranges produces no results, even if there are edits in that range.

Comes from https://gerrit.wikimedia.org/r/368327 for T171699

Thu, Sep 14, 1:43 PM · MW-1.30-release-notes (WMF-deploy-2017-09-19 (1.30.0-wmf.19)), Regression, Release-Engineering-Team, CheckUser
hashar moved T158974: MediaWiki core PHPCS job should only run against files changed in HEAD from In-progress to Done (within RelEng) on the Release-Engineering-Team (Kanban) board.
Thu, Sep 14, 10:51 AM · Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure (Little Steps Sprint), Patch-For-Review, Continuous-Integration-Config
hashar moved T130966: generalize extension submodule handling from In-progress to Done (within RelEng) on the Release-Engineering-Team (Kanban) board.
Thu, Sep 14, 10:51 AM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Config
hashar moved T50002: Jenkins: Assert no PHP errors (notices, warnings) were raised or exceptions were thrown from In-progress to Done (within RelEng) on the Release-Engineering-Team (Kanban) board.
Thu, Sep 14, 10:51 AM · Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure
hashar moved T161882: Migrate PHP5.5 jobs from Trusty to Jessie from In-progress to Done (within RelEng) on the Release-Engineering-Team (Kanban) board.
Thu, Sep 14, 10:51 AM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure (phase-out-trusty)
hashar moved T161086: Upgrade git package on zuul-merger instances contint1001 / contint2001 to benefit git-daemon from In-progress to Done (within RelEng) on the Release-Engineering-Team (Kanban) board.
Thu, Sep 14, 10:51 AM · Release-Engineering-Team (Kanban), Patch-For-Review, Continuous-Integration-Infrastructure
hashar moved T78342: Create a basic RSpec unit test for operations/puppet from Blocked (externally) to Done (within RelEng) on the Release-Engineering-Team (Kanban) board.
Thu, Sep 14, 10:51 AM · Ruby, User-zeljkofilipin, Release-Engineering-Team (Kanban), Continuous-Integration-Config, Patch-For-Review, Operations
hashar moved T128462: JJB should support YAML axis from Blocked (externally) to Done (within RelEng) on the Release-Engineering-Team (Kanban) board.
Thu, Sep 14, 10:51 AM · Release-Engineering-Team (Kanban), WorkType-NewFunctionality, Upstream, Browser-Tests-Infrastructure
hashar moved T166557: WebPageTest job fails intermittently with "java.io.IOException: Unexpected termination of the channel" from Blocked (externally) to Done (within RelEng) on the Release-Engineering-Team (Kanban) board.
Thu, Sep 14, 10:51 AM · Upstream, Jenkins, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure, Performance-Team
hashar moved T141450: mysql does not start when Trusty instances spawn from Backlog to Done on the Continuous-Integration-Infrastructure (phase-out-trusty) board.
Thu, Sep 14, 10:50 AM · Release-Engineering-Team (Backlog), Continuous-Integration-Infrastructure (phase-out-trusty), Patch-For-Review
hashar moved T144959: Install PHP5.5 on jessie CI instances from Backlog to Done on the Continuous-Integration-Infrastructure (phase-out-trusty) board.
Thu, Sep 14, 10:50 AM · Release-Engineering-Team (Backlog), Continuous-Integration-Infrastructure (phase-out-trusty)
hashar moved T161882: Migrate PHP5.5 jobs from Trusty to Jessie from In progress to Done on the Continuous-Integration-Infrastructure (phase-out-trusty) board.
Thu, Sep 14, 10:50 AM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure (phase-out-trusty)
hashar moved T161884: Migrate NodeJS Nodepool jobs from Trusty to Jessie from In progress to Done on the Continuous-Integration-Infrastructure (phase-out-trusty) board.
Thu, Sep 14, 10:50 AM · Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure (phase-out-trusty)
hashar moved T174972: Package php modules for Zend 5.5 on Jessie from In progress to Pending review on the Continuous-Integration-Infrastructure (phase-out-trusty) board.
Thu, Sep 14, 10:49 AM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure (phase-out-trusty)
hashar moved T175696: Remove trusty from Nodepool, WMCS, and clean out puppet from In progress to Pending review on the Continuous-Integration-Infrastructure (phase-out-trusty) board.
Thu, Sep 14, 10:49 AM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure (phase-out-trusty)
hashar moved T174972: Package php modules for Zend 5.5 on Jessie from Blocked (externally) to Done (within RelEng) on the Release-Engineering-Team (Kanban) board.
Thu, Sep 14, 10:49 AM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure (phase-out-trusty)
hashar moved T175696: Remove trusty from Nodepool, WMCS, and clean out puppet from Backlog to Done (within RelEng) on the Release-Engineering-Team (Kanban) board.
Thu, Sep 14, 10:49 AM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure (phase-out-trusty)
hashar moved T175696: Remove trusty from Nodepool, WMCS, and clean out puppet from Backlog to In progress on the Continuous-Integration-Infrastructure (phase-out-trusty) board.
Thu, Sep 14, 10:49 AM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure (phase-out-trusty)
hashar closed T157912: Freshly provisionned zuul fails connecting to Gerrit due to ssh key host as Declined.
Thu, Sep 14, 10:48 AM · Release-Engineering-Team (Next), Gerrit, Zuul, Patch-For-Review, Continuous-Integration-Infrastructure
hashar moved T175864: CI: operations-dns-lint broken due to missing Maxmind DB file from In-progress to Done (within RelEng) on the Release-Engineering-Team (Kanban) board.
Thu, Sep 14, 10:46 AM · Release-Engineering-Team (Kanban), Patch-For-Review, Operations, DNS, Continuous-Integration-Infrastructure, Traffic
hashar moved T175864: CI: operations-dns-lint broken due to missing Maxmind DB file from Backlog to In-progress on the Release-Engineering-Team (Kanban) board.
Thu, Sep 14, 10:45 AM · Release-Engineering-Team (Kanban), Patch-For-Review, Operations, DNS, Continuous-Integration-Infrastructure, Traffic
hashar triaged T175864: CI: operations-dns-lint broken due to missing Maxmind DB file as Normal priority.
Thu, Sep 14, 10:45 AM · Release-Engineering-Team (Kanban), Patch-For-Review, Operations, DNS, Continuous-Integration-Infrastructure, Traffic
hashar claimed T175864: CI: operations-dns-lint broken due to missing Maxmind DB file.

I have rebuild the jenkins build and it passed on the slave 1003 ( https://integration.wikimedia.org/ci/job/operations-dns-lint/4463/console ).

Thu, Sep 14, 10:44 AM · Release-Engineering-Team (Kanban), Patch-For-Review, Operations, DNS, Continuous-Integration-Infrastructure, Traffic
hashar added a comment to T175864: CI: operations-dns-lint broken due to missing Maxmind DB file.

I am trying to add the GeoIP files on the CI puppet master. Gotta fix some puppet madness with an undefined variable P6006 and https://gerrit.wikimedia.org/r/377986 puppetmaster: test for puppetmaster::geoip

Thu, Sep 14, 9:40 AM · Release-Engineering-Team (Kanban), Patch-For-Review, Operations, DNS, Continuous-Integration-Infrastructure, Traffic
hashar created P6006 (An Untitled Masterwork).
Thu, Sep 14, 9:29 AM
hashar added a comment to T175864: CI: operations-dns-lint broken due to missing Maxmind DB file.

That is related. As I migrated some jobs from Trusty to Jessie, I have added a couple Jessie instances. That file is not provisioned by puppet and it is thus missing.

Thu, Sep 14, 7:39 AM · Release-Engineering-Team (Kanban), Patch-For-Review, Operations, DNS, Continuous-Integration-Infrastructure, Traffic

Wed, Sep 13

hashar added a comment to T174972: Package php modules for Zend 5.5 on Jessie.

Moritz is rebuilding the Debian packages and will published them on apt.wikimedia.org . I am keeping this open until the upload has been completed. Then I can phase out the transient aptly repo :]

Wed, Sep 13, 6:59 PM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure (phase-out-trusty)
hashar added a comment to T175764: integration-slave-jessie-1003 (and others?) missing jsduck executable.

Should be good now:

Wed, Sep 13, 12:49 PM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure
hashar added a comment to T175764: integration-slave-jessie-1003 (and others?) missing jsduck executable.

Looks like it has been manually installed on one of the slave which is the one I used to verify whether jsduck is provisioned :(

Wed, Sep 13, 12:45 PM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure
hashar renamed T175696: Remove trusty from Nodepool, WMCS, and clean out puppet from Remove trusty from Nodepool and clean out puppet to Remove trusty from Nodepool, WMCS, and clean out puppet.
Wed, Sep 13, 8:19 AM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure (phase-out-trusty)
hashar added a comment to T175696: Remove trusty from Nodepool, WMCS, and clean out puppet.

Puppet cleaning is done via:

Wed, Sep 13, 8:18 AM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure (phase-out-trusty)
hashar triaged T175696: Remove trusty from Nodepool, WMCS, and clean out puppet as Normal priority.
Wed, Sep 13, 8:17 AM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure (phase-out-trusty)
hashar closed T141450: mysql does not start when Trusty instances spawn as Declined.

Almost every jobs are now running on Nodepool instances which do not suffer from this trouble.

Wed, Sep 13, 7:51 AM · Release-Engineering-Team (Backlog), Continuous-Integration-Infrastructure (phase-out-trusty), Patch-For-Review
hashar removed a project from T147778: Switch MediaWiki coverage job from PHP 5 to PHP 7: Continuous-Integration-Infrastructure (phase-out-trusty).

It is not running on trusty.

Wed, Sep 13, 7:50 AM · Release-Engineering-Team (Backlog), Continuous-Integration-Config
hashar closed T161882: Migrate PHP5.5 jobs from Trusty to Jessie as Resolved.
Wed, Sep 13, 7:44 AM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure (phase-out-trusty)
hashar closed T161882: Migrate PHP5.5 jobs from Trusty to Jessie, a subtask of T175696: Remove trusty from Nodepool, WMCS, and clean out puppet, as Resolved.
Wed, Sep 13, 7:44 AM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure (phase-out-trusty)

Tue, Sep 12

hashar added a comment to T161882: Migrate PHP5.5 jobs from Trusty to Jessie.

php-compile-php55 is the last job still on Trusty.

Tue, Sep 12, 8:40 PM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure (phase-out-trusty)
hashar added a comment to T175712: Install cumin in the WMCS infrastructure.

As a side effect, Beta-Cluster-Infrastructure and Continuous-Integration-Infrastructure would need a way to have a per project cumin master. We don't have access to the WMCS salt master.

Tue, Sep 12, 6:48 PM · Cloud-VPS, Operations-Software-Development
hashar added a comment to T174972: Package php modules for Zend 5.5 on Jessie.

https://gerrit.wikimedia.org/r/#/c/377469/2/modules/aptrepo/files/distributions-wikimedia adds the jessie-wikimedia component/ci :]

Tue, Sep 12, 3:09 PM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure (phase-out-trusty)
hashar added a comment to T161882: Migrate PHP5.5 jobs from Trusty to Jessie.

And I have deleted some left over jobs that had the ci-trusty-wikimedia label although they are not defined in JJB:

Tue, Sep 12, 3:00 PM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure (phase-out-trusty)
hashar updated the task description for T161882: Migrate PHP5.5 jobs from Trusty to Jessie.
Tue, Sep 12, 2:48 PM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure (phase-out-trusty)
hashar added a comment to T161882: Migrate PHP5.5 jobs from Trusty to Jessie.

Still have to switch the jobs using the label phpflavor-php55

Tue, Sep 12, 2:47 PM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure (phase-out-trusty)
hashar renamed T175696: Remove trusty from Nodepool, WMCS, and clean out puppet from Remove trusty from dib and clean out puppet to Remove trusty from Nodepool and clean out puppet.
Tue, Sep 12, 2:24 PM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure (phase-out-trusty)
hashar claimed T175696: Remove trusty from Nodepool, WMCS, and clean out puppet.
Tue, Sep 12, 2:22 PM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure (phase-out-trusty)
hashar added a parent task for T161882: Migrate PHP5.5 jobs from Trusty to Jessie: T175696: Remove trusty from Nodepool, WMCS, and clean out puppet.
Tue, Sep 12, 2:22 PM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure (phase-out-trusty)
hashar added a subtask for T175696: Remove trusty from Nodepool, WMCS, and clean out puppet: T161882: Migrate PHP5.5 jobs from Trusty to Jessie.
Tue, Sep 12, 2:22 PM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure (phase-out-trusty)
hashar created T175696: Remove trusty from Nodepool, WMCS, and clean out puppet.
Tue, Sep 12, 2:22 PM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure (phase-out-trusty)
hashar added a comment to T161882: Migrate PHP5.5 jobs from Trusty to Jessie.

We no more have any jobs on nodepool Trusty instances (label: ci-trusty-wikimedia) \o/

Tue, Sep 12, 1:52 PM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure (phase-out-trusty)
hashar added a comment to T174972: Package php modules for Zend 5.5 on Jessie.

And I have packaged php-luasandbox. The bulk of the work is done, what is left is maybe to polish up the packages then add them to apt.wikimedia.org. Meanwhile they are all published on a transient apt repo.

Tue, Sep 12, 10:50 AM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure (phase-out-trusty)
hashar moved T174972: Package php modules for Zend 5.5 on Jessie from Backlog to In progress on the Continuous-Integration-Infrastructure (phase-out-trusty) board.
Tue, Sep 12, 10:49 AM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure (phase-out-trusty)
hashar added a comment to T175298: Secret storage on contint1001 for Docker registry password.

We have bunch of credentials in https://integration.wikimedia.org/ci/credentials/ , they can then be exported as environment variables on a per job basis with https://docs.openstack.org/infra/jenkins-job-builder/wrappers.html#wrappers.credentials-binding

Tue, Sep 12, 7:53 AM · Release-Engineering-Team (Next), Release Pipeline
hashar added a project to T175293: Provision Docker >= 17.05 on contint1001: Operations.

In apt.wikimedia.org we have:

Tue, Sep 12, 7:48 AM · Patch-For-Review, Operations, Release-Engineering-Team (Kanban), Release Pipeline

Mon, Sep 11

hashar added a comment to T170492: figure out if nodepool is overwhelming rabbitmq and/or nova.

From this week-end logs, nova.network.manager had the same chain of logs:

2017-09-09 21:33:07.090 2408 WARNING nova.network.manager
[req-2106f08d-04ea-4cfc-a344-d0f7abf1072c nodepoolmanager contintcloud - - -]
Error cleaning up fixed ip allocation. Manual cleanup may be required.
ValueError: Circular reference detected
2017-09-09 21:33:07.269 2408 ERROR oslo_messaging.rpc.dispatcher
[req-2106f08d-04ea-4cfc-a344-d0f7abf1072c nodepoolmanager contintcloud - - -]
Exception during message handling: Timed out waiting for a reply to message ID 6e59f41d21354eccbc77bfe0fcc1c5c0

Though the message apparently got yield some 7 seconds later:

2017-09-09 21:33:14.487 2408 INFO oslo_messaging._drivers.amqpdriver [-]
No calling threads waiting for msg_id : 6e59f41d21354eccbc77bfe0fcc1c5c0
Mon, Sep 11, 7:15 PM · cloud-services-team (Kanban), Release-Engineering-Team (Watching / External), Nodepool, Cloud-VPS, Continuous-Integration-Infrastructure, Patch-For-Review
hashar updated the task description for T174972: Package php modules for Zend 5.5 on Jessie.
Mon, Sep 11, 4:25 PM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure (phase-out-trusty)
hashar removed a watcher for Beta-Cluster-Infrastructure: hashar.
Mon, Sep 11, 4:24 PM
hashar added a comment to T175495: Archive the Extension:Ads.

I have deleted the github repo wikimedia/mediawiki-extensions-Ads

Mon, Sep 11, 11:39 AM · User-MarcoAurelio, Repository-Admins, Cleanup