hashar (Antoine "hashar" Musso (WMF))
WMF Software developer - Release Engineering

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Thursday

  • Clear sailing ahead.

User Details

User Since
Oct 3 2014, 2:31 PM (224 w, 3 d)
Availability
Available
IRC Nick
hashar
LDAP User
Hashar
MediaWiki User
Unknown

https://www.mediawiki.org/wiki/User:Hashar

Based in Nantes, France CET/CEST (UTC+1, UTC+2)

Main IRC channel is #wikimedia-releng

antoine-approve

Recent Activity

Today

Dalba awarded T210739: Target deletion during page move fails a The World Burns token.
Tue, Jan 22, 9:24 AM · User-notice, Core Platform Team Backlog (Watching / External), Core Platform Team (Security, stability, performance and scalability (TEC1)), MediaWiki-Special-pages, Wikimedia-production-error
hashar added a comment to T207686: CI should run `pear package-validate` for PHP extensions with package.xml files.

I went with throwing an exception in the validation function:

$ pear package-validate
PHP Fatal error:  Uncaught Exception in /usr/share/php/PEAR/PackageFile/v2/Validator.php:60
Stack trace:
#0 /usr/share/php/PEAR/PackageFile/v2.php(1938): PEAR_PackageFile_v2_Validator->validate(Object(PEAR_PackageFile_v2), 3)
#1 /usr/share/php/PEAR/Command/Package.php(388): PEAR_PackageFile_v2->validate(3)
#2 /usr/share/php/PEAR/Command/Common.php(270): PEAR_Command_Package->doPackageValidate('package-validat...', Array, Array)
#3 /usr/share/php/pearcmd.php(316): PEAR_Command_Common->run('package-validat...', Array, Array)
#4 {main}
  thrown in /usr/share/php/PEAR/PackageFile/v2/Validator.php on line 60
Tue, Jan 22, 8:52 AM · Continuous-Integration-Config, LuaSandbox

Yesterday

hashar closed T214328: debian-glue job: ERROR: ld.so: object 'libeatmydata.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored. as Resolved.

Eventually we can revisit after the jobs get migrated to Debian Stretch and a more recent version of pbuilder.

Mon, Jan 21, 9:36 PM · Continuous-Integration-Infrastructure
hashar added a comment to T214328: debian-glue job: ERROR: ld.so: object 'libeatmydata.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored..

eatmydata is properly installed:

The following additional packages will be installed:
  libeatmydata1 libfakeroot
The following NEW packages will be installed:
  eatmydata fakeroot libeatmydata1 libfakeroot
Mon, Jan 21, 9:24 PM · Continuous-Integration-Infrastructure
hashar created T214328: debian-glue job: ERROR: ld.so: object 'libeatmydata.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored..
Mon, Jan 21, 7:47 PM · Continuous-Integration-Infrastructure
hashar edited projects for T212774: Upgrade jenkins-debian-glue to v0.20.0, added: Operations; removed Patch-For-Review.

I have managed to build the package for both jessie and stretch without any issues! :)

Mon, Jan 21, 4:59 PM · Operations, Packaging, Continuous-Integration-Infrastructure
hashar added a comment to T212774: Upgrade jenkins-debian-glue to v0.20.0.

My patches are in v0.20.0. I used to have the package build from operations/debs/jenkins-debian-glue which had our fork but it is no more needed.

Mon, Jan 21, 4:05 PM · Operations, Packaging, Continuous-Integration-Infrastructure
hashar added a comment to T137890: Relocate CI generated docs and coverage reports.

It is almost down, I could just use files received from rsync to be group writable. That requires a configuration tweak in rsyncd.conf achieved by the chain of patches:

Mon, Jan 21, 3:48 PM · serviceops, Release-Engineering-Team (Kanban), Patch-For-Review, Test-Coverage, Developer-Wishlist (2017), Technical-Debt, Continuous-Integration-Infrastructure

Sat, Jan 19

Binabik awarded T210739: Target deletion during page move fails a The World Burns token.
Sat, Jan 19, 8:00 PM · User-notice, Core Platform Team Backlog (Watching / External), Core Platform Team (Security, stability, performance and scalability (TEC1)), MediaWiki-Special-pages, Wikimedia-production-error
srishakatux awarded Blog Post: Gerrit now automatically adds reviewers a Love token.
Sat, Jan 19, 1:33 AM · Release-Engineering-Team, Gerrit

Fri, Jan 18

hashar added a comment to T214097: reviewers-by-blame plugin: only recent reviewers should be pinged.

As a past author of a code, there are good chance that you are qualified to be a reviewers. Then I can understand then changing to a new team or shifting interest, the review request is useless and perceived as spam.

Fri, Jan 18, 1:50 PM · Patch-For-Review, Gerrit
hashar added a comment to T213997: Exempt libraryupgrader from Gerrit's reviewers-by-blame plugin.

I have made the plugin to no more add any reviewers by default (done at All-Projects.git level). So you would no more get spam notifications.

Fri, Jan 18, 1:48 PM · Patch-For-Review, Upstream, Gerrit
hashar added a comment to T101131: Enable Gerrit reviewers-by-blame plugin.

As a follow up (also posted as a comment to J139):

Fri, Jan 18, 1:47 PM · Release-Engineering-Team (Kanban), Patch-For-Review, Developer-Wishlist (2017), Gerrit
hashar added a comment to Blog Post: Gerrit now automatically adds reviewers.

The Gerrit plugin blindly adds reviewers even when in a few cases it might not be appropriate (for a bot account, author of code who is not qualified to do a review, user that is no more active on a repository).

Fri, Jan 18, 1:46 PM · Release-Engineering-Team, Gerrit
hashar closed T210438: Option to allow Docker cache when building images as Resolved.

Patch completed and merged in.

Fri, Jan 18, 1:21 PM · Patch-For-Review, Release-Engineering-Team (Kanban), docker-pkg
Physikerwelt awarded Blog Post: Gerrit now automatically adds reviewers a Like token.
Fri, Jan 18, 12:37 PM · Release-Engineering-Team, Gerrit

Thu, Jan 17

MGChecker awarded Blog Post: Gerrit now automatically adds reviewers a Love token.
Thu, Jan 17, 11:16 PM · Release-Engineering-Team, Gerrit
Legoktm awarded Blog Post: Gerrit now automatically adds reviewers a Love token.
Thu, Jan 17, 9:59 PM · Release-Engineering-Team, Gerrit
D3r1ck01 awarded Blog Post: Gerrit now automatically adds reviewers a Love token.
Thu, Jan 17, 9:54 PM · Release-Engineering-Team, Gerrit
hashar added a comment to T214068: Display Zuul status of jobs for a change on Gerrit UI.

And the original JavaScript to do the magic looks like: https://github.com/openstack-infra/system-config/commit/0118d2b4b53cea2641c123a57c14bf8276237f09

Thu, Jan 17, 6:07 PM · Release-Engineering-Team (Backlog), Gerrit, Zuul, Continuous-Integration-Infrastructure
Addshore awarded T214068: Display Zuul status of jobs for a change on Gerrit UI a Like token.
Thu, Jan 17, 6:04 PM · Release-Engineering-Team (Backlog), Gerrit, Zuul, Continuous-Integration-Infrastructure
hashar created T214068: Display Zuul status of jobs for a change on Gerrit UI.
Thu, Jan 17, 6:03 PM · Release-Engineering-Team (Backlog), Gerrit, Zuul, Continuous-Integration-Infrastructure
dduvall awarded Blog Post: Gerrit now automatically adds reviewers a 100 token.
Thu, Jan 17, 5:58 PM · Release-Engineering-Team, Gerrit
kostajh awarded Blog Post: Gerrit now automatically adds reviewers a Yellow Medal token.
Thu, Jan 17, 5:02 PM · Release-Engineering-Team, Gerrit
hashar added a comment to T78768: Agree on and implement actions to prioritize code review of patches submitted by volunteers.

From one of the sub tasks I have published a blog explaining the Gerrit review by blame plugin as well as other manual way to find reviewers: J139: Blog Post: Gerrit now automatically adds reviewers. That would help to at least get some reviewers on changes since they are now added automatically by Gerrit.

Thu, Jan 17, 4:56 PM · Goal, Developer-Advocacy, DevRel-April-2016, DevRel-March-2016, DevRel-February-2016, DevRel-November-2015, DevRel-October-2015, ECT-March-2015, ECT-February-2015
hashar added a comment to T207984: Metrics that reduce workload on human reviewers.

I have published a blog explaining the Gerrit review by blame plugin as well as other manual way to find reviewers: J139: Blog Post: Gerrit now automatically adds reviewers

Thu, Jan 17, 4:55 PM · Epic, Code-Health-Metrics
hashar added a comment to T101131: Enable Gerrit reviewers-by-blame plugin.

I have published a blog explaining the Gerrit review by blame plugin as well as other manual way to find reviewers: J139: Blog Post: Gerrit now automatically adds reviewers

Thu, Jan 17, 4:55 PM · Release-Engineering-Team (Kanban), Patch-For-Review, Developer-Wishlist (2017), Gerrit
hashar added a comment to T91190: When uploading a new patch, reviewers should be added automatically.

I have published a blog explaining the Gerrit review by blame plugin as well as other manual way to find reviewers: J139: Blog Post: Gerrit now automatically adds reviewers

Thu, Jan 17, 4:55 PM · Team-Practices, Gerrit, Developer-Advocacy, Gerrit-Migration
hashar updated the post content for Blog Post: Gerrit now automatically adds reviewers.
Thu, Jan 17, 4:54 PM · Release-Engineering-Team, Gerrit
hashar added a project to T214047: [Bug] SSL failure doesn't cause browser test to be marked as failed: Browser-Tests.
hostname "saucelabs.com" does not match the server certificate (OpenSSL::SSL::SSLError)
Thu, Jan 17, 2:58 PM · Release-Engineering-Team (Backlog), Browser-Tests
zeljkofilipin awarded Blog Post: Gerrit now automatically adds reviewers a Party Time token.
Thu, Jan 17, 2:36 PM · Release-Engineering-Team, Gerrit
hashar added a comment to T91190: When uploading a new patch, reviewers should be added automatically.

I had the task closed since we have https://www.mediawiki.org/wiki/Git/Reviewers

Thu, Jan 17, 1:10 PM · Team-Practices, Gerrit, Developer-Advocacy, Gerrit-Migration
hashar added a comment to T207984: Metrics that reduce workload on human reviewers.

Might be related: in Gerrit we have enabled a plugin that adds reviewers based on whom previously touched the affected code. It looks promising based on my first few changes, relevant reviewers got added saving me some time (task was T101131).

Thu, Jan 17, 12:34 PM · Epic, Code-Health-Metrics
hashar created T214022: docker-pkg might consider skipping UNRELEASED entries.
Thu, Jan 17, 11:08 AM · docker-pkg
hashar added a comment to T213944: Jenkins jobs for npm-test fail on project with deps on node-gyp which requires python2.7.

For the other issue (wrong username) node-gyp source code has:

./lib/install.js:    log.warn('EACCES', 'user "%s" does not have permission to access the dev dir "%s"', osenv.user(), devDir)
Thu, Jan 17, 10:38 AM · Release-Engineering-Team (Kanban), User-zeljkofilipin, Continuous-Integration-Infrastructure, Jenkins, MediaWiki-extensions-Newsletter
hashar added a comment to T213944: Jenkins jobs for npm-test fail on project with deps on node-gyp which requires python2.7.

We have python-minimal in a bunch of npm containers:

$ git grep -h python.*minimal dockerfiles/*/Dockerfile.template
# python-minimal for node-gyp
RUN {{ "ruby ruby2.3 ruby2.3-dev rubygems-integration python-minimal build-essential" | apt_install }} \
# python-minimal for node-gyp
RUN {{ "nodejs-legacy python-minimal ruby ruby-dev rubygems-integration build-essential" | apt_install }}
# python-minimal for node-gyp
RUN {{ "nodejs-legacy npm ruby ruby2.1 ruby2.1-dev rubygems-integration python-minimal build-essential" | apt_install }} \
# python-minimal for node-gyp
RUN {{ "nodejs nodejs-legacy ruby ruby2.3 ruby2.3-dev rubygems-integration python-minimal build-essential" | apt_install }} \
Thu, Jan 17, 10:31 AM · Release-Engineering-Team (Kanban), User-zeljkofilipin, Continuous-Integration-Infrastructure, Jenkins, MediaWiki-extensions-Newsletter
hashar added a comment to T213944: Jenkins jobs for npm-test fail on project with deps on node-gyp which requires python2.7.

To reproduce:

$ docker run --rm -it --entrypoint=bash docker-registry.wikimedia.org/releng/npm-browser-test:0.3.1
$ cd /src
$ git init .
Initialized empty Git repository in /src/.git/
$ git fetch --quiet --depth=1 https://gerrit.wikimedia.org/r/p/mediawiki/extensions/Newsletter
$ git checkout FETCH_HEAD
$ npm install
<error reproduced>
Thu, Jan 17, 10:25 AM · Release-Engineering-Team (Kanban), User-zeljkofilipin, Continuous-Integration-Infrastructure, Jenkins, MediaWiki-extensions-Newsletter
hashar added a comment to T213944: Jenkins jobs for npm-test fail on project with deps on node-gyp which requires python2.7.

Note the Docker containers are being passed the environment from the host. Some variables are manually blacklisted, they are related to the login command. The env to the container with:

docker run ... --env-file <(/usr/bin/env|egrep -v '^(HOME|SHELL|PATH|LOGNAME|MAIL|HHVM_REPO_CENTRAL_PATH)=')
Thu, Jan 17, 10:20 AM · Release-Engineering-Team (Kanban), User-zeljkofilipin, Continuous-Integration-Infrastructure, Jenkins, MediaWiki-extensions-Newsletter
hashar added a comment to T213944: Jenkins jobs for npm-test fail on project with deps on node-gyp which requires python2.7.

fibers seems to be a native module which thus requires compilation. That is done using node-gyp which internally relies on python. The actual error:

Thu, Jan 17, 10:13 AM · Release-Engineering-Team (Kanban), User-zeljkofilipin, Continuous-Integration-Infrastructure, Jenkins, MediaWiki-extensions-Newsletter
hashar added a subtask for T186494: jenkins-debian-glue should run the lintian version from cowbuilder instead of from host: T212774: Upgrade jenkins-debian-glue to v0.20.0.
Thu, Jan 17, 8:55 AM · Upstream, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure, Packaging
hashar added a parent task for T212774: Upgrade jenkins-debian-glue to v0.20.0: T186494: jenkins-debian-glue should run the lintian version from cowbuilder instead of from host.
Thu, Jan 17, 8:55 AM · Operations, Packaging, Continuous-Integration-Infrastructure
hashar added a project to T212774: Upgrade jenkins-debian-glue to v0.20.0: Packaging.
Thu, Jan 17, 8:54 AM · Operations, Packaging, Continuous-Integration-Infrastructure
hashar renamed T212774: Upgrade jenkins-debian-glue to v0.20.0 from Upgrade jenkins-debian-glue to v0.19.0 to Upgrade jenkins-debian-glue to v0.20.0.
Thu, Jan 17, 8:54 AM · Operations, Packaging, Continuous-Integration-Infrastructure
Tgr awarded T101131: Enable Gerrit reviewers-by-blame plugin a Yellow Medal token.
Thu, Jan 17, 2:30 AM · Release-Engineering-Team (Kanban), Patch-For-Review, Developer-Wishlist (2017), Gerrit

Wed, Jan 16

hashar added a comment to T210780: labs/toollabs should always run debian-glue, possibly with multiple distributions.

Changing Build-Depends from python3:any to python3 fixes it. https://gerrit.wikimedia.org/r/#/c/labs/toollabs/+/484772/ reports:

Wed, Jan 16, 9:36 PM · Patch-For-Review, Release-Engineering-Team (Kanban), cloud-services-team (Kanban), Continuous-Integration-Config
hashar moved T210780: labs/toollabs should always run debian-glue, possibly with multiple distributions from Backlog to In-progress on the Release-Engineering-Team (Kanban) board.
Wed, Jan 16, 9:19 PM · Patch-For-Review, Release-Engineering-Team (Kanban), cloud-services-team (Kanban), Continuous-Integration-Config
hashar moved T35515: .odb file recognized as application/acad (first type entry in our list) from Backlog to In-progress on the Release-Engineering-Team (Kanban) board.
Wed, Jan 16, 9:19 PM · Release-Engineering-Team (Kanban), Patch-For-Review, Multimedia, MediaWiki-Uploading
hashar added a comment to T206129: Unable to change full name in Gerrit through contact settings page or command line.

@Paladox

You have to edit your name through wikitech

Wed, Jan 16, 7:59 PM · Gerrit
hashar awarded T101131: Enable Gerrit reviewers-by-blame plugin a Mountain of Wealth token.
Wed, Jan 16, 7:53 PM · Release-Engineering-Team (Kanban), Patch-For-Review, Developer-Wishlist (2017), Gerrit
hashar closed T101131: Enable Gerrit reviewers-by-blame plugin as Resolved.

The plugin version we were using was not compatible yet with Gerrit 2.15. In the previous upgrades we forgot to bump the plugin.

Wed, Jan 16, 7:52 PM · Release-Engineering-Team (Kanban), Patch-For-Review, Developer-Wishlist (2017), Gerrit
hashar created T213956: JENKINS-2111 path sanitization ineffective when using legacy Workspace Root Directory.
Wed, Jan 16, 7:32 PM · Jenkins, Continuous-Integration-Infrastructure
hashar renamed T211720: Upgrade jenkins instances to 2.150.2 from Upgrade jenkins instances to 2.150.1 to Upgrade jenkins instances to 2.150.2.
Wed, Jan 16, 7:31 PM · Jenkins, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure
hashar closed T211720: Upgrade jenkins instances to 2.150.2 as Resolved.
Wed, Jan 16, 7:30 PM · Jenkins, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure
hashar assigned T211720: Upgrade jenkins instances to 2.150.2 to thcipriani.

All Jenkins have been upgraded to 2.150.2. Thanks @Dzahn and @thcipriani !

Wed, Jan 16, 7:30 PM · Jenkins, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure
hashar added a project to T211720: Upgrade jenkins instances to 2.150.2: Jenkins.
Wed, Jan 16, 7:01 PM · Jenkins, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure
Framawiki awarded T210739: Target deletion during page move fails a The World Burns token.
Wed, Jan 16, 6:41 PM · User-notice, Core Platform Team Backlog (Watching / External), Core Platform Team (Security, stability, performance and scalability (TEC1)), MediaWiki-Special-pages, Wikimedia-production-error
hashar added a comment to T210271: Migrate analytics/refinery/source release jobs to Docker.

The job has to be refactored and generalized so we can use it on other maven repositories. mwdumper is one such use case ( T213874#4883586 ).

Wed, Jan 16, 8:31 AM · Continuous-Integration-Infrastructure (Slipway), Analytics
hashar updated subscribers of T213874: Build mwdumper automatically.

I had some discussions with @Gehel to create and publish proper releases out of maven repositories. The only example we have so far is for analytics/refinery which I have to migrate toward using Docker container T210271, and I think I will refactor those jobs and generalize them to all repositories. So if I am good enough, the end result would be that all maven repositories would result .jar files published to archiva.wikimedia.org.

Wed, Jan 16, 8:30 AM · Continuous-Integration-Config, Utilities-mwdumper
hashar added a comment to T189549: Setup CI for operations/software/gerrit.

Bazel provides Debian packages for Java 1.8. Guide: https://docs.bazel.build/versions/master/install-ubuntu.html#install-on-ubuntu

Wed, Jan 16, 7:42 AM · Release-Engineering-Team (Kanban), Continuous-Integration-Config, Gerrit
hashar renamed T189549: Setup CI for operations/software/gerrit from Setup CI for operations/software/gerrit/gerrit to Setup CI for operations/software/gerrit.
Wed, Jan 16, 7:40 AM · Release-Engineering-Team (Kanban), Continuous-Integration-Config, Gerrit

Tue, Jan 15

hashar added a comment to T101131: Enable Gerrit reviewers-by-blame plugin.

The plugin is going to be bumped by https://gerrit.wikimedia.org/r/#/c/operations/software/gerrit/+/484437/-1..1

Tue, Jan 15, 8:19 PM · Release-Engineering-Team (Kanban), Patch-For-Review, Developer-Wishlist (2017), Gerrit
hashar added a comment to T198901: Migrate production services to kubernetes using the pipeline.

From the releng meeting, I have added wikimedia/portals to the list.

Tue, Jan 15, 5:44 PM · Core Platform Team Backlog (Watching / External), Release-Engineering-Team, Epic, Services (watching), Operations, Release Pipeline
hashar added a comment to T213806: Migrate wikimedia-portals-build to Docker container.

I might look at migrating it to a CI Docker container. Longterm it would probably migrate to Blubber / Pipeline / Kubernetes which is T198901

Tue, Jan 15, 5:44 PM · Continuous-Integration-Infrastructure (Slipway), Wikimedia-Portals
hashar updated the task description for T198901: Migrate production services to kubernetes using the pipeline.
Tue, Jan 15, 5:43 PM · Core Platform Team Backlog (Watching / External), Release-Engineering-Team, Epic, Services (watching), Operations, Release Pipeline
hashar claimed T210285: Migrate selenium-Wikibase-chrome selenium-WikibaseLexeme-chrome to Docker containers.

I crafted a very basic container and got something to run with Wikibase. I will craft experimental Jenkins jobs and progress from there :-]

Tue, Jan 15, 4:15 PM · Release-Engineering-Team (Kanban), Patch-For-Review, Wikidata, Lexicographical data, User-zeljkofilipin, Browser-Tests, Continuous-Integration-Infrastructure (Slipway)
hashar committed rOSCC5144b1429ae1: Jenkins job validation (DO NOT SUBMIT) (authored by hashar).
Jenkins job validation (DO NOT SUBMIT)
Tue, Jan 15, 2:01 PM
hashar added a comment to T210285: Migrate selenium-Wikibase-chrome selenium-WikibaseLexeme-chrome to Docker containers.

@hashar Please do not remove these jobs. Those are daily jobs of Wikibase(Lexeme) extensions which we want to keep. It is true though, those have been red for more than a while. We're working on fixing those failures, to allow us to gradually migrate away from ruby tests to node ones.
It is actually my personal goal for this quarter to get all these daily selenium jobs of Wikibase's green. It is simply embarrassing that we haven't solved those problems for so long.

Tue, Jan 15, 1:32 PM · Release-Engineering-Team (Kanban), Patch-For-Review, Wikidata, Lexicographical data, User-zeljkofilipin, Browser-Tests, Continuous-Integration-Infrastructure (Slipway)
hashar added a comment to T191078: Typo on https://integration.wikimedia.org/ci/.

The patch did:

- login=Iniciar Sesion
+ login=Iniciar sesión
Tue, Jan 15, 12:55 PM · Jenkins, Continuous-Integration-Config
hashar added a comment to T101131: Enable Gerrit reviewers-by-blame plugin.

I went with install bazel from their apt package (which is a huge binary blob bah). Then:

$ cd ~/projects/operations/software/gerrit
$ bazel build plugins/reviewers-by-blame:reviewers-by-blame
INFO: Analysed target //plugins/reviewers-by-blame:reviewers-by-blame (142 packages loaded, 3182 targets configured).
INFO: Found 1 target...
Target //plugins/reviewers-by-blame:reviewers-by-blame up-to-date:
  bazel-genfiles/plugins/reviewers-by-blame/reviewers-by-blame.jar
INFO: Elapsed time: 44.699s, Critical Path: 12.04s
INFO: 126 processes: 121 processwrapper-sandbox, 5 worker.
INFO: Build completed successfully, 140 total actions
Tue, Jan 15, 12:26 PM · Release-Engineering-Team (Kanban), Patch-For-Review, Developer-Wishlist (2017), Gerrit
hashar added a comment to T206442: security.sensiolabs.org is shutting down at the end of October 2018.

Good that makes sense :-]

Tue, Jan 15, 11:18 AM · Patch-For-Review, MediaWiki-Vendor, Continuous-Integration-Infrastructure, Composer, Security
hashar added a comment to T213674: Possible first paint regression on mobile.

That comes from Grafana webpagereplay-mobile-alerts:

Tue, Jan 15, 11:09 AM · Performance-Team
hashar updated the task description for T213806: Migrate wikimedia-portals-build to Docker container.
Tue, Jan 15, 11:02 AM · Continuous-Integration-Infrastructure (Slipway), Wikimedia-Portals
hashar added a comment to T210286: Migrate wikidata-query-gui-build to Docker containers.

I have moved the part about Wikimedia portals to a standalone task T213806. Although the jobs for each repositories more or less share the same code, the migrations to Docker would most probably be slightly different.

Tue, Jan 15, 11:01 AM · Continuous-Integration-Infrastructure (Slipway), Wikidata Query UI, Wikidata
hashar renamed T210286: Migrate wikidata-query-gui-build to Docker containers from Migrate wikidata-query-gui-build and wikimedia-portals-build to Docker containers to Migrate wikidata-query-gui-build to Docker containers.
Tue, Jan 15, 11:00 AM · Continuous-Integration-Infrastructure (Slipway), Wikidata Query UI, Wikidata
hashar created T213806: Migrate wikimedia-portals-build to Docker container.
Tue, Jan 15, 10:59 AM · Continuous-Integration-Infrastructure (Slipway), Wikimedia-Portals
hashar merged task T190073: Migrate Jenkins jobs wikimedia-portals-build and wikidata-query-gui-build to Docker and to use an entry point (eg: npm builddeploy) into T210286: Migrate wikidata-query-gui-build to Docker containers.
Tue, Jan 15, 10:58 AM · Continuous-Integration-Infrastructure (Slipway), Discovery, Wikimedia-Portals, releng-201718-q4, Release-Engineering-Team (Kanban)
hashar merged T190073: Migrate Jenkins jobs wikimedia-portals-build and wikidata-query-gui-build to Docker and to use an entry point (eg: npm builddeploy) into T210286: Migrate wikidata-query-gui-build to Docker containers.
Tue, Jan 15, 10:57 AM · Continuous-Integration-Infrastructure (Slipway), Wikidata Query UI, Wikidata
hashar added a comment to T190073: Migrate Jenkins jobs wikimedia-portals-build and wikidata-query-gui-build to Docker and to use an entry point (eg: npm builddeploy).

The intent was to migrate to Docker but it was too complicated so I have moved to permanent slaves. Meanwhile I have filled a duplicate task T210286 for the migration out of permanent slaves.

Tue, Jan 15, 10:57 AM · Continuous-Integration-Infrastructure (Slipway), Discovery, Wikimedia-Portals, releng-201718-q4, Release-Engineering-Team (Kanban)
hashar closed T210282: mwext-CirrusSearch-whitespaces as Resolved.
Tue, Jan 15, 10:04 AM · Release-Engineering-Team (Kanban), Patch-For-Review, CirrusSearch, Discovery-Search, Continuous-Integration-Infrastructure (Slipway)
hashar moved T203084: Migrate DonationInterface CI job to Docker from Backlog to Stalled on the Continuous-Integration-Infrastructure (Slipway) board.
Tue, Jan 15, 10:02 AM · Continuous-Integration-Infrastructure (Slipway), Patch-For-Review, MediaWiki-extensions-DonationInterface, Release-Engineering-Team (Kanban)
hashar moved T210282: mwext-CirrusSearch-whitespaces from Backlog to In-progress on the Release-Engineering-Team (Kanban) board.
Tue, Jan 15, 10:00 AM · Release-Engineering-Team (Kanban), Patch-For-Review, CirrusSearch, Discovery-Search, Continuous-Integration-Infrastructure (Slipway)
hashar moved T210282: mwext-CirrusSearch-whitespaces from Ready to In progress on the Continuous-Integration-Infrastructure (Slipway) board.
Tue, Jan 15, 9:59 AM · Release-Engineering-Team (Kanban), Patch-For-Review, CirrusSearch, Discovery-Search, Continuous-Integration-Infrastructure (Slipway)
hashar claimed T210282: mwext-CirrusSearch-whitespaces.
Tue, Jan 15, 9:57 AM · Release-Engineering-Team (Kanban), Patch-For-Review, CirrusSearch, Discovery-Search, Continuous-Integration-Infrastructure (Slipway)
hashar added a comment to T210282: mwext-CirrusSearch-whitespaces.

I looked at the history of commits with a tiny script:

#!/usr/bin/python3
Tue, Jan 15, 9:52 AM · Release-Engineering-Team (Kanban), Patch-For-Review, CirrusSearch, Discovery-Search, Continuous-Integration-Infrastructure (Slipway)
hashar added a comment to T206442: security.sensiolabs.org is shutting down at the end of October 2018.

Can't we reuse upstream CLI? https://github.com/sensiolabs/security-checker

Tue, Jan 15, 8:58 AM · Patch-For-Review, MediaWiki-Vendor, Continuous-Integration-Infrastructure, Composer, Security
hashar added a comment to T213509: doc.wikimedia.org urls without trailing slash respond with HTTP 403 Forbidden.

Amazing, thank you very much for the apache-fast-test test!

Tue, Jan 15, 8:30 AM · Release-Engineering-Team (Kanban), Patch-For-Review, Continuous-Integration-Infrastructure

Mon, Jan 14

hashar added a comment to T213169: Grant sudo access for CI admins to doc.wikimedia.org publishing user.

I can confirm it is working fine. Thank you.

Mon, Jan 14, 9:14 PM · Patch-For-Review, SRE-Access-Requests, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure, Operations
hashar closed T196628: CI: upgrade tox, currently running 2.6.0 as Resolved.
Mon, Jan 14, 5:58 PM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure
hashar added a comment to T196628: CI: upgrade tox, currently running 2.6.0.

Cool! Thanks for the confirmation.

Mon, Jan 14, 5:58 PM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure
hashar closed T210279: Migrate integration-zuul-layoutdiff and integration-zuul-layoutvalidation-gate jobs to Docker containers as Resolved.
Mon, Jan 14, 5:21 PM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Config, Continuous-Integration-Infrastructure (Slipway)
hashar added a project to T208566: puppet.git rake fails with ruby 2.5: Continuous-Integration-Config.

The Gemfile uses puppet ~> 4.8.2 which is the version provided by jessie-backports and stretch.

Mon, Jan 14, 1:07 PM · Continuous-Integration-Config, Operations, Puppet
hashar added a comment to T196628: CI: upgrade tox, currently running 2.6.0.

I have upgraded all containers/jobs to containers releng/toxXXXXX:0.3.0. That comes with tox 2.9.1 and the containers also have multiple python versions (from T191764).

Mon, Jan 14, 12:18 PM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure
hashar added a comment to T196628: CI: upgrade tox, currently running 2.6.0.

[contint1001.wikimedia.org] out: ERROR: image docker-registry.discovery.wmnet/releng/tox-pyspark failed to build, see logs for details. The generated Dockerfile is:

Dockerfile
FROM docker-registry.discovery.wmnet/releng/tox:0.3.0
Mon, Jan 14, 11:26 AM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure
hashar added a comment to T196628: CI: upgrade tox, currently running 2.6.0.

Rebuilding:

Mon, Jan 14, 10:51 AM · Patch-For-Review, Release-Engineering-Team (Kanban), Continuous-Integration-Infrastructure

Sat, Jan 12

hashar edited projects for T208566: puppet.git rake fails with ruby 2.5, added: Operations; removed Continuous-Integration-Infrastructure.
Sat, Jan 12, 2:30 PM · Continuous-Integration-Config, Operations, Puppet
hashar merged task T42656: [Task] Wikibase: have test coverage of JavaScript QUnit tests into T184657: Generate JS code coverage reports for extensions.
Sat, Jan 12, 2:27 PM · Test-Coverage, Continuous-Integration-Infrastructure, Wikidata, MediaWiki-extensions-WikibaseRepository
hashar merged T42656: [Task] Wikibase: have test coverage of JavaScript QUnit tests into T184657: Generate JS code coverage reports for extensions.
Sat, Jan 12, 2:27 PM · Test-Coverage, JavaScript, Continuous-Integration-Infrastructure
hashar added a comment to T149924: Clear /srv/.git on contint1001.

https://doc.wikimedia.org/ is now served by doc1001.eqiad.wmnet. integration/docroot is cloned to /srv/docroot.

Sat, Jan 12, 2:23 PM · Release-Engineering-Team (Kanban), Patch-For-Review, Technical-Debt, Continuous-Integration-Infrastructure
hashar closed T128008: Remove manual $PHP_BIN handling in slave-scripts as Resolved.

Looks like it was a transient state that got fixed at some point :)

Sat, Jan 12, 2:21 PM · Technical-Debt, Continuous-Integration-Infrastructure
hashar closed T124800: CI trusty slaves do not have php5-apcu installed as Declined.
Sat, Jan 12, 2:19 PM · Continuous-Integration-Infrastructure