Page MenuHomePhabricator

dduvall (Dan Duvall)
Staff Software Engineer

User Details

User Since
Oct 7 2014, 4:24 PM (496 w, 4 d)
Availability
Busy Busy at E1727: dduvall on sabbatical until May 15.
IRC Nick
marxarelli
LDAP User
Dduvall
MediaWiki User
DDuvall (WMF) [ Global Accounts ]

Recent Activity

Mar 7 2024

dduvall updated subscribers of T359414: Less_Exception_Compiler: error evaluating function `fade` The first argument to fade must be a color index: 110 in QuickViewTutorialPopup.vue on line 3, column 331| <template>2| <section :class="QuickViewTutorialPopupClass">.

If I go to a referrer and open the console in Chrome, I see the error, but only if I'm using the Minerva skin. Here's a referrer with &useskin=minerva appended.

Mar 7 2024, 6:34 PM · Web-Team-Backlog, Structured-Data-Backlog, SDAW-SearchVue, Wikimedia-production-error

Mar 6 2024

dduvall created E1727: dduvall on sabbatical.
Mar 6 2024, 10:16 PM · Release-Engineering-Team, events

Mar 4 2024

dduvall added a comment to T337570: Get GitLab to render `T{\d}+` in MR overviews, comments, etc. as links to Phabricator.

I went ahead and implemented/submitted a Phorge integration upstream

Mar 4 2024, 7:23 PM · Release-Engineering-Team (Now this 🫠), User-brennen, collaboration-services, Phabricator, GitLab (Integrations)

Feb 29 2024

dduvall added a project to T358728: Solve OSV Double-Pipeline Problem without Requiring Many Default Rules: Security-Team.
Feb 29 2024, 7:21 PM · SecTeam-Processed, Security-Team, Release Pipeline, Release-Engineering-Team
dduvall added a comment to T358728: Solve OSV Double-Pipeline Problem without Requiring Many Default Rules.

That include looks to be owned by the Security Team. From our experience with Kokkuri, my general advice from GitLab CI includes is either:

Feb 29 2024, 7:20 PM · SecTeam-Processed, Security-Team, Release Pipeline, Release-Engineering-Team

Feb 26 2024

dduvall closed T356908: Do not use old version numbers on Blubber README as Resolved.
Feb 26 2024, 11:26 PM · Release-Engineering-Team (Priority Backlog 📥), Release Pipeline (Blubber)
dduvall added a comment to T337570: Get GitLab to render `T{\d}+` in MR overviews, comments, etc. as links to Phabricator.

I went ahead and implemented/submitted a Phorge integration upstream as well as a feature request to allow the custom issue tracker ID delimiter to be configured. Let's see how they are received. If they won't take either, I will revisit the local gem setup.

Feb 26 2024, 10:31 PM · Release-Engineering-Team (Now this 🫠), User-brennen, collaboration-services, Phabricator, GitLab (Integrations)

Feb 22 2024

dduvall added a comment to T337570: Get GitLab to render `T{\d}+` in MR overviews, comments, etc. as links to Phabricator.

Thinking about other implementation possibilities here... do we have any way to inject custom javascript into the GitLab UI? If so the use case of turning mentions of T\d+ into links to Phab seems like something that could be done with a script that is the equivalent of a MediaWiki Gadget. We could also go in an interesting direction of creating a Greasemonkey script or even a Wikimedia GitLab browser extension that did this kind of client side enhancement.

Feb 22 2024, 7:27 PM · Release-Engineering-Team (Now this 🫠), User-brennen, collaboration-services, Phabricator, GitLab (Integrations)
dduvall added a comment to T337570: Get GitLab to render `T{\d}+` in MR overviews, comments, etc. as links to Phabricator.

I'd like to see proper links to Phabricator in Gitlab, this would be a nice usability feature. Is the usage of a custom Gem still the preferred implementation for this? Currently the usage of local gems is disabled since Sep 2023 due to issues on upgrades. If we want to proceed with the custom gems we would need a solution to make sure the custom gem file survives a version upgrade or gets disabled and re-created after the upgrade.

Feb 22 2024, 5:35 PM · Release-Engineering-Team (Now this 🫠), User-brennen, collaboration-services, Phabricator, GitLab (Integrations)

Feb 13 2024

dduvall closed T356902: Publish Blubber reference doc as Resolved.

We recently did some work on Blubber (and other pipeline tooling) documentation in T352259: Review critical-path deployment pipeline documentation, and part of the work entailed refactoring the reference documentation.

Feb 13 2024, 7:39 PM · Release-Engineering-Team, Release Pipeline (Blubber)

Feb 12 2024

dduvall added a comment to T318289: Deprecate Blubber's CLI and microservice (blubberoid) interfaces.

Thanks for tackling Shellbox, @bd808. It looks like MW-Vagrant's Blubberoid wrapper is in turn used by https://gerrit.wikimedia.org/g/mediawiki/vagrant/+/4b15d7aeb71e28b13a653f137dc18bec0376db8d/puppet/modules/role/templates/addimage/systemd/image-suggestion-api.epp

Feb 12 2024, 5:24 PM · Release-Engineering-Team (Priority Backlog 📥), Epic, Release Pipeline (Blubber)

Feb 7 2024

dduvall changed the status of T356908: Do not use old version numbers on Blubber README from Open to In Progress.
Feb 7 2024, 8:08 PM · Release-Engineering-Team (Priority Backlog 📥), Release Pipeline (Blubber)
dduvall added a comment to T356684: python: error: externally-managed-environment.

Oh, you're using Blubberoid! It's deprecated and I'm planning to decommission it soon. Can you point me to your downstream project? Can we get that using the Blubber buildkit frontend perhaps (# syntax = line in the blubber.yaml?

Oops. I must've missed the announcement of that. Using the buildkit syntax seems to work, indeed.

Feb 7 2024, 7:59 PM · Release-Engineering-Team, Release Pipeline (Blubber)
dduvall added a comment to T352259: Review critical-path deployment pipeline documentation.

Additionally for Blubber, I deprecated the Getting Started pages and Deployment Pipeline documentation and removed them from the portal. I renamed Usage to Examples and linked to the project examples folder which contains acceptance tests with descriptions for people. I added a Reference page and portal item and linked to the project's docs/configuration.md file.

Feb 7 2024, 6:54 PM · User-brennen, Release-Engineering-Team, Documentation, Tech-Docs-Team
dduvall added a comment to T356684: python: error: externally-managed-environment.

Oh, you're using Blubberoid! It's deprecated and I'm planning to decommission it soon. Can you point me to your downstream project? Can we get that using the Blubber buildkit frontend perhaps (# syntax = line in the blubber.yaml?

Feb 7 2024, 6:25 PM · Release-Engineering-Team, Release Pipeline (Blubber)
dduvall added a comment to T356684: python: error: externally-managed-environment.

What version of Blubber are you using? Someone else encountered this previously (see T346090: Blubber: Add workaround for Bookworm's Python pip restrictions) and the workaround we settled on was setting PIP_BREAK_SYSTEM_PACKAGES. Not the most elegant solution but these are container images so "breaking" system package installation seems... ok perhaps?

Feb 7 2024, 6:02 PM · Release-Engineering-Team, Release Pipeline (Blubber)
dduvall added a comment to T352259: Review critical-path deployment pipeline documentation.

@dduvall do you think it makes sense for me to rename the User Guide (to Reference or similar) and review it slightly? Or should we wait for your mechanism of generating docs/configuration.md to be ready and deprecate the User Guide entirely when it's available?

Feb 7 2024, 4:53 PM · User-brennen, Release-Engineering-Team, Documentation, Tech-Docs-Team
KBach awarded T352259: Review critical-path deployment pipeline documentation a Love token.
Feb 7 2024, 9:41 AM · User-brennen, Release-Engineering-Team, Documentation, Tech-Docs-Team
thcipriani awarded T352259: Review critical-path deployment pipeline documentation a Love token.
Feb 7 2024, 1:30 AM · User-brennen, Release-Engineering-Team, Documentation, Tech-Docs-Team

Feb 6 2024

dduvall triaged T352259: Review critical-path deployment pipeline documentation as Medium priority.
Feb 6 2024, 11:08 PM · User-brennen, Release-Engineering-Team, Documentation, Tech-Docs-Team
dduvall added a comment to T352259: Review critical-path deployment pipeline documentation.

Blubber:

Feb 6 2024, 11:07 PM · User-brennen, Release-Engineering-Team, Documentation, Tech-Docs-Team

Feb 5 2024

dduvall claimed T352259: Review critical-path deployment pipeline documentation.

Sorry for the delay on my side. Assigning to myself as I think I'm the only one that still needs to perform review.

Feb 5 2024, 6:46 PM · User-brennen, Release-Engineering-Team, Documentation, Tech-Docs-Team
dduvall added a comment to T268269: Document GitLab Development Kit setup on-wiki.

Just a note that I had the best luck with https://gitlab.com/gitlab-org/gitlab-compose-kit on a Debian system. It's unofficial but provides lighter weight options than GDK for simply running tests. There's also a lot less churn when tearing down single components or even the entire thing (due to cached images and its isolation of GitLab services via Docker Compose).

Feb 5 2024, 6:44 PM · Release-Engineering-Team (Priority Backlog 📥), GitLab (Misc), Documentation, User-brennen

Jan 20 2024

Don-vip awarded T337570: Get GitLab to render `T{\d}+` in MR overviews, comments, etc. as links to Phabricator a Hungry Hippo token.
Jan 20 2024, 11:49 AM · Release-Engineering-Team (Now this 🫠), User-brennen, collaboration-services, Phabricator, GitLab (Integrations)

Jan 4 2024

dduvall awarded T354298: Wikimedia\Assert\PreconditionException: Expected MediaWiki\Block\AbstractBlock to belong to the local wiki, but it belongs to 'xxxwiki' a Love token.
Jan 4 2024, 6:15 PM · MW-1.42-notes (1.42.0-wmf.12; 2024-01-02), MediaWiki-Engineering, MediaWiki-extensions-CentralAuth, Wikimedia-production-error, MediaWiki-Platform-Team

Jan 2 2024

dduvall added a comment to T353850: UniversalLanguageSelector compact links and @wikimedia/codex loads on page load.

Thanks for the update, @Jdlrobson. I'll roll group0.

Jan 2 2024, 7:30 PM · Unplanned-Sprint-Work, Localization Infrastructure FY2023-24, MW-1.42-notes (1.42.0-wmf.15; 2024-01-23), Language-Team (Language-2024-January-March), UniversalLanguageSelector
dduvall added a comment to T353850: UniversalLanguageSelector compact links and @wikimedia/codex loads on page load.

How shall we proceed with 1.42.0-wmf.12 train given the outstanding patch? Is this still a blocker?

Jan 2 2024, 6:40 PM · Unplanned-Sprint-Work, Localization Infrastructure FY2023-24, MW-1.42-notes (1.42.0-wmf.15; 2024-01-23), Language-Team (Language-2024-January-March), UniversalLanguageSelector
dduvall removed a parent task for T354193: Broken CPU on mw2394: T350088: 1.42.0-wmf.12 deployment blockers.
Jan 2 2024, 6:35 PM · SRE, serviceops, ops-codfw
dduvall removed a subtask for T350088: 1.42.0-wmf.12 deployment blockers: T354193: Broken CPU on mw2394.
Jan 2 2024, 6:35 PM · Release-Engineering-Team (Priority Backlog 📥), Release, Train Deployments
dduvall lowered the priority of T354193: Broken CPU on mw2394 from Unbreak Now! to Medium.
Jan 2 2024, 6:35 PM · SRE, serviceops, ops-codfw
dduvall added a comment to T354193: Broken CPU on mw2394.

Thanks, @Dzahn. After looking a bit more, I don't think the presence in scap_targets should affect train, so I'm deescalating this. Whether or not depooled hosts should still be present in scap_targets is up for debate.

Jan 2 2024, 6:35 PM · SRE, serviceops, ops-codfw
dduvall added a comment to T354193: Broken CPU on mw2394.

This is a blocker until the host is removed from /etc/dsh/group/scap_targets.

Jan 2 2024, 6:19 PM · SRE, serviceops, ops-codfw
dduvall triaged T354193: Broken CPU on mw2394 as Unbreak Now! priority.
Jan 2 2024, 6:18 PM · SRE, serviceops, ops-codfw
dduvall added a subtask for T350088: 1.42.0-wmf.12 deployment blockers: T354193: Broken CPU on mw2394.
Jan 2 2024, 6:18 PM · Release-Engineering-Team (Priority Backlog 📥), Release, Train Deployments
dduvall added a parent task for T354193: Broken CPU on mw2394: T350088: 1.42.0-wmf.12 deployment blockers.
Jan 2 2024, 6:18 PM · SRE, serviceops, ops-codfw

Dec 16 2023

thcipriani awarded T351329: Manually provision Zuul v9 services in devtools as Docker based systemd services a Barnstar token.
Dec 16 2023, 1:32 AM · Patch-For-Review, Release-Engineering-Team (Quid Pro Crow 🦃), GitLab (Misc)

Dec 13 2023

dduvall added a project to T353356: Experiment with WMCS as a k8s provider for gitlab-cloud-runner cluster: cloud-services-team.
Dec 13 2023, 5:43 PM · cloud-services-team (FY2023/2024-Q3-Q4), Goal, Release-Engineering-Team (Priority Backlog 📥)
dduvall created T353356: Experiment with WMCS as a k8s provider for gitlab-cloud-runner cluster.
Dec 13 2023, 5:42 PM · cloud-services-team (FY2023/2024-Q3-Q4), Goal, Release-Engineering-Team (Priority Backlog 📥)

Dec 12 2023

dduvall closed T351329: Manually provision Zuul v9 services in devtools as Docker based systemd services as Resolved.

Zuul is fully provisioned in devtools on zuul-1001.devtools.eqiad1.wikimedia.cloud. The Zuul services are currently run via systemd/docker.

Dec 12 2023, 10:40 PM · Patch-For-Review, Release-Engineering-Team (Quid Pro Crow 🦃), GitLab (Misc)
dduvall closed T351329: Manually provision Zuul v9 services in devtools as Docker based systemd services, a subtask of T350814: Puppetize Zuul v9, as Resolved.
Dec 12 2023, 10:40 PM · Release-Engineering-Team (Priority Backlog 📥), GitLab (Misc)

Nov 15 2023

dduvall changed the status of T351329: Manually provision Zuul v9 services in devtools as Docker based systemd services, a subtask of T350814: Puppetize Zuul v9, from Open to In Progress.
Nov 15 2023, 5:04 PM · Release-Engineering-Team (Priority Backlog 📥), GitLab (Misc)
dduvall changed the status of T351329: Manually provision Zuul v9 services in devtools as Docker based systemd services from Open to In Progress.
Nov 15 2023, 5:04 PM · Patch-For-Review, Release-Engineering-Team (Quid Pro Crow 🦃), GitLab (Misc)
dduvall created T351329: Manually provision Zuul v9 services in devtools as Docker based systemd services.
Nov 15 2023, 5:03 PM · Patch-For-Review, Release-Engineering-Team (Quid Pro Crow 🦃), GitLab (Misc)

Nov 8 2023

dduvall created T350814: Puppetize Zuul v9.
Nov 8 2023, 5:37 PM · Release-Engineering-Team (Priority Backlog 📥), GitLab (Misc)

Nov 3 2023

thcipriani awarded T350288: Experiment with Zuul to GitLab CI pipeline delegation a Love token.
Nov 3 2023, 10:54 PM · Release-Engineering-Team (Social Piranhas 🐟), GitLab (Misc)
dduvall added a comment to T350478: Investigate docker-gc.service failures on GitLab runners.

Still, we could refactor docker-gc to make a direct query to get usage info only for volumes and images, and whenever we upgrade Docker we'll start to benefit from omitting container filesystem usage calculations.

Nov 3 2023, 7:04 PM · collaboration-services
dduvall added a comment to T350478: Investigate docker-gc.service failures on GitLab runners.

It seems that it's the calculation of running container filesystem usage that is taking so long, and docker-gc doesn't really need that usage figure since it only cleans up volumes and images.

Nov 3 2023, 6:24 PM · collaboration-services

Nov 2 2023

dduvall closed T350288: Experiment with Zuul to GitLab CI pipeline delegation, a subtask of T349872: Investigate and document "Depends-On" in GitLab, as Resolved.
Nov 2 2023, 9:06 PM · Release-Engineering-Team (Priority Backlog 📥), GitLab (Misc)
dduvall closed T350288: Experiment with Zuul to GitLab CI pipeline delegation as Resolved.

I'd say this experiment was a success.

Nov 2 2023, 9:06 PM · Release-Engineering-Team (Social Piranhas 🐟), GitLab (Misc)

Nov 1 2023

Dzahn awarded T313956: Document scap3 deployment of Phabricator a Mountain of Wealth token.
Nov 1 2023, 7:39 PM · Release-Engineering-Team (Social Piranhas 🐟), Phabricator
dduvall moved T350288: Experiment with Zuul to GitLab CI pipeline delegation from Backlog to In progress on the Release-Engineering-Team (Social Piranhas 🐟) board.
Nov 1 2023, 4:56 PM · Release-Engineering-Team (Social Piranhas 🐟), GitLab (Misc)
dduvall changed the status of T350288: Experiment with Zuul to GitLab CI pipeline delegation, a subtask of T349872: Investigate and document "Depends-On" in GitLab, from Open to In Progress.
Nov 1 2023, 4:56 PM · Release-Engineering-Team (Priority Backlog 📥), GitLab (Misc)
dduvall changed the status of T350288: Experiment with Zuul to GitLab CI pipeline delegation from Open to In Progress.
Nov 1 2023, 4:56 PM · Release-Engineering-Team (Social Piranhas 🐟), GitLab (Misc)
dduvall updated the task description for T350288: Experiment with Zuul to GitLab CI pipeline delegation.
Nov 1 2023, 4:52 PM · Release-Engineering-Team (Social Piranhas 🐟), GitLab (Misc)
dduvall updated the task description for T350288: Experiment with Zuul to GitLab CI pipeline delegation.
Nov 1 2023, 4:48 PM · Release-Engineering-Team (Social Piranhas 🐟), GitLab (Misc)
dduvall created T350288: Experiment with Zuul to GitLab CI pipeline delegation.
Nov 1 2023, 4:48 PM · Release-Engineering-Team (Social Piranhas 🐟), GitLab (Misc)

Oct 30 2023

dduvall closed T349923: Create development environment for hacking on Zuul/GitLab, a subtask of T349872: Investigate and document "Depends-On" in GitLab, as Resolved.
Oct 30 2023, 8:52 PM · Release-Engineering-Team (Priority Backlog 📥), GitLab (Misc)
dduvall closed T349923: Create development environment for hacking on Zuul/GitLab as Resolved.

The development environment now includes a GitLab runner and is generally working.

Oct 30 2023, 8:52 PM · GitLab, Release-Engineering-Team (Social Piranhas 🐟)

Oct 27 2023

dduvall triaged T349923: Create development environment for hacking on Zuul/GitLab as Medium priority.
Oct 27 2023, 5:29 PM · GitLab, Release-Engineering-Team (Social Piranhas 🐟)
dduvall added a comment to T349923: Create development environment for hacking on Zuul/GitLab.

Created a new repo at https://gitlab.wikimedia.org/repos/releng/gitlab-dev for GitLab/Zuul hacking. It needs a GitLab runner which I'll work on today.

Oct 27 2023, 5:29 PM · GitLab, Release-Engineering-Team (Social Piranhas 🐟)
dduvall created T349923: Create development environment for hacking on Zuul/GitLab.
Oct 27 2023, 4:17 PM · GitLab, Release-Engineering-Team (Social Piranhas 🐟)

Oct 4 2023

dduvall added a project to T348181: TypeError: Argument 1 passed to Wikibase\Search\Elastic\CirrusShowSearchHitHandler::newFromGlobalState() must implement interface IContextSource, instance of MediaWiki\Config\GlobalVarConfig given, called in /srv/mediawiki/php-: CirrusSearch.
Oct 4 2023, 6:20 PM · Discovery-Search, CirrusSearch, Wikimedia-production-error
dduvall added a subtask for T347080: 1.41.0-wmf.29 deployment blockers: T348181: TypeError: Argument 1 passed to Wikibase\Search\Elastic\CirrusShowSearchHitHandler::newFromGlobalState() must implement interface IContextSource, instance of MediaWiki\Config\GlobalVarConfig given, called in /srv/mediawiki/php-.
Oct 4 2023, 6:19 PM · Patch-For-Review, Release-Engineering-Team (Priority Backlog 📥), Release, Train Deployments
dduvall added a parent task for T348181: TypeError: Argument 1 passed to Wikibase\Search\Elastic\CirrusShowSearchHitHandler::newFromGlobalState() must implement interface IContextSource, instance of MediaWiki\Config\GlobalVarConfig given, called in /srv/mediawiki/php-: T347080: 1.41.0-wmf.29 deployment blockers.
Oct 4 2023, 6:19 PM · Discovery-Search, CirrusSearch, Wikimedia-production-error
dduvall triaged T348181: TypeError: Argument 1 passed to Wikibase\Search\Elastic\CirrusShowSearchHitHandler::newFromGlobalState() must implement interface IContextSource, instance of MediaWiki\Config\GlobalVarConfig given, called in /srv/mediawiki/php- as Unbreak Now! priority.
Oct 4 2023, 6:17 PM · Discovery-Search, CirrusSearch, Wikimedia-production-error
dduvall created T348180: PHP Deprecated: Use of OutputPageParserOutput hook to mutate TOC was deprecated in MediaWiki 1.41. [Called from ApiParse::execute].
Oct 4 2023, 6:11 PM · Wikimedia-production-error

Sep 28 2023

dduvall created T347630: Store MediaWiki image refs in scap history.
Sep 28 2023, 8:25 PM · Release-Engineering-Team (Priority Backlog 📥), Scap
dduvall removed a subtask for T345889: 1.41.0-wmf.28 deployment blockers: T344359: CVE-2023-45369: pagetriagelist API leaks suppressed usernames.
Sep 28 2023, 6:24 PM · Patch-For-Review, Release-Engineering-Team (Priority Backlog 📥), Release, Train Deployments
dduvall removed a parent task for T344359: CVE-2023-45369: pagetriagelist API leaks suppressed usernames: T345889: 1.41.0-wmf.28 deployment blockers.
Sep 28 2023, 6:24 PM · Moderator-Tools-Team (Kanban), SecTeam-Processed, Vuln-Infoleak, PageTriage, Security, Security-Team
dduvall awarded T347522: Page difference title is not parsed any more. a Love token.
Sep 28 2023, 5:41 PM · MediaWiki-Page-diffs, Regression
dduvall added a comment to T347522: Page difference title is not parsed any more..

The issue only affects wikis that override MediaWiki:Difference-title, for example here on he.wp: https://he.wikipedia.org/w/index.php?title=מדיה_ויקי:Difference-title&action=edit

We need to see how common it is, and why it was done, and then either restore the ability to use HTML in that message, or propose an alternative solution. I'll have a look.

Sep 28 2023, 5:04 PM · MediaWiki-Page-diffs, Regression

Sep 15 2023

dduvall added a comment to T337570: Get GitLab to render `T{\d}+` in MR overviews, comments, etc. as links to Phabricator.

I've installed the gitlab-phorge gem on devtools by manually cloning the repo to /srv/gitlab-wmf-gems/gitlab-phorge and specifying the following project level hiera:

Sep 15 2023, 7:15 PM · Release-Engineering-Team (Now this 🫠), User-brennen, collaboration-services, Phabricator, GitLab (Integrations)

Sep 11 2023

dduvall added a comment to T346090: Blubber: Add workaround for Bookworm's Python pip restrictions.

From my review comment:

This seems like an OK solution for now, as I don't think the risk of breaking the distro's Python installation necessarily applies within a container filesystem.

Sep 11 2023, 9:47 PM · Release-Engineering-Team, Release Pipeline (Blubber)
dduvall awarded T345843: Transfer ownership of mediawiki_api to Asaf a Love token.
Sep 11 2023, 4:55 PM · Ruby, User-zeljkofilipin

Sep 5 2023

dduvall added a comment to T318289: Deprecate Blubber's CLI and microservice (blubberoid) interfaces.

Another way to attempt to break the cycle would be to implement a native LLB generation mode in Blubber in parallel with the Dockerfile generation mode. This would allow testing to see if T318866 is resolved by that change.

Sep 5 2023, 11:33 PM · Release-Engineering-Team (Priority Backlog 📥), Epic, Release Pipeline (Blubber)
dduvall closed T345458: Refactor Blubber's BuildKit frontend gateway to use LLB directly, a subtask of T318289: Deprecate Blubber's CLI and microservice (blubberoid) interfaces, as Resolved.
Sep 5 2023, 11:31 PM · Release-Engineering-Team (Priority Backlog 📥), Epic, Release Pipeline (Blubber)
dduvall closed T345458: Refactor Blubber's BuildKit frontend gateway to use LLB directly as Resolved.
Sep 5 2023, 11:31 PM · Release Pipeline (Blubber), Release-Engineering-Team (Priority Backlog 📥)
dduvall added a comment to T345458: Refactor Blubber's BuildKit frontend gateway to use LLB directly.

An experimental native-LLB build of Blubber's BuildKit frontend has been published as docker-registry.wikimedia.org/repos/releng/blubber/buildkit:experimental-native-llb.

Sep 5 2023, 11:31 PM · Release Pipeline (Blubber), Release-Engineering-Team (Priority Backlog 📥)
dduvall updated the task description for T318289: Deprecate Blubber's CLI and microservice (blubberoid) interfaces.
Sep 5 2023, 11:30 PM · Release-Engineering-Team (Priority Backlog 📥), Epic, Release Pipeline (Blubber)
dduvall updated the task description for T318289: Deprecate Blubber's CLI and microservice (blubberoid) interfaces.
Sep 5 2023, 11:30 PM · Release-Engineering-Team (Priority Backlog 📥), Epic, Release Pipeline (Blubber)

Sep 1 2023

dduvall added a comment to T345000: Create a separate memory optimized gitlab runner pool for memory hungry jobs.

Some testing from my side:

My pytest job ran successfully: https://gitlab.wikimedia.org/repos/data-engineering/dumps/mediawiki-content-dump/-/jobs/137133

My somewhat heavier publish_conda_env release job seems to have stalled though: https://gitlab.wikimedia.org/repos/data-engineering/dumps/mediawiki-content-dump/-/jobs/137134

It was already publishing the artifact at 11 minutes in, but then it got at warning, presumably from k8s?:

WARNING: Getting job pod status pods "runner-emdqpmey-project-1420-concurrent-02lhsm" is forbidden: User "system:serviceaccount:gitlab-runner:gitlab-runner-memopt" cannot get resource "pods" in API group "" in the namespace "gitlab-runner"

And even though these new pods have a timeout of 20m, the job is still running at 26m+ as of this comment, but seems stalled? This job typically takes ~10 minutes.

Sep 1 2023, 11:28 PM · Release-Engineering-Team (Priority Backlog 📥), GitLab (CI & Job Runners)
dduvall triaged T345458: Refactor Blubber's BuildKit frontend gateway to use LLB directly as Medium priority.
Sep 1 2023, 5:55 PM · Release Pipeline (Blubber), Release-Engineering-Team (Priority Backlog 📥)
dduvall added a parent task for T345458: Refactor Blubber's BuildKit frontend gateway to use LLB directly: T318289: Deprecate Blubber's CLI and microservice (blubberoid) interfaces.
Sep 1 2023, 5:54 PM · Release Pipeline (Blubber), Release-Engineering-Team (Priority Backlog 📥)
dduvall added a subtask for T318289: Deprecate Blubber's CLI and microservice (blubberoid) interfaces: T345458: Refactor Blubber's BuildKit frontend gateway to use LLB directly.
Sep 1 2023, 5:54 PM · Release-Engineering-Team (Priority Backlog 📥), Epic, Release Pipeline (Blubber)
dduvall created T345458: Refactor Blubber's BuildKit frontend gateway to use LLB directly.
Sep 1 2023, 5:54 PM · Release Pipeline (Blubber), Release-Engineering-Team (Priority Backlog 📥)
dduvall closed T318290: Refactor PipelineLib to use blubber's buildkit frontend, a subtask of T318289: Deprecate Blubber's CLI and microservice (blubberoid) interfaces, as Resolved.
Sep 1 2023, 5:05 PM · Release-Engineering-Team (Priority Backlog 📥), Epic, Release Pipeline (Blubber)
dduvall closed T318290: Refactor PipelineLib to use blubber's buildkit frontend as Resolved.
Sep 1 2023, 5:05 PM · Release-Engineering-Team (Priority Backlog 📥), Epic, Release Pipeline (Blubber)

Aug 30 2023

dduvall added a comment to T345178: Recommended way to get kokkuri to build multi-arch in series not parallel?.

Sure, e.g. https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-evaluator/-/jobs/137599 which has two whole runs of npm test in it, one on ARM64 and another on AMD64. Sometimes one fails but not the other, such as when the packaged python is very slightly different between arches, and it's very challenging even with grep to work out which is which.

Aug 30 2023, 8:49 PM · Release-Engineering-Team (Seen), GitLab (CI & Job Runners)

Aug 29 2023

dduvall added a comment to T345000: Create a separate memory optimized gitlab runner pool for memory hungry jobs.

@xcollazo alright, we should be good now. Test out the memory-optimized tag and let us know the results!

Aug 29 2023, 5:50 PM · Release-Engineering-Team (Priority Backlog 📥), GitLab (CI & Job Runners)
dduvall added a comment to T345000: Create a separate memory optimized gitlab runner pool for memory hungry jobs.

Scratch that. I just realized that I overlooked the node tolerations in the runner config. I'll have to do a follow up. Sorry.

Aug 29 2023, 5:31 PM · Release-Engineering-Team (Priority Backlog 📥), GitLab (CI & Job Runners)
dduvall added a comment to T345000: Create a separate memory optimized gitlab runner pool for memory hungry jobs.

@xcollazo the memory optimized runner pool has been deployed. You can schedule jobs to this pool by using the tag memory-optimized, either at the pipeline level under defaults or at the job level.

Aug 29 2023, 5:27 PM · Release-Engineering-Team (Priority Backlog 📥), GitLab (CI & Job Runners)

Aug 28 2023

dduvall closed T318382: Upgrade docker on integration hosts for fixes to BuildKit builder, a subtask of T318290: Refactor PipelineLib to use blubber's buildkit frontend, as Resolved.
Aug 28 2023, 5:23 PM · Release-Engineering-Team (Priority Backlog 📥), Epic, Release Pipeline (Blubber)
dduvall closed T318382: Upgrade docker on integration hosts for fixes to BuildKit builder as Resolved.

thanks, @MoritzMuehlenhoff ! Closed

Aug 28 2023, 5:23 PM · Patch-For-Review, Release-Engineering-Team (Priority Backlog 📥), Epic, Release Pipeline (Blubber)

Aug 25 2023

dduvall closed T343725: 1.41.0-wmf.23 deployment blockers as Resolved.
Aug 25 2023, 6:36 PM · Patch-For-Review, Release-Engineering-Team (Priority Backlog 📥), Release, Train Deployments
dduvall claimed T345000: Create a separate memory optimized gitlab runner pool for memory hungry jobs.
Aug 25 2023, 4:41 PM · Release-Engineering-Team (Priority Backlog 📥), GitLab (CI & Job Runners)
dduvall created T345000: Create a separate memory optimized gitlab runner pool for memory hungry jobs.
Aug 25 2023, 4:28 PM · Release-Engineering-Team (Priority Backlog 📥), GitLab (CI & Job Runners)

Aug 24 2023

dduvall added a comment to T318382: Upgrade docker on integration hosts for fixes to BuildKit builder.

Thanks, Moritz. Can we do the same for buster, pulling in the newer 20.10.18~3~debian-buster packages as well? I think using the same exact version on contint and integration agents is probably best.

gentle ping, @MoritzMuehlenhoff

Aug 24 2023, 8:36 PM · Patch-For-Review, Release-Engineering-Team (Priority Backlog 📥), Epic, Release Pipeline (Blubber)
dduvall closed T344874: Adopt gitlab-cloud-runner Digital Ocean based cluster as the default for untagged jobs as Resolved.
Aug 24 2023, 7:35 PM · collaboration-services, Release-Engineering-Team (Priority Backlog 📥)
dduvall added a comment to T344874: Adopt gitlab-cloud-runner Digital Ocean based cluster as the default for untagged jobs.

WMCS runners are no longer scheduling untagged jobs. Thanks for the review/merge, @Jelto !

Aug 24 2023, 7:35 PM · collaboration-services, Release-Engineering-Team (Priority Backlog 📥)
dduvall created T344951: Migrate to using new GitLab CI runner authentication scheme.
Aug 24 2023, 7:25 PM · Patch-For-Review, collaboration-services, Release-Engineering-Team (Priority Backlog 📥), GitLab (CI & Job Runners)