Page MenuHomePhabricator

buildkit v0.21.1 released
Closed, ResolvedPublic

Description

Notable changes back to v0.20.0:

v0.21.1:
Builtin Dockerfile frontend has been updated to v1.15.1.
Fix buildctl --tlsdir for non-cert-manager.io tls certificate naming. #5950
Fix panic when null cache options were sent using solve grpc API. #5925

v0.21.0:
Builtin Dockerfile frontend has been updated to v1.15.0. changelog
Runc container runtime has been updated to v1.2.6. #5845
The cache manifest created by --cache-to now defaults to OCI artifact manifest (instead of OCI image index). For old behavior, set image-manifest=false. #5864
The cache timeout for registry credentials has been reduced from 10 min to 5 min. #5859
Buildctl --tlsdir option now allows filenames compatible with cert-manager.io. #5886
Update free-space filter GC/prune filter to not remove all data when no max-space value is set. #5827
Mitigate GitHub Actions cache v2 flakiness. #5805
Add autoallow and entitlements support to CDI devices. #5742
Support authentication in LLB for Git and HTTP. #5733
Support for adding additional request header fields for HTTP sources. #5732
OpenTelemetry traces now contain spans for layer extraction. #5831
containerd image exporter creates dangling images by default. #5858
Add support for bind and cache mounts for WCOW. #5708
Add session exporter capability. #5907 #5908
Add metadata-only transfer option for local source. #5897
Fix X mode to be Linux-compatible for file operations using chmod. #5850
Fix --chmod when applied to parent directories. #5788
Fix missing user-agent when buildkit requests layers from the registry. #5834
Fix missing user-agent for GitHub Actions importer. #5759 #5760
Fix reading secrets from any session on parallel build requests. #5833
Fix race condition causing "file used by another process" errors with WCOW. #5885

v0.20.2:
Fix possible UID overflow when setting user for container #5844 GHSA-265r-hfxg-fhmg
update RootlessKit to v2.3.4 #5825

v0.20.1:
Builtin Dockerfile frontend has been updated to v1.14.1
Fix panic during CDI manager initialization. #5769 cncf-tags/container-device-interface#254
Fix gRPC message size when writing SBOMs. #5798 containerd/containerd#11457
Fix possible panic with libc-bin emulation in QEMU v9.2.0. #5808
Update azblob client retries for GitHub Actions cache backend. #5797 tonistiigi/go-actions-cache#33

Upgrade areas:

  • gitlab-cloud-runners
  • WMCS and Trusted runners
  • buildctl referenced by kokkuri

Details

Related Changes in Gerrit:
Related Changes in GitLab:
TitleReferenceAuthorSource BranchDest Branch
blubber.yaml: Use buildkit:wmf-v0.21.1repos/releng/kokkuri!122dancymain-I3026c19f64df04bdb26d11c368324396b94aa113main
Chart.yaml 1.6.2: Bump addVersion to v1.15.0repos/releng/reggie!99dancymain-I45554b7faa554c4d23a87f30ebf0ead17817c7ecmain
Add support for application/vnd.oci.image.manifest.v1+jsonrepos/releng/reggie!98dancymain-Ib4576a8c4d16c05237cf557e59b5445a0bae8438main
staging.tfvars: Bump buildkitd_tag to wmf-v0.21.1repos/releng/gitlab-cloud-runner!469dancymain-I64bb7a8fb58d9214764ce574316c41fb7137c7c1main
Customize query in GitLab

Event Timeline

dancy triaged this task as Low priority.

Change #1143671 had a related patch set uploaded (by Ahmon Dancy; author: Ahmon Dancy):

[operations/puppet@production] Use buildkit wmf-v0.21.1 on WMCS and trusted runners

https://gerrit.wikimedia.org/r/1143671

Change #1143671 merged by Jelto:

[operations/puppet@production] Use buildkit wmf-v0.21.1 on WMCS and trusted runners

https://gerrit.wikimedia.org/r/1143671

dancy updated the task description. (Show Details)

Since the buildkit 0.21.1 upgrade there have been some cases where buildkit's storage directory has been filling up.

Examples:

This is new behavior. Hopefully the next version of buildkit (T394931) will address this but in the meantime you can use the following to free up space on the buildkit volumes:

for n in $(seq 0 2); do kubectl -n gitlab-runner exec buildkitd-$n -- buildctl --addr localhost:1234 prune; done

This assumes that your kubectl config is pointing to the gitlab-cloud-runner cluster.

Since the buildkit 0.21.1 upgrade there have been some cases where buildkit's storage directory has been filling up.

For the record, I don't know that buildkit 0.21.1 is the cause. It could also be an unrelated uptick in buildkitd's workload.

The buildkitd volume issue is moved to T395097.

T393856 is a new problem since deploying buildkit 0.21.1.