debian-glue jobs ignored error messages about libeatmydata.so in LD_PRELOAD
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	hashar
	Dec 11 2019, 10:04 AM

Description

See https://integration.wikimedia.org/ci/job/debian-glue/

The Debian glue job do spam a serie of:

Build output

enable_eatmydata
+ echo 'EXTRAPACKAGES="$EXTRAPACKAGES eatmydata"'
+ echo 'export LD_PRELOAD="${LD_PRELOAD:+$LD_PRELOAD:}libeatmydata.so"'
+ echo '# builtin support available with pbuilder >=0.225 (otherwise ignored):'
+ echo EATMYDATA=yes

…

ERROR: ld.so: object 'libeatmydata.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.

That happens early in the build since eatmydata is enabled before eatmydata extra package get installed. LD_PRELOAD should be set later.

Details

Related Changes in Gerrit:

Subject	Repo	Branch	Lines +/-
ci: always add eatmydata to cow images	operations/puppet	production	+61 -13
cloud - hieradata: add eatmydata to sid/bullseye	operations/puppet	production	+4 -0
R:pbuilder_base: add extra packages to updates as well	operations/puppet	production	+9 -0
package_builder: also inject extra packages on update	operations/puppet	production	+6 -3
cloud - hieradata: add extra_packages eatmydata to integrations package_builder	operations/puppet	production	+5 -0
P:ci::package_builder: update profile to pass through extra packages	operations/puppet	production	+8 -3
package_builder: add ability to inject extra packages	operations/puppet	production	+125 -47
package_builder: include eatmydata in base images	operations/puppet	production	+2 -0

Customize query in gerrit

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Resolved		hashar	T393847 Improve brevity of Jenkins console output
		Resolved		hashar	T240430 debian-glue jobs ignored error messages about libeatmydata.so in LD_PRELOAD

Event Timeline

hashar created this task.Dec 11 2019, 10:04 AM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptDec 11 2019, 10:04 AM

Triaging as low priority given the job has worked this way for years, so presumably the actual packages are fine and this is just noise? Tagging SRE for possible help if this warning is a nuisance and knows how to avoid it :)

thcipriani edited projects, added Release-Engineering-Team; removed Release-Engineering-Team-TODO, Release-Engineering-Team (CI & Testing services).Jan 12 2021, 5:19 PM

From other contexts, I *think* this needs to be fixed in Debian's own tooling. The impact is that eatmydata has no effect, except for producing warning messages. The real fix should be that apt can use eatmydata to speed things up.

I'm not sure we need to do anything about this.

thcipriani edited projects, added Release-Engineering-Team-TODO, Release-Engineering-Team (CI & Testing services); removed Release-Engineering-Team.Mar 2 2021, 5:38 PM

thcipriani moved this task from Should be empty (use Release-Engineering-Team) to Watching/External on the Release-Engineering-Team-TODO board.

That can be addressed by having the eatmydata package to be provided in the base cow builder images that we rely on. This way the package will be available very early in the process.

Change 676008 had a related patch set uploaded (by Hashar; author: Hashar):

[operations/puppet@production] package_builder: include eatmydata in base images

https://gerrit.wikimedia.org/r/676008

gerritbot added a project: Patch-For-Review.Mar 31 2021, 9:47 AM

hashar claimed this task.Mar 31 2021, 9:51 AM

hashar added a project: Technical-Debt.

Change 676035 had a related patch set uploaded (by Jbond; author: John Bond):

[operations/puppet@production] package_builder: add ability to inject extra packages

https://gerrit.wikimedia.org/r/676035

Change 676036 had a related patch set uploaded (by Jbond; author: John Bond):

[operations/puppet@production] P:ci::package_builder: update profile to pass through extra packages

https://gerrit.wikimedia.org/r/676036

Change 676037 had a related patch set uploaded (by Jbond; author: John Bond):

[operations/puppet@production] cloud - hieradata: add extra_packages eatmydata to integrations package_builder

https://gerrit.wikimedia.org/r/676037

Change 676008 abandoned by Hashar:

[operations/puppet@production] package_builder: include eatmydata in base images

Reason:

Largely extended by Jbond ! :]

https://gerrit.wikimedia.org/r/676008

Change 676035 merged by Jbond:

[operations/puppet@production] package_builder: add ability to inject extra packages

https://gerrit.wikimedia.org/r/676035

Change 676036 merged by Jbond:

[operations/puppet@production] P:ci::package_builder: update profile to pass through extra packages

https://gerrit.wikimedia.org/r/676036

Change 676037 merged by Jbond:

[operations/puppet@production] cloud - hieradata: add extra_packages eatmydata to integrations package_builder

https://gerrit.wikimedia.org/r/676037

Change 676127 had a related patch set uploaded (by Hashar; author: Hashar):

[operations/puppet@production] package_builder: also inject extra packages on update

https://gerrit.wikimedia.org/r/676127

thcipriani removed a project: Release-Engineering-Team (CI & Testing services).Apr 20 2021, 1:09 AM

thcipriani edited projects, added Release-Engineering-Team (Radar); removed Release-Engineering-Team-TODO.Apr 20 2021, 3:33 AM

thcipriani moved this task from Limbo to Watching/External on the Release-Engineering-Team (Radar) board.Apr 20 2021, 3:34 AM

Change 676133 had a related patch set uploaded (by Hashar; author: John Bond):

[operations/puppet@production] R:pbuilder_base: add extra packages to updates as well

https://gerrit.wikimedia.org/r/676133

Change 682962 had a related patch set uploaded (by Hashar; author: Hashar):

[operations/puppet@production] cloud - hieradata: add eatmydata to sid/bullseye

https://gerrit.wikimedia.org/r/682962

hashar edited projects, added Release-Engineering-Team (Doing); removed Release-Engineering-Team (Radar).Apr 27 2021, 2:56 PM

Change 676133 merged by Jbond:

[operations/puppet@production] R:pbuilder_base: add extra packages to updates as well

https://gerrit.wikimedia.org/r/676133

Change 682962 merged by Jbond:

[operations/puppet@production] cloud - hieradata: add eatmydata to sid/bullseye

https://gerrit.wikimedia.org/r/682962

I have confirmed that eatmydata is now included in all cowbuilder images. When jenkins debian glue invokes the build, it does try to include eatmydata and show it is already available:

00:00:27.213 eatmydata is already the newest version (105-9).

A test build no more show the annoying error! Thank you @jbond for the puppet refactoring and the quick reviews.

Change #1135966 had a related patch set uploaded (by Hashar; author: Hashar):

[operations/puppet@production] ci: add eatmydata to bookworm cow images

https://gerrit.wikimedia.org/r/1135966

hashar added a parent task: T393847: Improve brevity of Jenkins console output.Jun 10 2025, 9:31 AM

Change #1135966 merged by Arnaudb:

[operations/puppet@production] ci: always add eatmydata to cow images