GeoIP2-Country.mmdb" file
Open, Needs TriagePublic
Actions

Assigned To

Authored By

	Dreamy_Jazz
	Dec 18 2025, 4:27 PM

Description

Summary

The Beta Cluster logstash has ~441 logs in the last 24 hours for a missing /usr/share/GeoIP/GeoIP2-Country.mmdb file

Background

It seems that the Beta Cluster has logs indicating the /usr/share/GeoIP/GeoIP2-Country.mmdb file is missing, specifically being:

The file "/usr/share/GeoIP/GeoIP2-Country.mmdb" does not exist or is not readable.

The logs do not contain any more context than this, other than they are on the WikimediaEvents channel

Acceptance criteria

The issue causing these logs is solved so they no longer appear in the Beta Cluster logstash

Details

Other Assignee: Tchanders

Related Changes in Gerrit:

	Subject	Repo	Branch	Lines +/-
	Disable GeoIP2 lookups from WikimediaEvents on beta	operations/mediawiki-config	master	+5 -0

Customize query in gerrit

Related Objects

Mentioned Here: T403105: Remove need for manually applied MaxMind data hacks on Beta Cluster cache servers

Event Timeline

Dreamy_Jazz created this task.Dec 18 2025, 4:27 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptDec 18 2025, 4:27 PM

Dreamy_Jazz moved this task from Backlog to Ready on the Product Safety and Integrity (Essential Work Sprint (Dec 15th - Jan 9th)) board.Dec 18 2025, 4:44 PM

(Codesearch appears to confirm the WikimediaEvents connection, hence tagging. Perhaps Beta should set $wgWMEGeoIP2Path = null;? Or perhaps the file should be available, I don’t know.)

Dreamy_Jazz renamed this task from Beta cluster logstash has reports missing "/usr/share/GeoIP/GeoIP2-Country.mmdb" file to Beta cluster logstash reports missing "/usr/share/GeoIP/GeoIP2-Country.mmdb" file.Dec 19 2025, 3:45 PM

See also T403105: Remove need for manually applied MaxMind data hacks on Beta Cluster cache servers; seems potentially somewhat related?

Change #1220635 had a related patch set uploaded (by STran; author: STran):

[operations/mediawiki-config@master] Disable GeoIP2 lookups from WikimediaEvents on beta

https://gerrit.wikimedia.org/r/1220635

gerritbot added a project: Patch-For-Review.Dec 23 2025, 2:15 PM

Perhaps Beta should set $wgWMEGeoIP2Path = null;? Or perhaps the file should be available, I don’t know.

I've pushed up a config patch to reflect the current reality, which is that the database doesn't exist on Beta atm. Getting that database onto Beta might be a longer task and if/when it gets done, this config can be reverted.

STran claimed this task.Dec 23 2025, 2:24 PM

STran moved this task from Ready to Needs review on the Product Safety and Integrity (Essential Work Sprint (Dec 15th - Jan 9th)) board.

Change #1220635 merged by jenkins-bot:

[operations/mediawiki-config@master] Disable GeoIP2 lookups from WikimediaEvents on beta

https://gerrit.wikimedia.org/r/1220635

Maintenance_bot removed a project: Patch-For-Review.Jan 5 2026, 2:31 PM

Keeping this in progress so I can monitor logs for a bit before confirming this resolved the issue.

Tchanders updated Other Assignee, added: Tchanders.Jan 8 2026, 12:52 PM

This doesn't appear to have fixed the issue. Not sure it's worth moving to the next sprint

Dreamy_Jazz moved this task from Inbox to Next sprint on the Product Safety and Integrity board.Tue, Jan 20, 1:05 PM

Beta cluster logstash reports missing "/usr/share/GeoIP/GeoIP2-Country.mmdb" fileOpen, Needs TriagePublicActions