Goal
For IP Info to be working on beta cluster it needs access to the IP data files. This task is to ensure the files are accessible on beta.
Also update the $wgIPInfoGeoIP2Path config to point to the files.
Description
Description
Details
Details
| Subject | Repo | Branch | Lines +/- | |
|---|---|---|---|---|
| Add IPInfo extension config to InitialiseSettings-labs.php | operations/mediawiki-config | master | +14 -0 |
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Open | None | T285977 IP Info | |||
| Declined | Tchanders | T268294 Ensure the necessary data files are present and accessible on beta for IP Info to function |
Event Timeline
Comment Actions
The GeoLite2 files are available for the Beta Cluster, located in /user/share/GeoIP in deployment-deploy01.deployment-prep.eqiad1.wikimedia.cloud
I'd assume the full MaxMind files are not there due to licensing reasons.
Only the GeoLite2-City.mmdb and GeoLite2-Country.mmdb are there (GeoLite2-ASN.mmdb isn't present). They were added in 2018.
@CDanis Do you know if I'd be allowed to replace these files with the (perhaps) more up-to-date GeoLite2 files that we've been using in our local tests (https://dev.maxmind.com/geoip/geoip2/geolite2/) or at least add the ASN file?
Comment Actions
Change 644550 had a related patch set uploaded (by Tchanders; owner: Tchanders):
[operations/mediawiki-config@master] Add IPInfo extension config to InitialiseSettings-labs.php
Comment Actions
The GeoLite2 files are available for the Beta Cluster, located in /user/share/GeoIP in deployment-deploy01.deployment-prep.eqiad1.wikimedia.cloud
I'd assume the full MaxMind files are not there due to licensing reasons.
@Niharika This means that we'll only be able to show the data that relates to the city, country and perhaps ASN (if we're able to add that file) on Beta.
Comment Actions
@Tchanders Do you think there's a possibility we can get the complete files added there? I imagine Alex could follow up with Legal and see if they would allow that.
Comment Actions
Tagging @BBlack in the hopes he knows anything offhand about shipping new GeoLite2 or full GeoIP2 files to Beta Cluster
Comment Actions
Change 644550 merged by jenkins-bot:
[operations/mediawiki-config@master] Add IPInfo extension config to InitialiseSettings-labs.php
Comment Actions
@Tchanders / @ARamirez_WMF: Hi, the Due Date set for this open task was a while ago.
Can you please either update or reset the Due Date (by clicking ), or set the status of this task to resolved in case this task is done? Thanks.
Comment Actions
@Aklapper I reset the due date. This task was blocked and we forgot to update the due date.
Comment Actions
It's not clear to me if the MaxMind database files that are on the Beta Cluster were downloaded manually or were deployed via a Puppet module (maybe an outdated one?) but they haven't been updated since 2018:
phuedx@deployment-deploy01:~$ ls -l /usr/share/GeoIP/ total 62808 lrwxrwxrwx 1 root root 18 Oct 22 2018 GeoIP2-City.mmdb -> GeoLite2-City.mmdb lrwxrwxrwx 1 root root 21 Oct 22 2018 GeoIP2-Country.mmdb -> GeoLite2-Country.mmdb lrwxrwxrwx 1 root root 15 Oct 22 2018 GeoIPCity.dat -> GeoLiteCity.dat lrwxrwxrwx 1 root root 18 Oct 22 2018 GeoIP.dat -> GeoLiteCountry.dat -rw-r--r-- 1 root root 38297006 Oct 22 2018 GeoLite2-City.mmdb -rw-r--r-- 1 root root 2079637 Oct 22 2018 GeoLite2-Country.mmdb -rw-r--r-- 1 root root 3993422 Oct 22 2018 GeoLiteASNum.dat -rw-r--r-- 1 root root 19126858 Oct 22 2018 GeoLiteCity.dat -rw-r--r-- 1 root root 810094 Oct 22 2018 GeoLiteCountry.dat
AFAICT it's possible to get the Beta Cluster in a production-like state using the puppetmaster::geoip class with $fetch_private = false (see T288844#7376939) – @Dzahn: Have I understood this correctly? However, I'm not sure whose responsibility it is to make that change.