Page MenuHomePhabricator
Create Task
Maniphest T438366

Run GrowthExperiments:revalidateLinkRecommendations.php on all Wikimedia wikis
Open, MediumPublic
Actions

Description

Following the deployment of T429417: Add Link should not make a recommendation if one has already been accepted or declined (Limit an article to only one Add a Link suggestion), we should run GrowthExperiments:revalidateLinkRecommendations.php on all Wikimedia wikis. This would actually drop the recommendations that task aims to exclude, completing that effort.

This script is expected to take a significant time, requiring an engineer to babysit it every now and then. See T437158 for a prior example.

Related Objects
Search...

Event Timeline

Urbanecm_WMF created this task.Thu, Sep 17, 2:52 PM
Restricted Application added a project: Growth-Team. · View Herald TranscriptThu, Sep 17, 2:52 PM
Restricted Application added a subscriber: Aklapper. · View Herald Transcript
Urbanecm_WMF triaged this task as Medium priority.Thu, Sep 17, 2:53 PM
Urbanecm_WMF moved this task from Inbox to Blocked on the Growth-Team board.

Not actionable until T429417: Add Link should not make a recommendation if one has already been accepted or declined (Limit an article to only one Add a Link suggestion) is deployed, but I believe we should pull it in next sprint. It should be a formality :).

Urbanecm_WMF added a parent task: T429417: Add Link should not make a recommendation if one has already been accepted or declined (Limit an article to only one Add a Link suggestion).Thu, Sep 17, 2:53 PM
Urbanecm_WMF mentioned this in T438935: Clean up rejected link target exclusion.Wed, Sep 23, 7:22 AM
Urbanecm_WMF added a comment.Fri, Sep 25, 11:38 AM

Revalidating everything 1790175600 and older should do the trick (matches Wed Sep 23 2026 15:00:00 GMT+0000). Deployed happened at 14:37, so anything 15:00 and older should be revalidated.

Stashbot added a comment.Fri, Sep 25, 11:40 AM

Mentioned in SAL (#wikimedia-operations) [2026-09-25T11:40:47Z] <urbanecm@deploy1003> mwscript-k8s job started: foreachwikiindblist growthexperiments GrowthExperiments:revalidateLinkRecommendations.php --olderThan=1790175600 --verbose # T438366

Urbanecm_WMF added a comment.Fri, Sep 25, 11:42 AM

This is now running.

Urbanecm_WMF added a comment.Fri, Sep 25, 11:48 AM

How to access logs (for deployers):

[urbanecm@deploy1003 ~]$ kube_env mw-script eqiad
[urbanecm@deploy1003 ~]$ kubectl get jobs -l username=urbanecm -L script
NAME                       STATUS     COMPLETIONS   DURATION   AGE     SCRIPT
mw-script.eqiad.52qeefz7   Failed     0/1           4d         4d      moveTranslatableBundle.php
mw-script.eqiad.5rrhbbwd   Complete   1/1           11d        16d     revalidateLinkRecommendations.php
mw-script.eqiad.mt26yren   Running    0/1           6m56s      6m56s   revalidateLinkRecommendations.php
mw-script.eqiad.mu0x4w6y   Complete   1/1           93s        4d      moveTranslatableBundle.php
[urbanecm@deploy1003 ~]$ kubectl logs --tail=20 -f jobs/mw-script.eqiad.mt26yren
Defaulted container "mediawiki-mt26yren-app" out of: mediawiki-mt26yren-app, mediawiki-mt26yren-tls-proxy, mediawiki-mt26yren-rsyslog
afwiki   1984 is outdated, regenerating... success
afwiki   1985 is outdated, regenerating... success
afwiki   1986 is outdated, regenerating... success
afwiki   1987 is outdated, regenerating... success
afwiki   1988 is outdated, regenerating... success
afwiki   1990 is outdated, regenerating... success
afwiki   1991 is outdated, regenerating... success
afwiki   1994 is outdated, regenerating... success
afwiki   1995 is outdated, regenerating... success
afwiki   1996 is outdated, regenerating... success
afwiki   1997 is outdated, regenerating... success
afwiki   1952 is outdated, regenerating... success
afwiki   1951 is outdated, regenerating... success
afwiki   1950 is outdated, regenerating... success
afwiki   1949 is outdated, regenerating... success
afwiki   1947 is outdated, regenerating... success
afwiki   1946 is outdated, regenerating... success
afwiki   25 April is outdated, regenerating... success
afwiki   1945 is outdated, regenerating... success
afwiki   1944 is outdated, regenerating... success
afwiki   1943 is outdated, regenerating... success
afwiki   2002 is outdated, regenerating... success
^C
[urbanecm@deploy1003 ~]$
Urbanecm_WMF added a comment.Tue, Sep 29, 9:43 PM

The script is still here:

[urbanecm@deploy1003 ~]$ kubectl logs --tail=10 -f jobs/mw-script.eqiad.mt26yren
Defaulted container "mediawiki-mt26yren-app" out of: mediawiki-mt26yren-app, mediawiki-mt26yren-tls-proxy, mediawiki-mt26yren-rsyslog
cawiki   Spider-Man (pel·lícula) is outdated, regenerating... success
cawiki   NGC 147 is outdated, regenerating... success
cawiki   Slutsk is outdated, regenerating... success
cawiki   Sachsenspiegel is outdated, regenerating... success
cawiki   Estany de Mas Mateu is outdated, regenerating... success
cawiki   Estany de Bancells is outdated, regenerating... success
cawiki   Partida de la Porra is outdated, regenerating... success
cawiki   Trágala is outdated, regenerating... success
cawiki   Jardins del Buen Retiro is outdated, regenerating... success
cawiki   Toll de l'Alemany is outdated, regenerating... success
cawiki   Bassa de la Refoia is outdated, regenerating... success
cawiki   Castell de Secabecs is outdated, regenerating... success
cawiki   Torres Altes de Foix is outdated, regenerating... success
cawiki   Torre de Can Pepó is outdated, regenerating... success
cawiki   Vila Maria is outdated, regenerating... success
cawiki   Can Solé de Secabecs is outdated, regenerating... success
cawiki   Les Dous is outdated, regenerating... success
cawiki   Cal Tonquet is outdated, regenerating... success
cawiki   Molí dels Bessons is outdated, regenerating... success
^C
[urbanecm@deploy1003 ~]$
Urbanecm_WMF mentioned this in T429417: Add Link should not make a recommendation if one has already been accepted or declined (Limit an article to only one Add a Link suggestion).Mon, Oct 5, 12:49 PM

Script is still running:

[urbanecm@deploy1003 ~]$ kubectl logs --tail=10 -f jobs/mw-script.eqiad.mt26yren
Defaulted container "mediawiki-mt26yren-app" out of: mediawiki-mt26yren-app, mediawiki-mt26yren-tls-proxy, mediawiki-mt26yren-rsyslog
dewiki   Sasha Mitchell is outdated, regenerating... success
dewiki   Meeresstille und glückliche Fahrt (Beethoven) is outdated, regenerating... success
dewiki   Fliegenfänger is outdated, regenerating... success
dewiki   Ihringshausen is outdated, regenerating... success
dewiki   Wirtschaftsuniversität Prag is outdated, regenerating... success
dewiki   Herrenreiter-Fall is outdated, regenerating... success
dewiki   Eishockey in Geretsried is outdated, regenerating... success
dewiki   Wilhelm Knittel is outdated, regenerating... success
dewiki   Verteidigungsetat is outdated, regenerating... success
dewiki   Walter Raizner is outdated, regenerating... success
dewiki   Oderberger Straße is outdated, regenerating... success
dewiki   Giuseppe Merosi is outdated, regenerating... success
dewiki   Chlorcholinchlorid is outdated, regenerating... success
dewiki   Daewoo Tico is outdated, regenerating... success
dewiki   Wiesen-Schachtelhalm is outdated, regenerating... success
^C
[urbanecm@deploy1003 ~]$
Urbanecm_WMF added a comment.Thu, Oct 8, 8:47 PM

Still running:

[urbanecm@deploy1003 ~]$ kubectl logs --tail=20 -f jobs/mw-script.eqiad.mt26yren
Defaulted container "mediawiki-mt26yren-app" out of: mediawiki-mt26yren-app, mediawiki-mt26yren-tls-proxy, mediawiki-mt26yren-rsyslog
dewiki   Adolf Rohde is outdated, regenerating... success
dewiki   Jens Martin Gurr is outdated, regenerating... success
dewiki   Edir Macedo is outdated, regenerating... success
dewiki   Alte Krankenhäuser Altona is outdated, regenerating... success
dewiki   Thomas Fuchs (Mediziner) is outdated, regenerating... success
dewiki   Karl Stark (Künstler) is outdated, regenerating... success
dewiki   Le jardinier françois is outdated, regenerating... success
dewiki   Partido Social de Unidad Nacional is outdated, regenerating... success
dewiki   Silicon Labs is outdated, regenerating... has a prior submission already
dewiki   Bahnstrecke Burlington–Rouses Point is outdated, regenerating... success
dewiki   Liste der Bischöfe von Cefalù is outdated, regenerating... success
dewiki   Marcel De Grève is outdated, regenerating... success
dewiki   Großer Preis von Spanien 1973 is outdated, regenerating... success
dewiki   Flüsternde Schatten is outdated, regenerating... success
dewiki   Kastell Vețel is outdated, regenerating... success
dewiki   Claude Perron is outdated, regenerating... success
dewiki   Georg von der Decken (General) is outdated, regenerating... success
dewiki   Jacek Koman is outdated, regenerating... success
dewiki   Marianne Schmid Mast is outdated, regenerating... success
dewiki   Vincent Lunin is outdated, regenerating... success
dewiki   Mannschaftskader der deutschen Schachbundesliga 1999/2000 is outdated, regenerating... number of good links too small (1)
dewiki   Jennifer Holliday is outdated, regenerating... success
^C
[urbanecm@deploy1003 ~]$
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits