Do we have the excluded section data for all these wikis?

We don't; at least those following wikis do not produce any results:

urbanecm@wmf3345 Downloads % grep dagwiki wiki_sections.jsonl.txt
urbanecm@wmf3345 Downloads % grep madwiki wiki_sections.jsonl.txt
urbanecm@wmf3345 Downloads % grep altwiki wiki_sections.jsonl.txt

@Trizek-WMF - for these small wikis where we don't have excluded section data, do you think we can still release (since they have the ability to set this up via Community Configuration)?
Does the Edit Tag help doc make it clear how to adjust the associated Community Configuration?

In T410469#11421674, @KStoller-WMF wrote:

@Trizek-WMF - for these small wikis where we don't have excluded section data, do you think we can still release (since they have the ability to set this up via Community Configuration)?
Does the Edit Tag help doc make it clear how to adjust the associated Community Configuration?

Let's populate the excluded section whenever we can. For others, I'll leave my contact if they need any assistance.

In T410469#11420296, @Urbanecm_WMF wrote:

Do we have the excluded section data for all these wikis?

We don't; at least those following wikis do not produce any results:

urbanecm@wmf3345 Downloads % grep dagwiki wiki_sections.jsonl.txt
urbanecm@wmf3345 Downloads % grep madwiki wiki_sections.jsonl.txt
urbanecm@wmf3345 Downloads % grep altwiki wiki_sections.jsonl.txt

Is this the full list, or an sample of potentially more?

@Trizek-WMF No, only a sample (I was spot-checking the list for wikis I remember creating as an indication of "possibly recent enough to not be in the list"). I can create the full list and post it here.

In T410469#11428719, @Urbanecm_WMF wrote:

I can create the full list and post it here.

I could use a ratio of the wikis that wouldn't get excluded sections compared to the total to shape my communication. :)

urbanecm@wmf3345 Downloads % while read wiki; do
grep -F "$wiki" wiki_sections.jsonl.txt > /dev/null
echo -e "$wiki\t$?"
done < wikis.txt | grep -F 0
lldwiki	0
awawiki	0
wuuwiki	0
mywiki	0
smnwiki	0
diqwiki	0
shnwiki	0
mniwiki	0
fywiki	0
bowiki	0
skrwiki	0
tiwiki	0
dvwiki	0
mnwwiki	0
krcwiki	0
dtywiki	0
ganwiki	0
hywwiki	0
urbanecm@wmf3345 Downloads %

@Trizek-WMF This is the complete list. We have 33 wikis in the list in total, 18 of them do not have excluded sections, so about 54.5%.

In T410469#11428797, @Urbanecm_WMF wrote:

@Trizek-WMF This is the complete list. We have 33 wikis in the list in total, 18 of them do not have excluded sections, so about 54.5%.

Thank you. I randomly sampled some of them. I saw some differences regarding the number of articles available, so I'll re-check all of them and populate the configuration manually.

Can we make the task available but disabled, the same way we proceed with ja, ur and zh, please?

Change #1214568 had a related patch set uploaded (by Urbanecm; author: Urbanecm):

[operations/mediawiki-config@master] [Growth] Enable Add Link backend on a handful of wikis

https://gerrit.wikimedia.org/r/1214568

In T410469#11429106, @Trizek-WMF wrote:

Can we make the task available but disabled, the same way we proceed with ja, ur and zh, please?

Sure!

Cool, thanks. I'll work on this tomorrow.

Change #1214570 had a related patch set uploaded (by Urbanecm; author: Urbanecm):

[operations/mediawiki-config@master] [Growth] Enable Add Link backend on a handful of wikis

https://gerrit.wikimedia.org/r/1214570

Change #1214571 had a related patch set uploaded (by Urbanecm; author: Urbanecm):

[operations/mediawiki-config@master] [Growth] Sort the list of Add Link wikis alphabetically

https://gerrit.wikimedia.org/r/1214571

Change #1214568 abandoned by Urbanecm:

[operations/mediawiki-config@master] [Growth] Enable Add Link backend on a handful of wikis

https://gerrit.wikimedia.org/r/1214568

@Urbanecm_WMF lease let me know when it is ready so that I can manually populate the wikis.

I'm out until Tuesday though. Can we start the activation to end users on Wednesday evening?

In T410469#11433267, @Trizek-WMF wrote:

@Urbanecm_WMF lease let me know when it is ready so that I can manually populate the wikis.

I'm out until Tuesday though. Can we start the activation to end users on Wednesday evening?

Depends on when the config will be populated. The suggestions will need some time to revalidate (approximately 12 hours). So, if you will fill the config during Wednesday, I can start the process on Wednesday evening and deploy it on Thursday morning.

Problem: Several of the wikis listed in the A/Cs don't currently have GrowthExperiments enabled, as they are relatively new. How should we handle this situation? Should I also enable GrowthExperiments on those wikis? Or just leave those wikis be? It affects those wikis:

guwwiki
pcmwiki
gucwiki
kcgwiki
blkwiki
gurwiki

awawiki is having some troubles (@Urbanecm_WMF to investigate):

[urbanecm@deploy2002 ~]$ export WIKI=awawiki
[urbanecm@deploy2002 ~]$ jq "select(.wiki==\"$WIKI\" and .probability > 0.25) | .section" wiki_sections.jsonl | jq --slurp --compact-output "unique" | mwscript-k8s -f -- CommunityConfiguration:ChangeWikiConfig --wiki=$WIKI --summary='machine-generated configuration for excluding sections from link recommendations ([[phab:$PHAB]]), feel free to improve' GrowthSuggestedEdits link_recommendation.excludedSections $(cat)
⏳ Starting CommunityConfiguration:ChangeWikiConfig on Kubernetes as job mw-script.codfw.ziwh1hwz ...
🚀 Job is running.
📜 Streaming logs:
`["इन्हें` is not valid JSON: कंट्रोल कैरेक्टर त्रुटि, सम्भतः अशुद्ध रूप से एनकोड किया गया है
[urbanecm@deploy2002 ~]$ jq "select(.wiki==\"$WIKI\" and .probability > 0.25) | .section" wiki_sections.jsonl | jq --slurp --compact-output "unique"
["इन्हें भी देखें","टिप्पणी","बाहरी कड़ियाँ","संदर्भ","सन्दर्भ"]
[urbanecm@deploy2002 ~]$

In T410469#11433346, @Urbanecm_WMF wrote:

Problem: Several of the wikis listed in the A/Cs don't currently have GrowthExperiments enabled, as they are relatively new. How should we handle this situation? Should I also enable GrowthExperiments on those wikis? Or just leave those wikis be? It affects those wikis:

guwwiki
pcmwiki
gucwiki
kcgwiki
blkwiki
gurwiki

Thanks for catching this. I've updated the task:

The following wikis are removed from this task's acceptance criteria, because they do not currently have GrowthExperiments enabled:

guwwiki
gucwiki
kcgwiki
blkwiki
gurwiki
pcmwiki
The work to enable GrowthExperiemnts and "Add a Link" will be covered in follow-up tasks: T411801: Enable GrowthExperiments on 5 newer wikis (guw, guc, kcg, blk, gur) & T409480: Enable GrowthExperiments on a new wiki and document the process

In T410469#11433357, @Urbanecm_WMF wrote:

awawiki is having some troubles (@Urbanecm_WMF to investigate)

No, this is just me being silly... The $(cat) bit should've been wrapped in quotes, otherwise it is leaving a part of the JSON out, which is of course not valid... (T410457: Simplify Add Link deployment process is a very important task for deployments like this, as I just spent almost an hour trying to find the problem...)

Change #1214570 merged by jenkins-bot:

[operations/mediawiki-config@master] [Growth] Enable Add Link backend on a handful of wikis

https://gerrit.wikimedia.org/r/1214570

Change #1214571 merged by jenkins-bot:

[operations/mediawiki-config@master] [Growth] Sort the list of Add Link wikis alphabetically

https://gerrit.wikimedia.org/r/1214571

Mentioned in SAL (#wikimedia-operations) [2025-12-08T09:04:25Z] <urbanecm@deploy2002> Started scap sync-world: Backport for [[gerrit:1214570|[Growth] Enable Add Link backend on a handful of wikis (T410469)]], [[gerrit:1214571|[Growth] Sort the list of Add Link wikis alphabetically (T410469)]]

Mentioned in SAL (#wikimedia-operations) [2025-12-08T09:06:26Z] <urbanecm@deploy2002> urbanecm: Backport for [[gerrit:1214570|[Growth] Enable Add Link backend on a handful of wikis (T410469)]], [[gerrit:1214571|[Growth] Sort the list of Add Link wikis alphabetically (T410469)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

@Trizek-WMF Add a link should be ready to be configured via CC.

Mentioned in SAL (#wikimedia-operations) [2025-12-08T09:14:26Z] <urbanecm@deploy2002> Finished scap sync-world: Backport for [[gerrit:1214570|[Growth] Enable Add Link backend on a handful of wikis (T410469)]], [[gerrit:1214571|[Growth] Sort the list of Add Link wikis alphabetically (T410469)]] (duration: 10m 01s)

Pending @Trizek-WMF's go-ahead.

I accidentally posted the wrong list of wikis on the task before. This is the actual list of wikis without excluded sections:

urbanecm@wmf3345 Downloads % while read wiki; do
while> grep -F "$wiki" wiki_sections.jsonl.txt > /dev/null
while> echo -e "$wiki\t$?"
while> done < wikis.txt | grep -F 1
dagwiki	1
altwiki	1
taywiki	1
madwiki	1
pwnwiki	1
szywiki	1
shiwiki	1
avkwiki	1
niawiki	1
urbanecm@wmf3345 Downloads %

In T410469#11446489, @Urbanecm_WMF wrote:

I accidentally posted the wrong list of wikis on the task before. This is the actual list of wikis without excluded sections

I'm checking all wikis, with or without excluded sections, as I found several missing sections on the "included" list as well. :)

Change #1217575 had a related patch set uploaded (by Urbanecm; author: Urbanecm):

[operations/mediawiki-config@master] [Growth] Enable Add Link backend on a handful of wikis

https://gerrit.wikimedia.org/r/1217575

Change #1217575 merged by jenkins-bot:

[operations/mediawiki-config@master] [Growth] Enable Add Link backend on a handful of wikis

https://gerrit.wikimedia.org/r/1217575

Mentioned in SAL (#wikimedia-operations) [2025-12-11T19:37:32Z] <urbanecm@deploy2002> Started scap sync-world: Backport for [[gerrit:1217575|[Growth] Enable Add Link backend on a handful of wikis (T410469)]]

Mentioned in SAL (#wikimedia-operations) [2025-12-11T19:40:09Z] <urbanecm@deploy2002> urbanecm: Backport for [[gerrit:1217575|[Growth] Enable Add Link backend on a handful of wikis (T410469)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

Mentioned in SAL (#wikimedia-operations) [2025-12-11T19:46:27Z] <urbanecm@deploy2002> Finished scap sync-world: Backport for [[gerrit:1217575|[Growth] Enable Add Link backend on a handful of wikis (T410469)]] (duration: 08m 55s)

Deployed to end users.

Exciting, thanks!
I tested on wuuwiki & mywiki and there are "Add a Link" suggestions available on the homepage. I don't think we need to test on all wikis, but I'll let Elena decide if more testing is needed before we resolve.