19/19 models were trained successfully in the 16th round of wikis.

Model evaluation has been completed and below are the backtesting results:

CCing @MGerlach, in case he would like to add comments on the backtesting evaluation.

The conclusion on the backtesting results is that most of the languages look fine besides:

• snwiki (0.64), sowiki (0.71), szywiki (0.65), tawiki (0.72), thwiki (0.72) have a precision lower than the recommended one (0.75)

Talked to @MGerlach about these results and agreed that sowiki, tawiki, thwiki should be published but snwiki, szywiki shouldn't.

@kostajh, we published datasets for all 17/19 models that passed the evaluation in this round.

I moved Swahili Wikipedia (sw) to an earlier group.

I ran this script for adding the link-recommendation task type and populating the excluded sections entries:

PHAB=T308142
for WIKI in smwiki sowiki sqwiki srwiki srnwiki sswiki stwiki stqwiki suwiki szlwiki tawiki tcywiki tewiki tetwiki tgwiki thwiki; do
    ORIGIN=`mwscript getConfiguration.php $WIKI --settings 'wgCanonicalServer' --format json | jq --raw-output '.wgCanonicalServer'`
    mwscript extensions/GrowthExperiments/maintenance/changeWikiConfig.php $WIKI \
            --page MediaWiki:NewcomerTasks.json \
            --create-only \
            --json \
            --summary "Growth features configuration boilerplate ([[phab:$PHAB]])" \
            link-recommendation \
            '{ "type": "link-recommendation", "group": "easy" }'
    jq "select(.wiki==\"$WIKI\" and .probability > 0.25) | .section" wiki_sections.jsonl \
        | jq --slurp --compact-output "unique" \
        | mwscript extensions/GrowthExperiments/maintenance/changeWikiConfig.php $WIKI \
            --page MediaWiki:NewcomerTasks.json \
            --json \
            --summary "machine-generated configuration for excluding sections from link recommendations ([[phab:$PHAB]]), feel free to improve" \
            link-recommendation.excludedSections \
            "`cat`"
    echo "$ORIGIN/wiki/MediaWiki:NewcomerTasks.json"
    echo "$ORIGIN/w/index.php?title=MediaWiki:NewcomerTasks.json&diff=next"
    echo "Press <Enter> to continue"
    read # give time for manual verification
done

Note that the script didn't populate excludedSections for stqwiki because it is not present in the wiki_sections.jsonl, see T345562.

Change 974169 had a related patch set uploaded (by Sergio Gimeno; author: Sergio Gimeno):

[operations/mediawiki-config@master] GrowthExperiments: enable AddLink backend for 16,17th rounds of wikis

https://gerrit.wikimedia.org/r/974169

Change 974169 merged by jenkins-bot:

[operations/mediawiki-config@master] GrowthExperiments: enable AddLink backend for 16,17th rounds of wikis

https://gerrit.wikimedia.org/r/974169

Mentioned in SAL (#wikimedia-operations) [2023-11-15T14:39:11Z] <awight@deploy2002> Started scap: Backport for [[gerrit:974169|GrowthExperiments: enable AddLink backend for 16,17th rounds of wikis (T308142 T308143)]]

Mentioned in SAL (#wikimedia-operations) [2023-11-15T14:41:55Z] <awight@deploy2002> sgimeno and awight: Backport for [[gerrit:974169|GrowthExperiments: enable AddLink backend for 16,17th rounds of wikis (T308142 T308143)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug)

Mentioned in SAL (#wikimedia-operations) [2023-11-15T14:47:27Z] <awight@deploy2002> Finished scap: Backport for [[gerrit:974169|GrowthExperiments: enable AddLink backend for 16,17th rounds of wikis (T308142 T308143)]] (duration: 08m 16s)

Change 976804 had a related patch set uploaded (by Sergio Gimeno; author: Sergio Gimeno):

[operations/mediawiki-config@master] GrowthExperiments: enable AddLink frontend for 16,17th rounds of wikis

https://gerrit.wikimedia.org/r/976804

Change 976804 merged by jenkins-bot:

[operations/mediawiki-config@master] GrowthExperiments: enable AddLink frontend for 16,17th rounds of wikis

https://gerrit.wikimedia.org/r/976804

Mentioned in SAL (#wikimedia-operations) [2023-11-27T08:09:42Z] <taavi@deploy2002> Started scap: Backport for [[gerrit:976804|GrowthExperiments: enable AddLink frontend for 16,17th rounds of wikis (T308142 T308143)]]

Mentioned in SAL (#wikimedia-operations) [2023-11-27T08:18:49Z] <taavi@deploy2002> taavi and sgimeno: Backport for [[gerrit:976804|GrowthExperiments: enable AddLink frontend for 16,17th rounds of wikis (T308142 T308143)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug)

Mentioned in SAL (#wikimedia-operations) [2023-11-27T08:29:36Z] <taavi@deploy2002> Finished scap: Backport for [[gerrit:976804|GrowthExperiments: enable AddLink frontend for 16,17th rounds of wikis (T308142 T308143)]] (duration: 19m 54s)

Checked selected wikis from the list - leaving in the Test in Production column for monitoring during this week.