Page MenuHomePhabricator
Create Task
Maniphest T337348

Section-level images: Set up beta cluster
Closed, ResolvedPublic
Actions

Description

See also:

Details

ProjectBranchLines +/-Subject
operations/mediawiki-configmaster+6 -10[beta] GrowthExperiments: Fix beta $wgGEImageRecommendationServiceUrl
operations/mediawiki-configmaster+1 -1[beta] GrowthExperiments: Fix variable name
operations/mediawiki-configmaster+9 -1[beta] GrowthExperiments: Use ActionApiImageRecommendationApiHandler
Customize query in gerrit

Related Objects

Event Timeline

Tgr created this task.Tue, May 23, 10:33 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptTue, May 23, 10:33 PM
Tgr moved this task from Incoming to In Progress on the Growth-Team (Current Sprint) board.Tue, May 23, 10:33 PM
gerritbot added a comment.Tue, May 23, 10:34 PM

Change 920283 had a related patch set uploaded (by Gergő Tisza; author: Gergő Tisza):

[operations/mediawiki-config@master] [beta] GrowthExperiments: Use ActionApiImageRecommendationApiHandler

https://gerrit.wikimedia.org/r/920283

gerritbot added a project: Patch-For-Review.Tue, May 23, 10:34 PM
Tgr updated the task description. (Show Details)Tue, May 23, 10:34 PM
Stashbot added a comment.Wed, May 24, 12:47 PM

Mentioned in SAL (#wikimedia-operations) [2023-05-24T12:47:22Z] <tgr_> running changeWikiConfig.php on Growth pilot wikis for T337348

Tgr added a comment.Wed, May 24, 12:49 PM

Beta:

tgr@deployment-mwmaint02:~$ for WIKI in ar bn cs es; do mwscript GrowthExperiments:changeWikiConfig.php --wiki=${WIKI}wiki --json --page MediaWiki:NewcomerTasks.json --summary 'Prepare section image recommendations. This should have no visible effect (disabled via other means). [[phab:T337330]] [[phab:T321754]]' --create-only section-image-recommendation '{"type": "section-image-recommendation", "group": "medium", "maxTasksPerDay": 25}' ; done

Production (needed because of T337330):

tgr@mwmaint1002:~$ for WIKI in ar bn cs es fr; do mwscript GrowthExperiments:changeWikiConfig.php --wiki=${WIKI}wiki --json --page MediaWiki:NewcomerTasks.json --summary 'Prepare section image recommendations. This should have no visible effect (disabled via other means). [[phab:T337330]] [[phab:T321754]]' --create-only section-image-recommendation '{"type": "section-image-recommendation", "group": "medium", "maxTasksPerDay": 25}' ; done
gerritbot added a comment.Wed, May 24, 12:51 PM

Change 920283 merged by jenkins-bot:

[operations/mediawiki-config@master] [beta] GrowthExperiments: Use ActionApiImageRecommendationApiHandler

https://gerrit.wikimedia.org/r/920283

Tgr updated the task description. (Show Details)Wed, May 24, 12:52 PM
Maintenance_bot removed a project: Patch-For-Review.Wed, May 24, 1:10 PM
KStoller-WMF moved this task from Backlog to May 29-June 2 on the Section-Level-Image-Suggestions board.Fri, May 26, 5:50 PM
Tgr added a comment.Mon, May 29, 12:54 PM
In T337348#8876521, @Tgr wrote:

Beta:

tgr@deployment-mwmaint02:~$ for WIKI in ar bn cs es; do mwscript GrowthExperiments:changeWikiConfig.php --wiki=${WIKI}wiki --json --page MediaWiki:NewcomerTasks.json --summary 'Prepare section image recommendations. This should have no visible effect (disabled via other means). [[phab:T337330]] [[phab:T321754]]' --create-only section-image-recommendation '{"type": "section-image-recommendation", "group": "medium", "maxTasksPerDay": 25}' ; done

Production (needed because of T337330):

tgr@mwmaint1002:~$ for WIKI in ar bn cs es fr; do mwscript GrowthExperiments:changeWikiConfig.php --wiki=${WIKI}wiki --json --page MediaWiki:NewcomerTasks.json --summary 'Prepare section image recommendations. This should have no visible effect (disabled via other means). [[phab:T337330]] [[phab:T321754]]' --create-only section-image-recommendation '{"type": "section-image-recommendation", "group": "medium", "maxTasksPerDay": 25}' ; done

Also ran those on beta/prod enwiki, forgot that last time.

Tgr updated the task description. (Show Details)Mon, May 29, 2:58 PM
gerritbot added a comment.Mon, May 29, 4:46 PM

Change 924110 had a related patch set uploaded (by Gergő Tisza; author: Gergő Tisza):

[operations/mediawiki-config@master] [beta] GrowthExperiments: Fix variable name

https://gerrit.wikimedia.org/r/924110

gerritbot added a project: Patch-For-Review.Mon, May 29, 4:46 PM

Change 924110 merged by jenkins-bot:

[operations/mediawiki-config@master] [beta] GrowthExperiments: Fix variable name

https://gerrit.wikimedia.org/r/924110

gerritbot added a comment.Mon, May 29, 5:06 PM

Change 924111 had a related patch set uploaded (by Gergő Tisza; author: Gergő Tisza):

[operations/mediawiki-config@master] GrowthExperiments: Fix beta $wgGEImageRecommendationServiceUrl

https://gerrit.wikimedia.org/r/924111

gerritbot added a comment.Mon, May 29, 5:09 PM

Change 924111 merged by jenkins-bot:

[operations/mediawiki-config@master] [beta] GrowthExperiments: Fix beta $wgGEImageRecommendationServiceUrl

https://gerrit.wikimedia.org/r/924111

Maintenance_bot removed a project: Patch-For-Review.Mon, May 29, 5:10 PM
Tgr added a comment.Mon, May 29, 7:02 PM

Blocked on deploying rEGRE76227375bb1f: Section images: Accept more recommendation types as the name of the type has changed.

Tgr added a comment.Tue, May 30, 3:10 PM
Add 500 test pages per wiki
for LANG in en ar bn cs es; do
    echo "$LANG>>>"
    # get list of pages with recommendations
    curl -s "https://${LANG}.wikipedia.org/w/api.php?action=query&format=json&export=1&generator=search&formatversion=2&gsrsearch=hasrecommendation%3Aimage_section&gsrlimit=500" > export.json
    cat export.json | jq --raw-output '.query.export' > export.xml
    cat export.json | jq --raw-output '.query.pages[].title' > pages-$LANG.txt
    # import pages
    mwscript importDump.php ${LANG}wiki --username-prefix prod --no-local-users --report 50 export.xml
    mwscript rebuildrecentchanges.php ${LANG}wiki
    mwscript initSiteStats.php ${LANG}wiki --update
    # update search index
    mwscript CirrusSearch:ForceSearchIndex.php ${LANG}wiki --namespace 0 --skipLinks --indexOnSkip
    mwscript CirrusSearch:ForceSearchIndex.php ${LANG}wiki --namespace 0 --skipParse
    mwscript GrowthExperiments:importOresTopics.php ${LANG}wiki --apiUrl="https://${LANG}.wikipedia.org/w/api.php" --wikiId=${LANG}wiki --pageList pages-$LANG.txt
    mwscript CirrusSearch:UpdateWeightedTags.php ${LANG}wiki --tagType=recommendation.image_section --page-list pages-$LANG.txt
done

#validate
for LANG in en ar bn cs es; do
    mwscript GrowthExperiments:listTaskCounts.php ${LANG}wiki --topictype ores --tasktype section-image-recommendation --output json | jq '.taskTypeCounts["section-image-recommendation"]'
done
Tgr updated the task description. (Show Details)Tue, May 30, 3:10 PM
Tgr moved this task from In Progress to QA on the Growth-Team (Current Sprint) board.Tue, May 30, 3:17 PM

Recommendations are set up on beta enwiki, arwiki, bnwiki, cswiki, eswiki. (There is no beta frwiki and setting it up didn't seem worth the effort.)

Users need to opt in with ge.utils.enableSectionImageRecommendations() right now, that will be fixed soon.

Note that beta enwiki has lots of false positives ("the section already has an image"). I think that's just due to content changing more quickly on production enwiki. Beta en is also quite slow, no idea about that.

Etonkovidova closed this task as Resolved.Thu, Jun 1, 7:44 PM
Etonkovidova awarded a token.
Etonkovidova added a subscriber: Etonkovidova.

Section-level add image task is present in en, bn, es, cs, ar beta wikis - works as expected. Thanks, @Tgr!

Content licensed under Creative Commons Attribution-ShareAlike 3.0 (CC-BY-SA) unless otherwise noted; code licensed under GNU General Public License (GPL) or other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL