Page MenuHomePhabricator

Completion report on training 18 rounds of add-a-link models
Closed, ResolvedPublic

Description

Compile a completion report that shows the results of training, evaluating, and publishing 18 rounds of add-a-link models with potential next steps.

Event Timeline

Restricted Application added a subscriber: Aklapper. · View Herald Transcript

Below are the results of training, evaluating, and publishing 18 rounds of add-a-link models.

RoundWikisModels
TrainedEvaluatedPublished
17777
27777
39999
419191917
520191918
616161616
715141412
822212120
921202019
1019181817
1122212121
1223232321
1324242423
1416151512
1522222221
1619191917
1721212119
182222
Total304297297278

Next steps:

  1. T309263 - Liaise with @MGerlach from the Research team to improve the link-recommendation algorithm in order to:
    • support languages whose training pipeline failed
    • improve model performance for wikis that failed the backtesting evaluation
  2. T276438 - Work with ML Team to establish a streamlined way for running training pipelines for add-a-link models using Train Wing or its alternative.
  3. T327212 - Work with ML Team to manage the scheduling of recurring training pipeline runs to refresh add-a-link models using Train Wing or its alternative.

The Research team requested for a single table that shows evaluation metrics for all trained wikis and we shared in T343374#9064194