Review incidents from the past year to determine how many had a testable regression as the cause. From review identify the top 15 target projects.
- [[ https://office.wikimedia.org/wiki/Release_Engineering/FY1819-Planning/Code_Health | Release Engineering/FY1819-Planning/Code Health ]] > FY1819-Q1 > From review identify the top 15 target projects.
- [[ https://www.mediawiki.org/wiki/Wikimedia_Technology/Annual_Plans/FY2019/TEC13:_Code_Health/Goals#Outcome_2_/_Output_2.2 | Wikimedia Technology/Annual Plans/FY2019/TEC13: Code Health/Goals > Outcome 2 / Output 2.2 ]]
- Review existing e2e test coverage.
- Define prioritization scheme.
- Prioritize e2e testing gaps.
# Review existing e2e test coverage
List of repositories with at least one Selenium test.
| **Repository** | **Language**
| mediawiki/core | JavaScript
| mediawiki/extensions/AdvancedSearch | JavaScript
| mediawiki/extensions/CentralAuth | Ruby
| mediawiki/extensions/CentralNotice | Ruby
| mediawiki/extensions/CirrusSearch | JavaScript
| mediawiki/extensions/Echo | JavaScript
| mediawiki/extensions/ElectronPdfService | JavaScript
| mediawiki/extensions/GettingStarted | Ruby
| mediawiki/extensions/Math | JavaScript
| mediawiki/extensions/MobileFrontend | Ruby
| mediawiki/extensions/MultimediaViewer | Ruby
| mediawiki/extensions/Newsletter | JavaScript
| mediawiki/extensions/ORES | JavaScript
| mediawiki/extensions/Popups | JavaScript
| mediawiki/extensions/QuickSurveys | Ruby
| mediawiki/extensions/RelatedArticles | JavaScript
| mediawiki/extensions/RevisionSlider | Ruby
| mediawiki/extensions/TwoColConflict | JavaScript, Ruby
| mediawiki/extensions/Wikibase | JavaScript, Ruby
| mediawiki/extensions/WikibaseLexeme | JavaScript, Ruby
| mediawiki/skins/MinervaNeue | Ruby
| phab-deployment | JavaScript
| wikimedia/portals/deploy | JavaScript
# Define prioritization scheme
- How much change did happen (in the last 12 months)?
- https://wikimedia.biterg.io
- Does a repository have maintainers?
- https://www.mediawiki.org/wiki/Developers/Maintainers
- {T190891}
- Do maintainers want tests?
- [[ https://docs.google.com/spreadsheets/d/1plkHOPQ0HAMKKxNhBRH9PXo4340tQsyscstShwJjgvs/edit#gid=0 | Incident Review spreadsheet ]]
## How much change did happen
[[ https://wikimedia.biterg.io | Bitergia ]] report for the last year (P7586):
| Repository | Commits
| mediawiki/extensions | 35616
| operations/puppet | 7354
| mediawiki/core | 6288
| operations/mediawiki-config | 3160
| mediawiki/extensions/Wikibase | 2319
| mediawiki/skins | 2098
| apps/android/wikipedia | 1959
| phabricator/phabricator | 1532
| operations/software/librenms | 1446
| mediawiki/extensions/VisualEditor | 1263
| oojs/ui | 1229
| mediawiki/extensions/BlueSpiceExtensions | 1176
| integration/config | 1160
| pywikibot/core | 1101
| mediawiki/extensions/MobileFrontend | 923
| mediawiki/extensions/ContentTranslation | 915
| VisualEditor/VisualEditor | 856
| mediawiki/extensions/CirrusSearch | 688
| translatewiki | 674
| mediawiki/extensions/BlueSpiceFoundation | 622
| wikimedia/fundraising/crm | 621
| mediawiki/extensions/Popups | 603
| mediawiki/extensions/Flow | 563
| operations/dns | 539
| mediawiki/extensions/Translate | 510
| mediawiki/extensions/Echo | 504
| mediawiki/extensions/DonationInterface | 494
| mediawiki/services/parsoid | 444
| mediawiki/extensions/WikimediaMessages | 380
| mediawiki/extensions/CentralAuth | 376
| mediawiki/vagrant | 373
| mediawiki/extensions/AbuseFilter | 354
| mediawiki/extensions/Collection | 328
| mediawiki/services/restbase | 327
| mediawiki/extensions/UploadWizard | 311
| mediawiki/extensions/FlaggedRevs | 297
| mediawiki/extensions/TimedMediaHandler | 291
| mediawiki/extensions/ProofreadPage | 283
| mediawiki/extensions/UniversalLanguageSelector | 283
| mediawiki/extensions/Newsletter | 276
| mediawiki/skins/Vector | 275
| mediawiki/extensions/Cite | 271
| mediawiki/extensions/CodeMirror | 269
| integration/jenkins-job-builder | 252
| mediawiki/extensions/CentralNotice | 246
| mediawiki/extensions/Wikidata | 227
| mediawiki/extensions/ConfirmEdit | 225
| mediawiki/extensions/WikimediaEvents | 219
| mediawiki/extensions/Math | 215
| operations/debs/python-kafka | 214
# Prioritize e2e testing gaps
| Repository | Commits | Selenium
| mediawiki/extensions | 35616
| operations/puppet | 7354
| mediawiki/core | 6288 | JavaScript
| operations/mediawiki-config | 3160
| mediawiki/extensions/Wikibase | 2319 | JavaScript, Ruby
| mediawiki/skins | 2098
| apps/android/wikipedia | 1959
| phabricator/phabricator | 1532
| operations/software/librenms | 1446
| mediawiki/extensions/VisualEditor | 1263
| oojs/ui | 1229
| mediawiki/extensions/BlueSpiceExtensions | 1176
| integration/config | 1160
| pywikibot/core | 1101
| mediawiki/extensions/MobileFrontend | 923 | Ruby
| mediawiki/extensions/ContentTranslation | 915
| VisualEditor/VisualEditor | 856
| mediawiki/extensions/CirrusSearch | 688 | JavaScript
| translatewiki | 674
| mediawiki/extensions/BlueSpiceFoundation | 622
| wikimedia/fundraising/crm | 621
| mediawiki/extensions/Popups | 603 | JavaScript
| mediawiki/extensions/Flow | 563
| operations/dns | 539
| mediawiki/extensions/Translate | 510
| mediawiki/extensions/Echo | 504 | JavaScript
| mediawiki/extensions/DonationInterface | 494
| mediawiki/services/parsoid | 444
| mediawiki/extensions/WikimediaMessages | 380
| mediawiki/extensions/CentralAuth | 376 | Ruby
| mediawiki/vagrant | 373
| mediawiki/extensions/AbuseFilter | 354
| mediawiki/extensions/Collection | 328
| mediawiki/services/restbase | 327
| mediawiki/extensions/UploadWizard | 311
| mediawiki/extensions/FlaggedRevs | 297
| mediawiki/extensions/TimedMediaHandler | 291
| mediawiki/extensions/ProofreadPage | 283
| mediawiki/extensions/UniversalLanguageSelector | 283
| mediawiki/extensions/Newsletter | 276 | JavaScript
| mediawiki/skins/Vector | 275
| mediawiki/extensions/Cite | 271
| mediawiki/extensions/CodeMirror | 269
| integration/jenkins-job-builder | 252
| mediawiki/extensions/CentralNotice | 246 | Ruby
| mediawiki/extensions/Wikidata | 227
| mediawiki/extensions/ConfirmEdit | 225
| mediawiki/extensions/WikimediaEvents | 219
| mediawiki/extensions/Math | 215 | JavaScript
| operations/debs/python-kafka | 214