A few users have expressed confusion or concern about our implementation ordering strategy, as expressed in T363908. One thing we can do is to provide greater transparency about the ordering choices.
Background: . Each time implementations are reordered, the change already shows up in the function's page history. Reordering is primarily based on number of failing tests and average runtime of each implementation.
Proposal: Add (average runtime, number of failing tests) for the previous-first-ranked and newly-first-ranked implementations, so it's clear why the first -ranked implementation got changed. Use translations for each natural-language phrase in the message.
Example edit-message in English:
Updated the implementation list
Previous first-ranked: Z15917 (failing tests: 1, average runtime: 140ms)
Now first-ranked: Z13533 (failing tests: 0, average runtime: 167ms)
See also: T366659
Completion checklist
- Before closing this task, review one by one the checklist available here: https://www.mediawiki.org/wiki/Abstract_Wikipedia_team/Definition_of_Done#Front-end_Task/Bug_Completion_Checklist