Steps to replicate the issue (include links if applicable):
- Please see equality of natural numbers
- an update by WikiLambda system: https://www.wikifunctions.org/w/index.php?title=Z13522&diff=101731&oldid=101728
- My comment on my disconnection of successful implementations: https://www.wikifunctions.org/wiki/Talk:Z13522
- The function itself: https://www.wikifunctions.org/wiki/Z13522
- (If you must reproduce, re-connect the disconnected implementations and wait for WikiLambda system to do its thing.)
What happens?:
Two implementations with relatively poor performance were promoted above three implementations with better performance.
What should have happened instead?:
Disconnected test cases should be disregarded or have a lower weighting than connected test cases.
Software version (on Special:Version page; skip for WMF-hosted wikis like Wikipedia):
Other information (browser name/version, screenshots, etc.):
The function had six implementations and seven test cases. Two test cases were not connected at the time, since they test with invalid Natural number objects (negative value or leading zero). The implementations promoted by WikiLambda system were successful for all seven tests. Three of the less favoured implementations were successful for six out of seven tests, failing for the disconnected case with a leading zero. The preferred implementations rely on Python (==) and have significantly worse performance than the other three, which rely on built-in Z803 and Z866. (The sixth implementation relies on JavaScript (===) and had a timeout failure or two.)
Because disconnecting Z13524 (on April 18th: https://www.wikifunctions.org/w/index.php?title=Z13522&diff=99728&oldid=99559 ) seems to have made no difference to WikiLambda system’s preferences, I considered it appropriate to disconnect the preferred implementations for the time being.
Please see T360385 for issues that I suspect are related to this problem, at least in part.
Disconnections: https://www.wikifunctions.org/w/index.php?search=T363908&title=Special:Search&profile=advanced&fulltext=1&ns1=1