Page MenuHomePhabricator
Create Task
Maniphest T215543

Automated support for checking model fitness changes
Open, MediumPublic
Actions

Description

We need a nice way to check for model fitness changes in repos that have loads of models -- like wikimedia/editquality.

Event Timeline

Halfak created this task.Feb 7 2019, 6:43 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptFeb 7 2019, 6:43 PM
Harej triaged this task as Medium priority.Mar 26 2019, 9:10 PM
• ACraze moved this task from New development to Backlog/Other on the Machine-Learning-Team board.Jan 19 2021, 10:41 PM
• ACraze subscribed.

Using something like alibi-detect would make this pretty simple: https://github.com/SeldonIO/alibi-detect

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits