User Details
User Details
- User Since
- Jun 17 2019, 4:51 PM (89 w, 9 h)
- Availability
- Available
- IRC Nick
- accraze
- LDAP User
- Unknown
- MediaWiki User
- ACraze (WMF) [ Global Accounts ]
Fri, Feb 26
Fri, Feb 26
ACraze added a comment to T275709: Model Inventory.
Here is a csv file with the current ores model info:
Wed, Feb 24
Wed, Feb 24
ACraze created T275709: Model Inventory.
Tue, Feb 23
Tue, Feb 23
ACraze added a comment to T272874: Prepare 4 ORES English models for Lift Wing.
Great work on this so far @kevinbazira
Fri, Feb 19
Fri, Feb 19
ACraze edited projects for T273545: Kubeflow/KFServing Presentation, added: Machine-Learning-Team; removed Machine-Learning-Team (Active Tasks).
Thu, Feb 18
Thu, Feb 18
ACraze changed hashtags for Machine-Learning-Team, added #machine-learning-team; removed #scoring-platform-team.
Fri, Feb 12
Fri, Feb 12
ACraze added a comment to T272874: Prepare 4 ORES English models for Lift Wing.
You might want to use the ORES dockerfile as a starting point: https://github.com/wikimedia/ores/blob/master/Dockerfile
ACraze closed T274680: Empty the JADE repository in Gerrit (superseded by Jade repository) as Resolved.
awesome thanks @Legoktm ! Marking this as Resolved
ACraze added a comment to T274680: Empty the JADE repository in Gerrit (superseded by Jade repository).
It looks like Jenkins fails due to the repo already being 'archived'. Not sure if it's worth unarchiving in order to merge this last patch.
Wed, Feb 10
Wed, Feb 10
ACraze moved T273545: Kubeflow/KFServing Presentation from Active to Review on the Machine-Learning-Team (Active Tasks) board.
ACraze added a comment to T273545: Kubeflow/KFServing Presentation.
Dropping a link to the slides here: https://docs.google.com/presentation/d/1hDk_qoC45x3rSRvEqI5IBJ1vVXLskQp4PTmgQNR3on0/edit?usp=sharing
Tue, Feb 2
Tue, Feb 2
ACraze added a comment to T273545: Kubeflow/KFServing Presentation.
Just spitballing some ideas for the presentation here:
Mon, Feb 1
Mon, Feb 1
ACraze added a comment to T272919: Install KFServing standalone.
Thanks @Theofpa ! We are considering helm as it is part of our SRE stack used across the Foundation, however I can see the operators being very beneficial for long term use.
Jan 28 2021
Jan 28 2021
ACraze added a comment to T272919: Install KFServing standalone.
I found an example of using helm to install the KFServing dependencies:
https://github.com/kubeflow/kfserving/blob/8a8f33a85a12ea4813f726b41581cbf9335ede9b/test/scripts/run-e2e-tests.sh#L57
Jan 25 2021
Jan 25 2021
ACraze updated the task description for T272917: Lift Wing proof of concept.
ACraze updated subscribers of T272919: Install KFServing standalone.
Here are my notes from installing KFServing on GKE last quarter: https://etherpad.wikimedia.org/p/kfserving-standalone
TLDR: there is a weird version mismatch issue between Knative & Istio that can potentially prevent us from using the transformer (pre/post-processing) and explainabilty features in KFServing.
ACraze updated the task description for T272919: Install KFServing standalone.
ACraze added a comment to T272918: Create ml-serve k8s cluster.
Some questions:
- Do we know if there is a way to bootstrap a new wmf k8s cluster via puppet?
- Otherwise, should we just create a small cluster using kubeadm?
ACraze moved T272919: Install KFServing standalone from Active to On Deck on the Machine-Learning-Team (Active Tasks) board.
ACraze updated subscribers of T272918: Create ml-serve k8s cluster.
ACraze updated the task description for T272917: Lift Wing proof of concept.
ACraze updated the task description for T272917: Lift Wing proof of concept.
ACraze updated the task description for T272917: Lift Wing proof of concept.
ACraze added a subtask for T272917: Lift Wing proof of concept: T272919: Install KFServing standalone.
ACraze added a parent task for T272919: Install KFServing standalone: T272917: Lift Wing proof of concept.
ACraze added a subtask for T272917: Lift Wing proof of concept: T272918: Create ml-serve k8s cluster.
ACraze added a parent task for T272918: Create ml-serve k8s cluster: T272917: Lift Wing proof of concept.
ACraze added a comment to T272874: Prepare 4 ORES English models for Lift Wing.
I experimented a bit with packaging a revscoring model as a custom KFServing model a few months back.
Here's the WIP code: https://gist.github.com/accraze/72e41bc2d2e11f3b03c8f795bf3f657e
Jan 23 2021
Jan 23 2021
ACraze added a comment to T272728: Testing Model.
Here's a simple BoostedTreesClassifier that I trained on the Titanic dataset today. It's in the Tensorflow SavedModel format, which is required by KFServing/TFServing:
Jan 22 2021
Jan 22 2021
ACraze moved T272728: Testing Model from Review to Active on the Machine-Learning-Team (Active Tasks) board.
Jan 20 2021
Jan 20 2021
ACraze moved T272387: Clean Up Backlog Board from Active to Review on the Machine-Learning-Team (Active Tasks) board.
@calbon The Backlog has been cleared out and stale tickets have been moved into the new columns. Many thanks to @Ladsgroup for running his bot and helping sort a bunch of the 'New development' and 'Monitoring' tasks.
ACraze moved T271134: Some Machine Learning clusters do not support IPv6 from Lift Wing to ORES on the Machine-Learning-Team board.
ACraze moved T256085: Article Quality tokenizer error from Lift Wing to Needs More Evaluation on the Machine-Learning-Team board.
ACraze moved T240517: [EPIC] Growth: Newcomer tasks 1.1.1 (ORES topics) from Lift Wing to Needs More Evaluation on the Machine-Learning-Team board.
ACraze moved T132901: Use revision scoring to trigger flagged protection from Lift Wing to Needs More Evaluation on the Machine-Learning-Team board.
ACraze moved T223273: Update srwiki thresholds for goodfaith model from Lift Wing to Needs More Evaluation on the Machine-Learning-Team board.
ACraze moved T217232: Outreach campaign to raise awareness of Scoring Platform from Lift Wing to Needs More Evaluation on the Machine-Learning-Team board.
ACraze moved T155538: General image classifier for commons from Lift Wing to Needs More Evaluation on the Machine-Learning-Team board.
ACraze moved T182611: Train/test reverted edittype model for Catalan Wikipedia from New development to Needs More Evaluation on the Machine-Learning-Team board.
ACraze moved T196634: Deploy pilot edittype model from New development to Needs More Evaluation on the Machine-Learning-Team board.
ACraze moved T167362: Draft specification of article importance API from New development to Needs More Evaluation on the Machine-Learning-Team board.
ACraze moved T191768: Support for languages in ores-support-checklist from New development to ORES on the Machine-Learning-Team board.
ACraze moved T209732: Wire ORES recent_score events into Hadoop from New development to ORES on the Machine-Learning-Team board.
ACraze moved T209734: Include feature values in ORES changeprop stream from New development to ORES on the Machine-Learning-Team board.
ACraze moved T209737: Backfill ORES Hadoop scores with historical data from New development to ORES on the Machine-Learning-Team board.
ACraze moved T209739: Produce dump files for ORES scores from New development to ORES on the Machine-Learning-Team board.
ACraze moved T214545: Emit synthetic mediawiki.revision-score events for both datacenters from New development to ORES on the Machine-Learning-Team board.
Jan 19 2021
Jan 19 2021
ACraze added a comment to T215543: Automated support for checking model fitness changes .
Using something like alibi-detect would make this pretty simple: https://github.com/SeldonIO/alibi-detect
ACraze moved T215543: Automated support for checking model fitness changes from New development to Needs More Evaluation on the Machine-Learning-Team board.
ACraze moved T209960: Allow privileged users to label deleted revision in Wikilabels from New development to Wikilabels on the Machine-Learning-Team board.
ACraze moved T214723: Modify revscoring extract utility to include root datasources from New development to Revscoring on the Machine-Learning-Team board.
ACraze moved T208239: Make a wikilabels view to see a single task. from New development to Wikilabels on the Machine-Learning-Team board.
ACraze moved T191214: Edittypes repo setup from New development to Needs More Evaluation on the Machine-Learning-Team board.
ACraze moved T214054: Stress test ORES/kubernetes (above 4.5k scores/second) from New development to ORES on the Machine-Learning-Team board.
ACraze moved T197007: Take advantage of word2vec signal in all models from New development to ORES on the Machine-Learning-Team board.
ACraze moved T209649: Be able to flag judgments for additional participation from New development to Jade on the Machine-Learning-Team board.
ACraze moved T131481: Train/test copyvio detection model for text from New development to Revscoring on the Machine-Learning-Team board.
ACraze moved T209653: "Report error" button for ORES recent changes filter from New development to ORES on the Machine-Learning-Team board.
ACraze moved T190768: Add ORES editquality highlighting/filtering to article's history from New development to ORES on the Machine-Learning-Team board.
ACraze moved T223829: Implement citation classifier features for quality models from New development to Revscoring on the Machine-Learning-Team board.
ACraze moved T213117: Propose Jade integration with countervandalism network (CVN) from New development to Jade on the Machine-Learning-Team board.
ACraze moved T135495: Metrics around distinct user agents that hit ORES from New development to ORES on the Machine-Learning-Team board.
ACraze moved T173244: [Investigate] Use PMML for prediction model serialization from New development to Wikilabels on the Machine-Learning-Team board.
ACraze moved T166786: Semi-supervised, supervised learning for 2nd edit quality campaigns from New development to Revscoring on the Machine-Learning-Team board.
ACraze moved T143123: [Spike] Semi-supervised machine learning from New development to Needs More Evaluation on the Machine-Learning-Team board.
ACraze moved T121715: Train edit types model on labeled data for English Wikipedia from New development to ORES on the Machine-Learning-Team board.
ACraze moved T177245: Implement "orientation" for Flow's Structured Discussion revisions from New development to ORES on the Machine-Learning-Team board.
ACraze moved T117425: Develop manual testing strategy for bias detection from New development to Revscoring on the Machine-Learning-Team board.
ACraze moved T115566: Text normalization as part of regex extractor from New development to Revscoring on the Machine-Learning-Team board.
ACraze moved T116938: Train 'reverted' model for commonswiki from New development to ORES on the Machine-Learning-Team board.
ACraze moved T102340: Add turkish stemmer to NLTK from New development to Needs More Evaluation on the Machine-Learning-Team board.
ACraze moved T106279: Re-broadcast RCStream with ORES scores from New development to ORES on the Machine-Learning-Team board.