Page MenuHomePhabricator

ACraze (accraze)
Sr. Software Engineer (Machine Learning)

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Thursday

  • Clear sailing ahead.

User Details

User Since
Jun 17 2019, 4:51 PM (89 w, 9 h)
Availability
Available
IRC Nick
accraze
LDAP User
Unknown
MediaWiki User
ACraze (WMF) [ Global Accounts ]

Recent Activity

Fri, Feb 26

ACraze added a comment to T275709: Model Inventory.

Here is a csv file with the current ores model info:

Fri, Feb 26, 6:03 PM · artificial-intelligence, Machine-Learning-Team (Active Tasks)

Wed, Feb 24

ACraze added a project to T275709: Model Inventory: artificial-intelligence.
Wed, Feb 24, 11:11 PM · artificial-intelligence, Machine-Learning-Team (Active Tasks)
ACraze created T275709: Model Inventory.
Wed, Feb 24, 11:10 PM · artificial-intelligence, Machine-Learning-Team (Active Tasks)

Tue, Feb 23

ACraze added a comment to T272874: Prepare 4 ORES English models for Lift Wing.

Great work on this so far @kevinbazira

Tue, Feb 23, 6:46 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)

Fri, Feb 19

ACraze closed T273545: Kubeflow/KFServing Presentation as Resolved.
Fri, Feb 19, 5:36 PM · Machine-Learning-Team
ACraze edited projects for T273545: Kubeflow/KFServing Presentation, added: Machine-Learning-Team; removed Machine-Learning-Team (Active Tasks).
Fri, Feb 19, 5:35 PM · Machine-Learning-Team
ACraze added a project to T272874: Prepare 4 ORES English models for Lift Wing: Lift-Wing.
Fri, Feb 19, 4:48 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)

Thu, Feb 18

ACraze renamed Machine-Learning-Team from Machine Learning Team to Machine-Learning-Team.
Thu, Feb 18, 11:04 PM
ACraze changed hashtags for Machine-Learning-Team, added #machine-learning-team; removed #scoring-platform-team.
Thu, Feb 18, 10:41 PM

Fri, Feb 12

ACraze added a comment to T272874: Prepare 4 ORES English models for Lift Wing.

You might want to use the ORES dockerfile as a starting point: https://github.com/wikimedia/ores/blob/master/Dockerfile

Fri, Feb 12, 11:55 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze closed T274680: Empty the JADE repository in Gerrit (superseded by Jade repository) as Resolved.

awesome thanks @Legoktm ! Marking this as Resolved

Fri, Feb 12, 11:40 PM · Jade, Projects-Cleanup
ACraze added a comment to T274680: Empty the JADE repository in Gerrit (superseded by Jade repository).

It looks like Jenkins fails due to the repo already being 'archived'. Not sure if it's worth unarchiving in order to merge this last patch.

Fri, Feb 12, 10:58 PM · Jade, Projects-Cleanup
ACraze claimed T274680: Empty the JADE repository in Gerrit (superseded by Jade repository).
Fri, Feb 12, 10:48 PM · Jade, Projects-Cleanup

Wed, Feb 10

ACraze moved T273545: Kubeflow/KFServing Presentation from Active to Review on the Machine-Learning-Team (Active Tasks) board.
Wed, Feb 10, 7:49 PM · Machine-Learning-Team
ACraze added a comment to T273545: Kubeflow/KFServing Presentation.

Dropping a link to the slides here: https://docs.google.com/presentation/d/1hDk_qoC45x3rSRvEqI5IBJ1vVXLskQp4PTmgQNR3on0/edit?usp=sharing

Wed, Feb 10, 6:35 PM · Machine-Learning-Team

Tue, Feb 2

ACraze added a comment to T273545: Kubeflow/KFServing Presentation.

Just spitballing some ideas for the presentation here:

Tue, Feb 2, 11:19 PM · Machine-Learning-Team

Mon, Feb 1

ACraze added a comment to T272919: Install KFServing standalone.

Thanks @Theofpa ! We are considering helm as it is part of our SRE stack used across the Foundation, however I can see the operators being very beneficial for long term use.

Mon, Feb 1, 10:20 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)

Jan 28 2021

ACraze updated ACraze.
Jan 28 2021, 10:37 PM
ACraze added a comment to T272919: Install KFServing standalone.

I found an example of using helm to install the KFServing dependencies:
https://github.com/kubeflow/kfserving/blob/8a8f33a85a12ea4813f726b41581cbf9335ede9b/test/scripts/run-e2e-tests.sh#L57

Jan 28 2021, 7:47 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)

Jan 25 2021

ACraze updated the task description for T272917: Lift Wing proof of concept.
Jan 25 2021, 11:57 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze updated subscribers of T272919: Install KFServing standalone.

Here are my notes from installing KFServing on GKE last quarter: https://etherpad.wikimedia.org/p/kfserving-standalone
TLDR: there is a weird version mismatch issue between Knative & Istio that can potentially prevent us from using the transformer (pre/post-processing) and explainabilty features in KFServing.

Jan 25 2021, 11:52 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze updated the task description for T272919: Install KFServing standalone.
Jan 25 2021, 11:25 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze added a comment to T272918: Create ml-serve k8s cluster.

Some questions:

  • Do we know if there is a way to bootstrap a new wmf k8s cluster via puppet?
  • Otherwise, should we just create a small cluster using kubeadm?
Jan 25 2021, 11:12 PM · Patch-For-Review, Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze moved T272919: Install KFServing standalone from Active to On Deck on the Machine-Learning-Team (Active Tasks) board.
Jan 25 2021, 11:03 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze updated subscribers of T272918: Create ml-serve k8s cluster.
Jan 25 2021, 11:01 PM · Patch-For-Review, Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze triaged T272917: Lift Wing proof of concept as High priority.
Jan 25 2021, 11:00 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze updated the task description for T272917: Lift Wing proof of concept.
Jan 25 2021, 10:59 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze updated the task description for T272917: Lift Wing proof of concept.
Jan 25 2021, 10:56 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze updated the task description for T272917: Lift Wing proof of concept.
Jan 25 2021, 10:54 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze added a project to T272728: Testing Model: Lift-Wing.
Jan 25 2021, 10:48 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze added a subtask for T272917: Lift Wing proof of concept: T272728: Testing Model.
Jan 25 2021, 10:47 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze added a parent task for T272728: Testing Model: T272917: Lift Wing proof of concept.
Jan 25 2021, 10:47 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze added a project to T272919: Install KFServing standalone: Lift-Wing.
Jan 25 2021, 10:46 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze added a project to T272918: Create ml-serve k8s cluster: Lift-Wing.
Jan 25 2021, 10:45 PM · Patch-For-Review, Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze added a project to T272917: Lift Wing proof of concept: Lift-Wing.
Jan 25 2021, 10:43 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze added a subtask for T272917: Lift Wing proof of concept: T272919: Install KFServing standalone.
Jan 25 2021, 10:43 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze added a parent task for T272919: Install KFServing standalone: T272917: Lift Wing proof of concept.
Jan 25 2021, 10:43 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze created T272919: Install KFServing standalone.
Jan 25 2021, 10:42 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze added a subtask for T272917: Lift Wing proof of concept: T272918: Create ml-serve k8s cluster.
Jan 25 2021, 10:40 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze added a parent task for T272918: Create ml-serve k8s cluster: T272917: Lift Wing proof of concept.
Jan 25 2021, 10:40 PM · Patch-For-Review, Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze created T272918: Create ml-serve k8s cluster.
Jan 25 2021, 10:39 PM · Patch-For-Review, Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze created T272917: Lift Wing proof of concept.
Jan 25 2021, 10:37 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)
ACraze added a comment to T272874: Prepare 4 ORES English models for Lift Wing.

I experimented a bit with packaging a revscoring model as a custom KFServing model a few months back.
Here's the WIP code: https://gist.github.com/accraze/72e41bc2d2e11f3b03c8f795bf3f657e

Jan 25 2021, 8:02 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)

Jan 23 2021

ACraze added a comment to T272728: Testing Model.

Here's a simple BoostedTreesClassifier that I trained on the Titanic dataset today. It's in the Tensorflow SavedModel format, which is required by KFServing/TFServing:

Jan 23 2021, 12:21 AM · Lift-Wing, Machine-Learning-Team (Active Tasks)

Jan 22 2021

ACraze closed T272387: Clean Up Backlog Board as Resolved.
Jan 22 2021, 7:19 PM · Machine-Learning-Team (Active Tasks)
ACraze moved T272728: Testing Model from Review to Active on the Machine-Learning-Team (Active Tasks) board.
Jan 22 2021, 7:19 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)

Jan 20 2021

ACraze created T272541: Requesting ssh key change for production shell for Andy Craze.
Jan 20 2021, 8:32 PM · SRE, SRE-Access-Requests
ACraze moved T272387: Clean Up Backlog Board from Active to Review on the Machine-Learning-Team (Active Tasks) board.

@calbon The Backlog has been cleared out and stale tickets have been moved into the new columns. Many thanks to @Ladsgroup for running his bot and helping sort a bunch of the 'New development' and 'Monitoring' tasks.

Jan 20 2021, 1:06 AM · Machine-Learning-Team (Active Tasks)
ACraze moved T271134: Some Machine Learning clusters do not support IPv6 from Lift Wing to ORES on the Machine-Learning-Team board.
Jan 20 2021, 1:02 AM · User-crusnov, IPv6, Machine-Learning-Team, SRE-tools
ACraze moved T256085: Article Quality tokenizer error from Lift Wing to Needs More Evaluation on the Machine-Learning-Team board.
Jan 20 2021, 1:00 AM · Machine-Learning-Team
ACraze moved T247847: Proposal (GSoC 2020): Implement articlequality and draftquality model for ptwiki and apply insights to models for bs, uk, hi wikis from Lift Wing to Needs More Evaluation on the Machine-Learning-Team board.
Jan 20 2021, 12:59 AM · Machine-Learning-Team, artificial-intelligence, Google-Summer-of-Code (2020), Outreach-Programs-Projects
ACraze moved T249341: [Epic] Add drafttopic predictions to ElasticSearch index for the Draft namespace where available from Lift Wing to Needs More Evaluation on the Machine-Learning-Team board.
Jan 20 2021, 12:59 AM · Discovery-Search (Current work), Epic, drafttopic-modeling, Machine-Learning-Team
ACraze moved T240517: [EPIC] Growth: Newcomer tasks 1.1.1 (ORES topics) from Lift Wing to Needs More Evaluation on the Machine-Learning-Team board.
Jan 20 2021, 12:59 AM · Growth-Team (Current Sprint), Epic, Machine-Learning-Team, Discovery-Search
ACraze moved T132901: Use revision scoring to trigger flagged protection from Lift Wing to Needs More Evaluation on the Machine-Learning-Team board.
Jan 20 2021, 12:59 AM · MediaWiki-extensions-FlaggedRevs, Machine-Learning-Team
ACraze moved T223273: Update srwiki thresholds for goodfaith model from Lift Wing to Needs More Evaluation on the Machine-Learning-Team board.
Jan 20 2021, 12:58 AM · Growth-Team, Machine-Learning-Team
ACraze moved T217232: Outreach campaign to raise awareness of Scoring Platform from Lift Wing to Needs More Evaluation on the Machine-Learning-Team board.
Jan 20 2021, 12:58 AM · CommRel-Specialists-Support, Machine-Learning-Team
ACraze moved T210721: Contact number of some WMDE staff should be avalible to SRE/RelEng from Lift Wing to Needs More Evaluation on the Machine-Learning-Team board.
Jan 20 2021, 12:58 AM · Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, Machine-Learning-Team, SRE
ACraze moved T192478: Investigate PEP 503 repo for production deployment of python wheels from Lift Wing to Needs More Evaluation on the Machine-Learning-Team board.
Jan 20 2021, 12:58 AM · Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, Machine-Learning-Team, Performance Issue
ACraze moved T155538: General image classifier for commons from Lift Wing to Needs More Evaluation on the Machine-Learning-Team board.
Jan 20 2021, 12:57 AM · Wiki-Loves-Monuments, Wikimedia-Hackathon-2017, Research-Backlog, artificial-intelligence, Research ideas, Machine-Learning-Team
ACraze moved T169247: Document recommended process for installing vendor provided package upgrades in Wikimedia VPS from Lift Wing to Needs More Evaluation on the Machine-Learning-Team board.
Jan 20 2021, 12:57 AM · cloud-services-team (Kanban), Cloud-VPS, Machine-Learning-Team, Documentation
ACraze moved T194741: Productionize monthly article quality prediction datasets from New development to Needs More Evaluation on the Machine-Learning-Team board.
Jan 20 2021, 12:56 AM · Analytics-Radar, Machine-Learning-Team, artificial-intelligence, draftquality-modeling
ACraze moved T182611: Train/test reverted edittype model for Catalan Wikipedia from New development to Needs More Evaluation on the Machine-Learning-Team board.
Jan 20 2021, 12:55 AM · Machine-Learning-Team, edittypes-modeling, artificial-intelligence
ACraze moved T196634: Deploy pilot edittype model from New development to Needs More Evaluation on the Machine-Learning-Team board.
Jan 20 2021, 12:55 AM · Machine-Learning-Team, edittypes-modeling, artificial-intelligence
ACraze moved T167362: Draft specification of article importance API from New development to Needs More Evaluation on the Machine-Learning-Team board.
Jan 20 2021, 12:55 AM · Machine-Learning-Team, artificial-intelligence
ACraze moved T198586: Enable the use of last flagged revision as parent revision in revscoring API extractor from New development to ORES on the Machine-Learning-Team board.
Jan 20 2021, 12:54 AM · User-Cirdan, ORES, Machine-Learning-Team, MediaWiki-extensions-FlaggedRevs
ACraze moved T191768: Support for languages in ores-support-checklist from New development to ORES on the Machine-Learning-Team board.
Jan 20 2021, 12:54 AM · Machine-Learning-Team, ORES-Support-Checklist
ACraze moved T191765: Make a bot that updates mediawiki page using ores-support-checklist automatically from New development to ORES on the Machine-Learning-Team board.
Jan 20 2021, 12:53 AM · Machine-Learning-Team, ORES-Support-Checklist
ACraze moved T209732: Wire ORES recent_score events into Hadoop from New development to ORES on the Machine-Learning-Team board.
Jan 20 2021, 12:53 AM · Analytics-Radar, Machine-Learning-Team, Services (watching), Patch-For-Review, ORES
ACraze moved T209742: Purge ORES scores from Hadoop and begin backfill when model version changes from New development to ORES on the Machine-Learning-Team board.
Jan 20 2021, 12:53 AM · Analytics-Radar, ORES, Machine-Learning-Team
ACraze moved T209734: Include feature values in ORES changeprop stream from New development to ORES on the Machine-Learning-Team board.
Jan 20 2021, 12:52 AM · Analytics-Radar, ORES, Machine-Learning-Team
ACraze moved T209737: Backfill ORES Hadoop scores with historical data from New development to ORES on the Machine-Learning-Team board.
Jan 20 2021, 12:52 AM · Analytics-Radar, Machine-Learning-Team, ORES
ACraze moved T209739: Produce dump files for ORES scores from New development to ORES on the Machine-Learning-Team board.
Jan 20 2021, 12:52 AM · Analytics-Radar, Dumps-Generation, ORES, Machine-Learning-Team
ACraze moved T214545: Emit synthetic mediawiki.revision-score events for both datacenters from New development to ORES on the Machine-Learning-Team board.
Jan 20 2021, 12:52 AM · Analytics-Radar, Machine-Learning-Team, ORES

Jan 19 2021

ACraze added a comment to T215543: Automated support for checking model fitness changes .

Using something like alibi-detect would make this pretty simple: https://github.com/SeldonIO/alibi-detect

Jan 19 2021, 10:43 PM · Machine-Learning-Team
ACraze moved T215543: Automated support for checking model fitness changes from New development to Needs More Evaluation on the Machine-Learning-Team board.
Jan 19 2021, 10:41 PM · Machine-Learning-Team
ACraze moved T209960: Allow privileged users to label deleted revision in Wikilabels from New development to Wikilabels on the Machine-Learning-Team board.
Jan 19 2021, 10:41 PM · Machine-Learning-Team, Wikilabels
ACraze moved T214723: Modify revscoring extract utility to include root datasources from New development to Revscoring on the Machine-Learning-Team board.
Jan 19 2021, 10:41 PM · Machine-Learning-Team, ORES, revscoring, artificial-intelligence
ACraze moved T208239: Make a wikilabels view to see a single task. from New development to Wikilabels on the Machine-Learning-Team board.
Jan 19 2021, 10:41 PM · Wikilabels, Machine-Learning-Team
ACraze moved T191214: Edittypes repo setup from New development to Needs More Evaluation on the Machine-Learning-Team board.
Jan 19 2021, 10:41 PM · Machine-Learning-Team, artificial-intelligence, edittypes-modeling
ACraze moved T214054: Stress test ORES/kubernetes (above 4.5k scores/second) from New development to ORES on the Machine-Learning-Team board.
Jan 19 2021, 10:40 PM · Performance Issue, SRE, ORES, Machine-Learning-Team
ACraze moved T197007: Take advantage of word2vec signal in all models from New development to ORES on the Machine-Learning-Team board.
Jan 19 2021, 10:40 PM · Machine-Learning-Team, ORES
ACraze moved T209649: Be able to flag judgments for additional participation from New development to Jade on the Machine-Learning-Team board.
Jan 19 2021, 10:40 PM · Machine-Learning-Team, Jade
ACraze moved T131481: Train/test copyvio detection model for text from New development to Revscoring on the Machine-Learning-Team board.
Jan 19 2021, 10:40 PM · artificial-intelligence, Machine-Learning-Team, revscoring
ACraze moved T209653: "Report error" button for ORES recent changes filter from New development to ORES on the Machine-Learning-Team board.
Jan 19 2021, 10:40 PM · Growth-Team, Machine-Learning-Team, Edit-Review-Improvements, Jade
ACraze moved T190768: Add ORES editquality highlighting/filtering to article's history from New development to ORES on the Machine-Learning-Team board.
Jan 19 2021, 10:39 PM · artificial-intelligence, editquality-modeling, MediaWiki-Interface, MediaWiki-extensions-ORES, Machine-Learning-Team, ORES
ACraze moved T223829: Implement citation classifier features for quality models from New development to Revscoring on the Machine-Learning-Team board.
Jan 19 2021, 10:39 PM · articlequality-modeling, editquality-modeling, artificial-intelligence, Machine-Learning-Team
ACraze moved T213117: Propose Jade integration with countervandalism network (CVN) from New development to Jade on the Machine-Learning-Team board.
Jan 19 2021, 10:39 PM · Machine-Learning-Team, Jade
ACraze moved T135495: Metrics around distinct user agents that hit ORES from New development to ORES on the Machine-Learning-Team board.
Jan 19 2021, 10:39 PM · Machine-Learning-Team, ORES
ACraze moved T173244: [Investigate] Use PMML for prediction model serialization from New development to Wikilabels on the Machine-Learning-Team board.
Jan 19 2021, 10:38 PM · Analytics-Radar, ORES, Machine-Learning-Team, artificial-intelligence, revscoring
ACraze moved T166786: Semi-supervised, supervised learning for 2nd edit quality campaigns from New development to Revscoring on the Machine-Learning-Team board.
Jan 19 2021, 10:38 PM · artificial-intelligence, revscoring, Machine-Learning-Team
ACraze moved T102344: [Spike] Explore how we could train models on suppressed and revdeleted content from New development to Needs More Evaluation on the Machine-Learning-Team board.
Jan 19 2021, 10:38 PM · Spike, Machine-Learning-Team
ACraze moved T106869: Implement priority prediction functionality for WikiProject tasks module from New development to Needs More Evaluation on the Machine-Learning-Team board.
Jan 19 2021, 10:38 PM · Reports-bot, Machine-Learning-Team
ACraze moved T143123: [Spike] Semi-supervised machine learning from New development to Needs More Evaluation on the Machine-Learning-Team board.
Jan 19 2021, 10:38 PM · artificial-intelligence, Spike, Machine-Learning-Team
ACraze moved T121715: Train edit types model on labeled data for English Wikipedia from New development to ORES on the Machine-Learning-Team board.
Jan 19 2021, 10:38 PM · Machine-Learning-Team, artificial-intelligence, edittypes-modeling
ACraze moved T177245: Implement "orientation" for Flow's Structured Discussion revisions from New development to ORES on the Machine-Learning-Team board.
Jan 19 2021, 10:37 PM · Growth-Team, Machine-Learning-Team, ORES, Collaboration-Team-Triage, StructuredDiscussions
ACraze moved T117425: Develop manual testing strategy for bias detection from New development to Revscoring on the Machine-Learning-Team board.
Jan 19 2021, 10:37 PM · artificial-intelligence, revscoring, Machine-Learning-Team
ACraze moved T115566: Text normalization as part of regex extractor from New development to Revscoring on the Machine-Learning-Team board.
Jan 19 2021, 10:37 PM · artificial-intelligence, revscoring, Machine-Learning-Team
ACraze moved T116938: Train 'reverted' model for commonswiki from New development to ORES on the Machine-Learning-Team board.
Jan 19 2021, 10:37 PM · artificial-intelligence, Machine-Learning-Team, editquality-modeling, Commons
ACraze moved T102340: Add turkish stemmer to NLTK from New development to Needs More Evaluation on the Machine-Learning-Team board.
Jan 19 2021, 10:36 PM · Machine-Learning-Team, Upstream
ACraze moved T106279: Re-broadcast RCStream with ORES scores from New development to ORES on the Machine-Learning-Team board.
Jan 19 2021, 10:36 PM · Growth-Team, Machine-Learning-Team