Page MenuHomePhabricator
Feed Advanced Search

Yesterday

calbon added a comment to T280107: Generate dump of scored-revisions from 2018-2020 for Wikis except English Wikipedia.

Would it be possible to get all ORES scores ever as a one-off-job and then dump them online somewhere?

Wed, Apr 14, 4:01 PM · artificial-intelligence, editquality-modeling, ORES, Analytics, Machine-Learning-Team

Sun, Apr 11

calbon added a comment to T279134: GSOC 2021 Proposal : Retraining models from ORES to be deployable on Lift Wing.

Just seconding Chtnnh here. More technical details in approach would help the evaluation process.

Sun, Apr 11, 3:42 PM · Google-Summer-of-Code (2021)
calbon added a comment to T279819: Retraining models from ORES to be deployable on Lift Wing.

Thanks Chtnnh for helping Vini7148!

Sun, Apr 11, 3:39 PM · Google-Summer-of-Code (2021)

Wed, Apr 7

calbon added a comment to T276398: Experiment with on-wiki model documentation.

Oh awesome thanks Isaac. Where do you host the Python code?

Wed, Apr 7, 6:26 PM · Machine-Learning-Team (Active Tasks), Documentation, artificial-intelligence

Mon, Mar 22

calbon added a comment to T277609: Generate dump of scored-revisions from 2018-2020 for English Wikipedia.

This looks super interesting, when the data is out there I'd love to have it posted for a potential internship or GSoC project.

Mon, Mar 22, 5:46 PM · Data-Services, artificial-intelligence, editquality-modeling, ORES, Analytics, Machine-Learning-Team

Thu, Mar 18

calbon added a comment to T250110: New Service Request 'open_nsfw'.

Sounds great! Can you post here when the model is up on toolforge? I'd love to take a look.

Thu, Mar 18, 5:01 PM · artificial-intelligence, Service-deployment-requests, Services, SRE

Tue, Mar 16

calbon added a comment to T276862: Load a fastText model in to KFServing.

This is a good lesson for us about adding custom model library services into Lift Wing. That said, I suspec fastText is the easy case because it is so well supported generally.

Tue, Mar 16, 2:51 PM · Lift-Wing, Machine-Learning-Team

Mar 5 2021

Chtnnh awarded T276598: Create Draft Model Deployment Guidelines a Love token.
Mar 5 2021, 6:01 PM · AI-Governance, ORES, Lift-Wing, artificial-intelligence, Machine-Learning-Team (Active Tasks)
calbon created T276604: Have Public Comment Period.
Mar 5 2021, 5:57 PM · AI-Governance, Machine-Learning-Team (Active Tasks)
calbon created T276603: Publish Draft Guidlines.
Mar 5 2021, 5:56 PM · AI-Governance, Machine-Learning-Team (Active Tasks)
calbon created T276602: Talk with WMF Product Team.
Mar 5 2021, 5:55 PM · AI-Governance, Machine-Learning-Team (Active Tasks)
calbon created T276600: Talk with WMF Research Team.
Mar 5 2021, 5:54 PM · AI-Governance, Machine-Learning-Team (Active Tasks)
calbon created T276599: Talk with WMF Trust & Safety team.
Mar 5 2021, 5:54 PM · AI-Governance, Machine-Learning-Team (Active Tasks)
calbon created T276598: Create Draft Model Deployment Guidelines .
Mar 5 2021, 5:52 PM · AI-Governance, ORES, Lift-Wing, artificial-intelligence, Machine-Learning-Team (Active Tasks)

Mar 3 2021

calbon added a comment to T276398: Experiment with on-wiki model documentation.

Let's try whichever one is the easiest to start out with. That'll give us a good idea of the lowest hanging fruit are.

Mar 3 2021, 11:22 PM · Machine-Learning-Team (Active Tasks), Documentation, artificial-intelligence

Feb 12 2021

calbon added a comment to T264774: Create three Phab Projects for Machine Learning: Lift Wing, Pilot Flag, Test Grounds.

None yet, but soon

Feb 12 2021, 6:33 PM · Project-Admins

Feb 9 2021

calbon added a comment to T273741: Investigate unusual media traffic pattern for AsterNovi-belgii-flower-1mb.jpg on Commons.

Just to second what @fdans said, the data detective work was great and this was such a fun ticket to watch.

Feb 9 2021, 5:50 PM · Commons, Traffic, SRE

Feb 4 2021

calbon updated subscribers of T273549: Revamp our Machine Learning Team page on mediawiki.org.

@kevinbazira did a great pass, I need to do another to update a lot of the language.

Feb 4 2021, 7:19 PM · Machine-Learning-Team (Active Tasks)

Feb 1 2021

calbon updated the task description for T272874: Prepare 4 ORES English models for Lift Wing.
Feb 1 2021, 10:45 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)
calbon updated the task description for T272874: Prepare 4 ORES English models for Lift Wing.
Feb 1 2021, 10:43 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)
calbon renamed T272874: Prepare 4 ORES English models for Lift Wing from TKTK migrate 4 ORES english models to Lift wing to Prepare 4 ORES English models for Lift Wing.
Feb 1 2021, 10:37 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)
calbon closed T245449: Get pytorch running on AMD GPU as Declined.
Feb 1 2021, 10:35 PM · Machine-Learning-Team, Analytics
calbon created T273549: Revamp our Machine Learning Team page on mediawiki.org.
Feb 1 2021, 10:34 PM · Machine-Learning-Team (Active Tasks)
calbon claimed T273547: Publish a "How we work" doc.
Feb 1 2021, 10:31 PM · Machine-Learning-Team (Active Tasks)
calbon created T273547: Publish a "How we work" doc.
Feb 1 2021, 10:30 PM · Machine-Learning-Team (Active Tasks)
calbon created T273546: Publish 18 Month Roadmap.
Feb 1 2021, 10:29 PM · Machine-Learning-Team (Active Tasks)
calbon created T273545: Kubeflow/KFServing Presentation.
Feb 1 2021, 10:27 PM · Machine-Learning-Team

Jan 29 2021

calbon added a comment to T272874: Prepare 4 ORES English models for Lift Wing.

oh right, I remember really struggling with enchant. Yeah, I might work on a docker image to do this because it was really brutal last time to config my environment

Jan 29 2021, 12:33 AM · Lift-Wing, Machine-Learning-Team (Active Tasks)

Jan 28 2021

calbon renamed Machine-Learning-Team (Active Tasks) from Current Tasks to Active Tasks.
Jan 28 2021, 6:40 PM
calbon renamed Machine-Learning-Team (Active Tasks) from Active Tasks to Current Tasks.
Jan 28 2021, 6:38 PM
calbon edited Description on Machine-Learning-Team (Active Tasks).
Jan 28 2021, 6:38 PM
calbon renamed Machine-Learning-Team (Active Tasks) from Current to Active Tasks.
Jan 28 2021, 6:33 PM
calbon renamed Machine-Learning-Team from Machine Learning Platform to Machine Learning Team.
Jan 28 2021, 6:30 PM
calbon moved T269169: Create Draft Documentation For Moving Models Into Lift Wing from Active Tasks to Lift Wing on the Machine-Learning-Team board.
Jan 28 2021, 6:20 PM · Machine-Learning-Team, Lift-Wing
calbon moved T265066: Proof of concept: dockerized model served over CloudVPS from Active Tasks to Unorganized on the Machine-Learning-Team board.
Jan 28 2021, 6:20 PM · Machine-Learning-Team
calbon moved T264651: Migrate ORES/Revscoring/etc. repos to Gitlab or Gerrit from Active Tasks to Unorganized on the Machine-Learning-Team board.
Jan 28 2021, 6:20 PM · Machine-Learning-Team, ORES
calbon closed T265067: Publish Heavy Wing design doc to Wikitech as Resolved.
Jan 28 2021, 6:19 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)
calbon moved T269171: Create documentation for a workflow for evaluating models submitted for deployment. from Active Tasks to Unorganized on the Machine-Learning-Team board.
Jan 28 2021, 6:19 PM · Machine-Learning-Team
calbon moved T265066: Proof of concept: dockerized model served over CloudVPS from Active to On Deck on the Machine-Learning-Team (Active Tasks) board.
Jan 28 2021, 5:53 PM · Machine-Learning-Team
calbon moved T264651: Migrate ORES/Revscoring/etc. repos to Gitlab or Gerrit from Active to On Deck on the Machine-Learning-Team (Active Tasks) board.
Jan 28 2021, 5:53 PM · Machine-Learning-Team, ORES
calbon moved T269169: Create Draft Documentation For Moving Models Into Lift Wing from Active to On Deck on the Machine-Learning-Team (Active Tasks) board.
Jan 28 2021, 5:50 PM · Machine-Learning-Team, Lift-Wing
calbon moved T269171: Create documentation for a workflow for evaluating models submitted for deployment. from Active to On Deck on the Machine-Learning-Team (Active Tasks) board.
Jan 28 2021, 5:50 PM · Machine-Learning-Team
calbon closed T272728: Testing Model as Resolved.
Jan 28 2021, 5:50 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)
calbon closed T272728: Testing Model, a subtask of T272917: Lift Wing proof of concept, as Resolved.
Jan 28 2021, 5:50 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)
calbon added a comment to T272728: Testing Model.

Great, it all looks good. I am going to close this task

Jan 28 2021, 5:50 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)

Jan 25 2021

calbon created T272874: Prepare 4 ORES English models for Lift Wing.
Jan 25 2021, 5:10 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)

Jan 22 2021

calbon created T272728: Testing Model.
Jan 22 2021, 6:34 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)
calbon added a comment to T272687: Give access to ml-serve* to the non-ops members of the ML team.

kbazira needs access too

Jan 22 2021, 6:06 PM · Machine-Learning-Team (Active Tasks), SRE, SRE-Access-Requests

Jan 20 2021

calbon added a comment to T272541: Requesting ssh key change for production shell for Andy Craze.

I approve

Jan 20 2021, 8:33 PM · SRE, SRE-Access-Requests
calbon closed T249382: Scale: ORES topic models for uk, hu, hy, eu, sr (needed as soon as available) as Resolved.
Jan 20 2021, 6:40 PM · Machine-Learning-Team (Active Tasks), Serbian-Sites, Growth-Scaling, Growth-Team
calbon closed T258735: Build articlequality model for Hindi wiki as Resolved.
Jan 20 2021, 6:39 PM · Machine-Learning-Team (Active Tasks), artificial-intelligence, articlequality-modeling
calbon closed T258735: Build articlequality model for Hindi wiki, a subtask of T247847: Proposal (GSoC 2020): Implement articlequality and draftquality model for ptwiki and apply insights to models for bs, uk, hi wikis, as Resolved.
Jan 20 2021, 6:39 PM · Machine-Learning-Team, artificial-intelligence, Google-Summer-of-Code (2020), Outreach-Programs-Projects
calbon moved T258735: Build articlequality model for Hindi wiki from Done to Pending deployment on the Machine-Learning-Team (Active Tasks) board.
Jan 20 2021, 6:39 PM · Machine-Learning-Team (Active Tasks), artificial-intelligence, articlequality-modeling
calbon closed T249382: Scale: ORES topic models for uk, hu, hy, eu, sr (needed as soon as available), a subtask of T247507: Scale: deploy Growth features to 100 wikis, as Resolved.
Jan 20 2021, 6:39 PM · Goal, Growth-Scaling, Growth-Team (Current Sprint)
calbon moved T249382: Scale: ORES topic models for uk, hu, hy, eu, sr (needed as soon as available) from Done to Pending deployment on the Machine-Learning-Team (Active Tasks) board.
Jan 20 2021, 6:39 PM · Machine-Learning-Team (Active Tasks), Serbian-Sites, Growth-Scaling, Growth-Team
calbon updated the task description for T272513: upgrade kernel of liftwing machines.
Jan 20 2021, 6:38 PM · Machine-Learning-Team (Active Tasks)
calbon created T272513: upgrade kernel of liftwing machines.
Jan 20 2021, 5:24 PM · Machine-Learning-Team (Active Tasks)

Jan 19 2021

calbon created T272387: Clean Up Backlog Board.
Jan 19 2021, 3:34 PM · Machine-Learning-Team (Active Tasks)

Jan 6 2021

calbon added a comment to T267050: (Need By: TBD) rack/setup/install ml-serve100[1-4].

@Jclark-ctr Got it. Thanks.

Jan 6 2021, 5:27 PM · ops-eqiad, SRE, DC-Ops
calbon added a comment to T267050: (Need By: TBD) rack/setup/install ml-serve100[1-4].

@Jclark-ctr Thanks for the photos. For clarification, does this mean the GPU does not fit or that the GPU does fit but any future GPU's order should be smaller in dimensions?

Jan 6 2021, 5:23 PM · ops-eqiad, SRE, DC-Ops

Jan 5 2021

calbon added a comment to T263910: ORES redis: max number of clients reached....

I'm just happy I am not resetting it every few hours. One of our goals was to put it in a stable mode and we've done it!

Jan 5 2021, 3:11 PM · User-Ladsgroup, Sustainability (Incident Followup), Patch-For-Review, Okapi [Wikimedia Enterprise], serviceops, SRE, Machine-Learning-Team, ORES

Dec 1 2020

calbon created T269171: Create documentation for a workflow for evaluating models submitted for deployment..
Dec 1 2020, 9:39 PM · Machine-Learning-Team
calbon added a project to T269169: Create Draft Documentation For Moving Models Into Lift Wing: Lift-Wing.
Dec 1 2020, 9:36 PM · Machine-Learning-Team, Lift-Wing
calbon created T269169: Create Draft Documentation For Moving Models Into Lift Wing.
Dec 1 2020, 9:35 PM · Machine-Learning-Team, Lift-Wing
calbon updated subscribers of T264651: Migrate ORES/Revscoring/etc. repos to Gitlab or Gerrit.

@ACraze can you take a look at this and see how hard it would be.

Dec 1 2020, 6:22 PM · Machine-Learning-Team, ORES
calbon moved T264651: Migrate ORES/Revscoring/etc. repos to Gitlab or Gerrit from On Deck to Active on the Machine-Learning-Team (Active Tasks) board.
Dec 1 2020, 6:21 PM · Machine-Learning-Team, ORES
calbon triaged T264651: Migrate ORES/Revscoring/etc. repos to Gitlab or Gerrit as Medium priority.
Dec 1 2020, 6:21 PM · Machine-Learning-Team, ORES
calbon moved T265066: Proof of concept: dockerized model served over CloudVPS from Review to Active on the Machine-Learning-Team (Active Tasks) board.
Dec 1 2020, 6:14 PM · Machine-Learning-Team
calbon moved T265066: Proof of concept: dockerized model served over CloudVPS from Active to Review on the Machine-Learning-Team (Active Tasks) board.
Dec 1 2020, 6:14 PM · Machine-Learning-Team
calbon closed T264224: Evaluate Potential Amazon Data Donation as Resolved.
Dec 1 2020, 6:14 PM · draftquality-modeling, articlequality-modeling, artificial-intelligence, editquality-modeling, Machine-Learning-Team (Active Tasks)
calbon closed T264121: Script to restart ORES uwsgi service as Resolved.
Dec 1 2020, 6:14 PM · ORES, Machine-Learning-Team (Active Tasks)
calbon moved T264224: Evaluate Potential Amazon Data Donation from Review to Pending deployment on the Machine-Learning-Team (Active Tasks) board.
Dec 1 2020, 6:14 PM · draftquality-modeling, articlequality-modeling, artificial-intelligence, editquality-modeling, Machine-Learning-Team (Active Tasks)
calbon moved T264121: Script to restart ORES uwsgi service from Active to Pending deployment on the Machine-Learning-Team (Active Tasks) board.
Dec 1 2020, 6:14 PM · ORES, Machine-Learning-Team (Active Tasks)
calbon closed T265068: Publish Test Grounds design doc to Wikitech as Declined.
Dec 1 2020, 6:13 PM · Test-Grounds, Machine-Learning-Team (Active Tasks)
calbon closed T265069: Publish Pilot Flag design doc to Wikitech as Declined.
Dec 1 2020, 6:13 PM · Pilot-Flag, Machine-Learning-Team (Active Tasks)

Nov 16 2020

calbon added a comment to T131553: Look into matching images of the same painting.

Yeah this is definitely a nice task to jump in, Mat.

Nov 16 2020, 6:47 PM · artificial-intelligence, Machine-Learning-Team (Research)
calbon added a comment to T242819: ores.wmflabs.org - 503 icinga alerts.

@Ladsgroup Yeah go ahead.

Nov 16 2020, 5:02 PM · Patch-For-Review, Machine-Learning-Team (Active Tasks), SRE, ORES

Nov 9 2020

calbon added a comment to T263910: ORES redis: max number of clients reached....
Nov 9 2020, 2:28 PM · User-Ladsgroup, Sustainability (Incident Followup), Patch-For-Review, Okapi [Wikimedia Enterprise], serviceops, SRE, Machine-Learning-Team, ORES

Nov 6 2020

calbon added a comment to T263910: ORES redis: max number of clients reached....

@akosiaris Can you review it? I don't know enough about the nodes vs redis connection to intelligently review.

Nov 6 2020, 7:19 PM · User-Ladsgroup, Sustainability (Incident Followup), Patch-For-Review, Okapi [Wikimedia Enterprise], serviceops, SRE, Machine-Learning-Team, ORES

Oct 29 2020

calbon added a comment to T266498: New prod ssh key for calbon.

yep it works, thanks all!

Oct 29 2020, 3:49 PM · SRE-Access-Requests, SRE

Oct 26 2020

calbon created T266498: New prod ssh key for calbon.
Oct 26 2020, 6:26 PM · SRE-Access-Requests, SRE

Oct 22 2020

calbon closed T266254: Rename "Heavy Wing" as Resolved.
Oct 22 2020, 5:36 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)
calbon added a comment to T266254: Rename "Heavy Wing".

Lift Wing it is. Closing task.

Oct 22 2020, 5:36 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)
calbon changed hashtags for Lift-Wing, added #lift-wing; removed #heavy-wing.
Oct 22 2020, 5:35 PM
calbon renamed Lift-Wing from Heavy-Wing to Lift-Wing.
Oct 22 2020, 5:35 PM
calbon added a comment to T266254: Rename "Heavy Wing".

I kinda like Lift Wing. It keeps the idea of a the platform being a "wing" for models while invoking the concept of Model Lift.

Oct 22 2020, 5:16 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)
calbon added a comment to T266254: Rename "Heavy Wing".

"liftwing" - 6,780 results - no meaning

Oct 22 2020, 5:04 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)
calbon added a comment to T266254: Rename "Heavy Wing".
Oct 22 2020, 5:03 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)
calbon added a comment to T266254: Rename "Heavy Wing".

"rock wing" - 40,500 - no meaning

Oct 22 2020, 5:01 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)
calbon updated the task description for T266254: Rename "Heavy Wing".
Oct 22 2020, 4:43 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)
calbon updated subscribers of T266254: Rename "Heavy Wing".

@LarsWirzenius had the idea of random Swedish or english words:

Oct 22 2020, 4:40 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)
calbon created T266254: Rename "Heavy Wing".
Oct 22 2020, 4:37 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)

Oct 15 2020

calbon added a comment to T264224: Evaluate Potential Amazon Data Donation.

Based on feedback from Research and Legal, our requirements for this are:

Oct 15 2020, 5:12 PM · draftquality-modeling, articlequality-modeling, artificial-intelligence, editquality-modeling, Machine-Learning-Team (Active Tasks)
calbon added a comment to T265172: Requesting adding to ores-admin for Ladsgroup.

Approved! Thank you much Amir for the help!

Oct 15 2020, 4:21 PM · Machine-Learning-Team, SRE, SRE-Access-Requests
calbon closed T265083: Request increased quota for ores.calbon-test Cloud VPS project as Resolved.

Oh awesome. I was just working through the docs and the next part was the floating IP section, which I didn't have a quota for.

Oct 15 2020, 3:57 PM · Cloud-VPS (Quota-requests)

Oct 9 2020

calbon added a comment to T264121: Script to restart ORES uwsgi service.

I was thinking of sometime more simple: using fabric as a local script (run manually) to ssh into bastion, jumpproxy to an ores box, restart the service. Then I can just loop that if we need to restart ores. It isn't a long term solution but it beats sshing into each one manually

Oct 9 2020, 9:05 PM · ORES, Machine-Learning-Team (Active Tasks)

Oct 8 2020

calbon added a comment to T264121: Script to restart ORES uwsgi service.

Due to T263910: ORES redis: max number of clients reached... continuing to be a problem (I suspect), I am bringing back this task. Cumin isn't an option because it is SRE-specific. I'll get on coding it up in fabric.

Oct 8 2020, 9:33 PM · ORES, Machine-Learning-Team (Active Tasks)
calbon reopened T264121: Script to restart ORES uwsgi service as "Open".
Oct 8 2020, 9:32 PM · ORES, Machine-Learning-Team (Active Tasks)
calbon added a comment to T263910: ORES redis: max number of clients reached....

Suspiciously similar just happened to ores on eqiad. I reset the uwsgi service on all ores100x boxes and will monitor.

Oct 8 2020, 9:28 PM · User-Ladsgroup, Sustainability (Incident Followup), Patch-For-Review, Okapi [Wikimedia Enterprise], serviceops, SRE, Machine-Learning-Team, ORES
calbon created T265083: Request increased quota for ores.calbon-test Cloud VPS project.
Oct 8 2020, 8:03 PM · Cloud-VPS (Quota-requests)