calbon renamed T272874: Prepare 4 ORES English models for Lift Wing from TKTK migrate 4 ORES english models to Lift wing to Prepare 4 ORES English models for Lift Wing.

Mon, Feb 1, 10:37 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)

calbon closed T245449: Get pytorch running on AMD GPU as Declined.

Mon, Feb 1, 10:35 PM · Machine-Learning-Team, Analytics

calbon created T273549: Revamp our Machine Learning Team page on mediawiki.org.

Mon, Feb 1, 10:34 PM · Machine-Learning-Team (Active Tasks)

calbon claimed T273547: Publish a "How we work" doc.

Mon, Feb 1, 10:31 PM · Machine-Learning-Team (Active Tasks)

calbon created T273547: Publish a "How we work" doc.

Mon, Feb 1, 10:30 PM · Machine-Learning-Team (Active Tasks)

calbon created T273546: Publish 18 Month Roadmap.

Mon, Feb 1, 10:29 PM · Machine-Learning-Team (Active Tasks)

calbon created T273545: Kubeflow/KFServing Presentation.

Mon, Feb 1, 10:27 PM · Machine-Learning-Team

Jan 29 2021

calbon added a comment to T272874: Prepare 4 ORES English models for Lift Wing.

oh right, I remember really struggling with enchant. Yeah, I might work on a docker image to do this because it was really brutal last time to config my environment

Jan 29 2021, 12:33 AM · Lift-Wing, Machine-Learning-Team (Active Tasks)

Jan 28 2021

calbon renamed Machine-Learning-Team (Active Tasks) from Current Tasks to Active Tasks.

Jan 28 2021, 6:40 PM

calbon renamed Machine-Learning-Team (Active Tasks) from Active Tasks to Current Tasks.

Jan 28 2021, 6:38 PM

calbon edited Description on Machine-Learning-Team (Active Tasks).

Jan 28 2021, 6:38 PM

calbon renamed Machine-Learning-Team (Active Tasks) from Current to Active Tasks.

Jan 28 2021, 6:33 PM

calbon renamed Machine-Learning-Team from Machine Learning Platform to Machine Learning Team.

Jan 28 2021, 6:30 PM

calbon moved T269169: Create Draft Documentation For Moving Models Into Lift Wing from Active Tasks to Lift Wing on the Machine-Learning-Team board.

Jan 28 2021, 6:20 PM · Machine-Learning-Team, Lift-Wing

calbon moved T265066: Proof of concept: dockerized model served over CloudVPS from Active Tasks to Unorganized on the Machine-Learning-Team board.

Jan 28 2021, 6:20 PM · Machine-Learning-Team

calbon moved T264651: Migrate ORES/Revscoring/etc. repos to Gitlab or Gerrit from Active Tasks to Unorganized on the Machine-Learning-Team board.

Jan 28 2021, 6:20 PM · Machine-Learning-Team, ORES

calbon closed T265067: Publish Heavy Wing design doc to Wikitech as Resolved.

Jan 28 2021, 6:19 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)

calbon moved T269171: Create documentation for a workflow for evaluating models submitted for deployment. from Active Tasks to Unorganized on the Machine-Learning-Team board.

Jan 28 2021, 6:19 PM · Machine-Learning-Team

calbon moved T265066: Proof of concept: dockerized model served over CloudVPS from Active to On Deck on the Machine-Learning-Team (Active Tasks) board.

Jan 28 2021, 5:53 PM · Machine-Learning-Team

calbon moved T264651: Migrate ORES/Revscoring/etc. repos to Gitlab or Gerrit from Active to On Deck on the Machine-Learning-Team (Active Tasks) board.

Jan 28 2021, 5:53 PM · Machine-Learning-Team, ORES

calbon moved T269169: Create Draft Documentation For Moving Models Into Lift Wing from Active to On Deck on the Machine-Learning-Team (Active Tasks) board.

Jan 28 2021, 5:50 PM · Machine-Learning-Team, Lift-Wing

calbon moved T269171: Create documentation for a workflow for evaluating models submitted for deployment. from Active to On Deck on the Machine-Learning-Team (Active Tasks) board.

Jan 28 2021, 5:50 PM · Machine-Learning-Team

calbon closed T272728: Testing Model as Resolved.

Jan 28 2021, 5:50 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)

calbon closed T272728: Testing Model, a subtask of T272917: Lift Wing proof of concept, as Resolved.

Jan 28 2021, 5:50 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)

calbon added a comment to T272728: Testing Model.

Great, it all looks good. I am going to close this task

Jan 28 2021, 5:50 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)

Jan 25 2021

calbon created T272874: Prepare 4 ORES English models for Lift Wing.

Jan 25 2021, 5:10 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)

Jan 22 2021

calbon created T272728: Testing Model.

Jan 22 2021, 6:34 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)

calbon added a comment to T272687: Give access to ml-serve* to the non-ops members of the ML team.

kbazira needs access too

Jan 22 2021, 6:06 PM · Machine-Learning-Team (Active Tasks), SRE, SRE-Access-Requests

Jan 20 2021

calbon added a comment to T272541: Requesting ssh key change for production shell for Andy Craze.

I approve

Jan 20 2021, 8:33 PM · SRE, SRE-Access-Requests

calbon closed T249382: Scale: ORES topic models for uk, hu, hy, eu, sr (needed as soon as available) as Resolved.

Jan 20 2021, 6:40 PM · Machine-Learning-Team (Active Tasks), Serbian-Sites, Growth-Scaling, Growth-Team

calbon closed T258735: Build articlequality model for Hindi wiki as Resolved.

Jan 20 2021, 6:39 PM · Machine-Learning-Team (Active Tasks), artificial-intelligence, articlequality-modeling

calbon closed T258735: Build articlequality model for Hindi wiki, a subtask of T247847: Proposal (GSoC 2020): Implement articlequality and draftquality model for ptwiki and apply insights to models for bs, uk, hi wikis, as Resolved.

Jan 20 2021, 6:39 PM · Machine-Learning-Team, artificial-intelligence, Google-Summer-of-Code (2020), Outreach-Programs-Projects

calbon moved T258735: Build articlequality model for Hindi wiki from Done to Pending deployment on the Machine-Learning-Team (Active Tasks) board.

Jan 20 2021, 6:39 PM · Machine-Learning-Team (Active Tasks), artificial-intelligence, articlequality-modeling

calbon closed T249382: Scale: ORES topic models for uk, hu, hy, eu, sr (needed as soon as available), a subtask of T247507: Scale: deploy Growth features to 100 wikis, as Resolved.

Jan 20 2021, 6:39 PM · Goal, Growth-Scaling, Growth-Team (Current Sprint)

calbon moved T249382: Scale: ORES topic models for uk, hu, hy, eu, sr (needed as soon as available) from Done to Pending deployment on the Machine-Learning-Team (Active Tasks) board.

Jan 20 2021, 6:39 PM · Machine-Learning-Team (Active Tasks), Serbian-Sites, Growth-Scaling, Growth-Team

calbon updated the task description for T272513: upgrade kernel of liftwing machines.

Jan 20 2021, 6:38 PM · Machine-Learning-Team (Active Tasks)

calbon created T272513: upgrade kernel of liftwing machines.

Jan 20 2021, 5:24 PM · Machine-Learning-Team (Active Tasks)

Jan 19 2021

calbon created T272387: Clean Up Backlog Board.

Jan 19 2021, 3:34 PM · Machine-Learning-Team (Active Tasks)

Jan 6 2021

calbon added a comment to T267050: (Need By: TBD) rack/setup/install ml-serve100[1-4].

@Jclark-ctr Got it. Thanks.

Jan 6 2021, 5:27 PM · ops-eqiad, SRE, DC-Ops

calbon added a comment to T267050: (Need By: TBD) rack/setup/install ml-serve100[1-4].

@Jclark-ctr Thanks for the photos. For clarification, does this mean the GPU does not fit or that the GPU does fit but any future GPU's order should be smaller in dimensions?

Jan 6 2021, 5:23 PM · ops-eqiad, SRE, DC-Ops

Jan 5 2021

calbon added a comment to T263910: ORES redis: max number of clients reached....

I'm just happy I am not resetting it every few hours. One of our goals was to put it in a stable mode and we've done it!

Jan 5 2021, 3:11 PM · User-Ladsgroup, Sustainability (Incident Followup), Patch-For-Review, Okapi, serviceops, SRE, ORES, Machine-Learning-Team

Dec 1 2020

calbon created T269171: Create documentation for a workflow for evaluating models submitted for deployment..

Dec 1 2020, 9:39 PM · Machine-Learning-Team

calbon added a project to T269169: Create Draft Documentation For Moving Models Into Lift Wing: Lift-Wing.

Dec 1 2020, 9:36 PM · Machine-Learning-Team, Lift-Wing

calbon created T269169: Create Draft Documentation For Moving Models Into Lift Wing.

Dec 1 2020, 9:35 PM · Machine-Learning-Team, Lift-Wing

calbon updated subscribers of T264651: Migrate ORES/Revscoring/etc. repos to Gitlab or Gerrit.

@ACraze can you take a look at this and see how hard it would be.

Dec 1 2020, 6:22 PM · Machine-Learning-Team, ORES

calbon moved T264651: Migrate ORES/Revscoring/etc. repos to Gitlab or Gerrit from On Deck to Active on the Machine-Learning-Team (Active Tasks) board.

Dec 1 2020, 6:21 PM · Machine-Learning-Team, ORES

calbon triaged T264651: Migrate ORES/Revscoring/etc. repos to Gitlab or Gerrit as Medium priority.

Dec 1 2020, 6:21 PM · Machine-Learning-Team, ORES

calbon moved T265066: Proof of concept: dockerized model served over CloudVPS from Review to Active on the Machine-Learning-Team (Active Tasks) board.

Dec 1 2020, 6:14 PM · Machine-Learning-Team

calbon moved T265066: Proof of concept: dockerized model served over CloudVPS from Active to Review on the Machine-Learning-Team (Active Tasks) board.

Dec 1 2020, 6:14 PM · Machine-Learning-Team

calbon closed T264224: Evaluate Potential Amazon Data Donation as Resolved.

Dec 1 2020, 6:14 PM · draftquality-modeling, articlequality-modeling, artificial-intelligence, editquality-modeling, Machine-Learning-Team (Active Tasks)

calbon closed T264121: Script to restart ORES uwsgi service as Resolved.

Dec 1 2020, 6:14 PM · ORES, Machine-Learning-Team (Active Tasks)

calbon moved T264224: Evaluate Potential Amazon Data Donation from Review to Pending deployment on the Machine-Learning-Team (Active Tasks) board.

Dec 1 2020, 6:14 PM · draftquality-modeling, articlequality-modeling, artificial-intelligence, editquality-modeling, Machine-Learning-Team (Active Tasks)

calbon moved T264121: Script to restart ORES uwsgi service from Active to Pending deployment on the Machine-Learning-Team (Active Tasks) board.

Dec 1 2020, 6:14 PM · ORES, Machine-Learning-Team (Active Tasks)

calbon closed T265068: Publish Test Grounds design doc to Wikitech as Declined.

Dec 1 2020, 6:13 PM · Test-Grounds, Machine-Learning-Team (Active Tasks)

calbon closed T265069: Publish Pilot Flag design doc to Wikitech as Declined.

Dec 1 2020, 6:13 PM · Pilot-Flag, Machine-Learning-Team (Active Tasks)

Nov 16 2020

calbon added a comment to T131553: Look into matching images of the same painting.

Yeah this is definitely a nice task to jump in, Mat.

Nov 16 2020, 6:47 PM · artificial-intelligence, Machine-Learning-Team (Research)

calbon added a comment to T242819: ores.wmflabs.org - 503 icinga alerts.

@Ladsgroup Yeah go ahead.

Nov 16 2020, 5:02 PM · Patch-For-Review, Machine-Learning-Team (Active Tasks), SRE, ORES

Nov 9 2020

calbon added a comment to T263910: ORES redis: max number of clients reached....

Nov 9 2020, 2:28 PM · User-Ladsgroup, Sustainability (Incident Followup), Patch-For-Review, Okapi, serviceops, SRE, ORES, Machine-Learning-Team

Nov 6 2020

calbon added a comment to T263910: ORES redis: max number of clients reached....

@akosiaris Can you review it? I don't know enough about the nodes vs redis connection to intelligently review.

Nov 6 2020, 7:19 PM · User-Ladsgroup, Sustainability (Incident Followup), Patch-For-Review, Okapi, serviceops, SRE, ORES, Machine-Learning-Team

Oct 29 2020

calbon added a comment to T266498: New prod ssh key for calbon.

yep it works, thanks all!

Oct 29 2020, 3:49 PM · SRE, SRE-Access-Requests

Oct 26 2020

calbon created T266498: New prod ssh key for calbon.

Oct 26 2020, 6:26 PM · SRE, SRE-Access-Requests

Oct 22 2020

calbon closed T266254: Rename "Heavy Wing" as Resolved.

Oct 22 2020, 5:36 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)

calbon added a comment to T266254: Rename "Heavy Wing".

Lift Wing it is. Closing task.

Oct 22 2020, 5:36 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)

calbon changed hashtags for Lift-Wing, added #lift-wing; removed #heavy-wing.

Oct 22 2020, 5:35 PM

calbon renamed Lift-Wing from Heavy-Wing to Lift-Wing.

Oct 22 2020, 5:35 PM

calbon added a comment to T266254: Rename "Heavy Wing".

I kinda like Lift Wing. It keeps the idea of a the platform being a "wing" for models while invoking the concept of Model Lift.

Oct 22 2020, 5:16 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)

calbon added a comment to T266254: Rename "Heavy Wing".

"liftwing" - 6,780 results - no meaning

Oct 22 2020, 5:04 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)

calbon added a comment to T266254: Rename "Heavy Wing".

Oct 22 2020, 5:03 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)

calbon added a comment to T266254: Rename "Heavy Wing".

"rock wing" - 40,500 - no meaning

Oct 22 2020, 5:01 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)

calbon updated the task description for T266254: Rename "Heavy Wing".

Oct 22 2020, 4:43 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)

calbon updated subscribers of T266254: Rename "Heavy Wing".

@LarsWirzenius had the idea of random Swedish or english words:

Oct 22 2020, 4:40 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)

calbon created T266254: Rename "Heavy Wing".

Oct 22 2020, 4:37 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)

Oct 15 2020

calbon added a comment to T264224: Evaluate Potential Amazon Data Donation.

Based on feedback from Research and Legal, our requirements for this are:

Oct 15 2020, 5:12 PM · draftquality-modeling, articlequality-modeling, editquality-modeling, artificial-intelligence, Machine-Learning-Team (Active Tasks)

calbon added a comment to T265172: Requesting adding to ores-admin for Ladsgroup.

Approved! Thank you much Amir for the help!

Oct 15 2020, 4:21 PM · Machine-Learning-Team, SRE-Access-Requests, SRE

calbon closed T265083: Request increased quota for ores.calbon-test Cloud VPS project as Resolved.

Oh awesome. I was just working through the docs and the next part was the floating IP section, which I didn't have a quota for.

Oct 15 2020, 3:57 PM · Cloud-VPS (Quota-requests)

Oct 9 2020

calbon added a comment to T264121: Script to restart ORES uwsgi service.

I was thinking of sometime more simple: using fabric as a local script (run manually) to ssh into bastion, jumpproxy to an ores box, restart the service. Then I can just loop that if we need to restart ores. It isn't a long term solution but it beats sshing into each one manually

Oct 9 2020, 9:05 PM · ORES, Machine-Learning-Team (Active Tasks)

Oct 8 2020

calbon added a comment to T264121: Script to restart ORES uwsgi service.

Due to T263910: ORES redis: max number of clients reached... continuing to be a problem (I suspect), I am bringing back this task. Cumin isn't an option because it is SRE-specific. I'll get on coding it up in fabric.

Oct 8 2020, 9:33 PM · ORES, Machine-Learning-Team (Active Tasks)

calbon reopened T264121: Script to restart ORES uwsgi service as "Open".

Oct 8 2020, 9:32 PM · ORES, Machine-Learning-Team (Active Tasks)

calbon added a comment to T263910: ORES redis: max number of clients reached....

Suspiciously similar just happened to ores on eqiad. I reset the uwsgi service on all ores100x boxes and will monitor.

Oct 8 2020, 9:28 PM · User-Ladsgroup, Sustainability (Incident Followup), Patch-For-Review, Okapi, serviceops, SRE, ORES, Machine-Learning-Team

calbon created T265083: Request increased quota for ores.calbon-test Cloud VPS project.

Oct 8 2020, 8:03 PM · Cloud-VPS (Quota-requests)

calbon created T265069: Publish Pilot Flag design doc to Wikitech.

Oct 8 2020, 6:14 PM · Pilot-Flag, Machine-Learning-Team (Active Tasks)

calbon claimed T265067: Publish Heavy Wing design doc to Wikitech.

Oct 8 2020, 6:10 PM · Lift-Wing, Machine-Learning-Team (Active Tasks)