Page MenuHomePhabricator
Feed Advanced Search

Thu, Oct 15

calbon added a comment to T264224: Evaluate Potential Amazon Data Donation.

Based on feedback from Research and Legal, our requirements for this are:

Thu, Oct 15, 5:12 PM · draftquality-modeling, articlequality-modeling, artificial-intelligence, editquality-modeling, Machine Learning Platform (Current)
calbon added a comment to T265172: Requesting adding to ores-admin for Ladsgroup.

Approved! Thank you much Amir for the help!

Thu, Oct 15, 4:21 PM · Machine Learning Platform, SRE-Access-Requests, Operations
calbon closed T265083: Request increased quota for ores.calbon-test Cloud VPS project as Resolved.

Oh awesome. I was just working through the docs and the next part was the floating IP section, which I didn't have a quota for.

Thu, Oct 15, 3:57 PM · Cloud-VPS (Quota-requests)

Fri, Oct 9

calbon added a comment to T264121: Script to restart ORES uwsgi service.

I was thinking of sometime more simple: using fabric as a local script (run manually) to ssh into bastion, jumpproxy to an ores box, restart the service. Then I can just loop that if we need to restart ores. It isn't a long term solution but it beats sshing into each one manually

Fri, Oct 9, 9:05 PM · ORES, Machine Learning Platform (Current)

Thu, Oct 8

calbon added a comment to T264121: Script to restart ORES uwsgi service.

Due to T263910: ORES redis: max number of clients reached... continuing to be a problem (I suspect), I am bringing back this task. Cumin isn't an option because it is SRE-specific. I'll get on coding it up in fabric.

Thu, Oct 8, 9:33 PM · ORES, Machine Learning Platform (Current)
calbon reopened T264121: Script to restart ORES uwsgi service as "Open".
Thu, Oct 8, 9:32 PM · ORES, Machine Learning Platform (Current)
calbon added a comment to T263910: ORES redis: max number of clients reached....

Suspiciously similar just happened to ores on eqiad. I reset the uwsgi service on all ores100x boxes and will monitor.

Thu, Oct 8, 9:28 PM · Sustainability (Incident Followup), Patch-For-Review, Okapi, serviceops, Operations, ORES, Machine Learning Platform
calbon created T265083: Request increased quota for ores.calbon-test Cloud VPS project.
Thu, Oct 8, 8:03 PM · Cloud-VPS (Quota-requests)
calbon created T265069: Publish Pilot Flag design doc to Wikitech.
Thu, Oct 8, 6:14 PM · Pilot-Flag, Machine Learning Platform (Current)
calbon claimed T265067: Publish Heavy Wing design doc to Wikitech.
Thu, Oct 8, 6:10 PM · Heavy-Wing, Machine Learning Platform (Current)
calbon created T265068: Publish Test Grounds design doc to Wikitech.
Thu, Oct 8, 6:10 PM · Test-Grounds, Machine Learning Platform (Current)
calbon created T265067: Publish Heavy Wing design doc to Wikitech.
Thu, Oct 8, 6:09 PM · Heavy-Wing, Machine Learning Platform (Current)
calbon created T265066: Proof of concept: dockerized model served over CloudVPS.
Thu, Oct 8, 5:53 PM · Machine Learning Platform (Current)

Wed, Oct 7

calbon edited Description on Machine Learning Platform.
Wed, Oct 7, 4:40 PM
calbon edited Description on Machine Learning Platform.
Wed, Oct 7, 4:39 PM
calbon added a comment to T264651: Migrate ORES/Revscoring/etc. repos to Gitlab or Gerrit.

That is a good point. I should move this to a backlog

Wed, Oct 7, 3:49 PM · ORES, Machine Learning Platform (Current)

Tue, Oct 6

calbon added a project to T264651: Migrate ORES/Revscoring/etc. repos to Gitlab or Gerrit: ORES.
Tue, Oct 6, 6:31 PM · ORES, Machine Learning Platform (Current)
calbon added a comment to T264774: Create three Phab Projects.

@Aklapper Not yet! That is going to be some upcoming phabricator tickets. :)

Tue, Oct 6, 5:52 PM · Project-Admins
calbon added a comment to T264774: Create three Phab Projects.

Ah sorry.

Tue, Oct 6, 5:23 PM · Project-Admins
calbon created T264774: Create three Phab Projects.
Tue, Oct 6, 4:20 PM · Project-Admins

Mon, Oct 5

calbon closed T264120: Write product plan for Pilot Flag as Resolved.
Mon, Oct 5, 10:01 PM · Machine Learning Platform (Current)
calbon closed T264119: Write Heavy Wing product plan as Resolved.
Mon, Oct 5, 10:01 PM · Machine Learning Platform (Current)
calbon moved T264120: Write product plan for Pilot Flag from Active to Review on the Machine Learning Platform (Current) board.
Mon, Oct 5, 10:01 PM · Machine Learning Platform (Current)
calbon renamed T264224: Evaluate Potential Amazon Data Donation from Document labels & schema for model repos to Evaluate Potential Amazon Data Donation.
Mon, Oct 5, 5:31 PM · draftquality-modeling, articlequality-modeling, artificial-intelligence, editquality-modeling, Machine Learning Platform (Current)
calbon added a comment to T264224: Evaluate Potential Amazon Data Donation.

Thanks @ACraze. I am talking to legal about it. They'll have the final say.

Mon, Oct 5, 5:31 PM · draftquality-modeling, articlequality-modeling, artificial-intelligence, editquality-modeling, Machine Learning Platform (Current)
calbon created T264651: Migrate ORES/Revscoring/etc. repos to Gitlab or Gerrit.
Mon, Oct 5, 5:30 PM · ORES, Machine Learning Platform (Current)
calbon added a comment to T223782: Build article quality model for Dutch Wikipedia.

Hey! Yep, the modeling work needs to be completed first.

Mon, Oct 5, 5:24 PM · artificial-intelligence, articlequality-modeling, Wikilabels, Machine Learning Platform

Fri, Oct 2

calbon closed T223836: [Spike] Modeling grammar and style as Declined.
Fri, Oct 2, 3:13 PM · Machine Learning Platform
calbon added a comment to T223836: [Spike] Modeling grammar and style.

can do!

Fri, Oct 2, 3:13 PM · Machine Learning Platform
calbon added a comment to T263910: ORES redis: max number of clients reached....

I just had to do another service restart.

Fri, Oct 2, 3:12 PM · Sustainability (Incident Followup), Patch-For-Review, Okapi, serviceops, Operations, ORES, Machine Learning Platform

Thu, Oct 1

calbon updated the task description for T264119: Write Heavy Wing product plan.
Thu, Oct 1, 4:51 PM · Machine Learning Platform (Current)
calbon updated subscribers of T264119: Write Heavy Wing product plan.

@klausman @kevinbazira @ACraze My draft of the heavy wing product plan is complete. Can you all read it over the next few weekdays and add feedback to the doc.

Thu, Oct 1, 4:51 PM · Machine Learning Platform (Current)
calbon added a comment to T264255: Review request for data export.

No objection from me. The ORES data referred to in this ticket is not sensitive or PII.

Thu, Oct 1, 12:05 AM · Analytics-Kanban, Security, Analytics

Wed, Sep 30

calbon added a comment to T264119: Write Heavy Wing product plan.

Draft of plan: https://docs.google.com/document/d/1U8PKfotPUFmEXH1EXrQwqlccFE8i7smlQtxMrTAM6GE/edit#heading=h.ckc5x9wh4dku

Wed, Sep 30, 8:58 PM · Machine Learning Platform (Current)
calbon closed T264121: Script to restart ORES uwsgi service as Resolved.
Wed, Sep 30, 5:28 PM · ORES, Machine Learning Platform (Current)
calbon added a comment to T264121: Script to restart ORES uwsgi service.

I'm going to close this ticket because the issue is being caused by Okapi and will be resolved soon enough that this script isn't required.

Wed, Sep 30, 5:28 PM · ORES, Machine Learning Platform (Current)
calbon added a comment to T264142: Remove Ladsgroup's Paypal from GitHub Org .

I think the even simpler solution would be to change payment method to a Wikimedia credit card, that would remove any individual's liability if something goes wrong.

Wed, Sep 30, 4:16 PM · Machine Learning Platform (Current)

Tue, Sep 29

calbon closed T131553: Look into matching images of the same painting as Declined.
Tue, Sep 29, 10:49 PM · artificial-intelligence, Machine Learning Platform (Research)
calbon added a comment to T131553: Look into matching images of the same painting.

can do!

Tue, Sep 29, 10:49 PM · artificial-intelligence, Machine Learning Platform (Research)
calbon added a comment to T263910: ORES redis: max number of clients reached....

Nope no deploys have happened recently. It has been happening every few hours since the 24th

Tue, Sep 29, 10:44 PM · Sustainability (Incident Followup), Patch-For-Review, Okapi, serviceops, Operations, ORES, Machine Learning Platform
calbon created T264142: Remove Ladsgroup's Paypal from GitHub Org .
Tue, Sep 29, 10:38 PM · Machine Learning Platform (Current)
calbon added a comment to T263949: Github says we maxed our shared storage quota .

If nobody else has worked on this yet I can take it.

Tue, Sep 29, 10:36 PM · Release-Engineering-Team, Wikimedia-GitHub, Wikipedia-iOS-App-Backlog, iOS-app-Bugs
calbon created T264121: Script to restart ORES uwsgi service.
Tue, Sep 29, 6:54 PM · ORES, Machine Learning Platform (Current)
calbon claimed T264120: Write product plan for Pilot Flag.
Tue, Sep 29, 6:47 PM · Machine Learning Platform (Current)
calbon created T264120: Write product plan for Pilot Flag.
Tue, Sep 29, 6:47 PM · Machine Learning Platform (Current)
calbon created T264119: Write Heavy Wing product plan.
Tue, Sep 29, 6:45 PM · Machine Learning Platform (Current)

Mon, Sep 28

calbon added a comment to T263949: Github says we maxed our shared storage quota .

@Ladsgroup Let's figure out a way to get your personal paypal out of there. That is unfair to you and a vulnerability to the system. Now we have about 10 different reasons to have our call!

Mon, Sep 28, 7:46 PM · Release-Engineering-Team, Wikimedia-GitHub, Wikipedia-iOS-App-Backlog, iOS-app-Bugs

Sun, Sep 27

calbon updated subscribers of T263910: ORES redis: max number of clients reached....

Any ideas on causes and solutions @Halfak?

Sun, Sep 27, 8:29 PM · Sustainability (Incident Followup), Patch-For-Review, Okapi, serviceops, Operations, ORES, Machine Learning Platform
calbon added a comment to T263910: ORES redis: max number of clients reached....

Sun, Sep 27, 8:09 PM · Sustainability (Incident Followup), Patch-For-Review, Okapi, serviceops, Operations, ORES, Machine Learning Platform
calbon added a comment to T263910: ORES redis: max number of clients reached....

I've sudo service uwsgi-ores restart on all ORES200x boxes again. This fixes the problem temporarily (~24 hours)
and tomorrow we'll start on a permanent solution

Sun, Sep 27, 8:03 PM · Sustainability (Incident Followup), Patch-For-Review, Okapi, serviceops, Operations, ORES, Machine Learning Platform

Sat, Sep 26

calbon added a comment to T263910: ORES redis: max number of clients reached....

It started happening again, I went into each Ores200X box and manually sudo service uwsgi-ores restart to restart it.

Sat, Sep 26, 7:41 PM · Sustainability (Incident Followup), Patch-For-Review, Okapi, serviceops, Operations, ORES, Machine Learning Platform
calbon added a comment to T263910: ORES redis: max number of clients reached....

Sat, Sep 26, 6:10 PM · Sustainability (Incident Followup), Patch-For-Review, Okapi, serviceops, Operations, ORES, Machine Learning Platform
calbon added a comment to T263910: ORES redis: max number of clients reached....

every time it starts at 16:00

Sat, Sep 26, 6:06 PM · Sustainability (Incident Followup), Patch-For-Review, Okapi, serviceops, Operations, ORES, Machine Learning Platform

Thu, Sep 24

calbon added a comment to T261407: Add a link engineering: Create event for event gate to update search index after obtaining link recommendations.

I am not certain what this ticket is about so I'll admit I have no thoughts smart or otherwise. Give me a bit to dig into the ticket discussion and figure it out

Thu, Sep 24, 5:19 PM · Discovery-Search, Discovery, Growth-Structured-Tasks, Growth-Team
calbon added a comment to T258735: Build articlequality model for Hindi wiki.

I've reopened it. We have been clearing out the backlog and this must have gotten caught up in it. Apologies from me

Thu, Sep 24, 5:14 PM · Machine Learning Platform (Current), artificial-intelligence, articlequality-modeling
calbon reopened T258735: Build articlequality model for Hindi wiki, a subtask of T247847: Proposal (GSoC 2020): Implement articlequality and draftquality model for ptwiki and apply insights to models for bs, uk, hi wikis, as Open.
Thu, Sep 24, 5:14 PM · Machine Learning Platform, artificial-intelligence, Google-Summer-of-Code (2020), Outreach-Programs-Projects
calbon reopened T258735: Build articlequality model for Hindi wiki as "Open".
Thu, Sep 24, 5:14 PM · Machine Learning Platform (Current), artificial-intelligence, articlequality-modeling
calbon added a comment to T193905: arwiki goodfaith model is not usable.

@Ghassanmas Huge thanks for the offer to help. To give context, we are planning on retraining all the models in the future from new data which would solve this particular task.

Thu, Sep 24, 4:26 PM · artificial-intelligence, editquality-modeling, ORES
calbon added a comment to T257359: Update Turkish Wikipedia's labeling campaign for 2020.

@kevinbazira where did we end up with this?

Thu, Sep 24, 4:08 PM · artificial-intelligence, editquality-modeling, Machine Learning Platform
calbon added a comment to T214201: Implement NSFW image classifier using Open NSFW.

@Aklapper @Chtnnh @Nuria For the next 9 months the team will be focused on building a model training, deployment, and management infrastructure. We can deploy models other folks create but we don't have the bandwidth to tackle this ourselves.

Thu, Sep 24, 3:16 PM · Structured-Data-Backlog, artificial-intelligence

Wed, Sep 23

calbon added a watcher for Machine Learning Platform: calbon.
Wed, Sep 23, 5:19 PM
calbon archived Machine Learning Platform (Research).
Wed, Sep 23, 5:11 PM
calbon closed T215732: Investigate using MLEAP for serilization of models as Declined.
Wed, Sep 23, 4:48 PM · Machine Learning Platform (Research), ORES
calbon closed T28426: Create Quality Bias Alert for Cited Information Sources as Declined.
Wed, Sep 23, 4:48 PM · Machine Learning Platform (Research), artificial-intelligence, articlequality-modeling, WorkType-NewFunctionality, MediaWiki-extensions-General
calbon closed T106858: Can we use revscoring to predict ClueBot's scores?, a subtask of T106398: Revscoring tasks from Wikimania discussions, as Declined.
Wed, Sep 23, 4:47 PM · Research-and-Data-2016-Q1, Research-management, Research, Machine Learning Platform (Current)
calbon closed T106858: Can we use revscoring to predict ClueBot's scores? as Declined.
Wed, Sep 23, 4:47 PM · Machine Learning Platform (Research), Research-consulting, Research
calbon removed a project from T167697: [Discuss] Hosting the draft quality dataset on labsDB: Machine Learning Platform (Research).
Wed, Sep 23, 4:46 PM · draftquality-modeling, artificial-intelligence
calbon removed a project from T188281: Investigate deployment concurrency limitations for ORES: Machine Learning Platform (Research).
Wed, Sep 23, 4:46 PM · Scap
calbon removed a project from T171178: Generate a draft quality dataset: Machine Learning Platform (Research).
Wed, Sep 23, 4:45 PM · draftquality-modeling, artificial-intelligence
calbon closed T203853: Expose Jade data through Lua as Declined.
Wed, Sep 23, 4:45 PM · Machine Learning Platform (Research), MediaWiki-extensions-Scribunto, Jade
calbon closed T208349: Measure group polarization in Jade as Resolved.
Wed, Sep 23, 4:44 PM · Machine Learning Platform (Research), Jade
calbon closed T210751: check for multicollinearity in newcomer LogReg model as Resolved.
Wed, Sep 23, 4:44 PM
calbon moved T212435: Review real-world query plans and performance for Jade from Research to Ready to go on the Machine Learning Platform board.
Wed, Sep 23, 4:42 PM · Machine Learning Platform, DBA, Jade
calbon removed a project from T133405: [research] Why is the japanese 'reverted' model so bad?: Machine Learning Platform (Research).
Wed, Sep 23, 4:41 PM · artificial-intelligence, editquality-modeling
calbon removed a project from T136005: [Spike] Explore issues with enwiki articlequality model: Machine Learning Platform (Research).
Wed, Sep 23, 4:41 PM · artificial-intelligence, articlequality-modeling, Spike
calbon removed a project from T145809: [Research] What's the difference in scoring ranges when we don't balance sample weight?: Machine Learning Platform (Research).
Wed, Sep 23, 4:40 PM · artificial-intelligence, editquality-modeling, revscoring
calbon removed a project from T150777: Sentence bank for importance assertions: Machine Learning Platform (Research).
Wed, Sep 23, 4:40 PM · artificial-intelligence, revscoring
calbon closed T155111: [Spike] Investigate use of Apertium LTtoolbox API in labs/production as Declined.
Wed, Sep 23, 4:39 PM · Machine Learning Platform (Research), artificial-intelligence, Spike, revscoring
calbon closed T155111: [Spike] Investigate use of Apertium LTtoolbox API in labs/production, a subtask of T157041: Address memory usage issues for deploying PCFG-based features, as Declined.
Wed, Sep 23, 4:39 PM · ORES, artificial-intelligence, Machine Learning Platform
calbon removed a project from T160226: [Spec] Add score comparison check to deployment checklist: Machine Learning Platform (Research).
Wed, Sep 23, 4:39 PM · artificial-intelligence, revscoring
calbon removed a project from T168913: Investigate parallelizing the model makefile: Machine Learning Platform (Research).
Wed, Sep 23, 4:38 PM · artificial-intelligence, Performance Issue, draftquality-modeling, articlequality-modeling, editquality-modeling
calbon removed a project from T141896: Impact of ORES on Wikidata: time-to-revert changes: Machine Learning Platform (Research).
Wed, Sep 23, 4:38 PM · Wikidata
calbon closed T213496: Investigate formal test framework for Oozie jobs, a subtask of T209739: Produce dump files for ORES scores, as Declined.
Wed, Sep 23, 4:37 PM · Analytics-Radar, Dumps-Generation, ORES, Machine Learning Platform
calbon closed T213496: Investigate formal test framework for Oozie jobs as Declined.
Wed, Sep 23, 4:37 PM · Machine Learning Platform (Research), Analytics
calbon closed T195916: Improve the draft topic model as Declined.
Wed, Sep 23, 4:37 PM · drafttopic-modeling
calbon removed a project from T195920: Increase depth of classes for draft topic (target biography): Machine Learning Platform (Research).
Wed, Sep 23, 4:36 PM · drafttopic-modeling
calbon removed a project from T208140: Detect/flag potentially malicious gadget/javascript edits : Machine Learning Platform (Research).
Wed, Sep 23, 4:36 PM · MediaWiki-extensions-Gadgets, Code-Health, artificial-intelligence
calbon removed a project from T149223: [Spike] Is Varnish caching ORES responses?: Machine Learning Platform (Research).
Wed, Sep 23, 4:36 PM · Spike, ORES
calbon removed a project from T162890: Article quality models for Italian Wikipedia: Machine Learning Platform (Research).
Wed, Sep 23, 4:35 PM · artificial-intelligence, editquality-modeling, Wikilabels
calbon removed a project from T168075: Generate ranked list of likely SM articles for Turkish Wikipedia: Machine Learning Platform (Research).
Wed, Sep 23, 4:35 PM · Turkish-Sites, ORES, articlequality-modeling, artificial-intelligence
calbon removed a project from T200005: Threshold rounding considered harmful: Machine Learning Platform (Research).
Wed, Sep 23, 4:34 PM · artificial-intelligence, revscoring
calbon closed T210264: Investigate memory usage of ORES in kubernetes , a subtask of T182331: [Epic] Deploy ORES in kubernetes cluster, as Resolved.
Wed, Sep 23, 4:34 PM · Operations, ORES, Machine Learning Platform
calbon closed T210264: Investigate memory usage of ORES in kubernetes as Resolved.
Wed, Sep 23, 4:34 PM · Machine Learning Platform (Research), Operations, ORES
calbon removed a project from T120431: Machine-learning tool to reduce toxic talk page interactions: Machine Learning Platform (Research).
Wed, Sep 23, 4:33 PM · ORES, Community-Wishlist-Survey-2015
calbon removed a project from T127467: Finding items on Wikidata that should be merged: Machine Learning Platform (Research).
Wed, Sep 23, 4:33 PM · Wikimedia-Hackathon-2018, Wikidata, WMDE-Tech-Communication-Mentoring-And-Events
calbon removed a project from T155560: Linked fact checker: Machine Learning Platform (Research).
Wed, Sep 23, 4:32 PM · WikiCite, artificial-intelligence, Wikidata
calbon removed a project from T186256: Investigate training ORES with AbuseFilter conditions: Machine Learning Platform (Research).
Wed, Sep 23, 4:32 PM · AbuseFilter, ORES
calbon removed a project from T193905: arwiki goodfaith model is not usable: Machine Learning Platform (Research).
Wed, Sep 23, 4:32 PM · artificial-intelligence, editquality-modeling, ORES
calbon removed a project from T214201: Implement NSFW image classifier using Open NSFW: Machine Learning Platform (Research).
Wed, Sep 23, 4:32 PM · Structured-Data-Backlog, artificial-intelligence
calbon removed a project from T200898: Analyze the effects of ORES deployments on counter-vandalism behavior: Machine Learning Platform (Research).
Wed, Sep 23, 4:31 PM · ORES, Research ideas