Page MenuHomePhabricator
Feed Advanced Search

Feb 26 2019

GitHub <noreply@github.com> committed rOEQ1e92a256c341: Merge c2711fe88b311675ac2e422efc7537b93205c588 into… (authored by Halfak).
Merge c2711fe88b311675ac2e422efc7537b93205c588 into…
Feb 26 2019, 8:26 PM
GitHub <noreply@github.com> committed rOEQ528c7f0e22f7: Merge 706185313fd445575612ebda876cfdef468d69dc into… (authored by Halfak).
Merge 706185313fd445575612ebda876cfdef468d69dc into…
Feb 26 2019, 7:49 PM
Halfak committed rOEQ706185313fd4: Convert wiki configs to modular structure..
Convert wiki configs to modular structure.
Feb 26 2019, 7:49 PM
GitHub <noreply@github.com> committed rOEQ0ab3879e06f0: Merge 0421199d55d4a15954ef11c85f0b4b270a3b1c03 into… (authored by Halfak).
Merge 0421199d55d4a15954ef11c85f0b4b270a3b1c03 into…
Feb 26 2019, 7:38 PM
Halfak committed rOEQ0421199d55d4: Convert wiki configs to modular structure..
Convert wiki configs to modular structure.
Feb 26 2019, 7:38 PM
Halfak committed rOEQf3cc1e38fe2e: Adds fawiki and concatenated block to template..
Adds fawiki and concatenated block to template.
Feb 26 2019, 7:38 PM
Halfak committed rOEQ17ea475969b5: Adds wiki config conversion files..
Adds wiki config conversion files.
Feb 26 2019, 7:38 PM
Halfak committed rOEQ9933eb5c5613: Addresses notes from awight about modular templates..
Addresses notes from awight about modular templates.
Feb 26 2019, 7:38 PM
Halfak committed rOEQb4e3b76d5845: Adds globals.yaml and other modularized configs..
Adds globals.yaml and other modularized configs.
Feb 26 2019, 7:38 PM
Halfak committed rOEQc9dd5d3aff93: Makes Makefile template more modular..
Makes Makefile template more modular.
Feb 26 2019, 7:38 PM
Halfak placed T109366: Chinese language utilities up for grabs.

Hi @Tiger3018! I've added this to our backlog. Now that we have the basic list you have provided, we need to do the work to get it integrated into a language file like the ones you see here: https://github.com/wikimedia/revscoring/tree/master/revscoring/languages We're working on other things so we haven't gotten to it yet.

Feb 26 2019, 2:53 PM · Machine-Learning-Team (Active Tasks), artificial-intelligence, Chinese-Sites, revscoring
GitHub <noreply@github.com> committed rORESe1d2bc1a6a40: Merge pull request #318 from wikimedia/even_more_docker (authored by Halfak).
Merge pull request #318 from wikimedia/even_more_docker
Feb 26 2019, 12:18 AM
Halfak moved T215363: Create new editquality labeling campaign for hewiki from Review to Parked on the Machine-Learning-Team (Active Tasks) board.
Feb 26 2019, 12:18 AM · Machine-Learning-Team (Active Tasks), User-Ladsgroup, ORES
Halfak moved T214841: ores sends duplicate page text over the wire from Review to Parked on the Machine-Learning-Team (Active Tasks) board.
Feb 26 2019, 12:18 AM · User-Ladsgroup, Machine-Learning-Team (Active Tasks), Performance Issue, ORES
Halfak moved T215906: Re-enable eslint test for ORES CI from Review to Completed on the Machine-Learning-Team (Active Tasks) board.
Feb 26 2019, 12:18 AM · User-Ladsgroup, ORES, Machine-Learning-Team (Active Tasks)
Halfak added a comment to T214841: ores sends duplicate page text over the wire.

The PR didn't quite do what it needed to do so I pushed a followup commit and cleaned up some of the tests.

Feb 26 2019, 12:17 AM · User-Ladsgroup, Machine-Learning-Team (Active Tasks), Performance Issue, ORES
Halfak committed rORESe0c150692046: Use an independent injection_cache copy when extracting root datasources..
Use an independent injection_cache copy when extracting root datasources.
Feb 26 2019, 12:13 AM

Feb 25 2019

Halfak added a comment to T216838: [Discuss] ORES without celery.

Oh! I misread. I agree with your point about not needing to drop it. I think the idea of dropping it comes from @Joe's proposal that we make ORES look like other services.

Feb 25 2019, 11:31 PM · SRE, ORES, Machine-Learning-Team
Halfak added a comment to T216838: [Discuss] ORES without celery.

Aaron misunderstands @Ladsgroup and then deletes his comment when he realizes his mistake

Feb 25 2019, 11:29 PM · SRE, ORES, Machine-Learning-Team
GitHub <noreply@github.com> committed rOEQbb9f1f393d29: Merge 5509671f9de041fdf5e8cee73867357361a59e55 into… (authored by Halfak).
Merge 5509671f9de041fdf5e8cee73867357361a59e55 into…
Feb 25 2019, 5:01 PM
Halfak committed rOEQ5509671f9de0: Adds fawiki and concatenated block to template..
Adds fawiki and concatenated block to template.
Feb 25 2019, 5:01 PM
GitHub <noreply@github.com> committed rOEQcc37e6734fc9: Merge af796d6095eac33630184c70df04d6192fe49c3a into… (authored by Halfak).
Merge af796d6095eac33630184c70df04d6192fe49c3a into…
Feb 25 2019, 4:26 PM
Halfak committed rOEQaf796d6095ea: Adds globals.yaml and other modularized configs..
Adds globals.yaml and other modularized configs.
Feb 25 2019, 4:26 PM
GitHub <noreply@github.com> committed rOEQ8a166fab6490: Merge 1b328339d92272c334cf6820da902e04ca084171 into… (authored by Halfak).
Merge 1b328339d92272c334cf6820da902e04ca084171 into…
Feb 25 2019, 4:12 PM
Halfak committed rOEQ1b328339d922: Adds globals.yaml and other modularized configs..
Adds globals.yaml and other modularized configs.
Feb 25 2019, 4:12 PM

Feb 22 2019

Halfak added a comment to T122676: Implement sentinel for ORES production Redis.

submitting jobs from changeprop to an uWSGI endpoint directly

Feb 22 2019, 5:08 PM · Machine-Learning-Team, ORES
Halfak moved T216838: [Discuss] ORES without celery from Research & analysis to Ideas on the Machine-Learning-Team board.
Feb 22 2019, 5:07 PM · SRE, ORES, Machine-Learning-Team
Halfak created T216838: [Discuss] ORES without celery.
Feb 22 2019, 5:06 PM · SRE, ORES, Machine-Learning-Team
Halfak added a comment to T203127: Implement "last known good version" API.

I generally agree that exposing something like this is a good idea. We'll likely want to have different rules on per-wiki basis. E.g. in English Wikipedia, you only need to wait 48 hours (max) to see if an edit will be reverted with high confidence. In smaller wikis with less robust patrolling, you'll likely want to wait longer to confirm an edit as good. There are also likely some improvements we can make the algorithm to help 3rd party reuse remain fresher for such wikis. E.g. by looking at the edit history and user groups of an editor.

Feb 22 2019, 4:28 PM · Page Content Service, Epic

Feb 21 2019

Halfak closed T216616: Gerrit mirror from phab broken for source/draftquality as Resolved.

There we go! Looks like we can resolve this.

Feb 21 2019, 3:22 PM · User-MarcoAurelio, Patch-For-Review, User-Zppix, ORES, draftquality-modeling, Release-Engineering-Team, artificial-intelligence, Machine-Learning-Team (Active Tasks)
GitHub <noreply@github.com> committed rODQ264071ce5312: Minor fix to README (authored by Halfak).
Minor fix to README
Feb 21 2019, 2:16 PM
Halfak added a comment to T216616: Gerrit mirror from phab broken for source/draftquality.

I made https://github.com/wikimedia/draftquality/commit/264071ce5312e67561b597d31ada86a1b3487747 to see if it would propagate.

Feb 21 2019, 2:16 PM · User-MarcoAurelio, Patch-For-Review, User-Zppix, ORES, draftquality-modeling, Release-Engineering-Team, artificial-intelligence, Machine-Learning-Team (Active Tasks)
Halfak committed rORESDEPLOY5d50713a5e95: Updates to draftquality submodule..
Updates to draftquality submodule.
Feb 21 2019, 2:04 PM
GitHub <noreply@github.com> committed rOEQb159bb07df3f: Merge 570415ce5e255f555e8ed707dc451772acb113eb into… (authored by Halfak).
Merge 570415ce5e255f555e8ed707dc451772acb113eb into…
Feb 21 2019, 11:41 AM

Feb 20 2019

Halfak updated the task description for T216616: Gerrit mirror from phab broken for source/draftquality.
Feb 20 2019, 2:21 PM · User-MarcoAurelio, Patch-For-Review, User-Zppix, ORES, draftquality-modeling, Release-Engineering-Team, artificial-intelligence, Machine-Learning-Team (Active Tasks)
Halfak updated subscribers of T216616: Gerrit mirror from phab broken for source/draftquality.

@Ladsgroup tried turning mirroring off and on again. We also tried scheduling an update. Nothing seems to have changed and we don't see any errors.

Feb 20 2019, 2:19 PM · User-MarcoAurelio, Patch-For-Review, User-Zppix, ORES, draftquality-modeling, Release-Engineering-Team, artificial-intelligence, Machine-Learning-Team (Active Tasks)
Halfak created T216616: Gerrit mirror from phab broken for source/draftquality.
Feb 20 2019, 2:17 PM · User-MarcoAurelio, Patch-For-Review, User-Zppix, ORES, draftquality-modeling, Release-Engineering-Team, artificial-intelligence, Machine-Learning-Team (Active Tasks)
Halfak committed rORESDEPLOYfc63898f44be: Updates submodules for rebuilt models + kowiki.
Updates submodules for rebuilt models + kowiki
Feb 20 2019, 1:46 PM
Halfak committed rORESDEPLOY860c70b73de3: Updates submodules for rebuilt models + kowiki.
Updates submodules for rebuilt models + kowiki
Feb 20 2019, 1:46 PM
Halfak added a comment to T215406: Rebuild all models with revscoring 2.3.3.

https://github.com/wikimedia/ores-wmflabs-deploy/pull/104

Feb 20 2019, 1:45 PM · Patch-For-Review, Machine-Learning-Team (Active Tasks), User-Ladsgroup, ORES
Halfak moved T193905: arwiki goodfaith model is not usable from Ready to go to Research & analysis on the Machine-Learning-Team board.
Feb 20 2019, 1:11 PM · editquality-modeling, artificial-intelligence, ORES

Feb 19 2019

Halfak raised the priority of T214054: Stress test ORES on kubernetes (above 4.5k scores/second) from Low to High.
Feb 19 2019, 10:48 PM · SRE, ORES, Machine-Learning-Team
Halfak moved T207858: Clean up Jade title calculations from Unsorted to Ready to go on the Machine-Learning-Team board.
Feb 19 2019, 10:47 PM · Machine-Learning-Team, Jade
Halfak moved T203853: Expose Jade data through Lua from Unsorted to Research & analysis on the Machine-Learning-Team board.
Feb 19 2019, 10:46 PM · Machine-Learning-Team (Research), Scribunto, Jade
Halfak moved T213496: Investigate formal test framework for Oozie jobs from Unsorted to Ready to go on the Machine-Learning-Team board.
Feb 19 2019, 10:46 PM · Machine-Learning-Team (Research), Analytics
Halfak moved T191214: Edittypes repo setup from Unsorted to New development on the Machine-Learning-Team board.
Feb 19 2019, 10:46 PM · Machine-Learning-Team, artificial-intelligence, edittypes-modeling
Halfak moved T208819: Implement Jade Entity UI from Unsorted to New development on the Machine-Learning-Team board.
Feb 19 2019, 10:45 PM · Epic, Machine-Learning-Team (Active Tasks), Design, Jade
Halfak moved T209444: [Epic] Jade accessibility audit from Parked to Non-Epic on the Machine-Learning-Team (Active Tasks) board.
Feb 19 2019, 10:45 PM · Machine-Learning-Team, Accessibility, Jade, Epic
Halfak edited projects for T209444: [Epic] Jade accessibility audit, added: Machine-Learning-Team (Active Tasks); removed Machine-Learning-Team.
Feb 19 2019, 10:44 PM · Machine-Learning-Team, Accessibility, Jade, Epic
Halfak moved T212264: Precache should include bot edits to wikidata from Maintenance/cleanup to Ready to go on the Machine-Learning-Team board.
Feb 19 2019, 10:44 PM · ORES, Machine-Learning-Team
Halfak moved T212264: Precache should include bot edits to wikidata from Unsorted to Maintenance/cleanup on the Machine-Learning-Team board.
Feb 19 2019, 10:44 PM · ORES, Machine-Learning-Team
Halfak lowered the priority of T212435: Review real-world query plans and performance for Jade from Medium to Low.
Feb 19 2019, 10:44 PM · Machine-Learning-Team, Jade
Halfak moved T210269: Build helm charts for ORES from Backlog/Lift Wing to New development on the Machine-Learning-Team board.
Feb 19 2019, 10:43 PM · SRE, ORES, Machine-Learning-Team
Halfak moved T210269: Build helm charts for ORES from Unsorted to Backlog/Lift Wing on the Machine-Learning-Team board.
Feb 19 2019, 10:42 PM · SRE, ORES, Machine-Learning-Team
Halfak updated the task description for T210269: Build helm charts for ORES.
Feb 19 2019, 10:42 PM · SRE, ORES, Machine-Learning-Team
Halfak added a comment to T210269: Build helm charts for ORES.

Is this something that will be part of the common infrastructure for services in kubernetes?

Feb 19 2019, 10:42 PM · SRE, ORES, Machine-Learning-Team
Halfak moved T210264: Investigate memory usage of ORES in kubernetes from Unsorted to Research & analysis on the Machine-Learning-Team board.
Feb 19 2019, 10:37 PM · Machine-Learning-Team (Research), SRE, ORES
Halfak updated the task description for T210264: Investigate memory usage of ORES in kubernetes .
Feb 19 2019, 10:36 PM · Machine-Learning-Team (Research), SRE, ORES
Halfak raised the priority of T182331: [Epic] Deploy ORES in kubernetes cluster from Low to High.
Feb 19 2019, 10:35 PM · SRE, ORES, Machine-Learning-Team
Halfak lowered the priority of T109366: Chinese language utilities from High to Medium.
Feb 19 2019, 10:30 PM · Machine-Learning-Team (Active Tasks), artificial-intelligence, Chinese-Sites, revscoring
Halfak raised the priority of T109366: Chinese language utilities from Medium to High.
Feb 19 2019, 10:30 PM · Machine-Learning-Team (Active Tasks), artificial-intelligence, Chinese-Sites, revscoring
Halfak raised the priority of T210721: Contact number of some WMDE staff should be avalible to SRE/RelEng from High to Needs Triage.
Feb 19 2019, 10:30 PM · Release-Engineering-Team (Radar), Machine-Learning-Team, SRE
Halfak moved T210577: Build a test setup for redis sentinel in cloud VPS from Unsorted to Ready to go on the Machine-Learning-Team board.
Feb 19 2019, 10:28 PM · Machine-Learning-Team, ORES
Halfak moved T210580: Write puppet for redis-sentinel from Unsorted to Ready to go on the Machine-Learning-Team board.
Feb 19 2019, 10:28 PM · Infrastructure-Foundations, Machine-Learning-Team, Puppet, ORES
Halfak moved T210582: New node request: oresrdb[12]003 from Unsorted to Ready to go on the Machine-Learning-Team board.
Feb 19 2019, 10:27 PM · Machine-Learning-Team, ORES
Halfak moved T210605: Run a test failover in labs before migrating prod to sentinel from Unsorted to Ready to go on the Machine-Learning-Team board.
Feb 19 2019, 10:27 PM · Machine-Learning-Team, ORES
Halfak triaged T179630: Improve search-ability of ORES stuff as Low priority.
Feb 19 2019, 10:25 PM · SEO, ORES, Machine-Learning-Team
Halfak triaged T194737: Improve features for wikibase vandalism detection model as Medium priority.
Feb 19 2019, 10:21 PM · Wikidata-Campsite, Wikidata, Machine-Learning-Team, editquality-modeling, artificial-intelligence
Halfak closed T207548: How far is ORES in training? as Declined.

@TheDJ, let us know if this addresses your question. Please feel free to open if I have missed something.

Feb 19 2019, 10:20 PM · Machine-Learning-Team, ORES
Halfak added a comment to T216246: [Discuss] ORES model development and deployment processes.

Stat machines are not used to deploy to prod for ORES.

Feb 19 2019, 8:45 PM · Machine-Learning-Team
Halfak moved T210584: Make celery queues transient from Parked to Completed on the Machine-Learning-Team (Active Tasks) board.
Feb 19 2019, 4:56 PM · Performance Issue, ORES, Machine-Learning-Team (Active Tasks), User-Ladsgroup
Halfak moved T213586: orespoolcounter1002.eqiad.wmnet reporting compile errors from Parked to Completed on the Machine-Learning-Team (Active Tasks) board.
Feb 19 2019, 4:56 PM · ORES, Puppet, Machine-Learning-Team (Active Tasks)
Halfak moved T214960: Jade workshop position paper for HumBL from Parked to Completed on the Machine-Learning-Team (Active Tasks) board.
Feb 19 2019, 4:56 PM · Machine-Learning-Team (Active Tasks), Jade
Halfak updated subscribers of T190968: Simplify and modularize the Makefile template.

@Ladsgroup, I'd love to have your notes on this one.

Feb 19 2019, 4:50 PM · Machine-Learning-Team (Active Tasks), editquality-modeling, artificial-intelligence

Feb 15 2019

Halfak added a comment to T201146: Build article quality model for Galician Wikipedia.

I believe that if you remove "|default" from the relevant line in MediaWiki:Gadgets-definition, it will disable the gadget by default.

Feb 15 2019, 8:41 PM · Machine-Learning-Team (Active Tasks), artificial-intelligence, articlequality-modeling, Wikilabels
Halfak triaged T190411: ELI5 ORES docs as Low priority.
Feb 15 2019, 8:35 PM · Documentation, ORES, Machine-Learning-Team
Halfak triaged T214841: ores sends duplicate page text over the wire as Medium priority.
Feb 15 2019, 8:34 PM · User-Ladsgroup, Machine-Learning-Team (Active Tasks), Performance Issue, ORES
Halfak moved T194740: Write and update Jupyter notebooks documenting ORES models and components from Parked to Completed on the Machine-Learning-Team (Active Tasks) board.
Feb 15 2019, 8:33 PM · Machine-Learning-Team (Active Tasks), Documentation, Wikimedia-Hackathon-2018
Halfak closed T194740: Write and update Jupyter notebooks documenting ORES models and components as Resolved.
Feb 15 2019, 8:32 PM · Machine-Learning-Team (Active Tasks), Documentation, Wikimedia-Hackathon-2018
Halfak moved T188280: [Epic] Write an ORES manual from Parked to Non-Epic on the Machine-Learning-Team (Active Tasks) board.
Feb 15 2019, 8:31 PM · Machine-Learning-Team, Epic, Documentation, ORES
Halfak edited projects for T188280: [Epic] Write an ORES manual, added: Machine-Learning-Team (Active Tasks); removed Machine-Learning-Team.
Feb 15 2019, 8:31 PM · Machine-Learning-Team, Epic, Documentation, ORES
Halfak moved T190814: Improve documentation for answering "What is ORES and how can I use it?" from Documentation to Ready to go on the Machine-Learning-Team board.
Feb 15 2019, 8:31 PM · Machine-Learning-Team, Epic, Documentation, ORES
Halfak triaged T190814: Improve documentation for answering "What is ORES and how can I use it?" as Low priority.
Feb 15 2019, 8:30 PM · Machine-Learning-Team, Epic, Documentation, ORES
Halfak moved T190691: Document how to calculate pop-rate from Documentation to Ready to go on the Machine-Learning-Team board.
Feb 15 2019, 8:30 PM · Documentation, revscoring, artificial-intelligence, Machine-Learning-Team
Halfak triaged T190691: Document how to calculate pop-rate as Medium priority.
Feb 15 2019, 8:29 PM · Documentation, revscoring, artificial-intelligence, Machine-Learning-Team
Halfak added a comment to T190691: Document how to calculate pop-rate.

I think the best strategy here is to explicitly document the meaning of the param in revscoring extract. There are differences depending on how the sample is gathered, but so long as someone has a basic grasp of math, they should be able to work out what to do by the intention.

Feb 15 2019, 8:29 PM · Documentation, revscoring, artificial-intelligence, Machine-Learning-Team
Halfak added a comment to T192504: Streamline workflow for new ORES model lifecycle.

I'm not sure what is being asked for here. Are you imagine a page documenting steps taken or a specific type of automation? Also what kind of model?

Feb 15 2019, 8:26 PM · Machine-Learning-Team, ORES
Halfak triaged T181831: Document ORES architecture from a robustness perspective as Low priority.
Feb 15 2019, 8:25 PM · Sustainability (Incident Followup), Machine-Learning-Team, Documentation
Halfak added a comment to T181831: Document ORES architecture from a robustness perspective.

I'm not sure I understand what's being asked for here. Could you provide examples of where this is documented well for other systems that we might crib from?

Feb 15 2019, 8:24 PM · Sustainability (Incident Followup), Machine-Learning-Team, Documentation
Halfak moved T182054: Elaborate documentation on how to deploy ORES to a new wiki from Documentation to Ready to go on the Machine-Learning-Team board.
Feb 15 2019, 8:24 PM · Machine-Learning-Team, MediaWiki-extensions-ORES, ORES, Documentation
Halfak triaged T182054: Elaborate documentation on how to deploy ORES to a new wiki as Medium priority.
Feb 15 2019, 8:23 PM · Machine-Learning-Team, MediaWiki-extensions-ORES, ORES, Documentation
Halfak moved T208349: Measure group polarization in Jade from Documentation to Research & analysis on the Machine-Learning-Team board.
Feb 15 2019, 8:23 PM · Machine-Learning-Team (Research), Jade
Halfak renamed T208349: Measure group polarization in Jade from Document group polarization as a risk to JADE to Measure group polarization in Jade.
Feb 15 2019, 8:22 PM · Machine-Learning-Team (Research), Jade
Halfak triaged T209406: Audit and repair model documentation on mw:ORES/* as Medium priority.
Feb 15 2019, 8:21 PM · artificial-intelligence, editquality-modeling, drafttopic-modeling, draftquality-modeling, articlequality-modeling, Documentation, Machine-Learning-Team
Halfak added a comment to T195759: Create a Jade poster.

@awight, were you able to make progress on this?

Feb 15 2019, 8:21 PM · Machine-Learning-Team, Jade
Halfak added a comment to T109366: Chinese language utilities.

I think the best next step is to provide a starting list of regexes for badwords, informals, or words to watch. Then we can run some experiments with zhconv to see if we're doing OK.

Feb 15 2019, 8:20 PM · Machine-Learning-Team (Active Tasks), artificial-intelligence, Chinese-Sites, revscoring
Halfak moved T203505: Feedback on ORES threshold optimization docs from Parked to Completed on the Machine-Learning-Team (Active Tasks) board.
Feb 15 2019, 8:18 PM · Machine-Learning-Team (Active Tasks), User-srodlund, ORES, Documentation
Halfak closed T203505: Feedback on ORES threshold optimization docs as Resolved.
Feb 15 2019, 8:14 PM · Machine-Learning-Team (Active Tasks), User-srodlund, ORES, Documentation
Halfak moved T208338: Improve revscoring READMEs from Documentation to Ready to go on the Machine-Learning-Team board.
Feb 15 2019, 8:14 PM · Machine-Learning-Team (Active Tasks), User-srodlund, ORES, revscoring, artificial-intelligence, Documentation
Halfak triaged T208338: Improve revscoring READMEs as Medium priority.
Feb 15 2019, 8:13 PM · Machine-Learning-Team (Active Tasks), User-srodlund, ORES, revscoring, artificial-intelligence, Documentation