Page MenuHomePhabricator
Create Task
Maniphest T176324

Scoring platform team FY18 Q2
Closed, ResolvedPublic
Actions

Description

Etherpad: https://etherpad.wikimedia.org/p/Scoring_platform_FY18Q2

  • New language support (Amir)
    • svwiki
    • eswiki
    • eswikibooks
  • JADE MVP in Labs (Adam)
    • an API
      • indicate how a human would provide a judgement (e.g. "damaging" is a boolean and has translatable messages)
      • indicate some sort of grouping between "damaging" and "goodfaith" / "drafttopic" and "draftquality"
    • a state database (could be postgres like wikilabels)
    • a event generation system (could hook into eventbus)
    • Explicitly left for future work
      • curation/moderation
      • mediawiki integration
      • any reference UI
  • Draft topic modeling (Sumit)
    • publish a dataset of wikiproject directory
    • publish a labeled dataset of new page creations
    • train/test a draft topic model
    • report on results --> peer review?
  • Deploy on new ORES* cluster (Aaron, Amir)
    • Stress testing and tuning complete
      • Filehandle issue is addressed
    • Logs overhaul complete
    • Make sure everything that should be is in logstash
    • Make sure that team can read log files on ORES*
    • Graphite metrics storage clean-up

Related Objects
Search...

StatusSubtypeAssignedTask
 ResolvedakosiarisT162039 Prepare to service applications from kubernetes
 ResolvedakosiarisT162041 Expand the infrastructure to codfw
 ResolvedRobHT161700 CODFW: (4) hardware access request for kubernetes
 ResolvedRobHT142578 codfw/eqiad:(9+9) hardware access request for ORES
Unknown Object (Task)
 ResolvedakosiarisT165170 rack/setup/install ores2001-2009
 ResolvedNoneT176324 Scoring platform team FY18 Q2
 ResolvedHalfakT174558 Deploy damaging/goodfaith model for svwiki
 ResolvedHalfakT174559 Train & test damaging/goodfaith model for svwiki
 ResolvedHalfakT174557 Complete svwiki edit quality campaign
 ResolvedCatropeT130279 Deploy ORES filters to Spanish Wikipedia
 ResolvedNoneT131963 Complete eswiki edit quality campaign
 ResolvedNoneT176331 Deploy edit quality models for eswikibooks
 ResolvedLadsgroupT176332 Train/test edit quality models for eswikibooks
 ResolvedLadsgroupT145408 Complete Spanish Wikibooks edit quality campaign
 ResolvedawightT176333 Deploy JADE prototype in Beta Cluster
 ResolvedKeeganT170954 Set up working group for JADE
 ResolvedKeeganT174685 Create list of ORES collaborators (focus on language asset helpers)
 ResolvedHalfakT181098 Implement basic path structure for JADE (judgements)
 ResolvedawightT187216 Build prototype JADE extension
 ResolvedBawolffT188308 Security review for Extension:JADE
 ResolvedawightT199750 JADE pages on beta no longer render
 ResolvedawightT176336 Deploy drafttopic model to production ORES
 ResolvedHalfakT123327 Train/test draft topic model (new article routing AI)
 ResolvedSumitT172321 Build mid-level WikiProject category training set
 ResolvedSumitT172325 Efficient method for mapping a WikiProject template to the WikiProject Directory
 ResolvedSumitT172326 Create machine-readable version of the WikiProject Directory
 ResolvedSumitT175037 Publish Machine-Readable WikiProjects Dataset
 ResolvedSumitT179311 Generate mid-level WikiProject categories
 ResolvedSumitT181166 Revscoring: Statistic for multilabel classification
 ResolvedHalfakT181163 Revscoring tune does not recognize a set of labels as target
 ResolvedawightT192293 Check drafttopic model memory usage
 ResolvedNoneT194295 Phabricator repo is not mirroring to gerrit as hoped
 ResolvedawightT194322 Drafttopic breaks ?features parameter
 ResolvedawightT195593 Investigate memory issues surrounding trial drafttopic deployment
 DuplicateNoneT181855 scap support for git-lfs
 Resolved• mmodellT180627 Support git-lfs in scap
 ResolvedawightT180628 Install git-lfs client (at least on scap targets & masters)
 DeclinedNoneT182085 Connect Phabricator to swift for storage of git-lfs and file uploads.
 Resolved• mmodellT192042 Create gerrit mirrors for all github-based ORES repos
 ResolvedfgiunchediT192124 Deploy Scap 3.8.0 to production
 ResolvedakosiarisT168073 Switch ORES to dedicated cluster
 ResolvedakosiarisT165171 rack/setup/install ores1001-1009
 Resolved• mmodellT181552 Git refusing to clone some ORES submodules
 ResolvedawightT181661 Connection timeout from tin to new ores servers
 ResolvedakosiarisT182347 SCAP: Upload debian package version 3.7.4-3
 ResolvedakosiarisT183046 scap 3.7.4-2 is broken
 InvalidNoneT182801 New, mysterious scap failure
 ResolvedHalfakT185901 Preliminary deployment of ORES to new cluster
 ResolvedakosiarisT171851 Reimage ores* hosts with Debian Stretch
 ResolvedawightT169246 Stress/capacity test new ores* cluster
 ResolvedHalfakT174402 Review and fix file handle management in worker and celery processes
 ResolvedawightT177036 Clean up file handle and Redis connection management in ORES worker and celery processes
 ResolvedNoneT175736 Give ores admins read access to /srv/log/ores/main.log*
 ResolvedawightT179095 Wheels built on ores-misc-01 are incompatible with ores* and scb*
 ResolvedawightT181806 Problem with Redis server configuration on new ORES cluster
 ResolvedHalfakT182799 Make sure ORES is compatible with stretch
 ResolvedHalfakT184072 Rebuild ORES models on Stretch
 ResolvedHalfakT184073 Provision a Stretch box we can use to build ORES models
 ResolvedakosiarisT184074 Verify that all enchant/spelling dictionaries are available on Stretch. Port if needed.
 ResolvedHalfakT184135 Rebuild ORES wheels on Stretch
 ResolvedHalfakT184296 Convert CloudVPS instances to stretch.
ResolvedHalfakT184766 Convert ores-misc-01 to stretch
 ResolvedSumitT184765 Back up ores-misc-01 to ores-staging-01

Event Timeline

Halfak created this task.Sep 20 2017, 3:53 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptSep 20 2017, 3:53 PM
Halfak updated the task description. (Show Details)Sep 20 2017, 4:45 PM
Halfak added subtasks: T174558: Deploy damaging/goodfaith model for svwiki, T130279: Deploy ORES filters to Spanish Wikipedia.
Halfak added a subtask: T176331: Deploy edit quality models for eswikibooks.Sep 20 2017, 4:50 PM
Halfak added a subtask: T176333: Deploy JADE prototype in Beta Cluster.Sep 20 2017, 4:53 PM
Halfak added a subtask: T176336: Deploy drafttopic model to production ORES.Sep 20 2017, 4:56 PM
Halfak added a subtask: T168073: Switch ORES to dedicated cluster.
awight changed the status of subtask T168073: Switch ORES to dedicated cluster from Stalled to Open.Dec 14 2017, 9:24 PM
Halfak closed subtask T176331: Deploy edit quality models for eswikibooks as Resolved.Jan 30 2018, 8:31 PM
Halfak closed subtask T174558: Deploy damaging/goodfaith model for svwiki as Resolved.
akosiaris closed subtask T168073: Switch ORES to dedicated cluster as Resolved.Feb 22 2018, 12:00 PM
Halfak closed subtask T176331: Deploy edit quality models for eswikibooks as Resolved.Feb 23 2018, 5:51 PM
Catrope closed subtask T130279: Deploy ORES filters to Spanish Wikipedia as Resolved.Mar 1 2018, 12:20 AM
awight changed the status of subtask T176333: Deploy JADE prototype in Beta Cluster from Open to Stalled.Mar 5 2018, 3:49 PM
awight changed the status of subtask T176333: Deploy JADE prototype in Beta Cluster from Stalled to Open.Mar 13 2018, 6:00 PM
awight closed subtask T176333: Deploy JADE prototype in Beta Cluster as Resolved.Mar 14 2018, 4:10 AM
awight closed subtask T176336: Deploy drafttopic model to production ORES as Resolved.Jun 6 2018, 3:28 PM
Ladsgroup closed this task as Resolved.Jul 23 2018, 5:02 PM
Ladsgroup subscribed.

It's almost a year since this Q has passed. Closing this

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits