awight (Adam Roses Wight)
User

Projects (15)

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Wednesday

  • Clear sailing ahead.

User Details

User Since
Oct 12 2014, 9:02 PM (188 w, 1 d)
Availability
Available
IRC Nick
awight
LDAP User
Awight
MediaWiki User
Awight (WMF)

Recent Activity

Yesterday

GitHub <noreply@github.com> committed rORES39ddaf59a0a1: Merge 43781f179becb005060d8ea7cfe149f4f4a52dd1 into… (authored by awight).
Merge 43781f179becb005060d8ea7cfe149f4f4a52dd1 into…
Sun, May 20, 10:54 PM
awight committed rORESacd080541640: T195077/docker compose for tests (#253) (authored by Oriolsoriano).
T195077/docker compose for tests (#253)
Sun, May 20, 10:54 PM
GitHub <noreply@github.com> committed rORES7a79e68c3ed9: Merge 43781f179becb005060d8ea7cfe149f4f4a52dd1 into… (authored by awight).
Merge 43781f179becb005060d8ea7cfe149f4f4a52dd1 into…
Sun, May 20, 10:29 PM
awight committed rORES43781f179bec: eslint fixes (authored by awight).
eslint fixes
Sun, May 20, 10:29 PM
awight committed rORESad4372710d85: Allow CORS for our server (authored by awight).
Allow CORS for our server
Sun, May 20, 2:42 PM

Sat, May 19

awight added a comment to T195077: Set up a docker-compose containing ORES services required to run tests.

Minor update: we noticed that the existing Travis CI configuration only requires one redis service, and we point both the task queue and score cache at the same server.

Sat, May 19, 5:37 PM · Wikimedia-Hackathon-2018, Scoring-platform-team
awight added a subtask for T195073: Use docker for ORES travis-ci tests: T195077: Set up a docker-compose containing ORES services required to run tests.
Sat, May 19, 5:27 PM · Scoring-platform-team, ORES
awight added a parent task for T195077: Set up a docker-compose containing ORES services required to run tests: T195073: Use docker for ORES travis-ci tests.
Sat, May 19, 5:27 PM · Wikimedia-Hackathon-2018, Scoring-platform-team
awight moved T195083: Provide a user-accessible page showing current thresholds for each sensitivity level from Backlog to Project on the Wikimedia-Hackathon-2018 board.
Sat, May 19, 5:24 PM · Wikimedia-Hackathon-2018, MediaWiki-extensions-ORES, Global-Collaboration, Scoring-platform-team (Current)
awight moved T183410: Create base docker image for ORES from Backlog to Project on the Wikimedia-Hackathon-2018 board.
Sat, May 19, 5:24 PM · Wikimedia-Hackathon-2018, Scoring-platform-team (Current), User-Zppix
awight edited projects for T183410: Create base docker image for ORES, added: Wikimedia-Hackathon-2018; removed Wikimania-Hackathon-2018.
Sat, May 19, 5:24 PM · Wikimedia-Hackathon-2018, Scoring-platform-team (Current), User-Zppix
awight created T195083: Provide a user-accessible page showing current thresholds for each sensitivity level.
Sat, May 19, 5:19 PM · Wikimedia-Hackathon-2018, MediaWiki-extensions-ORES, Global-Collaboration, Scoring-platform-team (Current)
awight created T195074: Make Celery `result_backend` and `broker_url` configurable by environment variable.
Sat, May 19, 4:00 PM · Scoring-platform-team, ORES
awight updated subscribers of T195073: Use docker for ORES travis-ci tests.
Sat, May 19, 3:32 PM · Scoring-platform-team, ORES
awight closed T183410: Create base docker image for ORES as Resolved.
Sat, May 19, 3:32 PM · Wikimedia-Hackathon-2018, Scoring-platform-team (Current), User-Zppix
awight closed T183410: Create base docker image for ORES, a subtask of T183214: Wiki-ai Travis-CI Image upgrade, as Resolved.
Sat, May 19, 3:32 PM · User-Zppix, Scoring-platform-team
awight closed T183410: Create base docker image for ORES, a subtask of T195073: Use docker for ORES travis-ci tests, as Resolved.
Sat, May 19, 3:31 PM · Scoring-platform-team, ORES
awight assigned T183410: Create base docker image for ORES to Oriolsoriano.
Sat, May 19, 3:31 PM · Wikimedia-Hackathon-2018, Scoring-platform-team (Current), User-Zppix
awight added a subtask for T195073: Use docker for ORES travis-ci tests: T183410: Create base docker image for ORES.
Sat, May 19, 3:31 PM · Scoring-platform-team, ORES
awight added a parent task for T183410: Create base docker image for ORES: T195073: Use docker for ORES travis-ci tests.
Sat, May 19, 3:31 PM · Wikimedia-Hackathon-2018, Scoring-platform-team (Current), User-Zppix
awight created T195073: Use docker for ORES travis-ci tests.
Sat, May 19, 3:30 PM · Scoring-platform-team, ORES
awight committed rORES098f428e2154: T183410/docker base image (#251) (authored by Oriolsoriano).
T183410/docker base image (#251)
Sat, May 19, 2:41 PM
GitHub <noreply@github.com> committed rORES0d6806eed0f7: Merge a882a6c6c7fa18c21577e0059d3238918f0195ad into… (authored by awight).
Merge a882a6c6c7fa18c21577e0059d3238918f0195ad into…
Sat, May 19, 10:24 AM
awight committed rORESa882a6c6c7fa: Display the API URL we'll get from. (authored by awight).
Display the API URL we'll get from.
Sat, May 19, 10:24 AM
GitHub <noreply@github.com> committed rORES4ad6f53b28dd: Merge b138a8eb541b5e1753827a1aa531a2d82a9fa907 into… (authored by awight).
Merge b138a8eb541b5e1753827a1aa531a2d82a9fa907 into…
Sat, May 19, 9:46 AM
awight committed rORESb138a8eb541b: If no models are selected, default to all (authored by awight).
If no models are selected, default to all
Sat, May 19, 9:44 AM
awight updated subscribers of T195033: Contribution inequality graphs for Wikistats.
Sat, May 19, 8:42 AM · Product-Analytics, Contributors-Analysis, Analytics-Wikistats, Analytics
awight created T195033: Contribution inequality graphs for Wikistats.
Sat, May 19, 8:41 AM · Product-Analytics, Contributors-Analysis, Analytics-Wikistats, Analytics

Fri, May 18

awight added a project to T183410: Create base docker image for ORES: Wikimania-Hackathon-2018.
Fri, May 18, 10:02 PM · Wikimedia-Hackathon-2018, Scoring-platform-team (Current), User-Zppix
awight updated the task description for T131861: migrate bad words detection to editquality repo.
Fri, May 18, 4:33 PM · Easy, artificial-intelligence, User-Ladsgroup, Scoring-platform-team, editquality-modeling, Bad-Words-Detection-System
awight updated the task description for T131861: migrate bad words detection to editquality repo.
Fri, May 18, 4:31 PM · Easy, artificial-intelligence, User-Ladsgroup, Scoring-platform-team, editquality-modeling, Bad-Words-Detection-System
awight updated the task description for T131861: migrate bad words detection to editquality repo.
Fri, May 18, 4:26 PM · Easy, artificial-intelligence, User-Ladsgroup, Scoring-platform-team, editquality-modeling, Bad-Words-Detection-System
awight placed T131861: migrate bad words detection to editquality repo up for grabs.
Fri, May 18, 4:21 PM · Easy, artificial-intelligence, User-Ladsgroup, Scoring-platform-team, editquality-modeling, Bad-Words-Detection-System
awight updated the task description for T131861: migrate bad words detection to editquality repo.
Fri, May 18, 4:18 PM · Easy, artificial-intelligence, User-Ladsgroup, Scoring-platform-team, editquality-modeling, Bad-Words-Detection-System
awight added a project to T131861: migrate bad words detection to editquality repo: Easy.
Fri, May 18, 4:15 PM · Easy, artificial-intelligence, User-Ladsgroup, Scoring-platform-team, editquality-modeling, Bad-Words-Detection-System
awight updated subscribers of T131861: migrate bad words detection to editquality repo.
Fri, May 18, 4:13 PM · Easy, artificial-intelligence, User-Ladsgroup, Scoring-platform-team, editquality-modeling, Bad-Words-Detection-System
awight edited projects for T166105: Extend greek language assets, added: Scoring-platform-team (Current); removed Scoring-platform-team.
Fri, May 18, 4:12 PM · Scoring-platform-team (Current), Bad-Words-Detection-System
awight updated the task description for T183410: Create base docker image for ORES.
Fri, May 18, 1:37 PM · Wikimedia-Hackathon-2018, Scoring-platform-team (Current), User-Zppix
awight updated the task description for T183410: Create base docker image for ORES.
Fri, May 18, 1:35 PM · Wikimedia-Hackathon-2018, Scoring-platform-team (Current), User-Zppix
awight updated subscribers of T183410: Create base docker image for ORES.
Fri, May 18, 1:33 PM · Wikimedia-Hackathon-2018, Scoring-platform-team (Current), User-Zppix
awight renamed T183410: Create base docker image for ORES from Create base docker image and set env vars for Wiki-AI CI to Create base docker image for ORES.
Fri, May 18, 1:33 PM · Wikimedia-Hackathon-2018, Scoring-platform-team (Current), User-Zppix

Wed, May 16

awight added a project to T140364: Model information UI (graphs and statistics): Wikimedia-Hackathon-2018.
Wed, May 16, 9:39 AM · Wikimedia-Hackathon-2018, ORES, Scoring-platform-team
awight added a comment to T140364: Model information UI (graphs and statistics).

Here's a tiny bit of code I put together for P-R graphs specifically, https://github.com/adamwight/thresholds_diagrams

Wed, May 16, 9:38 AM · Wikimedia-Hackathon-2018, ORES, Scoring-platform-team
awight merged T194739: Create more visual aids for ORES into T140364: Model information UI (graphs and statistics).
Wed, May 16, 9:37 AM · Wikimedia-Hackathon-2018, ORES, Scoring-platform-team
awight merged task T194739: Create more visual aids for ORES into T140364: Model information UI (graphs and statistics).
Wed, May 16, 9:37 AM · Wikimedia-Hackathon-2018, Documentation, Scoring-platform-team
awight added a comment to T194603: ores-beta lacking a firewall rule to allow port 8081.

Weird punchline... I added another of the production roles cos we think there are messy interdependencies, and after rebooting, the result was *no* iptables firewall. That's bizarre but fine for now.

Wed, May 16, 9:29 AM · Scoring-platform-team (Current), ORES
awight created T194809: Write deployment guide for Wikilabels.
Wed, May 16, 9:15 AM · Wikilabels, Scoring-platform-team

Tue, May 15

awight updated the task description for T194758: Rewrite scoring libraries to replace pywikibase with mwbase.
Tue, May 15, 1:54 PM · revscoring, Wikimedia-Hackathon-2018, artificial-intelligence, Scoring-platform-team
awight created T194758: Rewrite scoring libraries to replace pywikibase with mwbase.
Tue, May 15, 1:53 PM · revscoring, Wikimedia-Hackathon-2018, artificial-intelligence, Scoring-platform-team
awight added a comment to T194603: ores-beta lacking a firewall rule to allow port 8081.

Workaround to apply every boot until this is resolved:

iptables -A INPUT -p tcp --dport 8081 -j ACCEPT
Tue, May 15, 1:21 PM · Scoring-platform-team (Current), ORES
awight added a comment to T194329: ores1001 is in some kind of death spiral.

Great, we can leave this closed for now, but it began around some test deployments I did, so I'm concerned and will monitor the next few carefully.

Tue, May 15, 10:48 AM · ORES, Scoring-platform-team (Current)
awight created T194740: Write and update Jupyter notebooks documenting ORES models and components.
Tue, May 15, 10:43 AM · Documentation, Scoring-platform-team, Wikimedia-Hackathon-2018
awight created T194739: Create more visual aids for ORES.
Tue, May 15, 10:37 AM · Wikimedia-Hackathon-2018, Documentation, Scoring-platform-team

Sun, May 13

awight created T194603: ores-beta lacking a firewall rule to allow port 8081.
Sun, May 13, 6:37 PM · Scoring-platform-team (Current), ORES

Thu, May 10

awight added a parent task for T194322: Drafttopic breaks ?features parameter: T176336: Deploy drafttopic model to ORES.
Thu, May 10, 1:19 AM · drafttopic-modeling, Scoring-platform-team (Current)
awight added a subtask for T176336: Deploy drafttopic model to ORES: T194322: Drafttopic breaks ?features parameter.
Thu, May 10, 1:19 AM · Patch-For-Review, drafttopic-modeling, Scoring-platform-team (Current), ORES, artificial-intelligence
awight closed T194315: deployment-ores01 needs more disk space as Resolved.
Thu, May 10, 1:18 AM · Scoring-platform-team
awight renamed T194315: deployment-ores01 needs more disk space from deployment-ores01 should get more puppet roles by default to deployment-ores01 needs more disk space.
Thu, May 10, 1:18 AM · Scoring-platform-team
awight updated the task description for T194315: deployment-ores01 needs more disk space.
Thu, May 10, 12:45 AM · Scoring-platform-team

Wed, May 9

awight updated the task description for T194315: deployment-ores01 needs more disk space.
Wed, May 9, 11:49 PM · Scoring-platform-team
awight created T194329: ores1001 is in some kind of death spiral.
Wed, May 9, 11:45 PM · ORES, Scoring-platform-team (Current)
awight renamed T194315: deployment-ores01 needs more disk space from deployment-ores01 needs a bigger disk to deployment-ores01 should get more puppet roles by default.
Wed, May 9, 11:33 PM · Scoring-platform-team
awight committed rORESWHEELS89b0962fc25f: Remove another duplicate wheel (authored by awight).
Remove another duplicate wheel
Wed, May 9, 11:27 PM
awight committed rORESWHEELSf6bcaa5ed730: Remove newer mwreverts until we need it (authored by awight).
Remove newer mwreverts until we need it
Wed, May 9, 11:27 PM
awight added a comment to T194315: deployment-ores01 needs more disk space.

Strange, every time I recreate the machine as a "large", which is supposed to have a 80GB disk, I only see a 20GB root partition.

Wed, May 9, 11:26 PM · Scoring-platform-team
awight created T194322: Drafttopic breaks ?features parameter.
Wed, May 9, 10:49 PM · drafttopic-modeling, Scoring-platform-team (Current)
awight committed rORESDEPLOYbf1e2b1f29d7: Bump wheels (authored by awight).
Bump wheels
Wed, May 9, 10:42 PM
awight committed rORESDEPLOY1b13ef1b297e: Bump wheels (authored by awight).
Bump wheels
Wed, May 9, 10:36 PM
awight committed rORESDEPLOY2a099391e336: Remove scap submodule cruft (authored by awight).
Remove scap submodule cruft
Wed, May 9, 10:21 PM
awight created P7113 (An Untitled Masterwork).
Wed, May 9, 10:19 PM
awight created T194315: deployment-ores01 needs more disk space.
Wed, May 9, 9:34 PM · Scoring-platform-team
awight committed rORESDEPLOYc0db10224d57: Provision the drafttopic model (authored by awight).
Provision the drafttopic model
Wed, May 9, 9:31 PM
awight created P7109 (An Untitled Masterwork).
Wed, May 9, 9:21 PM
awight committed rORESDEPLOYbcb6b18348c7: Provision the drafttopic model (authored by awight).
Provision the drafttopic model
Wed, May 9, 9:01 PM
awight committed rORESDEPLOY49cb16b0eed6: Add the assets submodule and word2vec, git-lfs enabled (authored by awight).
Add the assets submodule and word2vec, git-lfs enabled
Wed, May 9, 9:01 PM
awight committed rORESDEPLOYba5285fd1187: Point submodules at gerrit (authored by awight).
Point submodules at gerrit
Wed, May 9, 9:00 PM
awight committed rORESDEPLOY7064288c4f96: Provision the drafttopic model (authored by awight).
Provision the drafttopic model
Wed, May 9, 8:52 PM
awight committed rDRAFTTOPIC9fd88df288a4: Clean up Makefile, move build steps from documentation (authored by awight).
Clean up Makefile, move build steps from documentation
Wed, May 9, 7:21 PM
awight committed rDRAFTTOPICcfb0436d8725: Clean up Makefile, move build steps from documentation (authored by awight).
Clean up Makefile, move build steps from documentation
Wed, May 9, 7:17 PM
awight added a project to T194295: Phabricator repo is not mirroring to gerrit as hoped: Gerrit.

We need a Gerrit admin to CR and submit this, https://gerrit.wikimedia.org/r/#/c/432145/

Wed, May 9, 7:16 PM · Gerrit, Scoring-platform-team (Current), Release-Engineering-Team
awight moved T192293: Check drafttopic model memory usage from Active to Done on the Scoring-platform-team (Current) board.
Wed, May 9, 6:33 PM · drafttopic-modeling, Scoring-platform-team (Current), ORES, artificial-intelligence
awight added a comment to T192293: Check drafttopic model memory usage.

I'm pretty certain this won't cause 2x overall memory usage, although it is the upper bound. Some of RSS ends up being copy-on-write shared across processes, but we can't predict what proportion that will be. I think we should check memory usage on the canary box before doing the full deployment.

Wed, May 9, 6:33 PM · drafttopic-modeling, Scoring-platform-team (Current), ORES, artificial-intelligence
awight added a subtask for T176336: Deploy drafttopic model to ORES: T194295: Phabricator repo is not mirroring to gerrit as hoped.
Wed, May 9, 6:29 PM · Patch-For-Review, drafttopic-modeling, Scoring-platform-team (Current), ORES, artificial-intelligence
awight added a parent task for T194295: Phabricator repo is not mirroring to gerrit as hoped: T176336: Deploy drafttopic model to ORES.
Wed, May 9, 6:29 PM · Gerrit, Scoring-platform-team (Current), Release-Engineering-Team
awight created T194295: Phabricator repo is not mirroring to gerrit as hoped.
Wed, May 9, 6:29 PM · Gerrit, Scoring-platform-team (Current), Release-Engineering-Team
GitHub <noreply@github.com> committed rDRAFTTOPICff7a6b65e184: Merge 24c70ce7dd7475a158846678a771829ab867d29d into… (authored by awight).
Merge 24c70ce7dd7475a158846678a771829ab867d29d into…
Wed, May 9, 6:19 PM
awight committed rDRAFTTOPIC24c70ce7dd74: [WIP] Script to pull pages of interest using API (authored by awight).
[WIP] Script to pull pages of interest using API
Wed, May 9, 6:19 PM
awight committed rDRAFTTOPIC4f0d459112d0: Move some data build steps from documentation to the Makefile (authored by awight).
Move some data build steps from documentation to the Makefile
Wed, May 9, 6:19 PM
awight committed rDRAFTTOPICe5b7adfb13bd: Stub notebook for demonstrating how to poke at the model (authored by awight).
Stub notebook for demonstrating how to poke at the model
Wed, May 9, 6:19 PM
awight committed rDRAFTTOPIC63696f163c44: Clean up Makefile and assumptions (authored by awight).
Clean up Makefile and assumptions
Wed, May 9, 6:19 PM
awight added a comment to T180627: Support git-lfs.

You know, we should probably install git-lfs everywhere we can, just like git, and do git lfs install --global as part of it.

Wed, May 9, 5:28 PM · Release-Engineering-Team (Kanban), Scoring-platform-team, Patch-For-Review, Scap

Tue, May 8

awight added a comment to T180627: Support git-lfs.

15:50 < awight> twentyafterfour: bad news, my test LFS deployment failed to pull the files again
15:51 < awight> tin:/srv/deployment/ores/deploy/scap/log/scap-sync-2018-05-01-0003-1-gae55746.log
15:51 < awight> git lfs install --global did happen
15:51 < awight> ah.
15:52 < awight> It's probably because git lfs install happened after submodule update -i.

Tue, May 8, 11:21 PM · Release-Engineering-Team (Kanban), Scoring-platform-team, Patch-For-Review, Scap
awight added a comment to T192293: Check drafttopic model memory usage.

Slightly different results when running under ORES, it seems that performing drafttopic scoring does have a one-time effect on RES for each thread.

Tue, May 8, 10:57 PM · drafttopic-modeling, Scoring-platform-team (Current), ORES, artificial-intelligence
awight created T194222: ORES: new type of filter to select when a given model will be included in scores.
Tue, May 8, 10:37 PM · drafttopic-modeling, Scoring-platform-team, ORES
awight created T194221: Sort classes when printing model_info.
Tue, May 8, 10:30 PM · ORES, Scoring-platform-team
awight committed rORESDEPLOY39a752242e22: [WIP] Provision the drafttopic model (authored by awight).
[WIP] Provision the drafttopic model
Tue, May 8, 10:26 PM
awight moved T176336: Deploy drafttopic model to ORES from Epics to Pending deployment on the Scoring-platform-team (Current) board.
Tue, May 8, 9:51 PM · Patch-For-Review, drafttopic-modeling, Scoring-platform-team (Current), ORES, artificial-intelligence
awight moved T193834: Rebuild drafttopic with corrected data from Review to Done on the Scoring-platform-team (Current) board.
Tue, May 8, 9:51 PM · drafttopic-modeling, Scoring-platform-team (Current)
awight added a project to T194220: Host JADE schemas on metawiki: JADE.
Tue, May 8, 9:48 PM · JADE, Scoring-platform-team
awight created T194220: Host JADE schemas on metawiki.
Tue, May 8, 9:48 PM · JADE, Scoring-platform-team