awight (Adam Roses Wight)
User

Projects (15)

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Thursday

  • Clear sailing ahead.

User Details

User Since
Oct 12 2014, 9:02 PM (209 w, 1 d)
Availability
Available
IRC Nick
awight
LDAP User
Awight
MediaWiki User
Awight (WMF) [ Global Accounts ]

Recent Activity

Today

awight committed rEJADa0f3e36e65d4: Tests to demonstrate SpamBlacklist integration (authored by awight).
Tests to demonstrate SpamBlacklist integration
Tue, Oct 16, 7:58 AM
awight committed rEJADb89ed93258f3: Render Judgment pages as wikitext (authored by awight).
Render Judgment pages as wikitext
Tue, Oct 16, 7:58 AM
awight committed rEJADfb1f11b4ecda: Add and fix return type hinting (authored by awight).
Add and fix return type hinting
Tue, Oct 16, 7:58 AM
awight committed rEJADe521a238cd91: Split user schema into local, global ID, and IP (authored by awight).
Split user schema into local, global ID, and IP
Tue, Oct 16, 7:58 AM
awight committed rEJADebba33ef4271: Improve ApiGetJudgments tests (authored by awight).
Improve ApiGetJudgments tests
Tue, Oct 16, 7:58 AM
awight committed rEJADd6b83c5e3cab: TitleHelper test coverage (authored by awight).
TitleHelper test coverage
Tue, Oct 16, 7:58 AM
awight committed rEJADc7d4835781e1: Write tests for PageEntityJudgmentSetStorage (authored by awight).
Write tests for PageEntityJudgmentSetStorage
Tue, Oct 16, 7:58 AM
awight committed rEJAD69b93b9634cf: Minor test cleanup (authored by awight).
Minor test cleanup
Tue, Oct 16, 7:57 AM
awight committed rEJADa47f0dc82379: Remove unused class (authored by awight).
Remove unused class
Tue, Oct 16, 7:57 AM
awight committed rEJAD1218bad04948: Write tests for PageEntityJudgmentSetStorage (authored by awight).
Write tests for PageEntityJudgmentSetStorage
Tue, Oct 16, 6:28 AM
awight committed rEJAD5992653622ae: Tests to demonstrate SpamBlacklist integration (authored by awight).
Tests to demonstrate SpamBlacklist integration
Tue, Oct 16, 5:01 AM
awight committed rEJADf69d5dd46932: Render Judgment pages as wikitext (authored by awight).
Render Judgment pages as wikitext
Tue, Oct 16, 5:01 AM
awight committed rEJAD81eeeaf6e6eb: Tests to demonstrate SpamBlacklist integration (authored by awight).
Tests to demonstrate SpamBlacklist integration
Tue, Oct 16, 4:36 AM
awight committed rEJAD684c756a133b: Render Judgment pages as wikitext (authored by awight).
Render Judgment pages as wikitext
Tue, Oct 16, 4:36 AM
awight committed rEJAD5523f3e1fcd3: Tests to demonstrate SpamBlacklist integration (authored by awight).
Tests to demonstrate SpamBlacklist integration
Tue, Oct 16, 4:36 AM
awight committed rEJAD117404196e0e: Render Judgment pages as wikitext (authored by awight).
Render Judgment pages as wikitext
Tue, Oct 16, 4:36 AM
awight committed rEJADebca6d4a2b1e: Split user schema into local, global ID, and IP (authored by awight).
Split user schema into local, global ID, and IP
Tue, Oct 16, 4:36 AM
awight committed rEJAD31386e658e7e: Split user schema into local, global ID, and IP (authored by awight).
Split user schema into local, global ID, and IP
Tue, Oct 16, 4:20 AM

Yesterday

awight committed rEJAD9ac5480e574e: [WIP] Split user schema into local, global ID, and IP (authored by awight).
[WIP] Split user schema into local, global ID, and IP
Mon, Oct 15, 10:59 PM
awight added a comment to T179524: Consistent TimeoutErrors when using Celery 4.

@Ladsgroup That's great news! Note that in T179524#3735543 I disclose that I may have worked around this problem with a barbaric hack.

Mon, Oct 15, 6:25 PM · Scoring-platform-team, Patch-For-Review, ORES

Sat, Oct 13

awight committed rEJADb58604ae6f6b: [WIP] Write tests for PageEntityJudgmentSetStorage (authored by awight).
[WIP] Write tests for PageEntityJudgmentSetStorage
Sat, Oct 13, 12:47 AM

Fri, Oct 12

awight committed rEJAD80d874a94e56: Tests to demonstrate SpamBlacklist integration (authored by awight).
Tests to demonstrate SpamBlacklist integration
Fri, Oct 12, 7:54 PM
awight committed rEJADb43436f24a72: Render Judgment pages as wikitext (authored by awight).
Render Judgment pages as wikitext
Fri, Oct 12, 7:54 PM
awight committed rEJAD1c5b979830bf: Split user schema into ID or IP; validate (authored by awight).
Split user schema into ID or IP; validate
Fri, Oct 12, 7:54 PM
awight committed rEJAD9c9e7e4822df: Spaces to tabs in JSON files (authored by awight).
Spaces to tabs in JSON files
Fri, Oct 12, 7:32 AM
awight committed rEJAD996133029148: Maintenance scripts for judgment indexes (authored by awight).
Maintenance scripts for judgment indexes
Fri, Oct 12, 1:25 AM
awight committed rEJAD849e35588d6a: Hooks to maintain judgment link tables (authored by awight).
Hooks to maintain judgment link tables
Fri, Oct 12, 1:25 AM

Thu, Oct 11

awight committed rEJAD967d787874a4: Hooks to maintain judgment link tables (authored by awight).
Hooks to maintain judgment link tables
Thu, Oct 11, 11:36 PM
awight committed rEJADba7ba2eef59b: Maintenance scripts for judgment indexes (authored by awight).
Maintenance scripts for judgment indexes
Thu, Oct 11, 11:36 PM
awight committed rEJAD4e0c3c7b6546: PSR-4 autoload tests by namespace rather than listing each class. (authored by awight).
PSR-4 autoload tests by namespace rather than listing each class.
Thu, Oct 11, 11:36 PM
awight added a comment to T202596: Write our anticipated "phase two" schemas and submit for review.

@Marostegui These are the proposed indexes, if you want to discuss something concrete:
https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/JADE/+/456078/

Thu, Oct 11, 11:17 PM · MW-1.32-notes (WMF-deploy-2018-09-25 (1.32.0-wmf.23)), Patch-For-Review, DBA, Scoring-platform-team (Current), User-Joe, Operations, JADE
awight committed rEJAD30067413418a: Maintenance scripts for judgment indexes (authored by awight).
Maintenance scripts for judgment indexes
Thu, Oct 11, 11:06 PM
awight committed rEJADd7e2e743bf54: Hooks to maintain judgment link tables (authored by awight).
Hooks to maintain judgment link tables
Thu, Oct 11, 11:06 PM
awight committed rEJADc29e769d16b2: Hooks to maintain judgment link tables (authored by awight).
Hooks to maintain judgment link tables
Thu, Oct 11, 11:06 PM
awight committed rEJADa3b5443e4e12: Maintenance scripts for judgment indexes (authored by awight).
Maintenance scripts for judgment indexes
Thu, Oct 11, 11:06 PM
awight committed rEJAD0246c5e554fb: Hooks to maintain judgment link tables (authored by awight).
Hooks to maintain judgment link tables
Thu, Oct 11, 11:06 PM
awight committed rEJAD2ae05343aa42: PSR-4 autoload tests by namespace rather than listing each class. (authored by awight).
PSR-4 autoload tests by namespace rather than listing each class.
Thu, Oct 11, 11:06 PM
awight committed rEJAD95fe31d6536d: Secondary schema for JADE indexes (authored by awight).
Secondary schema for JADE indexes
Thu, Oct 11, 11:06 PM
awight committed rEJADb0e25e519dc8: Maintenance scripts for judgment indexes (authored by awight).
Maintenance scripts for judgment indexes
Thu, Oct 11, 11:06 PM
awight committed rEJAD928c58f2d7a1: PSR-4 autoload tests by namespace rather than listing each class. (authored by awight).
PSR-4 autoload tests by namespace rather than listing each class.
Thu, Oct 11, 11:06 PM
awight committed rEJAD839fe7e5fb67: Secondary schema for JADE indexes (authored by awight).
Secondary schema for JADE indexes
Thu, Oct 11, 11:06 PM
awight committed rEJAD47cabc4c50c3: Tests to demonstrate SpamBlacklist integration (authored by awight).
Tests to demonstrate SpamBlacklist integration
Thu, Oct 11, 10:15 PM
awight committed rEJADec6384a8bd1f: Render Judgment pages as wikitext (authored by awight).
Render Judgment pages as wikitext
Thu, Oct 11, 10:15 PM
awight committed rEJAD7aab7eec596b: Split user schema into ID or IP; validate (authored by awight).
Split user schema into ID or IP; validate
Thu, Oct 11, 10:15 PM
awight committed rEJADf93aa79c4acd: Followup: convert user subschema to use oneOf (authored by awight).
Followup: convert user subschema to use oneOf
Thu, Oct 11, 10:15 PM
awight committed rEJADfb328b983f72: Always require damaging and goodfaith together (authored by awight).
Always require damaging and goodfaith together
Thu, Oct 11, 10:15 PM
awight committed rEJAD90126390b408: Always require damaging and goodfaith together (authored by awight).
Always require damaging and goodfaith together
Thu, Oct 11, 9:17 PM
awight committed rEJAD2d6847a16471: Followup: convert user subschema to use oneOf (authored by awight).
Followup: convert user subschema to use oneOf
Thu, Oct 11, 9:17 PM
awight committed rEJADfa29b4989a89: Always require damaging and goodfaith together (authored by awight).
Always require damaging and goodfaith together
Thu, Oct 11, 9:09 PM
awight committed rORES640629b9c840: Make ScoreRequest JSON serialiazble (#271) (authored by Ladsgroup).
Make ScoreRequest JSON serialiazble (#271)
Thu, Oct 11, 7:33 PM
awight committed rORESb69e914bf5b0: Move logging_config to a dedicated section of general configs (#272) (authored by Ladsgroup).
Move logging_config to a dedicated section of general configs (#272)
Thu, Oct 11, 5:28 PM
awight moved T206221: Merge logging config to the main config in ORES from Review to Pending deployment on the Scoring-platform-team (Current) board.
Thu, Oct 11, 5:26 PM · Patch-For-Review, User-Ladsgroup, ORES, Scoring-platform-team (Current)

Wed, Oct 10

awight placed T191214: Edittypes repo setup up for grabs.

Unassigning.

Wed, Oct 10, 11:29 PM · Scoring-platform-team, artificial-intelligence, edittypes-modeling
awight added a comment to T190968: Simplify and modularize the Makefile template.

Can we shelf this in the backlog?

Wed, Oct 10, 11:29 PM · Scoring-platform-team, editquality-modeling, artificial-intelligence
awight moved T195083: Provide a user-accessible page showing current thresholds for each sensitivity level from Active to Done on the Scoring-platform-team (Current) board.
Wed, Oct 10, 11:28 PM · Wikimedia-Hackathon-2018, MediaWiki-extensions-ORES, Global-Collaboration, Scoring-platform-team (Current)
awight closed T195083: Provide a user-accessible page showing current thresholds for each sensitivity level as Resolved.

Nice hustle, this is deployed!
https://en.wikipedia.org/wiki/Special:ORESModels

Wed, Oct 10, 11:28 PM · Wikimedia-Hackathon-2018, MediaWiki-extensions-ORES, Global-Collaboration, Scoring-platform-team (Current)
awight moved T198232: Draft of ORES threshold optimization documentation from Active to Review on the Scoring-platform-team (Current) board.
Wed, Oct 10, 11:27 PM · Documentation, ORES, Scoring-platform-team (Current)
awight reassigned T198232: Draft of ORES threshold optimization documentation from awight to Halfak.
Wed, Oct 10, 11:27 PM · Documentation, ORES, Scoring-platform-team (Current)
awight added a comment to T197096: [Epic] Use LFS for large ORES files.

This task should be deduped or linked to T171619

Wed, Oct 10, 11:26 PM · Patch-For-Review, User-Ladsgroup, Scoring-platform-team (Current)
awight committed rORES9c10f5f581d0: Add LogstashHandler and LogstashFormatter (#268) (authored by Ladsgroup).
Add LogstashHandler and LogstashFormatter (#268)
Wed, Oct 10, 11:25 PM
awight renamed T171619: [Epic] ORES should use a git large file plugin for storing serialized binaries from ORES should use a git large file plugin for storing serialized binaries to [Epic] ORES should use a git large file plugin for storing serialized binaries.
Wed, Oct 10, 11:25 PM · Epic, Scoring-platform-team (Current), Operations, Release-Engineering-Team (Watching / External), Scap, ORES
awight moved T171619: [Epic] ORES should use a git large file plugin for storing serialized binaries from Active to Epics on the Scoring-platform-team (Current) board.
Wed, Oct 10, 11:25 PM · Epic, Scoring-platform-team (Current), Operations, Release-Engineering-Team (Watching / External), Scap, ORES
awight claimed T206573: Validate global user ID; revisit user schema.
Wed, Oct 10, 11:24 PM · Patch-For-Review, Scoring-platform-team (Current), JADE
awight moved T206573: Validate global user ID; revisit user schema from Active to Review on the Scoring-platform-team (Current) board.
Wed, Oct 10, 11:24 PM · Patch-For-Review, Scoring-platform-team (Current), JADE
awight moved T168921: Send error logs to logstash from Review to Pending deployment on the Scoring-platform-team (Current) board.
Wed, Oct 10, 11:23 PM · Patch-For-Review, User-Ladsgroup, Scoring-platform-team (Current), ORES
awight moved T169586: Send celery logs and events to logstash from Review to Pending deployment on the Scoring-platform-team (Current) board.
Wed, Oct 10, 11:23 PM · Patch-For-Review, User-Ladsgroup, Scoring-platform-team (Current), Wikimedia-Logstash, ORES
awight moved T181630: Send celery and wsgi service logs to logstash from Review to Pending deployment on the Scoring-platform-team (Current) board.
Wed, Oct 10, 11:23 PM · Patch-For-Review, Scoring-platform-team (Current), User-Ladsgroup, Wikimedia-Logstash, monitoring, Wikimedia-Incident, Operations
awight moved T205256: ORES uwsgi logs in logstash are useless from Review to Pending deployment on the Scoring-platform-team (Current) board.
Wed, Oct 10, 11:23 PM · Patch-For-Review, Scoring-platform-team (Current), User-Ladsgroup, ORES
awight moved T181546: Let the ORES application set log severity, not uWSGI from Review to Pending deployment on the Scoring-platform-team (Current) board.
Wed, Oct 10, 11:23 PM · Patch-For-Review, User-Ladsgroup, Scoring-platform-team (Current), Operations
awight added a comment to T206654: ORES workers using dramatically higher CPU, increasing linearly with time.

Following up from IRC, I set loggers.celery.level to DEBUG in logging_config.yaml, and was able to demonstrate locally that celery debug logs would appear in /srv/log/ores/app.log.

Wed, Oct 10, 11:18 PM · ORES, Scoring-platform-team (Current)
awight added a comment to T206654: ORES workers using dramatically higher CPU, increasing linearly with time.

I found this config on production, so in theory our workers should be restarting themselves:

CELERYD_MAX_TASKS_PER_CHILD: 100
Wed, Oct 10, 11:15 PM · ORES, Scoring-platform-team (Current)
awight added a comment to T206037: Merge articlequality and itemquality.

"talk quality"? Generally we don't refer to discussions as "content". "Content pages" does not include talk pages.

Wed, Oct 10, 10:33 PM · Scoring-platform-team (Current), MW-1.32-notes (WMF-deploy-2018-10-16 (1.32.0-wmf.26)), Growth-Team, MediaWiki-extensions-PageCuration, Patch-For-Review, ORES
awight updated subscribers of T206654: ORES workers using dramatically higher CPU, increasing linearly with time.
Wed, Oct 10, 8:46 PM · ORES, Scoring-platform-team (Current)
awight added a comment to T206654: ORES workers using dramatically higher CPU, increasing linearly with time.

Both issues mention a poll syscall returning POLLNVAL that we should be able to see in the strace if it's the same problem. Is it the worker manager or the worker threads which go 100% CPU? Do the straces match this profile?

Wed, Oct 10, 8:46 PM · ORES, Scoring-platform-team (Current)
awight added a comment to T206037: Merge articlequality and itemquality.

"Content" is commonly used among Wikipedians. "Content pages" is an official definition used in Wiki stats.

Wed, Oct 10, 7:14 PM · Scoring-platform-team (Current), MW-1.32-notes (WMF-deploy-2018-10-16 (1.32.0-wmf.26)), Growth-Team, MediaWiki-extensions-PageCuration, Patch-For-Review, ORES
awight added a comment to T206037: Merge articlequality and itemquality.

Additionally, the itemquality -> articlequality is much easier, only affects Wikidata clients, and doesn't introduce a new key.

Wed, Oct 10, 6:48 PM · Scoring-platform-team (Current), MW-1.32-notes (WMF-deploy-2018-10-16 (1.32.0-wmf.26)), Growth-Team, MediaWiki-extensions-PageCuration, Patch-For-Review, ORES
awight added a comment to T206037: Merge articlequality and itemquality.

I'm going to push this forward, but would first like to reopen discussion of the name. "contentquality" is something we invented among our team, and has no inherent meaning to Wikimedians. Perhaps we should merge "itemquality" into "articlequality" instead, which would keep its approximate original meaning, and has easily discoverable documentation.

Wed, Oct 10, 6:47 PM · Scoring-platform-team (Current), MW-1.32-notes (WMF-deploy-2018-10-16 (1.32.0-wmf.26)), Growth-Team, MediaWiki-extensions-PageCuration, Patch-For-Review, ORES
awight renamed T206037: Merge articlequality and itemquality from Rename articlequality and itemquality to "contentquality" to Merge articlequality and itemquality.
Wed, Oct 10, 6:38 PM · Scoring-platform-team (Current), MW-1.32-notes (WMF-deploy-2018-10-16 (1.32.0-wmf.26)), Growth-Team, MediaWiki-extensions-PageCuration, Patch-For-Review, ORES
awight added a comment to T206654: ORES workers using dramatically higher CPU, increasing linearly with time.

Looks like the trouble started on Sept 22nd, 16:00 UTC.

Wed, Oct 10, 5:09 PM · ORES, Scoring-platform-team (Current)
awight triaged T206654: ORES workers using dramatically higher CPU, increasing linearly with time as High priority.
Wed, Oct 10, 4:45 PM · ORES, Scoring-platform-team (Current)
awight created T206654: ORES workers using dramatically higher CPU, increasing linearly with time.
Wed, Oct 10, 4:45 PM · ORES, Scoring-platform-team (Current)
awight committed rEJAD2fe04a735f33: Split user schema into ID or IP; validate (authored by awight).
Split user schema into ID or IP; validate
Wed, Oct 10, 3:48 PM
awight committed rEJADc4f21224baae: Tests to demonstrate SpamBlacklist integration (authored by awight).
Tests to demonstrate SpamBlacklist integration
Wed, Oct 10, 3:28 PM
awight committed rEJAD98eb6946cc59: Split user schema into ID, IP, or username; validate (authored by awight).
Split user schema into ID, IP, or username; validate
Wed, Oct 10, 3:28 PM

Tue, Oct 9

awight updated subscribers of T206573: Validate global user ID; revisit user schema.

@Halfak I got some confirmation on IRC that nobody expects our extension to filter or rename users included in the JSON content. The analogous user signatures in wikitext aren't filtered in any special way, at least. This seems to clear our path to allowing usernames…

Tue, Oct 9, 11:06 PM · Patch-For-Review, Scoring-platform-team (Current), JADE
awight moved T200297: Introduce a new namespace for collaborative judgments about wiki entities from Active to Review on the Scoring-platform-team (Current) board.
Tue, Oct 9, 10:42 PM · Scoring-platform-team (Current), DBA, Operations, JADE, TechCom-RFC
awight moved T200297: Introduce a new namespace for collaborative judgments about wiki entities from In Progress to Review on the JADE board.
Tue, Oct 9, 10:41 PM · Scoring-platform-team (Current), DBA, Operations, JADE, TechCom-RFC
awight added a comment to T200297: Introduce a new namespace for collaborative judgments about wiki entities.

The fully implemented secondary schema is ready for TechCom review:
https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/JADE/+/456078/

Tue, Oct 9, 10:41 PM · Scoring-platform-team (Current), DBA, Operations, JADE, TechCom-RFC
awight claimed T201365: AbuseFilter integration for JADE.
Tue, Oct 9, 10:39 PM · MW-1.32-notes (WMF-deploy-2018-10-16 (1.32.0-wmf.26)), Patch-For-Review, Scoring-platform-team (Current), JADE, AbuseFilter
awight claimed T206255: SpamBlacklist integration for JADE.
Tue, Oct 9, 10:39 PM · Patch-For-Review, Scoring-platform-team (Current), SpamBlacklist, JADE
awight moved T206346: Support wikitext in judgment notes and endorsement comment fields from Active to Review on the Scoring-platform-team (Current) board.
Tue, Oct 9, 10:39 PM · Patch-For-Review, Scoring-platform-team (Current), JADE
awight committed rEJAD12b78fd5e6fa: Tests to demonstrate SpamBlacklist integration (authored by awight).
Tests to demonstrate SpamBlacklist integration
Tue, Oct 9, 10:39 PM
awight moved T206255: SpamBlacklist integration for JADE from Active to Review on the Scoring-platform-team (Current) board.
Tue, Oct 9, 10:39 PM · Patch-For-Review, Scoring-platform-team (Current), SpamBlacklist, JADE
awight committed rEJAD0f5db26de500: Validate global user ID in endorsements (authored by awight).
Validate global user ID in endorsements
Tue, Oct 9, 9:03 PM
awight committed rEJAD1a40b148889e: Render Judgment pages as wikitext (authored by awight).
Render Judgment pages as wikitext
Tue, Oct 9, 9:03 PM
awight edited projects for T206573: Validate global user ID; revisit user schema, added: Scoring-platform-team (Current); removed Scoring-platform-team.
Tue, Oct 9, 8:42 PM · Patch-For-Review, Scoring-platform-team (Current), JADE
awight updated the task description for T206573: Validate global user ID; revisit user schema.
Tue, Oct 9, 8:41 PM · Patch-For-Review, Scoring-platform-team (Current), JADE
awight created T206573: Validate global user ID; revisit user schema.
Tue, Oct 9, 8:26 PM · Patch-For-Review, Scoring-platform-team (Current), JADE
awight closed T197653: Surface JADE validation errors as Resolved.
Tue, Oct 9, 8:23 PM · Scoring-platform-team (Current), JADE
awight committed rEJAD6f7fa88bcea3: [WIP] Tests for SpamBlacklist integration (authored by awight).
[WIP] Tests for SpamBlacklist integration
Tue, Oct 9, 7:29 PM