awight (Adam Roses Wight)
User

Projects (10)

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Friday

  • Clear sailing ahead.

User Details

User Since
Oct 12 2014, 9:02 PM (217 w, 2 d)
Availability
Available
IRC Nick
awight
LDAP User
Awight
MediaWiki User
Awight (WMF) [ Global Accounts ]

Recent Activity

Fri, Dec 7

awight added a comment to T211069: Decide whether we will include raw features.

Offsite chat suggests that there's value in actually storing the raw "root" data sources that we build the feature tree from. Let's estimate the storage requirements for doing that.

Fri, Dec 7, 3:57 PM · Dumps-Generation, Analytics, Epic, ORES, revscoring, artificial-intelligence, Scoring-platform-team

Thu, Dec 6

awight triaged T211346: Make Jade UI elements translatable as Normal priority.
Thu, Dec 6, 3:15 PM · Scoring-platform-team (Current), JADE

Tue, Dec 4

awight committed rORESea85df5c12b9: [WIP] Up-to-date sample for API client usage (authored by awight).
[WIP] Up-to-date sample for API client usage
Tue, Dec 4, 12:43 AM

Mon, Dec 3

awight updated the task description for T211069: Decide whether we will include raw features.
Mon, Dec 3, 11:43 PM · Dumps-Generation, Analytics, Epic, ORES, revscoring, artificial-intelligence, Scoring-platform-team
awight updated subscribers of T211069: Decide whether we will include raw features.
Mon, Dec 3, 11:41 PM · Dumps-Generation, Analytics, Epic, ORES, revscoring, artificial-intelligence, Scoring-platform-team
awight created T211069: Decide whether we will include raw features.
Mon, Dec 3, 11:41 PM · Dumps-Generation, Analytics, Epic, ORES, revscoring, artificial-intelligence, Scoring-platform-team
awight committed rEJADd66d61e724e9: Throw a fit and s/JADE/Jade/ (authored by awight).
Throw a fit and s/JADE/Jade/
Mon, Dec 3, 11:16 PM
awight committed rEJAD383133db663e: Add indexes to filter by judgment value (authored by awight).
Add indexes to filter by judgment value
Mon, Dec 3, 11:16 PM
awight committed rEJAD344223dad480: Summarize preferred judgment values in link table (authored by awight).
Summarize preferred judgment values in link table
Mon, Dec 3, 11:16 PM
awight committed rEJAD0e70f38ecde8: Throw a fit and s/JADE/Jade/ (authored by awight).
Throw a fit and s/JADE/Jade/
Mon, Dec 3, 11:16 PM
awight committed rEJADe69b8e914dd2: Add indexes to filter by judgment value (authored by awight).
Add indexes to filter by judgment value
Mon, Dec 3, 11:16 PM
awight committed rEJAD97212dabdfc4: Summarize preferred judgment values in link table (authored by awight).
Summarize preferred judgment values in link table
Mon, Dec 3, 11:16 PM
awight committed rEJAD9e02a3ba77b9: Store content quality as an integer index (authored by awight).
Store content quality as an integer index
Mon, Dec 3, 11:16 PM
GitHub <noreply@github.com> committed rORESb5fce0b1f495: Merge de0972fe434ef2f4a5ac078d839baac239c01668 into… (authored by awight).
Merge de0972fe434ef2f4a5ac078d839baac239c01668 into…
Mon, Dec 3, 11:11 PM
awight committed rORESde0972fe434e: Support CIDR ranges in the IP whitelist (authored by awight).
Support CIDR ranges in the IP whitelist
Mon, Dec 3, 11:11 PM
awight committed rORES3827ddf30e8b: Support CIDR ranges in the IP whitelist (authored by awight).
Support CIDR ranges in the IP whitelist
Mon, Dec 3, 11:06 PM
GitHub <noreply@github.com> committed rORESc029993bcd08: Merge 3827ddf30e8b00afa4e50d9283e3e5839e7a8b99 into… (authored by awight).
Merge 3827ddf30e8b00afa4e50d9283e3e5839e7a8b99 into…
Mon, Dec 3, 11:06 PM
awight committed rEJAD69b26ae33f4d: Store content quality as an integer index (authored by awight).
Store content quality as an integer index
Mon, Dec 3, 11:02 PM
awight committed rEJAD827b0f6afede: Store content quality as an integer index (authored by awight).
Store content quality as an integer index
Mon, Dec 3, 10:56 PM
awight moved T210103: Support CIDR range whitelist for ORES throttling from Active to Review on the Scoring-platform-team (Current) board.
Mon, Dec 3, 10:48 PM · Scoring-platform-team (Current), ORES
GitHub <noreply@github.com> committed rORESe83137032780: Merge b136d2363fe53b87b96eb0d5d976fb4155f35119 into… (authored by awight).
Merge b136d2363fe53b87b96eb0d5d976fb4155f35119 into…
Mon, Dec 3, 9:23 PM
awight committed rORESb136d2363fe5: Support CIDR ranges in the IP whitelist (authored by awight).
Support CIDR ranges in the IP whitelist
Mon, Dec 3, 9:23 PM
awight added a comment to T210103: Support CIDR range whitelist for ORES throttling.

I'm backing away from the scope of this—going to implement the feature for this task in the quick way, and save refactoring for a rainier day.

Mon, Dec 3, 8:44 PM · Scoring-platform-team (Current), ORES
awight added a comment to T211046: Rename "JADE" extension to "Jade".

https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/JADE/+/476771/

Mon, Dec 3, 7:45 PM · Patch-For-Review, Gerrit, Scoring-platform-team, JADE
awight added a subtask for T183381: Deploy JADE extension to production: T211046: Rename "JADE" extension to "Jade".
Mon, Dec 3, 7:44 PM · Epic, Goal, Services (watching), Operations, TechCom, Scoring-platform-team (Current), JADE
awight added a parent task for T211046: Rename "JADE" extension to "Jade": T183381: Deploy JADE extension to production.
Mon, Dec 3, 7:44 PM · Patch-For-Review, Gerrit, Scoring-platform-team, JADE
awight moved T211046: Rename "JADE" extension to "Jade" from Bugs & stuff to Repo Admin on the Gerrit board.
Mon, Dec 3, 7:43 PM · Patch-For-Review, Gerrit, Scoring-platform-team, JADE
awight created T211046: Rename "JADE" extension to "Jade".
Mon, Dec 3, 7:43 PM · Patch-For-Review, Gerrit, Scoring-platform-team, JADE
awight moved T199069: [Epic] Write user-facing documentation for JADE from Active to Epics on the Scoring-platform-team (Current) board.
Mon, Dec 3, 6:49 PM · Epic, Documentation, Scoring-platform-team (Current), JADE
awight renamed T199069: [Epic] Write user-facing documentation for JADE from Write user-facing documentation for JADE to [Epic] Write user-facing documentation for JADE.
Mon, Dec 3, 6:49 PM · Epic, Documentation, Scoring-platform-team (Current), JADE
awight edited projects for T201887: JADE literature review, added: Scoring-platform-team; removed Scoring-platform-team (Current).
Mon, Dec 3, 6:48 PM · Scoring-platform-team, JADE
awight claimed T210103: Support CIDR range whitelist for ORES throttling.
Mon, Dec 3, 6:48 PM · Scoring-platform-team (Current), ORES
awight added a comment to T210103: Support CIDR range whitelist for ORES throttling.

Okay, thanks for the feedback. I like your suggestion and will try to extract all IP calculations into a third class, ParallelHostLimiter or something of the sort.

Mon, Dec 3, 6:47 PM · Scoring-platform-team (Current), ORES
awight created T211041: ORES wheels deployment repo Jenkins job should gate-and-submit.
Mon, Dec 3, 6:28 PM · Scoring-platform-team, ORES, Continuous-Integration-Config

Sat, Dec 1

awight committed rEJAD4734d2ca11a3: Throw a fit and s/JADE/Jade/ (authored by awight).
Throw a fit and s/JADE/Jade/
Sat, Dec 1, 12:04 AM
awight committed rEJADf1f7bc9a8282: Add indexes to filter by judgment value (authored by awight).
Add indexes to filter by judgment value
Sat, Dec 1, 12:04 AM
awight committed rEJAD5ff897dec1fa: Summarize preferred judgment values in link table (authored by awight).
Summarize preferred judgment values in link table
Sat, Dec 1, 12:04 AM
awight committed rEJADf8511eed4a4c: Store content quality as an integer index (authored by awight).
Store content quality as an integer index
Sat, Dec 1, 12:04 AM
awight committed rEJADecec3aad1e2c: Throw a fit and s/JADE/Jade/ (authored by awight).
Throw a fit and s/JADE/Jade/
Sat, Dec 1, 12:04 AM
awight committed rEJADdf0136f6de02: Add indexes to filter by judgment value (authored by awight).
Add indexes to filter by judgment value
Sat, Dec 1, 12:04 AM
awight committed rEJAD5ec18e3bc76f: Summarize preferred judgment values in link table (authored by awight).
Summarize preferred judgment values in link table
Sat, Dec 1, 12:04 AM
awight committed rEJAD856632fd0628: Store content quality as an integer index (authored by awight).
Store content quality as an integer index
Sat, Dec 1, 12:04 AM

Fri, Nov 30

awight committed rEJAD2a7d5e8283f4: Throw a fit and s/JADE/Jade/ (authored by awight).
Throw a fit and s/JADE/Jade/
Fri, Nov 30, 11:50 PM
awight committed rEJAD4c7f875e49f7: Add indexes to filter by judgment value (authored by awight).
Add indexes to filter by judgment value
Fri, Nov 30, 11:50 PM
awight committed rEJAD866c9fe60388: Summarize preferred judgment values in link table (authored by awight).
Summarize preferred judgment values in link table
Fri, Nov 30, 11:49 PM
awight committed rEJAD945568d08660: Add indexes to filter by judgment value (authored by awight).
Add indexes to filter by judgment value
Fri, Nov 30, 11:49 PM
awight committed rEJAD0a8028942daa: Throw a fit and s/JADE/Jade/ (authored by awight).
Throw a fit and s/JADE/Jade/
Fri, Nov 30, 11:49 PM
awight committed rEJAD95c2f48b1441: Summarize preferred judgment values in link table (authored by awight).
Summarize preferred judgment values in link table
Fri, Nov 30, 11:49 PM
awight committed rEJAD9d4715e1cf93: Store content quality as an integer index (authored by awight).
Store content quality as an integer index
Fri, Nov 30, 11:49 PM
awight committed rEJAD9ba673e4347e: Rename functions to match the new model name (authored by awight).
Rename functions to match the new model name
Fri, Nov 30, 11:49 PM
awight committed rEJAD814aef60c25c: [WIP] Store content quality as an integer index (authored by awight).
[WIP] Store content quality as an integer index
Fri, Nov 30, 11:27 PM
awight committed rEJADde646b353996: Define a constant for the judgment model (authored by awight).
Define a constant for the judgment model
Fri, Nov 30, 11:27 PM
awight committed rEJADef3822bbdbb5: Throw a fit and s/JADE/Jade/ (authored by awight).
Throw a fit and s/JADE/Jade/
Fri, Nov 30, 9:09 PM
awight committed rEJAD71cc94652d50: Add indexes to filter by judgment value (authored by awight).
Add indexes to filter by judgment value
Fri, Nov 30, 9:09 PM
awight committed rEJAD1b4d8dee45b3: Summarize preferred judgment values in link table (authored by awight).
Summarize preferred judgment values in link table
Fri, Nov 30, 9:09 PM

Thu, Nov 29

awight committed rORES674376695dc9: Add RedisSentinel class for score cache (#295) (authored by Ladsgroup).
Add RedisSentinel class for score cache (#295)
Thu, Nov 29, 11:55 PM
awight moved T210579: Add support for redis-sentinel in score cache from Review to Pending deployment on the Scoring-platform-team (Current) board.
Thu, Nov 29, 11:53 PM · User-Ladsgroup, Scoring-platform-team (Current), ORES
awight renamed T210804: Regression: Judgment validation allows for multiple judgments with the same value e.g. 2x {damaging, badfaith} from Regression: Judgment validation allows for multiples e.g. {damaging, badfaith} to Regression: Judgment validation allows for multiple judgments with the same value e.g. 2x {damaging, badfaith}.
Thu, Nov 29, 11:50 PM · Scoring-platform-team, JADE
awight moved T201146: Build article quality model for Galician Wikipedia from Review to Pending deployment on the Scoring-platform-team (Current) board.
Thu, Nov 29, 10:48 PM · Scoring-platform-team (Current), artificial-intelligence, articlequality-modeling, Wikilabels
awight committed rEJAD774a32612b92: Throw a fit and s/JADE/Jade/ (authored by awight).
Throw a fit and s/JADE/Jade/
Thu, Nov 29, 10:40 PM
awight committed rEJADa15106e1a128: Add indexes to filter by judgment value (authored by awight).
Add indexes to filter by judgment value
Thu, Nov 29, 10:40 PM
awight committed rEJADadc2ef53d780: Summarize preferred judgment values in link table (authored by awight).
Summarize preferred judgment values in link table
Thu, Nov 29, 10:40 PM
awight committed rEJAD1f89e24808ef: Catch DBError and return Status (authored by awight).
Catch DBError and return Status
Thu, Nov 29, 10:40 PM
awight created T210804: Regression: Judgment validation allows for multiple judgments with the same value e.g. 2x {damaging, badfaith}.
Thu, Nov 29, 10:30 PM · Scoring-platform-team, JADE
awight added a comment to T200297: Introduce a new namespace for collaborative judgments about wiki entities.

@Marostegui Hello! I've added a few summary columns and indexes to the link tables, and the resulting DDL would look like this:
https://gerrit.wikimedia.org/r/plugins/gitiles/mediawiki/extensions/JADE/+/4644f1f0f9fa723062123df947af30b084d3b1f8/sql/

Thu, Nov 29, 9:53 PM · Patch-For-Review, Scoring-platform-team (Current), DBA, Operations, JADE, TechCom-RFC
awight committed rEJAD4644f1f0f9fa: Add indexes to filter by judgment value (authored by awight).
Add indexes to filter by judgment value
Thu, Nov 29, 9:36 PM
awight committed rEJADdbd7886ee05d: Summarize preferred judgment values in link table (authored by awight).
Summarize preferred judgment values in link table
Thu, Nov 29, 9:36 PM
awight updated the task description for T210678: Accidentally merged models in editquality; need to rewrite history.
Thu, Nov 29, 9:23 PM · Scoring-platform-team
awight committed rEJAD37834fa7f9d5: [WIP] Add indexes to filter by judgment value (authored by awight).
[WIP] Add indexes to filter by judgment value
Thu, Nov 29, 9:13 PM
awight committed rEJAD49c06f3a63ea: Catch DBError and return Status (authored by awight).
Catch DBError and return Status
Thu, Nov 29, 9:13 PM
awight committed rEJAD45cc84b6b4e5: Summarize preferred judgment values in link table (authored by awight).
Summarize preferred judgment values in link table
Thu, Nov 29, 9:13 PM
awight committed rEJAD6ec78dd30ed3: [WIP] Add indexes to filter by judgment value (authored by awight).
[WIP] Add indexes to filter by judgment value
Thu, Nov 29, 8:42 PM
awight committed rEJAD52834d756ca6: Summarize preferred judgment values in link table (authored by awight).
Summarize preferred judgment values in link table
Thu, Nov 29, 8:42 PM
awight committed rEJAD0cbbdfde65bf: [WIP] Summarize preferred judgment values in link table (authored by awight).
[WIP] Summarize preferred judgment values in link table
Thu, Nov 29, 4:43 AM
awight committed rEJADfee06ebf7061: [WIP] Add indexes to filter by judgment value (authored by awight).
[WIP] Add indexes to filter by judgment value
Thu, Nov 29, 4:43 AM
awight committed rEJAD769c6d909b1e: Catch DBError and return Status (authored by awight).
Catch DBError and return Status
Thu, Nov 29, 4:43 AM
awight committed rEJAD1fc72a3d6494: [WIP] Summarize preferred judgment values in link table (authored by awight).
[WIP] Summarize preferred judgment values in link table
Thu, Nov 29, 1:09 AM

Wed, Nov 28

awight committed rOEQ31d146a3f089: Itwiki damaging/goodfaith (#172) (authored by Halfak).
Itwiki damaging/goodfaith (#172)
Wed, Nov 28, 11:18 PM
awight moved T206333: Change default serializer of celery from pickle to json from Review to Pending deployment on the Scoring-platform-team (Current) board.
Wed, Nov 28, 11:16 PM · Patch-For-Review, Scoring-platform-team (Current), User-Ladsgroup, ORES
awight created T210678: Accidentally merged models in editquality; need to rewrite history.
Wed, Nov 28, 11:09 PM · Scoring-platform-team
awight moved T208779: Train/test damaging & goodfaith models for Italian Wikipedia (itwiki) from Review to Pending deployment on the Scoring-platform-team (Current) board.
Wed, Nov 28, 10:44 PM · editquality-modeling, Scoring-platform-team (Current), artificial-intelligence
awight committed rEJADdd2552b206b9: [WIP] Summarize preferred judgment values in link table (authored by awight).
[WIP] Summarize preferred judgment values in link table
Wed, Nov 28, 9:48 PM
awight created T210662: AWight to summarize CSCW notes to a blog.
Wed, Nov 28, 8:46 PM · Scoring-platform-team
awight created T210638: Write tests for ApiHooksHandler.
Wed, Nov 28, 6:12 PM · Scoring-platform-team, MediaWiki-extensions-ORES

Tue, Nov 27

awight added a comment to T209731: Choose HDFS paths and partitioning for ORES scores.

Another comment about folders that I hadn't thought before having read your update in the description: I actually think that the chosen is not the most efficient.
In term of data-retrieval, using /wmf/data/ores/score/wiki=enwiki/model=editquality/model_version=2.1/ or /wmf/data/ores/score/model=editquality/model_version=2.1/wiki=enwiki/ is very similar.
However it is different at deletion step: the latter is a lot easier, as it involves only a single delete for the whole model.

Tue, Nov 27, 11:46 PM · Analytics, ORES, Scoring-platform-team
awight created T210562: Create test fixtures for Jade user testing.
Tue, Nov 27, 11:27 PM · Scoring-platform-team, User-Testing, JADE
awight created T210560: Design and implement prototype of Jade integration with Special:Watchlist .
Tue, Nov 27, 11:20 PM · Scoring-platform-team, User-Testing, JADE
awight created T210558: Prototype Jade controls on the action=diff page.
Tue, Nov 27, 11:06 PM · Scoring-platform-team, User-Testing, JADE
awight added a comment to T209524: In a multi-part judgment, can one of the parts be null?.

@Halfak We need your feedback here. All I remember from IRC was that you wanted "not null" validation, but don't know what your reasoning is.

Tue, Nov 27, 11:05 PM · JADE
awight updated the task description for T199128: Create overlay UI for editing Judgement pages.
Tue, Nov 27, 10:22 PM · Design, Scoring-platform-team, JADE
awight updated the task description for T199128: Create overlay UI for editing Judgement pages.
Tue, Nov 27, 10:19 PM · Design, Scoring-platform-team, JADE
awight added a comment to T200297: Introduce a new namespace for collaborative judgments about wiki entities.

Thanks, this has been a helpful tangent!

Tue, Nov 27, 10:02 PM · Patch-For-Review, Scoring-platform-team (Current), DBA, Operations, JADE, TechCom-RFC
awight added a comment to T200297: Introduce a new namespace for collaborative judgments about wiki entities.

I think we can support filtering by adding an index on the summary data? I was planning to do this unless there's a technical reason not to.

This would be a significant change to the schema and usage patterns as discussed in the RFC. It's actually a completely new usage pattern. It will need at least another feedback round with DBAs, and kind of invalidates the RFC discussion we had.

An index on that field would allow prefix matches. Denormalized summaries for display are conceptually quite different from filter criteria, though. This should be explored with a clearer view on the use cases .

Again: adding filter functionality is not a minor change, it really turns the entire proposals on its head.

Tue, Nov 27, 7:44 PM · Patch-For-Review, Scoring-platform-team (Current), DBA, Operations, JADE, TechCom-RFC
awight added a comment to T200297: Introduce a new namespace for collaborative judgments about wiki entities.

Harej and I chatted about this yesterday, and I've started working on code to populate link table summary data. The tentative agreement is that we'll go ahead and implement this summary data for the damaging and goodfaith schemas. The reason this is happening now is that ALTERs to the link table will become prohibitively expensive, and might take a few months to perform live.

But the summary denormalization is still for augmentation (display), not filtering, no?

Tue, Nov 27, 7:31 PM · Patch-For-Review, Scoring-platform-team (Current), DBA, Operations, JADE, TechCom-RFC
awight created T210535: [Epic] Code support for Jade user testing.
Tue, Nov 27, 7:29 PM · Scoring-platform-team, User-Testing, JADE
awight added a comment to T181542: Monitoring for top IPs and User-Agents hitting the ORES service.

So the plan is to have the data in logstash which is already behind NDA.

Tue, Nov 27, 6:08 PM · Scoring-platform-team, monitoring
awight added a comment to T200297: Introduce a new namespace for collaborative judgments about wiki entities.

The second bullet point ("filter RC for edits which are ORES-nondamaging and JADE-damaging") seems like a product proposal. I think this one will be up to @Harej to prioritize.

Tue, Nov 27, 5:22 PM · Patch-For-Review, Scoring-platform-team (Current), DBA, Operations, JADE, TechCom-RFC
awight added a comment to T195074: Make Celery `result_backend` and `broker_url` configurable by environment variable.

The details are vague to me at this point, but I think the issue was that we would be spinning up several docker containers and they have to be able to find each other. If we're getting the URLs configured some other way, that's fine!

Tue, Nov 27, 1:39 AM · Scoring-platform-team, ORES
awight closed T183949: Jinja error in ORES as Invalid.

I checked on ores1001 and locally, and "unicode-escape" is a valid encoding. Let's call this "invalid" until it happens again.

Tue, Nov 27, 1:34 AM · ORES, Scoring-platform-team
awight committed rEJAD73cbf75d8dc7: [WIP] Summarize preferred judgment values in link table (authored by awight).
[WIP] Summarize preferred judgment values in link table
Tue, Nov 27, 1:23 AM