awight (Adam Roses Wight)
User

Projects (15)

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Tuesday

  • Clear sailing ahead.

User Details

User Since
Oct 12 2014, 9:02 PM (196 w, 6 d)
Availability
Available
IRC Nick
awight
LDAP User
Awight
MediaWiki User
Awight (WMF) [ Global Accounts ]

Recent Activity

Thu, Jul 19

awight committed rEJAD0b69166ed2cc: [WIP] JADE API to store judgments (authored by awight).
[WIP] JADE API to store judgments
Thu, Jul 19, 10:06 PM

Tue, Jul 17

awight created T199834: Write full specification for the JADE API.
Tue, Jul 17, 7:55 PM · Scoring-platform-team, JADE, Documentation
awight moved T198232: Draft of ORES threshold optimization documentation from Active to Review on the Scoring-platform-team (Current) board.
Tue, Jul 17, 7:41 PM · Documentation, ORES, Scoring-platform-team (Current)
awight updated the task description for T198232: Draft of ORES threshold optimization documentation.
Tue, Jul 17, 7:40 PM · Documentation, ORES, Scoring-platform-team (Current)
awight added a comment to T196547: Extension:JADE scalability concerns due to creating a page per revision.

@daniel Surprisingly, there is interest in this going through TechCom after all. I've been digesting discussion into this page, https://etherpad.wikimedia.org/p/JADE_scalability_FAQ but would like to ask you for an example of the best format for presenting the issues to the committee?

Tue, Jul 17, 2:32 PM · TechCom-RFC, DBA, Scoring-platform-team (Current), User-Joe, Operations, JADE

Mon, Jul 16

awight closed T199750: JADE pages on beta no longer render, a subtask of T176333: Deploy JADE prototype in Beta Cluster, as Resolved.
Mon, Jul 16, 9:27 PM · Scoring-platform-team (Current), JADE
awight closed T199750: JADE pages on beta no longer render as Resolved.

I don't like it, but the solution was to overwrite the page with new content...

Mon, Jul 16, 9:27 PM · Scoring-platform-team (Current), JADE
awight triaged T199750: JADE pages on beta no longer render as Normal priority.
Mon, Jul 16, 9:14 PM · Scoring-platform-team (Current), JADE
awight committed rEJAD60239d90da5a: Rename namespace from Jade to Judgment (authored by awight).
Rename namespace from Jade to Judgment
Mon, Jul 16, 6:59 PM

Fri, Jul 13

awight committed rEJADdbf2ee52931c: Document that judgment.notes supports wikitext. (authored by awight).
Document that judgment.notes supports wikitext.
Fri, Jul 13, 4:06 PM

Thu, Jul 12

awight created T199486: Updates to JADE diagrams.
Thu, Jul 12, 10:36 PM · Documentation, Scoring-platform-team, JADE
awight updated the task description for T196475: Experiment with LIME integration for ORES, providing explanations for its predictions.
Thu, Jul 12, 10:27 PM · Scoring-platform-team (Current), ORES
awight triaged T199485: Document differences between features in Python and API as Low priority.
Thu, Jul 12, 10:23 PM · ORES, Scoring-platform-team
awight created T199485: Document differences between features in Python and API.
Thu, Jul 12, 10:23 PM · ORES, Scoring-platform-team
awight updated the task description for T196547: Extension:JADE scalability concerns due to creating a page per revision.
Thu, Jul 12, 10:10 PM · TechCom-RFC, DBA, Scoring-platform-team (Current), User-Joe, Operations, JADE
awight added a comment to T185116: Write vagrant role for Wikimedia dumps.

I added an XML dump and import clause so we have more content, but we don't have data in every table yet. See the commit message for a list of empty tables. Personally, I'd prefer to merge like this and incrementally improve, since it's usable and adds value as-is...

Thu, Jul 12, 5:31 PM · Patch-For-Review, Dumps-Generation, MediaWiki-Vagrant
Addshore awarded T97012: [Task] Wikibase defaults should be usable out of the box a Like token.
Thu, Jul 12, 3:52 PM · Technical-Debt, Wikidata
awight added a comment to T185116: Write vagrant role for Wikimedia dumps.

@ArielGlenn The patch is ready to submit now, IMO. With the global parsing fix merged and the latest tweak to the vagrant role, it's possible to run a dump.

Thu, Jul 12, 3:31 AM · Patch-For-Review, Dumps-Generation, MediaWiki-Vagrant
awight added a comment to T185116: Write vagrant role for Wikimedia dumps.

Testing more, I found a missing step. I need to run "make" in /vagrant/srv/mwbzutils/xmldumps-backup/mwbzutils

Thu, Jul 12, 1:22 AM · Patch-For-Review, Dumps-Generation, MediaWiki-Vagrant

Wed, Jul 11

awight committed rEPFM24a472d7bbbd: Use editRevId for better edit conflict detection (authored by awight).
Use editRevId for better edit conflict detection
Wed, Jul 11, 11:41 PM
Acamicamacaraca awarded T199355: Investigate srwiki goodfaith model, why is it so bad? a Like token.
Wed, Jul 11, 11:03 PM · Scoring-platform-team
awight added a comment to T199355: Investigate srwiki goodfaith model, why is it so bad?.

One question, if we start training new model, will ORES still be in RC?

Wed, Jul 11, 11:02 PM · Scoring-platform-team
awight added a comment to T197653: Surface JADE validation errors.

Looks like we can override Content::prepareSave and return a Status::newFatal with a more specific error string.

Wed, Jul 11, 10:26 PM · Scoring-platform-team, JADE
awight updated subscribers of T198144: Implement a modeling self-check process.

@notconfusing Great results so far! I've been pretty distant from the investigations into bad models so far, but have a few random thoughts:

  • Reverts are a problematic data set. @Ladsgroup did a k-means cluster analysis and found many distinct clusters, with differing numbers of clusters in each language. This informed our decision to move beyond revert classifiers. We should probably focus on damaging and goodfaith for now. My interpretation is that "reverted" is not actually a proper label, it actually masks several more meaningful and detailed labels.
  • We've noticed that certain labelers have systematic biases, it might be interesting to calculate an average variance for each individual labeler.
  • https://en.wikipedia.org/wiki/Active_learning_(machine_learning)#Query_strategies has alternative methods for identifying problematic observations, FWIW.
  • My naive impulse is to set up a second round of human labeling. Maybe we should even provide a "not sure" choice to get some signal about human certainty levels? I don't know what the industry norms are for that.
Wed, Jul 11, 8:20 PM · Wikilabels, artificial-intelligence, Scoring-platform-team
awight committed rEPFM7c8e64dcc40b: Use editRevId for better edit conflict detection (authored by awight).
Use editRevId for better edit conflict detection
Wed, Jul 11, 7:28 PM
awight created T199355: Investigate srwiki goodfaith model, why is it so bad?.
Wed, Jul 11, 6:18 PM · Scoring-platform-team
awight added a comment to T196547: Extension:JADE scalability concerns due to creating a page per revision.

I think the proposed plan ha deep architecture problems at storage layer, so we should discuss in depth possibilities to be able to move forward- I don't have any problem with the functionality itself- it is the proposed way of implementing it that we should try to agree on. I propose to organize a video meeting to discuss better.

Wed, Jul 11, 4:49 PM · TechCom-RFC, DBA, Scoring-platform-team (Current), User-Joe, Operations, JADE

Thu, Jul 5

awight renamed T58849: Edit conflict detection by timestamp should be deprecated from Edit conflict by epoch seconds has a race condition to Edit conflict detection by timestamp should be deprecated.
Thu, Jul 5, 4:29 PM · User-Daniel, MW-1.28-release-notes, MW-1.28-release (WMF-deploy-2016-06-28_(1.28.0-wmf.8)), MW-1.27-release (WMF-deploy-2015-12-08_(1.27.0-wmf.8)), MW-1.27-release-notes, Epic, Patch-For-Review, MediaWiki-Page-editing
awight added a comment to T58849: Edit conflict detection by timestamp should be deprecated.

Lowered the priority because the epoch seconds check is a fallback to more accurate editRevId, the latest revision ID. The remaining work is to remove the fallback.

Thu, Jul 5, 12:24 PM · User-Daniel, MW-1.28-release-notes, MW-1.28-release (WMF-deploy-2016-06-28_(1.28.0-wmf.8)), MW-1.27-release (WMF-deploy-2015-12-08_(1.27.0-wmf.8)), MW-1.27-release-notes, Epic, Patch-For-Review, MediaWiki-Page-editing
awight renamed T58849: Edit conflict detection by timestamp should be deprecated from Edit conflict detection suffers a race condition to Edit conflict by epoch seconds has a race condition.
Thu, Jul 5, 12:23 PM · User-Daniel, MW-1.28-release-notes, MW-1.28-release (WMF-deploy-2016-06-28_(1.28.0-wmf.8)), MW-1.27-release (WMF-deploy-2015-12-08_(1.27.0-wmf.8)), MW-1.27-release-notes, Epic, Patch-For-Review, MediaWiki-Page-editing

Wed, Jul 4

awight added a comment to T196547: Extension:JADE scalability concerns due to creating a page per revision.

There's a lot to go through in this thread. We won't be doubling the revision table, my current estimate for the upper bound of activity is actually 0.5M additional pages and revisions per year on the largest wikis, and only hundreds or thousands of additional pages on the smaller wikis. If you want to store revisions from this namespace on x1, that sounds like a reasonable precaution to me. Where is this sharding configured? Is it okay that we continue to use wiki pages and revisions or would we have to use a custom table?

Wed, Jul 4, 11:28 AM · TechCom-RFC, DBA, Scoring-platform-team (Current), User-Joe, Operations, JADE
awight added a comment to T196547: Extension:JADE scalability concerns due to creating a page per revision.

@jcrespo I see, well in this case content storage is exactly what we're planning to use. Is there anything special to do in order to set that up? For example, the judgment about https://en.wikipedia.org/?diff=12345678 will be made on the same wiki, in https://en.wikipedia.org/wiki/Judgment:Diff/12345678

Wed, Jul 4, 10:23 AM · TechCom-RFC, DBA, Scoring-platform-team (Current), User-Joe, Operations, JADE
awight added a comment to T196547: Extension:JADE scalability concerns due to creating a page per revision.

@jcrespo Thanks for the reply!

Wed, Jul 4, 9:56 AM · TechCom-RFC, DBA, Scoring-platform-team (Current), User-Joe, Operations, JADE
awight updated the task description for T196547: Extension:JADE scalability concerns due to creating a page per revision.
Wed, Jul 4, 9:10 AM · TechCom-RFC, DBA, Scoring-platform-team (Current), User-Joe, Operations, JADE
awight updated subscribers of T196547: Extension:JADE scalability concerns due to creating a page per revision.

Hi @jcrespo @BBlack, nudging per T183381#4296475 and here, we're hoping to deploy a new extension whose impact is limited to about 0.5M additional pages created per year, on large wikis, assuming the most optimistic, uncontrollable uptake scenario. I'd love to hear DBA and Traffic perspectives on the proposal.

Wed, Jul 4, 9:07 AM · TechCom-RFC, DBA, Scoring-platform-team (Current), User-Joe, Operations, JADE

Tue, Jul 3

awight committed rEJADde38d6aae42e: Rename namespace from Jade to Judgment (authored by awight).
Rename namespace from Jade to Judgment
Tue, Jul 3, 4:35 PM
awight committed rEJAD4f7f38f04b7b: [DNM] Rename namespace from Jade to Judgment (authored by awight).
[DNM] Rename namespace from Jade to Judgment
Tue, Jul 3, 4:32 PM
awight updated subscribers of T196547: Extension:JADE scalability concerns due to creating a page per revision.

CC @Fjalapeno, I'd be interested in your thoughts about the potential for a flood of data here.

Tue, Jul 3, 10:23 AM · TechCom-RFC, DBA, Scoring-platform-team (Current), User-Joe, Operations, JADE
awight updated subscribers of T183381: Deploy JADE extension to production.
Tue, Jul 3, 10:17 AM · Goal, Patch-For-Review, Services (watching), Operations, TechCom, Scoring-platform-team (Current), JADE
awight updated the task description for T183381: Deploy JADE extension to production.
Tue, Jul 3, 10:16 AM · Goal, Patch-For-Review, Services (watching), Operations, TechCom, Scoring-platform-team (Current), JADE
awight updated the task description for T198691: Handle Jade edit conflicts.
Tue, Jul 3, 10:02 AM · Scoring-platform-team, JADE
awight triaged T198691: Handle Jade edit conflicts as Low priority.
Tue, Jul 3, 9:57 AM · Scoring-platform-team, JADE
awight created T198691: Handle Jade edit conflicts.
Tue, Jul 3, 9:57 AM · Scoring-platform-team, JADE
awight committed rEJAD1ebd7beb2466: Accept liberal cases; cleanup (authored by awight).
Accept liberal cases; cleanup
Tue, Jul 3, 9:45 AM
awight added a comment to T58849: Edit conflict detection by timestamp should be deprecated.

Now I'm thinking that we shouldn't make the editRevId parameter mandatory, and can point to the other ApiEditPage params being optional as precedent. The default behavior of guessing editRevid = page.latest is sane and is usually correct as well, so requiring clients to track page.latest before making an edit adds complexity with no gain.

Tue, Jul 3, 9:26 AM · User-Daniel, MW-1.28-release-notes, MW-1.28-release (WMF-deploy-2016-06-28_(1.28.0-wmf.8)), MW-1.27-release (WMF-deploy-2015-12-08_(1.27.0-wmf.8)), MW-1.27-release-notes, Epic, Patch-For-Review, MediaWiki-Page-editing
awight updated the task description for T198207: Write JADE internal APIs to simplify integrations.
Tue, Jul 3, 8:47 AM · Patch-For-Review, Scoring-platform-team (Current), JADE
awight added a comment to T198347: Re-activate staging access for Adam.

@awight yes please, also a new fundraising ssh key :)

Tue, Jul 3, 7:54 AM · Fundraising-Backlog, fundraising-tech-ops

Mon, Jul 2

awight moved T198207: Write JADE internal APIs to simplify integrations from Active to Review on the Scoring-platform-team (Current) board.
Mon, Jul 2, 10:14 PM · Patch-For-Review, Scoring-platform-team (Current), JADE
awight committed rEJADc82371466991: Improve test coverage (authored by awight).
Improve test coverage
Mon, Jul 2, 10:03 PM
awight committed rEJAD83123e147c99: Implement getjudgments (authored by awight).
Implement getjudgments
Mon, Jul 2, 10:03 PM
awight committed rEJAD36bd53344ff5: Simplify test with global user (authored by awight).
Simplify test with global user
Mon, Jul 2, 10:03 PM
awight committed rEJAD87ac3b4b7f45: Translatable entity type (authored by awight).
Translatable entity type
Mon, Jul 2, 10:03 PM
awight committed rEJAD7223ca3f7235: Improve test coverage (authored by awight).
Improve test coverage
Mon, Jul 2, 9:58 PM
awight committed rEJADe3b8f5b4692f: Implement getjudgments (authored by awight).
Implement getjudgments
Mon, Jul 2, 9:12 PM
awight committed rEJAD36bb0861cde2: Simplify test with global user (authored by awight).
Simplify test with global user
Mon, Jul 2, 9:11 PM
awight committed rEJAD44156d7eb6b3: Translatable entity type (authored by awight).
Translatable entity type
Mon, Jul 2, 9:11 PM
awight committed rEJAD3f6464cd8ef2: JADE API to store judgments (authored by awight).
JADE API to store judgments
Mon, Jul 2, 4:02 PM
awight committed rEJAD8c7ddfb728a4: [WIP] Translatable entity type (authored by awight).
[WIP] Translatable entity type
Mon, Jul 2, 4:02 PM
awight committed rEJADeab0a5f458dc: JADE API to store judgments (authored by awight).
JADE API to store judgments
Mon, Jul 2, 3:57 PM
awight committed rEJAD00c64e01246c: [WIP] Translatable entity type (authored by awight).
[WIP] Translatable entity type
Mon, Jul 2, 3:25 PM
awight committed rEJAD9a9913e6c619: [WIP] Translatable entity type (authored by awight).
[WIP] Translatable entity type
Mon, Jul 2, 1:31 PM
awight committed rEJADf71b5f5f9b2e: JADE API to store judgments (authored by awight).
JADE API to store judgments
Mon, Jul 2, 1:31 PM
awight committed rEJADbabf29067624: JADE API to store judgments (authored by awight).
JADE API to store judgments
Mon, Jul 2, 1:17 PM
awight added a comment to T58849: Edit conflict detection by timestamp should be deprecated.

It doesn't look like we ever solved the race condition for ApiEditPage, which doesn't use editRevId. I'd like to require this param everywhere, it's quite risky to edit a page without knowing what revision we're basing changes on.

Mon, Jul 2, 1:12 PM · User-Daniel, MW-1.28-release-notes, MW-1.28-release (WMF-deploy-2016-06-28_(1.28.0-wmf.8)), MW-1.27-release (WMF-deploy-2015-12-08_(1.27.0-wmf.8)), MW-1.27-release-notes, Epic, Patch-For-Review, MediaWiki-Page-editing
awight triaged T198603: How should calling functions check permissions when using PageUpdater? as Low priority.
Mon, Jul 2, 9:58 AM · MediaWiki-General-or-Unknown
awight created T198603: How should calling functions check permissions when using PageUpdater?.
Mon, Jul 2, 9:58 AM · MediaWiki-General-or-Unknown
awight committed rEJAD61a8b2f6dd7c: Drop entity from the schema (authored by awight).
Drop entity from the schema
Mon, Jul 2, 9:18 AM
awight committed rEJADa539ededb25c: [WIP] Translatable entity type (authored by awight).
[WIP] Translatable entity type
Mon, Jul 2, 9:18 AM
awight committed rEJAD9f96b9a19408: [WIP] JADE API to store judgments (authored by awight).
[WIP] JADE API to store judgments
Mon, Jul 2, 9:18 AM
awight committed rEJAD845ca951ae27: [WIP] JADE API to store judgments (authored by awight).
[WIP] JADE API to store judgments
Mon, Jul 2, 9:07 AM
awight committed rEJADf4a5681dc95b: [WIP] Translatable entity type (authored by awight).
[WIP] Translatable entity type
Mon, Jul 2, 9:07 AM
awight committed rEJADa7163489eb96: Fix schema: syntax of boolean data (authored by awight).
Fix schema: syntax of boolean data
Mon, Jul 2, 9:07 AM
awight committed rEJAD50758c679f44: Drop entity from the schema (authored by awight).
Drop entity from the schema
Mon, Jul 2, 9:07 AM

Sat, Jun 30

awight committed rEJADd3e33b78a046: [WIP] JADE API to store judgments (authored by awight).
[WIP] JADE API to store judgments
Sat, Jun 30, 9:46 PM
awight created T198542: Integrate JADE with ORES extension.
Sat, Jun 30, 8:53 PM · Design, MediaWiki-extensions-ORES, JADE, Scoring-platform-team, Global-Collaboration
awight committed rEJAD08c8f7d90a14: JADE API to store judgments (authored by awight).
JADE API to store judgments
Sat, Jun 30, 12:38 PM
awight moved T179301: Document JADE judgment structure from Review to Pending deployment on the Scoring-platform-team (Current) board.
Sat, Jun 30, 10:29 AM · MW-1.32-release-notes (WMF-deploy-2018-07-17 (1.32.0-wmf.13)), Patch-For-Review, Scoring-platform-team (Current), Easy, Documentation
awight moved T198302: Copy Wiki Labels translations over to Extension:JADE from Review to Done on the Scoring-platform-team (Current) board.
Sat, Jun 30, 10:29 AM · MW-1.32-release-notes (WMF-deploy-2018-07-10 (1.32.0-wmf.12)), Scoring-platform-team (Current), Patch-For-Review, JADE, I18n

Thu, Jun 28

awight committed rEJADe999f3a62ce8: [WIP] API to add judgments given flat parameters (authored by awight).
[WIP] API to add judgments given flat parameters
Thu, Jun 28, 10:29 PM
awight committed rEJAD0d376d04426a: [WIP] API to add judgments given flat parameters (authored by awight).
[WIP] API to add judgments given flat parameters
Thu, Jun 28, 10:25 PM
awight committed rEJAD8a465901f0b0: Lint (authored by awight).
Lint
Thu, Jun 28, 10:16 PM
awight committed rEJAD83c16e8e58ce: [WIP] API to add judgments given flat parameters (authored by awight).
[WIP] API to add judgments given flat parameters
Thu, Jun 28, 10:05 PM
awight committed rEJAD2ee077ca17f3: Drop entity from the schema (authored by awight).
Drop entity from the schema
Thu, Jun 28, 10:00 PM
awight committed rEJAD7833ce11f11c: [WIP] API to add judgments given flat parameters (authored by awight).
[WIP] API to add judgments given flat parameters
Thu, Jun 28, 10:00 PM
awight committed rEJADb96d8ac4d050: Fix schema gap: when data must be boolean (authored by awight).
Fix schema gap: when data must be boolean
Thu, Jun 28, 10:00 PM
awight committed rEJADec542d39976a: Fix schema gap: when data must be boolean (authored by awight).
Fix schema gap: when data must be boolean
Thu, Jun 28, 9:37 PM
awight committed rEJAD5d21952c064d: [WIP] API to add judgments given flat parameters (authored by awight).
[WIP] API to add judgments given flat parameters
Thu, Jun 28, 9:37 PM
awight committed rEJADbec6734a5221: [WIP] API to add judgments given flat parameters (authored by awight).
[WIP] API to add judgments given flat parameters
Thu, Jun 28, 4:32 PM
awight committed rEJAD6e4bf7c840ae: Drop entity from the schema (authored by awight).
Drop entity from the schema
Thu, Jun 28, 4:32 PM
awight committed rEJAD6cd5a21ddd80: [WIP] API to add judgments given flat parameters (authored by awight).
[WIP] API to add judgments given flat parameters
Thu, Jun 28, 4:28 PM
awight committed rEJAD96c9a5a36d7c: Drop entity from the schema. (authored by awight).
Drop entity from the schema.
Thu, Jun 28, 4:28 PM
awight claimed T198207: Write JADE internal APIs to simplify integrations.
Thu, Jun 28, 4:23 PM · Patch-For-Review, Scoring-platform-team (Current), JADE
awight added a comment to T198347: Re-activate staging access for Adam.

Should I post my yubikey serial again? I won't actually have access to it until July 12th, fwiw.

Thu, Jun 28, 11:12 AM · Fundraising-Backlog, fundraising-tech-ops
awight created T198380: Show Wikidata itemquality model (and other missing models) in the ORES support matrix tool report.
Thu, Jun 28, 9:25 AM · ORES, Scoring-platform-team

Wed, Jun 27

awight moved T198302: Copy Wiki Labels translations over to Extension:JADE from Active to Review on the Scoring-platform-team (Current) board.
Wed, Jun 27, 11:51 AM · MW-1.32-release-notes (WMF-deploy-2018-07-10 (1.32.0-wmf.12)), Scoring-platform-team (Current), Patch-For-Review, JADE, I18n
awight edited projects for T198302: Copy Wiki Labels translations over to Extension:JADE, added: Scoring-platform-team (Current); removed Scoring-platform-team.
Wed, Jun 27, 11:50 AM · MW-1.32-release-notes (WMF-deploy-2018-07-10 (1.32.0-wmf.12)), Scoring-platform-team (Current), Patch-For-Review, JADE, I18n
awight committed rEJAD4f2de5660050: Add labels from the current UI concept. (authored by awight).
Add labels from the current UI concept.
Wed, Jun 27, 11:47 AM
awight created T198302: Copy Wiki Labels translations over to Extension:JADE.
Wed, Jun 27, 10:34 AM · MW-1.32-release-notes (WMF-deploy-2018-07-10 (1.32.0-wmf.12)), Scoring-platform-team (Current), Patch-For-Review, JADE, I18n
awight added a comment to T197098: Use JADE as a repository for ORES counterexamples.

It looks like clients can't communicate any type of "PATROLLED" message, indicating that a change has been reviewed and is good?

Wed, Jun 27, 8:44 AM · JADE, Scoring-platform-team, Huggle

Tue, Jun 26

awight committed rEJADc43088d36ca2: Fix tests; schema prevents extra top-level properties (authored by awight).
Fix tests; schema prevents extra top-level properties
Tue, Jun 26, 8:27 PM