Page MenuHomePhabricator
Create Task
Maniphest T297511

Instrumentation of UI and logging of events for analysis
Closed, ResolvedPublic
Actions

Description

In order to understand which of Wikifunction's User Experiences work how well, we need to instrument the UI and log the events. We need to work together with the Metrics Platform team on choosing the right things to measure and to make the results visible.

Details

Related Changes in Gerrit:
SubjectRepoBranchLines +/-
Add instrument to log uses of function evaluator componentmediawiki/extensions/WikiLambdamaster+14 -1
Vue: Instrument main app load timemediawiki/extensions/WikiLambdamaster+84 -4
Customize query in gerrit

Related Objects
Search...

StatusSubtypeAssignedTask
 ResolvedPRODUCTION ERRORJdforrester-WMFT344206 Special:MathStatus exception error on Wikifunctions
 ResolvedJdforrester-WMFT342865 Post-creation work for wikifunctionswiki
 ResolvedBTullisT289316 Prepare and check storage layer for Wikifunctions.org (new public content wiki)
 ResolvedJdforrester-WMFT275945 Create Wikifunctions.org
 ResolvedDVrandecicT289321 Pre-launch performance review of Wikifunctions
 ResolvedcmassaroT313226 Get all SRE-type things ready for launching Wikifunctions
 ResolvedClement_GoubertT313227 Get new edge & internal HTTPS certificates expanded to add wikifunctions.org and *.wikifunctions.org
 ResolvedJdforrester-WMFT307723 Ensure the runbooks for function-* services are good enough
 ResolvedcmassaroT297314 New Service Request: function-orchestrator and function-evaluator (for Wikifunctions launch)
 ResolvedoriT295698 Create helm charts for Wikifunctions services
 ResolvedsbassettT289322 Pre-launch security review of Wikifunctions
 ResolvedakosiarisT340041 Setup kubernetes namespaces for wikifunctions
 ResolvedJdforrester-WMFT340141 Add a variant of WikiLambda's ReloadBuiltinData maintenance script that will insert new pre-defined ZObjects from function-schemata
 ResolvedRequest• CCoxwell-WMFT339936 Please add Abstract Wiki team members to `deployment` prod SRE group
 ResolvedRequestgenghT340614 Requesting access to deployment for gengh
 ResolvedRequestArnoldokothT340890 Requesting access to deployment for cec
 ResolvedcmassaroT326785 Kubernetes Wikifunctions security and control measures
 ResolvedQuiddityT337866 Prepare Main Page content for Wikifunctions ahead of launch
 ResolvedJdforrester-WMFT327459 Set up an interwiki prefix to Wikifunctions
 ResolvedJdforrester-WMFT291594 Have discussion tools enabled on Wikifunctions on launch by default
 ResolvedJdforrester-WMFT291595 Determine initial launch configuration for Wikifunctions
 ResolvedJdforrester-WMFT340775 Launch-blocking bugs
 ResolvedBUG REPORTgenghT337457 DefaultView page-wide: When validateZObject returns false, the UI doesn't reflect the error state
 ResolvedBUG REPORTgenghT340627 Display cancel dialog (after edits) on browser interactions
 ResolvedgenghT336877 Provide a "Cancel" control in edit mode for ZObjects
 ResolvedBUG REPORTJdforrester-WMFT340732 User functionmaintainer and functioneer cannot edit a non-attached implementation
 ResolvedBUG REPORTJdforrester-WMFT340748 User should not be able to create or edit Programming Language objects
 ResolvedBUG REPORTDVrandecicT338020 router.js state module: Fix Special:EvaluateFunctionCall navigation
 ResolvedBUG REPORTcmassaroT338315 Calling a Function Returns Undefined with Degenerate Implementation
 ResolvedBUG REPORTJdforrester-WMFT340022 Persistent no js warning after load
 ResolvedBUG REPORTAAlhazwani-WMFT337987 Make various fixes for RTL support in WikiLambda UX
 DuplicateBUG REPORTNoneT337989 Function view: Content isn't flipped and so displays in the wrong order on dir=rtl context
 ResolvedBUG REPORTJdforrester-WMFT342212 Adapt wikilambda-zobject-title better for RTL user interface
 ResolvedBUG REPORTDVrandecicT337070 When adding a tester, literal arguments can not be immediately added
 ResolvedgenghT336562 DefaultView page-wide behavior: Make sure that all used and referred Zids and keys are fetched
 ResolvedBUG REPORTcmassaroT336719 Cannot call "is BCE" (function which takes a type that references itself)
 ResolvedBUG REPORTgenghT336984 Raw key ids are shown instead of labels in argument references
 ResolvedgenghT287514 Handle old (non-current) ZObject pages, or at least warn the user that they're looking at the current version despite their request
 ResolvedJdforrester-WMFT299176 Phase Theta – Root task
 ResolvedJdforrester-WMFT314485 We are ready for the last three phases, especially the next, ι (Iota)
 Resolved• CCoxwell-WMFT290522 Object model: Add short description to Z2/Persistent Objects, Z2K5
 Resolved• CCoxwell-WMFT335360 Provide short description (Z2K5) view/editing in function views, not just default views
 ResolvedAAlhazwani-WMFT303229 Create a design for having short descriptions on function pages
 ResolvedLadsgroupT341102 addWiki.php fails with CannotReplaceActiveServiceException
 ResolvedJdforrester-WMFT338164 Restrict Type creation to functionmaintainers
 ResolvedJdforrester-WMFT323399 Add Wikifunctions as a sibling project to the Portals once it launches
 ResolvedcmassaroT342820 Migrate wikifunctions.org from locked-down to limited mode, letting users edit wikitext pages and some
 ResolvedJdforrester-WMFT268678 Make Wikifunctions a true multi-lingual wiki, exposing content in each language to readers and search engines with parity
 ResolvedDVrandecicT338190 Performance review of Wikifunctions multingual setup and caching
 ResolvedgenghT341500 Implement UX to select natural language one reads and edits Wikifunctions
 ResolvedBUG REPORTJdforrester-WMFT342891 Under `view/lang/zid` routes, Edit pages are rendered with "viewmode=true" even if `?action=edit` is present
 ResolvedDMartin-WMFT297511 Instrumentation of UI and logging of events for analysis
 ResolvedDMartin-WMFT303351 Decide what things we want to measure (and why) about the UI
 ResolvedDMartin-WMFT338005 WikiLambda: configure event logging infrastructure
 ResolvedDMartin-WMFT336722 WikiLambda: Define Metrics Platform stream(s) for initial event logging
 ResolvedDMartin-WMFT340160 WikiLambda: Track function-creation attempts
 ResolvedDMartin-WMFT340779 WikiLambda: Track (already existing) function-editing attempts
ResolvedDMartin-WMFT340783 WikiLambda: Track test-creation attempts
 ResolvedDMartin-WMFT340784 WikiLambda: Track implementation-creation attempts
 ResolvedDMartin-WMFT340786 WikiLambda: Track function-evaluation requests
 ResolvedQuiddityT271271 Ensure essential pages will be available on Wikifunctions
 ResolvedQuiddityT300515 Docs: create "Extension:WikiLambda/Evaluate function call" help page
 ResolvedQuiddityT300517 Docs: create "Extension:WikiLambda/Creating ZObjects" help page
 ResolvedDVrandecicT300519 Docs: create "Extension:WikiLambda/Objects by type" help page
 ResolvedDVrandecicT300516 Docs: create "Extension:WikiLambda/Duplicate Object labels" help page
 ResolvedQuiddityT309199 Documentation: create wiki page about function review process and update link to it in FunctionViewerDetails.vue

Event Timeline

DVrandecic created this task.Dec 10 2021, 5:50 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptDec 10 2021, 5:50 PM
Jdforrester-WMF mentioned this in T299176: Phase Theta – Root task.Mar 8 2022, 10:34 PM
Jdforrester-WMF added a parent task: T303344: Function orchestration and evaluation is undertaken with regard to careful monitoring and control on various measures.Mar 8 2022, 11:13 PM
Jdforrester-WMF added a parent task: T314485: We are ready for the last three phases, especially the next, ι (Iota).Aug 3 2022, 1:47 PM
Jdforrester-WMF moved this task from Incoming to Ready: G8. Ready for Iota on the Abstract Wikipedia team (Phase θ – Throttling) board.
Jdforrester-WMF removed a parent task: T303344: Function orchestration and evaluation is undertaken with regard to careful monitoring and control on various measures.Nov 28 2022, 7:30 PM
gerritbot added a comment.Dec 7 2022, 9:18 PM

Change 861462 had a related patch set uploaded (by Jforrester; author: Jforrester):

[mediawiki/extensions/WikiLambda@master] Vue: Instrument main app load time

https://gerrit.wikimedia.org/r/861462

gerritbot added a project: Patch-For-Review.Dec 7 2022, 9:18 PM
gerritbot added a comment.Jan 5 2023, 11:02 PM

Change 861462 merged by jenkins-bot:

[mediawiki/extensions/WikiLambda@master] Vue: Instrument main app load time

https://gerrit.wikimedia.org/r/861462

Maintenance_bot removed a project: Patch-For-Review.Jan 5 2023, 11:30 PM
ReleaseTaggerBot added a project: MW-1.40-notes (1.40.0-wmf.18; 2023-01-09).Jan 6 2023, 12:01 AM
Jdforrester-WMF subscribed.Jan 6 2023, 4:53 PM

OK, as of now we're tracking an initial app load time metric, but nothing else. Further work is blocked on the product decision of what we want to measure about user behaviour.

Jdforrester-WMF added a subtask: T336722: WikiLambda: Define Metrics Platform stream(s) for initial event logging.May 30 2023, 10:09 PM
DMartin-WMF added a subtask: T338005: WikiLambda: configure event logging infrastructure.Jun 2 2023, 2:35 AM
DMartin-WMF removed a subtask: T336722: WikiLambda: Define Metrics Platform stream(s) for initial event logging.
Jdforrester-WMF moved this task from Phase θ – Throttling to Phase λ – Launch on the Abstract Wikipedia team board.Jun 16 2023, 8:51 AM
Jdforrester-WMF edited projects, added Abstract Wikipedia team (Phase λ – Launch); removed Abstract Wikipedia team (Phase θ – Throttling).
Jdforrester-WMF moved this task from Incoming to Engineering tasks on the Abstract Wikipedia team (Phase λ – Launch) board.Jun 16 2023, 8:53 AM
DMartin-WMF added a subtask: T340160: WikiLambda: Track function-creation attempts.Jun 22 2023, 8:01 PM
DMartin-WMF added a subtask: T340779: WikiLambda: Track (already existing) function-editing attempts .Jun 29 2023, 6:39 PM
DMartin-WMF added a subtask: T340783: WikiLambda: Track test-creation attempts.
DMartin-WMF added a subtask: T340784: WikiLambda: Track implementation-creation attempts.Jun 29 2023, 6:47 PM
DMartin-WMF added a subtask: T340786: WikiLambda: Track function-evaluation requests.Jun 29 2023, 7:12 PM
gerritbot added a comment.Jul 6 2023, 11:23 PM

Change 936099 had a related patch set uploaded (by David Martin; author: David Martin):

[mediawiki/extensions/WikiLambda@master] Add instrument to log uses of function evaluator component

https://gerrit.wikimedia.org/r/936099

gerritbot added a project: Patch-For-Review.Jul 6 2023, 11:23 PM
gerritbot added a comment.Jul 11 2023, 4:17 AM

Change 936099 abandoned by David Martin:

[mediawiki/extensions/WikiLambda@master] Add instrument to log uses of function evaluator component

Reason:

Superseded by patch 936766

https://gerrit.wikimedia.org/r/936099

Maintenance_bot removed a project: Patch-For-Review.Jul 11 2023, 4:29 AM
DMartin-WMF claimed this task.Jul 17 2023, 8:52 PM
Jdforrester-WMF changed the task status from Open to In Progress.Jul 17 2023, 9:39 PM
Jdforrester-WMF moved this task from Engineering tasks to In progress on the Abstract Wikipedia team (Phase λ – Launch) board.
DVrandecic closed subtask T340784: WikiLambda: Track implementation-creation attempts as Resolved.Jul 19 2023, 3:58 AM
DVrandecic closed subtask T340786: WikiLambda: Track function-evaluation requests as Resolved.
DVrandecic closed subtask T340779: WikiLambda: Track (already existing) function-editing attempts as Resolved.
DVrandecic closed subtask T340783: WikiLambda: Track test-creation attempts as Resolved.Jul 19 2023, 4:03 AM
Jdforrester-WMF closed subtask T303351: Decide what things we want to measure (and why) about the UI as Resolved.Jul 19 2023, 2:46 PM
Jdforrester-WMF moved this task from In progress to QA needed on the Abstract Wikipedia team (Phase λ – Launch) board.Jul 24 2023, 8:47 PM
DVrandecic closed subtask T340160: WikiLambda: Track function-creation attempts as Resolved.Jul 25 2023, 1:56 AM
DVrandecic moved this task from QA needed to Immediately after launch on the Abstract Wikipedia team (Phase λ – Launch) board.Jul 25 2023, 3:15 AM
Jdforrester-WMF moved this task from Phase λ – Launch to In Progress on the Abstract Wikipedia team board.Jul 27 2023, 4:39 PM
Jdforrester-WMF edited projects, added Abstract Wikipedia team; removed Abstract Wikipedia team (Phase λ – Launch).
Jdforrester-WMF added a parent task: T342820: Migrate wikifunctions.org from locked-down to limited mode, letting users edit wikitext pages and some.Jul 27 2023, 4:41 PM
DMartin-WMF closed this task as Resolved.Jul 27 2023, 9:02 PM
DMartin-WMF closed subtask T338005: WikiLambda: configure event logging infrastructure as Resolved.
Jdforrester-WMF moved this task from In Progress to Verify in production on the Abstract Wikipedia team board.Jul 27 2023, 9:05 PM
MNeisler mentioned this in T358873: QA Wikilambda instrumentation port to new core interactions metrics platform version.Apr 30 2024, 7:37 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits