We'd like to spend a few days to explore how the impact of a tool could be measured.
Planned outcome:
- A list of defined metrics
- Summary of available data sources and gaps to define tool impact metrics
- Visualization to display raw data
We'd like to spend a few days to explore how the impact of a tool could be measured.
Planned outcome:
@bd808 wrote on the project Slack channel:
I'm a lurker in that I won't be around during experiment week to help, but I had an idea about an impact metric to offer: on-wiki edits made via OAuth grants which can be connected back to specific tools. Each OAuth grant has a callback URL that could be used to infer the "owning" tool. Each edit made under OAuth authentication also carries a "change tag" of OAuth CID: NNNN indicating which OAuth grant was used. See https://www.mediawiki.org/wiki/Manual:Tags for more about change tags.
part of making this usable would probably be working to expose the "safe" to be public parts of the OAuth grants tables in the Wiki Replicas. https://phabricator.wikimedia.org/T247800
That second link is not public − it requires authentication, and if I am logged in with a google account it tells me I do not have access to view it.