| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | None | T235888 Define evaluation plan for GLOW project | |||
| Resolved | Iflorez | T233806 Prepare a preliminary metric plan for GLOW | |||
| Resolved | None | T234560 identify a reliable user field for use with the revision, page...maybe also the actor table |
Event Timeline
Here's what we've decided on and discussed so far:
Editors
number of ditors
number of editors that are resource recipients
active editors
new editors
new editor retention
Output: Articles
article count
quality article count
quality article count by resource recipients
new articles
edits to existing articles
new articles: by date/exp/survival
Readers
pageviews (including access_method, country, referer_class)
Content Quality
number of editors/article
revert rate
pageviews
incoming links
outgoing links
page_len raw
page_len relative score
Gaps/Topics
articles output (%) from topic lists
Based on the data gathered in ticket T233804, I recommend using the following metrics:
a) For periodic checkpoints - Survey each GLOW project/wiki-host (eg. Project Tiger Punjabi, Project Tiger Hindi, Project Saraswati Bahasa, etc..) along the 25 metrics outlined as of 9/25/19 in the draft evaluation framework. Use these measures to compare activity across the sites and inform potential coordinating/organizing/administrative realignment for low performing wikis and/or to inform proceeding launch processes in the next projects. Status metrics for each GLOW project/wiki-host:
Editors
number of editors number of editors that are resource recipients active editors new editors new editor retention
Output: Articles
article count quality article count quality article count by resource recipients new articles edits to existing articles new articles: by date/exp/survival
Readers
pageviews (including access_method, country, referer_class)
Content Quality
number of editors/article revert rate pageviews incoming links outgoing links page_len raw page_len relative score
Gaps/Topics
articles output (%) from topic lists
b) For the end of period analysis and evaluation - Survey each GLOW wiki host along 6 metrics:
monthly active editors [at x months] monthly editors (all edits, all registrations) [at x months] size: number of content pages [at x months] interlanguage links and interwiki page links (proxy for time on site?) [at x months] readership from search engine referrals unique devices accessing the site
And track the following context metrics:
Internet usage across the country Mobile-cellular subscriptions (saturation)