Page MenuHomePhabricator

Design exploration: Allow organizers to track contributions in the scope of an activity on the wikis
Closed, ResolvedPublic

Authored By
ifried
Sep 25 2024, 7:08 PM
Referenced Files
F57687718: image.png
Nov 7 2024, 4:07 PM
F57687714: image.png
Nov 7 2024, 4:07 PM
F57687687: image.png
Nov 7 2024, 4:07 PM
F57687685: image.png
Nov 7 2024, 4:07 PM
F57687682: image.png
Nov 7 2024, 4:07 PM
F57687680: image.png
Nov 7 2024, 4:07 PM
F57687678: image.png
Nov 7 2024, 4:07 PM

Description

User problem:

Organizers do not have a way of easily tracking contributions and then reporting on impact of their organized activity on the wikis. This means that it is harder to share the successes and challenges and learnings of their organized activities, and it is harder to motivate people to join their activities due to unclear understanding of the impact.

Background:

One of the most important tasks related to organizing events on the wikis is tracking and reporting on impact. For events that focus on contributions, this means tracking contribution data, such as: the number of articles created, the number of articles edited, the total number of edits, the number of photos uploaded, etc.

Contribution data is important to many people. It is important to the event organizers and event stakeholders (such as grant officers, partner institutions, host venues), since it gives them an understanding of the impact of their events, their successes, and their gaps/challenges to address in the future. For the prospective participants, they can see impact reporting of past events, which can help motivate them to join future events. For event participants, it can help them feel like their work and time was valued, since they understand the impact of their individual contributions and the impact of the event overall.

However, there is no easy way to track contributions that are in the scope of an activity on the wikis. There are many external tools to track contributions, and different wikis & campaigns use different tools. However, many of these solutions pose challenges, including: they are off the wikis, they do not work well for tracking the contributions of experienced editors, and/or they can be hard to use.

This has made us wonder: Is there a simple, first stab that we can take at tracking contributions in organized activities? This first stab would focus on making it easy for organizers to know which contributions are within the scope of an organized activity.

How we would like to improve the situation:
  • We would like to develop simple, light-weight methods for indicating which contributions are in the scope of an organized activity, which could be done in the following ways:
    • Perhaps organizers can create a worklist and assign articles or have articles claimed by participants
    • Perhaps participants can specify if a contribution is under an organized activity when publishing an edit
  • This could be complemented by ways to surface to contributors, and especially moderators, that a certain contribution is from an organized activity, such as:
    • Tagging edits in RecentChanges, watchlist, contribution history as being a part of an organized activity (we will know the activity name, date, and other details if it is through event registration)
Some things to consider:
  • We have some other teams that are thinking about how organizers can create and manage basic worklists (cc @PWaigi-WMF & LPL team). We would not want to duplicate efforts. What is reusable from their current and potential future work?
  • Perhaps it is easiest to start with a way to modify the editing experience to mark an edit as within scope of a campaign/organized activity, but we would need to talk to the Editing team about this.
  • Tracking contributions is a part of the storytelling organizers do to communicate the impact of their aan inctivities. How can we provide an experience that tells a story? That can inspire or motivate contributors? That can help us more easily surface gaps and challenges to address?

Post-MVP questions:

  • What if a contributor is not registered for an activity via Event Registration (since it isn't really an activity that would use Event Registration), such as the 'Add a fact' experiment? However, there may still be interest in tracking their contributions (for example, Add a fact is using the hashtag tool for tracking). Is there a way they could use this new experience instead, and it could be marked as 'Other'? for collaborative activity? Would this be too messy and unreliable, data-wise? Would this be something that would be worth it for us to consider including?

Event Timeline

ifried updated the task description. (Show Details)
ifried added a subscriber: PWaigi-WMF.

Hello, @Sadads & @Udehb-WMF. I have created a basic draft ticket for a project idea we may pursue later in the year. I am not sure if we will work on it yet or not, but the first step is to do some design explorations. Adding you to this ticket see what comes up for you and what ideas you have. Thanks!

ifried updated the task description. (Show Details)
ifried updated the task description. (Show Details)

Something to consider is that the two most popular, non-dashboard based tools for tracking have different forms of submission:

Similarly, Wikimedia Brazil has developed a tool that does something like Fountain, but semi-automatically guesses which arrticles are in scope: https://iw.toolforge.org/wikiscore

However, the first two tools often leave organizers very disatisfied.

@Sadads:

Thank you! Two follow-up questions:

  • Hashtag tool: What does a user do if they forget to add a hashtag in the edit summary? Is there a way to go back and add it later?
  • Question about both Hashtag & Fountain: What are the main reasons that the first two tools leave organizers unsatisfied? Curious to learn more!

@ifried The only strategy for going back and tagging edits that didn't get a hashtag the first time, is to make another edit so that minimally

So for hashtags, the main point of dissatisfaction is around the "what if I forgot" stage of the edit (there is no easy way to go back and add something), and then the second part of the dissatisfaction is the unreliability of the tool (it occasionally gets slow or breaks down in a way that is hard for organizers to understand for example).and it's huge distance from the on-wiki monitoring environment (i.e. no links in the edit summaries).

As for fountain: the main challenges are related to the complexity of creating, maintain, and helping participants remember to track -- I think communities mostly use it because its convenient, available, and is one of the few tools that allows for you to do a point system -- so much so that Wiki Loves Folklore created a conceptual fork of Fountain: https://tools.wikilovesfolklore.org/ . I think the WMBrazil contest tool could mostly replace Fountain in terms of user needs, and is a bit more consistent with global needs than CampWiz.

Design explorations

1. Organizers can create worklists, and define goals for specific articles

image.png (1×2 px, 205 KB)
image.png (1×2 px, 217 KB)
image.png (1×2 px, 234 KB)

If organizers don't create worklists in advance, once the event begins we can suggest articles to add to the worklist based on the editing activity of the participants

image.png (1×2 px, 170 KB)
image.png (1×2 px, 186 KB)

2. Organizers can see activity/progress against the worklist, so they can understand the impact/success of the event

image.png (1×2 px, 206 KB)

Open question: what if there are edits that should be included in the scope of the event but for whatever reason were not tagged? Can we allow organizers to retroactively tag/connect edits to the event?

image.png (1×2 px, 191 KB)

Open questions & ideas for further exploration:

  • Allow participants to claim certain articles and/or goals within those articles
  • Allow organizers to assign certain articles and/or goals within those articles to specific participants
  • Allow organizers to reuse worklists from past events
  • Should the tracking/analytics experience be different from the worklist creation experience? Is it okay for all of this to happen in one place?
  • How much should we encourage organizers to create a worklist? Should it be required? It seems like having a worklist with clearly defined goals would increase the impact of any event.

I'm closing this task because the design exploration work in the scope of this ticket is complete and because the open questions/ideas documented have been added to the main epic ticket (T373232).