@NForrester thanks for submitting this request. I acknowledge that we're reviewing it.

If we prioritize this work, we will need to dedicate engineering and some research scientist resources to make this possible. We will also need to maintain the data. For that, we need to better understand a few things:

• Will the availability of this data support you or others with FY24 annual plan work? If yes, can you point to specific hypotheses or components of the AP that this will support?
• What decisions have been made based on the ad-hoc data you have received in the past? What has been the impact of this data? It would be great if you can point to (private or public) reports where the data has been used in for decision making for us to be able to assess the impact of it.
• Any other pointers that you think it can be helpful for us to consider?

Hello Leila, I will respond to the questions in turn, with them copied in.

Will the availability of this data support you or others with FY24 annual plan work? If yes, can you point to specific hypotheses or components of the AP that this will support?

Yes, this data will support our team with FY24 annual plan work. Specifically, it will support the goal Safety and Inclusion, subsection Disinformation:

“In 2023−2024, we will collaborate across the Foundation and work with communities across the world to address the threat to the mission, content, and people caused by disinformation in a number of ways:
Strengthen investigations to identify disinformation on-wiki in collaboration with volunteer functionaries and support from research and partnerships.

Support and strengthen sharing of information, tactics, and resources among functionaries and other key self-governance stakeholders and affiliates working to counter disinformation in their communities.”

What decisions have been made based on the ad-hoc data you have received in the past? What has been the impact of this data? It would be great if you can point to (private or public) reports where the data has been used in for decision making for us to be able to assess the impact of it.

Risk Observatory data provided to the team in the past has included data about reversion times, which were used as part of a deep-dive research into disinformation on Russian Wikipedia (sent to you privately).
Recommendations emerging from that research greatly impacted the setup of the Trust & Safety Disinformation team’s workflows in FY22/23. They included expanding the disinformation response playbook to include processes for dealing with high-risk disinformation events outside of election periods (which was highly impactful given the Russian invasion of Ukraine), and updates to the team’s disinformation taxonomy (again, highly impactful for election-related projects, as it helped us make decisions around what to include in initial analysis).

Please let me know if you require any further information or clarifications here. Many thanks!

@NForrester thanks for expanding (and the email). A quick note that we have not forgotten you. We have done some preliminary work on this front and we should be able to make a decision on this front in the coming days. thanks for your patience.

@NForrester thanks for your patience. This is now prioritized on our end. I'm going to resolve this task. Please follow T343065 for technical implementation if you choose to.

@Pablo I need your help here. :) I assign this task to you on our end. Please maintain it with information about relevant subtasks and make sure Nathan is notified once the request is completed. Asking for Nathan's formal sign-off on this task before we close it is ideal to make sure we delivered what they asked for.

Weekly updates

• I informed @NForrester about the delay with this task during the Disinformation Working Group Call.
• We expect to have the process completed throughout Q2.

Weekly updates

• @nickifeajika created a notebook with a test of the methods for the data collection process and we are currently reviewing it, thank you @NForrester for your patience!

Weekly updates

• Due to internal issues, there will be changes in the allocation of research engineering resources. As a consequence, we are already coordinating to minimize the delay of this deliverable.

Weekly updates

• @fkaelin has created a replica of the dashboard that relies on a data ingestion pipeline that will run automatically on a periodic basis.
• We are currently evaluating code and data (it covers revisions from 2019-01 to 2023-10).

Weekly updates

• No issues were found while exploring the data except for the current limit to the 48 major wikis (the rest of language will added in the production run).
• @NForrester and I had a meeting and reviewed the new dashboard. He will explore it with the rest of the team and, if possible, share feedback in the Disinformation Working Group Call next week.

@NForrester any feedback on this?

@Pablo / @leila: Hi, the Due Date set for this open task passed a while ago.
Could you please either update or reset the Due Date (by clicking Edit Task), or set the status of this task to resolved in case this task is done? Thanks!

@NForrester and I will have a conversation next week to address the closure of this ticket, so I will edit the task to update the Due Date accordingly, thanks @Aklapper!

Feedback notes for the Risk Observatory can be found here: https://docs.google.com/document/d/1ZL8jPP1nMhsDItQebI9jBfi6MadPPmWhwQbrY3_1czQ/edit#heading=h.9m20oajao1zn

Thank you @NForrester for this quality feedback! I will therefore solve the task and we will consider your suggestions for future dashboard improvements :)