Goal
Recently ptwiki turned off editing for IP editors. This has been done using an AbuseFilter for the time being. We should monitor some metrics to see how this impacts the health of the project long term.
@jwang recommended keeping these metrics in a notebook that auto-refreshes periodically. This will allow the metrics to be shared more broadly.
To begin with, this could include:
- Number of active editors
- Number of edits
- Number of blocks
- Number of reverts
- Number of accounts created
- Retention rate
- Checkuser checks
In future we can include:
- Quality of edits with ORES
Done:
The summary is refreshed weekly and published at: https://analytics.wikimedia.org/published/notebooks/AHT/ptwiki_dashboard.html
Covered metrics:
- Number of active editors
- Number of edits
- Number of blocks
- Number of reverts
- Definition 1: number of edits reverted by the snapshot time
- Definition 2: number of edits reverted within 48 hours
- Number of accounts created
- Retention rate
- Checkuser checks
- Number of non-reverted edits
- Definition 1: number of edits which were not reverted by the snapshot time
- Definition 2: number of edits which were not reverted within 48 hours
- Number of edits by non-bot vs bot registered users
- Quality of edits with ORES
Observations by the end of November 2020 (Week 48th)
After turning off IP editing on ptwiki, we saw:
- a 57% YoY increase in active registered editors
- a 20% YoY increase in new accounts
- a 10% YoY decrease in total edits
- a 50% YoY decrease in reverts
- a 3% YoY decrease in non-reverted edits
- a 85% YoY decrease in blocks