Page MenuHomePhabricator

How many edits will Automoderator review on a given day?
Closed, ResolvedPublic

Description

We receive a question asking how many edits Automoderator will review (T345092#9339050), given the various constraints we're putting on it to improve the false positive rate.

For the top 15 Wikipedias by size, per day:

  • How many edits are made in total?
  • How many of these edits are to the main namespace?
  • How many of those edits are:
    • Page creations
    • Made by bots
    • Made by administrators
    • Self-reverts

Event Timeline

KCVelaga_WMF changed the task status from Open to In Progress.Jan 8 2024, 11:39 AM
KCVelaga_WMF claimed this task.

@Samwalton9-WMF

Here is the data (Except "All Edits", everything is within main namespace only)

WikipediaAll EditsMain Namespace EditsPage CreationsRedirect CreationsNon Redirect CreationsBot EditsSysop EditsRevertsSelf Reverts
enwiki18400111254521141431519872871787160934
frwiki284911985156217727212121791755103
dewiki27037189155642002861243196875773
ruwiki2325117690165612912714855432946108
eswiki208301711145412323419654981942144
itwiki1750514033280621572984105488494
jawiki15967136552951121371083174539126
zhwiki1591712255491233222172916239688
arwiki110587368247541354808329240570
plwiki9155719626088133254968231729
idwiki785352042029673187549318340
nlwiki77966457184561012189129221823
fawiki6449489236366255122225441839
ptwiki61524205202708935946819730
trwiki5925458128940179166018527339

@Samwalton9-WMF

Here is the data (Except "All Edits", everything is within main namespace only)

Thanks! Could you explain the differences between 'Page creations' 'redirect creations' and 'non redirect creations'?

@Samwalton9-WMF Page creations is all page creations (within main namespace), which is technically equal to redirects + non-redirects. However, non-redirects count include both articles and disambiguation pages.

In the table above, the numbers are the averages of their own individual columns, but not sum of the averages. For example, "Page Creations" is calculated as "average number of page creations / day", but not as sum of "average number of redirect creations / day" + "average number of non-direct creations / day". So page creations may not be the exact sum of redirect and non-redirect columns, but should be close. I have verified, redirects + non-redirects = page creations , holds true for yearly totals.

@Samwalton9-WMF Page creations is all page creations (within main namespace), which is technically equal to redirects + non-redirects. However, non-redirects count include both articles and disambiguation pages.

In the table above, the numbers are the averages of their own individual columns, but not sum of the averages. For example, "Page Creations" is calculated as "average number of page creations / day", but not as sum of "average number of redirect creations / day" + "average number of non-direct creations / day". So page creations may not be the exact sum of redirect and non-redirect columns, but should be close. I have verified, redirects + non-redirects = page creations , holds true for yearly totals.

Oh I see, this makes sense. Can you help me understand why the sum of Page Creations, Bot Edits, Sysop Edits, and Self Reverts might sum to more than the total of Main Namespace Edits? Is it because they're independently counted and might be duplicated?

@Samwalton9-WMF Sorry missed this. I only see that sum of Page Creations, Bot Edits, Sysop Edits, and Self Reverts is greater than Main Namespace Edits for arwiki, unless I missing something. This can happen as some of these columns are non-exclusive of each other:

  • Sysop edits and Bot edits also include page creations.
  • Similarly with reverts, the reverts column counts both self and non-self reverts. Example, for enwiki, of 7160 reverts, 934 are self-reverts, and some of these self-reverts could have been by admins as well.

Let me know if it would be helpful to isolate any of these for exclusive counts (for example, sysop edits excluding reverts and page creations).

Gotcha - thanks for explaining! From this I found that of all mainspace edits on the projects we investigated here, on average:

  • ~4% are page creations
  • ~23% are bot edits (there are notable outliers here which bump up the % - ar.wiki at 65% and a few around 35%)
  • ~10% are sysop edits (ar.wiki is again a notable outlier at 45%)
  • ~0.7% are self-reverts

These percentages can't be added together directly since, per the last comment, they're not exclusive of each other, but this gives a rough scale of how many edits we're skipping entirely given our current configuration and model limits.