We may want to merge this related ticket in: T246324: List top Wikipedias with high deletion ratios for Content Translation

@Pginer-WMF

I've completed the initial analysis to measure the number of wikis were translations are deleted more often than new articles.

Please see summary of results below and notebook for further details.

Data: Data comes from mediawiki_history and is restricted to only main namespace articles created and deleted during the reviewed time period. Bots are excluded. Note: There are some slight differences between this data and the data found using https://quarry.wmcloud.org/query/43687, which I believe is partly due to differences in how bots are identified between the replicas and mediawiki_history but I'm investigating and will confirm.

Reviewed Time Periods: I reviewed two possible time periods: quarterly and every 6 months for this initial analysis but time periods can be easily adjusted. Happy to discuss which time period might work best and how frequently we'd like to review these rates over time.

Wiki size threshold: There are a number of smaller wikis where only a few content translation articles were created during the reviewed period. These were removed from the analysis to reduce noise and focus on wikis with more representative data. In the data below, I excluded wikis where 15 or fewer articles were created during the reviewed time period but this threshold can be adjusted if needed.

Quarterly Comparison

i. There were 3 wikis that had higher deletion ratios for content translated articles for both quarters: kawiki, bewiki, and mrwiki.
ii. Most of these were smaller sized wikis. The only two larger sized wikis (with over 100,000+ articles) on this list are Hindi Wikipedia (hiwiki) and Persian Wikipedia (fawiki). The deletion ratio for cx created articles was less than 1% higher than non-cx articles for both of these wikis in Q4.
iii. Note: With only 25 created translations, this is still a small wiki. The highest deletion ratio for a larger size wiki (with over 100,000+ total articles) is Hindi Wikipedia with a deletion ratio of 24.2% for cx created articles compared to 23.36% for articles created without cx (only a 0.8% difference)

List of Wikis where higher deletion ratios are higher for articles created with Content Translation (April 2021 - June 2021)

6 Month Comparison

iii. There were 8 wikis that had higher deletion ratios for content translated articles both 6 month periods: hawwiki, iswiki, kuwiki, arywiki, arzwiki, fiwiki, lawiki, and eowiki.

List of Wikis where higher deletion ratios are higher for articles created with Content Translation (Jan 2021 - June 2021)

Note: There are some slight differences between this data and the data found using https://quarry.wmcloud.org/query/43687, which I believe is partly due to differences in how bots are identified between the replicas and mediawiki_history but I'm investigating and will confirm.

I discussed this with @nshahquinn-wmf and we determined is likely because the query in https://quarry.wmcloud.org/query/43687 looks at the ratio of deleted articles to surviving (non-deleted) articles instead of the ratio of deleted articles to all created articles. The was corrected in the following query: https://quarry.wmcloud.org/query/53775

I confirmed that the numbers I reported in T286636#7345479 above are consistent with the data found using this corrected query of the replicas.

Thanks @MNeisler for sharing these results (and for confirming the origin of the inconsistencies with the previous query). At first sight the format provided seems very useful. I'll be looking into it in more detail.