@AUgolnikova-WMF I see the deletion rates increase over time because a file may be deleted 2 months or longer time after uploading. In this case, we can set a timeframe of deletion for the metrics similar to revision. For example, total number of filed deletion requests within 30 days (or 60 days) of uploading monthly

@AUgolnikova-WMF Please find the baselines for upload wizard improvements below. The data is from April 2023 and May 2023, the detailed number can be found in this notebook

Here are some notes and finds:

• The data excluding mobile and bot uploads.
• For both months, there were more uploads through the upload wizard compared to other work streams.
• For upload wizard, over 70% of uploads are own works. While from other upload methods, it's hard to define whether the files are own work or not, because not as the upload wizard, the edit comments are not standard or in other languages. We can only find very few (< 0.02%) uploads that are own work.
• Uploads that were own work have a lower deletion rate than not own work. Uploads through upload wizard have a higher deletion rate compared to uploads through other methods.
• I used edit comments to determine whether deletions are speedy deletions or not. But a large number of comments are empty or not standard. As a result, the actual speedy deletion numbers may be greater than the data we calculated.

Below is the data:
April

• File Uploads Metrics:
  • There were 579,666 uploads in Commons, 303,901 (52.3%) of uploads were from upload wizard, and 276,038 (47.6%) were from other upload methods.
  • Of all the uploads from the upload wizard, 71.1% were own work, and 28.9% were not.
• Deletion Meitrcs:
  • There were in total 16,285 deletion requests, 271 of them were speedy deletions. 60.9% of them were uploads from upload wizard, and 38.9% of them were from other upload methods.
  • In upload wizard uploads, there were 9,923 deletions. 4,847 (48.8%) were own work and 5,076 (51.2%) were not own work. 170 of them were speedy deletions.
• Deletion Rate:
  • The overall deletion rate is 2.76%. the upload wizard uploads (3.21%) have higher deletion rate than uploads through other methods (2.27%).
  • Among the uploads through upload wizard, own work 2.21% has a lower deletion rate than not own work (5.66%)

May

• File Uploads Metrics:
  • There were 585,035 uploads in Commons, 313,852 (53.6%) of uploads were from upload wizard, and 271,183 (46.4%) were from other upload method.
  • Of all the uploads from upload wizard, 74.6% were own work, and 25.2% were not own work.
• Deletion Meitrcs:
  • There were in total 13,074 deletion requests, 256 of which were speedy deletions. 60.9% of them were uploads from upload wizard, and 39% of them were from other upload methods.
  • In upload wizard uploads, there were 7,959 deletions. 4,993 (63%) were own work and 2966 (37%) were not own work. 177 of them were speedy deletions.
• Deletion Rate:
  • the overall deletion rate was 2.19%. the upload wizard uploads (2.09%) have higher deletion rate than uploads through other methods (1.85%).
  • Among the uploads through upload wizard, own work 2.09% has lower deletion rate than not own work (3.65%).

Month over month deletion rate from January 2023 to May 2023:

Overall Deletion Rate

Upload Wizard Deletion Rate

Other Upload Methods Deletion Rate

Some notes from the data:

• We can see deletion rates increasing over time.
• the deletion rate of own work doesn't change as much as not own work, maybe because the problems that cause the deletion of own work are easier to detect than the problems of not own work.
• The deletion rate for uploads through the upload wizard is higher.

Adding data for deletion requests in the queue:

April
The number of deletion requests in the queue for files uploaded in April by the end of April is 2,675.

May
The number of deletion requests in the queue for files uploaded in May by the end of May is 7,881.

Adding data for the overall deletions rate for the last 12 months by the end of June 2023, including deleted files and outstanding deletion requests

uploads means number of files uploaded within certain month
deletions means number of files uploaded within certain month that have been deleted by the end of June 2023. the deletions of files could be happened anytime from the file creation to the end of June 2023.
outstanding_deletions means number of files uploaded within certain month that still in the DR queue by the end of June 2023. the submission of deletion requests of files could be happened anytime from the file creation to the end of June 2023.
deletion_rate is (deletions+outstanding_deletions)/uploads

We can use April 2023 data as an example, there are 579,707 files uploaded from April 1, 2023 - April 30, 2023. Out of these 579,707 files, 17,741 files were deleted between April 1, 2023 - June 30, 2023; 488 files are still in the deletion request queue by June 30, 2023, these deletion requests could be submitted any time between April 1, 2023 - June 30, 2023.

Below are the deletion rates of media uploaded within a given month that is flagged for deletion within 30 days of being uploaded in May, June and July 2023.

Deletion rate = (deletions + outstanding deletions) / uploads

I also added deletion of uploads within 30 days for uploads through the upload wizard only

Future data will be updated in this sheet https://docs.google.com/spreadsheets/d/1qR6yPFktt-DTfETFJD50a2ooVbPe6Ad9m1S3fEdK2kE/edit#gid=0