In T244567#7231975, @WindEwriX wrote:

Same error «local-multiwrite» for https://ru.wikipedia.org/wiki/Файл:Карта_Швеции.png, cannot delete, cannot revert to old version (empty 'oldimage' field). Two entries in upload log, only one of them corresponds to page's history.

The same on https://uk.wikipedia.org/wiki/Файл:Балістичні_таблиці_P1720666.JPG

2 more files which were not in https://commons.wikimedia.org/wiki/Category:Deletion_error/T244567

• https://commons.wikimedia.org/wiki/File:Us_jointservcom_rib.png
• https://commons.wikimedia.org/wiki/File:Karte_s_muehlhausen.png

on ptwiki, same error: https://pt.wikipedia.org/wiki/File:A_Walk_in_the_Sun.jpg

One more: https://commons.wikimedia.org/wiki/File:Genting_Group.jpg

The possible cause on why the files can't be deleted is because they have a "non-existent" revision of the file. i.e, "no thumbnail"

One more: https://commons.wikimedia.org/wiki/File:Ballen_en_Alianza_Petrolera.jpg

Note that it is possible to overwrite https://commons.wikimedia.org/wiki/File:Ballen_en_Alianza_Petrolera.jpg with a new file, and to delete the old version. Weird.

Right now, 82 files in https://commons.wikimedia.org/wiki/Category:Deletion_error/T244567

In T244567#7395913, @Stanglavine wrote:

on ptwiki, same error: https://pt.wikipedia.org/wiki/File:A_Walk_in_the_Sun.jpg

On ptwiki I see more 4 files with an empty oi_archive_name (https://quarry.wmcloud.org/query/61588), I tried to delete some, but I have the same error (we don't need delete these now, only File:A_Walk_in_the_Sun.jpg, but if we need, we can't).

Same error on it.wiki when trying to delete https://it.wikipedia.org/wiki/File:Luigi_Faravelli.gif

Also on deWP: https://de.wikipedia.org/wiki/Datei:NTUA.gif

File:Spöke.jpg on Commons also cannot be deleted and also does not have a thumbnail in first of the file version.

How can file revisions go missing? Don't we have backups? Why can't we delete a file, even though one or more file revisions is missing? What can we do to prevent file revisions from going missing in the future, and to compensate for their missing status in the present?

@Jeff_G: Because software code has bugs, so there is phabricator.wikimedia.org as a bug tracker. You could inspect the software code, find mistakes, and create code fixes for mistakes. Please consider bringing up general questions on the wikitech-l mailing list - thanks!

This file also cannot be deleted:
https://commons.wikimedia.org/wiki/File:Nour_Photography.jpg

Current new example: https://en.wikipedia.org/wiki/File:KKNO_logo.jpg
Fails with error: Error deleting file: An unknown error occurred in storage backend "local-multiwrite".

While examining this vulnerability, I found another bug, T328112: Unexpected value: "oldimage"="", FYI.

Change 884347 had a related patch set uploaded (by Ammarpad; author: Ammarpad):

[mediawiki/core@master] Improve handling of missing files on File page

https://gerrit.wikimedia.org/r/884347

These files are missing on disc (or have archived versions that are) and so cannot be deleted (since the deletion code requires a file to exist first). From the code, it seems it's already known that some files are irretrievably lost on Wikimedia servers; for instance in code comment shown T244567#6518947 which is still in source. That's the first problem.

The second problem, which I think is the immediate cause for this specific error is the fact that a deletion link is added for these files (which the code already knows will not work); as well as a revert link, which causes T328112. There's also a rev-delete checkbox too, which I'm sure will not work.

Change 884347 merged by jenkins-bot:

[mediawiki/core@master] Improve handling of missing files on File page

https://gerrit.wikimedia.org/r/884347

The deletion link should be removed from the revisions which don't have a file on disk, but it should still be there for the file as a whole and that deletion should go through while gracefully handling missing versions. Is that what the patch above is about? We definitely do not want to just make the situation more confusing by removing all the links (then people would not even be able to end up here with no error message to search)

https://commons.wikimedia.org/wiki/File:Carsten_Rusch.jpg

Error deleting file: An unknown error occurred in storage backend "local-multiwrite".

https://commons.wikimedia.org/wiki/File:Human_Flaccid_Penis.jpg

https://commons.wikimedia.org/wiki/File:%D0%93%D0%BE%D1%81%D0%BF%D1%80%D0%BE%D0%BC,_%D0%B2%D0%B8%D0%B4_%D1%81%D0%BE_%D1%81%D1%82%D0%BE%D1%80%D0%BE%D0%BD%D1%8B_%D0%BF%D0%BB.%D0%A1%D0%B2%D0%BE%D0%B1%D0%BE%D0%B4%D1%8B.JPG

https://commons.wikimedia.org/w/index.php?title=File:Derzhprom.JPG&action=delete

https://commons.wikimedia.org/wiki/File:Derzhprom.JPG

https://commons.wikimedia.org/wiki/File:%D0%93%D0%BE%D1%81%D0%BF%D1%80%D0%BE%D0%BC,_%D0%B2%D0%B8%D0%B4_%D1%81%D0%BE_%D1%81%D1%82%D0%BE%D1%80%D0%BE%D0%BD%D1%8B_%D0%BF%D0%BB.%D0%A1%D0%B2%D0%BE%D0%B1%D0%BE%D0%B4%D1%8B.JPG

https://commons.wikimedia.org/wiki/File:Asif_Malik.jpg

https://commons.wikimedia.org/wiki/File:Indian_Professional_Academy.jpg

Change 919406 had a related patch set uploaded (by Umherirrender; author: Umherirrender):

[mediawiki/core@master] file: Check for old image existence in LocalFileDeleteBatch

https://gerrit.wikimedia.org/r/919406

One more https://commons.wikimedia.org/wiki/File:The_fish_avatara_of_Vishnu_saves_Manu_during_the_great_deluge.jpg

I can't even move it to a parking area, like it was done other files with the same issue:

Error while moving the page.
A detailed description of the error is shown below:
API request failed (internal_api_error_DBQueryError): [56e10902-cece-466e-8ca5-d016b109afe3] Caught exception of type Wikimedia\Rdbms\DBQueryError <i>at Thu, 25 May 2023 12:02:51 GMT</i> <u>served by mw1484</u>

I think that must be a separate issue, both given the DBQueryError and that the object is present in both swift clusters:

root@ms-fe1009:~# swift stat wikipedia-commons-local-public.d4 d/d4/The_fish_avatara_of_Vishnu_saves_Manu_during_the_great_deluge.jpg
        Account: AUTH_mw
      Container: wikipedia-commons-local-public.d4
         Object: d/d4/The_fish_avatara_of_Vishnu_saves_Manu_during_the_great_deluge.jpg
   Content Type: image/jpeg
 Content Length: 21269
  Last Modified: Thu, 25 May 2023 12:11:17 GMT
           ETag: 1f94670c1002d396cea50ee8aa872d7d
Meta Sha1Base36: r8v6t7yq6jkgo3s12gkj30ibin2fkys
  Accept-Ranges: bytes
    X-Timestamp: 1685016676.79279
     X-Trans-Id: tx65b903fb09a641f899051-00646f50d8

root@ms-fe2009:~# swift stat wikipedia-commons-local-public.d4 d/d4/The_fish_avatara_of_Vishnu_saves_Manu_during_the_great_deluge.jpg
        Account: AUTH_mw
      Container: wikipedia-commons-local-public.d4
         Object: d/d4/The_fish_avatara_of_Vishnu_saves_Manu_during_the_great_deluge.jpg
   Content Type: image/jpeg
 Content Length: 21269
  Last Modified: Thu, 25 May 2023 12:11:18 GMT
           ETag: 1f94670c1002d396cea50ee8aa872d7d
Meta Sha1Base36: r8v6t7yq6jkgo3s12gkj30ibin2fkys
     X-Trans-Id: tx077e7ccba4ed43cf83bfd-00646f50e6
  Accept-Ranges: bytes
    X-Timestamp: 1685016677.27598

The issue of this bug is when a old file is missing, in this case the version from "17:47, 10 September 2012".

https://commons.wikimedia.org/wiki/File:..Arunachal_Pradesh_Flag(INDIA).png
https://commons.wikimedia.org/wiki/File:Derzhprom.JPG
https://commons.wikimedia.org/wiki/File:%D0%93%D0%BE%D1%81%D0%BF%D1%80%D0%BE%D0%BC,_%D0%B2%D0%B8%D0%B4_%D1%81%D0%BE_%D1%81%D1%82%D0%BE%D1%80%D0%BE%D0%BD%D1%8B_%D0%BF%D0%BB.%D0%A1%D0%B2%D0%BE%D0%B1%D0%BE%D0%B4%D1%8B.JPG

Change 919406 merged by jenkins-bot:

[mediawiki/core@master] file: Check for old image existence in LocalFileDeleteBatch

https://gerrit.wikimedia.org/r/919406