Page MenuHomePhabricator

Problem with uploading large files (2 GB)
Closed, DuplicatePublicBUG REPORT

Description

Steps to replicate the issue (include links if applicable):

  • When trying to upload a 2GB PDF file, UploadWizard gives the following error: The file mwstore://local-swift-codfw/local-temp/d/dd/1an8dgb0q6ow.gr4vk6.12187057.pdf.0 does not exist
  • It seems there is a problem also using user-scripts for large uploads. When the user tried to use User:Rillke/bigChunkedUpload.js to upload same file, it gave the following error: 01203: FAILED: internal_api_error_DBQueryError: [e7d19154-c94b-4562-98d6-40be70bf6b79] Caught exception of type Wikimedia\Rdbms\DBQueryError

What happens?:
It seems that the problem happens server-side: the server wanted to do something with the file that was uploaded but not yet published, but the file was lost on the server

What should have happened instead?:
The file should have been uploaded correctly.

Software version (skip for WMF-hosted wikis like Wikipedia):

Other information (browser name/version, screenshots, etc.):
Tried to reformulate the problem from this discussion on Commons.

See also: T355610: Problem uploading 4GB FLAC file in Upload Wizard to Wikimedia Commons

Event Timeline

Sannita renamed this task from Problem with uploading large files to Problem with uploading large files (2 GB).Jan 19 2024, 3:12 PM
Sannita created this task.

When did you try with upload wizard and get the error message you describe here? I've checked the swift logs for 18 and 19 January, and get no hits at all for 1an8dgb0q6ow.gr4vk6.12187057.pdf.0.

I have the same problem uploading FLAC files, same error

When did you try with upload wizard and get the error message you describe here? I've checked the swift logs for 18 and 19 January, and get no hits at all for 1an8dgb0q6ow.gr4vk6.12187057.pdf.0.

You should ask directly to the user on Commons, I was just helping them creating a Phab ticket, since they didn't know how to do it.

I'm afraid I don't have the time and resources to follow discussions elsewhere, and without that information there's nothing much more I can do with this report.

I'm afraid I don't have the time and resources to follow discussions elsewhere, and without that information there's nothing much more I can do with this report.

I'll ask then, and report when I have an answer.

@MatthewVernon the affected files are https://commons.wikimedia.org/w/index.php?title=File:1an7ghzwafv8.s9fwlh.12187057.pdf, https://commons.wikimedia.org/w/index.php?title=File:1an8d2mlysto.eax27x.12187057.pdf, https://commons.wikimedia.org/w/index.php?title=File:1an7lorvv7xk.fidryt.12187057.pdf and https://commons.wikimedia.org/w/index.php?title=File:1an7jaean4cw.be9k8c.12187057.pdf, they should have been uploaded around Jan 14-16.

The user also made another attempt today at 16:30 UTC, error around 17:04 UTC: "The file mwstore://local-swift-codfw/local-temp/8/80/1antmj4sd920.5c90pr.12187057.pdf.0 does not exist".

Right, those are all too far ago to still in the recent logs. Today's, however, I can find, and swift has done what was asked of it - that file was uploaded and subsequently deleted (before further requests got 404, which you'd expect after a successful delete).

@MatthewVernon I just used Upload Wizard to upload the file. I did not see neither attempt to delete the file after upload. After progressbar reached the end, it just spit out the abovementioned error.

You can try to upload the file yourself: https://fex.net/s/ckmb8ov - the same file or any other PDF bigger than 1.5 GB.

I do get the same error with a webm file. I was able to upload the first 1GB of the file and do a revision upload of the first 2GB, but once I try to upload either the complete file of 3.6GB or even a part of 2.1GB I either get the same error as MikhasiRV or I get a "someone is doing something with this file" error. I can upload the whole file to my web space if you need it for upload tests.

I think the simplest way to correct this error is to lower the maximum upload limit to 1 GB for validation.

I think the simplest way to correct this error is to lower the maximum upload limit to 1 GB for validation.

That would be reducing functionality. I would prefer to see the problem fixed.

@MatthewVernon I just used Upload Wizard to upload the file. I did not see neither attempt to delete the file after upload. After progressbar reached the end, it just spit out the abovementioned error.

You can try to upload the file yourself: https://fex.net/s/ckmb8ov - the same file or any other PDF bigger than 1.5 GB.

I was able to download the file as F 1-74-0217.PDF. In case one of us gets it to upload, what filename would you like and how would you like the file description page to read?

Right, those are all too far ago to still in the recent logs. Today's, however, I can find, and swift has done what was asked of it - that file was uploaded and subsequently deleted (before further requests got 404, which you'd expect after a successful delete).

See also the previous remains deleted in https://commons.wikimedia.org/wiki/Commons:Deletion_requests/Files_uploaded_by_MikhasikRV .

I was able to download the file as F 1-74-0217.PDF. In case one of us gets it to upload, what filename would you like and how would you like the file description page to read?

As I said in the other thread, this is not the only file I need to upload. But how did you manage to upload that file? Using Upload Wizard?

I was able to download the file as F 1-74-0217.PDF. In case one of us gets it to upload, what filename would you like and how would you like the file description page to read?

As I said in the other thread, this is not the only file I need to upload. But how did you manage to upload that file? Using Upload Wizard?

Since you seem to want to continue on your user talk page, please see https://commons.wikimedia.org/w/index.php?title=User_talk:MikhasikRV&diff=prev&oldid=846805191 .