Page MenuHomePhabricator

chunked upload fails consitstently when uploading the last byte: timeout!
Open, Needs TriagePublicBUG REPORT

Description

Last byte of uplad takes 65 seconds then fails http response 504: timeout

21,20:09:38fyi: Uploading chunk [1 of 16] of 'Piss-In%2C_Pee_for_Free_2022_Berlin_03.webm.uiirjbbuiir.116091891.uploadrevision' filekey null Piss-In,_Pee_for_Free_2022_Berlin_03.webm 1
21,20:10:55inf: Status filekey not null CONTINUE 9,0905% uploaded; last chunk 96.654.900 bytes uploaded, 76 secs, served by mw1398.eqiad.wmnet
21,20:10:55fyi: Uploading chunk [2 of 16] of 'Piss-In%2C_Pee_for_Free_2022_Berlin_03.webm.uiirjbbuiir.116091891.uploadrevision' filekey 192ky40fpfc8.qacyv7.6080484.webm Piss-In,_Pee_for_Free_2022_Berlin_03.webm 1
21,20:12:58inf: Status filekey not null CONTINUE 18,1814% uploaded; last chunk 96.659.000 bytes uploaded, 123 secs, served by mw1360.eqiad.wmnet
21,20:12:58fyi: Uploading chunk [3 of 16] of 'Piss-In%2C_Pee_for_Free_2022_Berlin_03.webm.uiirjbbuiir.116091891.uploadrevision' filekey 192ky40fpfc8.qacyv7.6080484.webm Piss-In,_Pee_for_Free_2022_Berlin_03.webm 1
21,20:14:57inf: Status filekey not null CONTINUE 27,2723% uploaded; last chunk 96.659.000 bytes uploaded, 118 secs, served by mw1424.eqiad.wmnet
21,20:14:57fyi: Uploading chunk [4 of 16] of 'Piss-In%2C_Pee_for_Free_2022_Berlin_03.webm.uiirjbbuiir.116091891.uploadrevision' filekey 192ky40fpfc8.qacyv7.6080484.webm Piss-In,_Pee_for_Free_2022_Berlin_03.webm 1
21,20:17:20inf: Status filekey not null CONTINUE 36,3632% uploaded; last chunk 96.659.000 bytes uploaded, 143 secs, served by mw1443.eqiad.wmnet
21,20:17:20fyi: Uploading chunk [5 of 16] of 'Piss-In%2C_Pee_for_Free_2022_Berlin_03.webm.uiirjbbuiir.116091891.uploadrevision' filekey 192ky40fpfc8.qacyv7.6080484.webm Piss-In,_Pee_for_Free_2022_Berlin_03.webm 1
21,20:18:37inf: Status filekey not null CONTINUE 45,4542% uploaded; last chunk 96.659.000 bytes uploaded, 77 secs, served by mw1344.eqiad.wmnet
21,20:18:37fyi: Uploading chunk [6 of 16] of 'Piss-In%2C_Pee_for_Free_2022_Berlin_03.webm.uiirjbbuiir.116091891.uploadrevision' filekey 192ky40fpfc8.qacyv7.6080484.webm Piss-In,_Pee_for_Free_2022_Berlin_03.webm 1
21,20:20:31inf: Status filekey not null CONTINUE 54,5451% uploaded; last chunk 96.659.000 bytes uploaded, 113 secs, served by mw1392.eqiad.wmnet
21,20:20:31fyi: Uploading chunk [7 of 16] of 'Piss-In%2C_Pee_for_Free_2022_Berlin_03.webm.uiirjbbuiir.116091891.uploadrevision' filekey 192ky40fpfc8.qacyv7.6080484.webm Piss-In,_Pee_for_Free_2022_Berlin_03.webm 1
21,20:22:24inf: Status filekey not null CONTINUE 63,6360% uploaded; last chunk 96.659.000 bytes uploaded, 113 secs, served by mw1383.eqiad.wmnet
21,20:22:24fyi: Uploading chunk [8 of 16] of 'Piss-In%2C_Pee_for_Free_2022_Berlin_03.webm.uiirjbbuiir.116091891.uploadrevision' filekey 192ky40fpfc8.qacyv7.6080484.webm Piss-In,_Pee_for_Free_2022_Berlin_03.webm 1
21,20:23:41inf: Status filekey not null CONTINUE 72,7269% uploaded; last chunk 96.659.000 bytes uploaded, 77 secs, served by mw1344.eqiad.wmnet
21,20:23:42fyi: Uploading chunk [9 of 16] of 'Piss-In%2C_Pee_for_Free_2022_Berlin_03.webm.uiirjbbuiir.116091891.uploadrevision' filekey 192ky40fpfc8.qacyv7.6080484.webm Piss-In,_Pee_for_Free_2022_Berlin_03.webm 1
21,20:25:39inf: Status filekey not null CONTINUE 81,8178% uploaded; last chunk 96.659.000 bytes uploaded, 117 secs, served by mw1376.eqiad.wmnet
21,20:25:39fyi: Uploading chunk [10 of 16] of 'Piss-In%2C_Pee_for_Free_2022_Berlin_03.webm.uiirjbbuiir.116091891.uploadrevision' filekey 192ky40fpfc8.qacyv7.6080484.webm Piss-In,_Pee_for_Free_2022_Berlin_03.webm 1
21,20:27:37inf: Status filekey not null CONTINUE 90,9087% uploaded; last chunk 96.659.000 bytes uploaded, 117 secs, served by mw1448.eqiad.wmnet
21,20:27:37fyi: Uploading chunk [11 of 16] of 'Piss-In%2C_Pee_for_Free_2022_Berlin_03.webm.uiirjbbuiir.116091891.uploadrevision' filekey 192ky40fpfc8.qacyv7.6080484.webm Piss-In,_Pee_for_Free_2022_Berlin_03.webm 1
21,20:28:56inf: Status filekey not null CONTINUE 99,9996% uploaded; last chunk 96.659.000 bytes uploaded, 79 secs, served by mw1380.eqiad.wmnet
21,20:28:56fyi: Uploading chunk [12 of 16] of 'Piss-In%2C_Pee_for_Free_2022_Berlin_03.webm.uiirjbbuiir.116091891.uploadrevision' filekey 192ky40fpfc8.qacyv7.6080484.webm Piss-In,_Pee_for_Free_2022_Berlin_03.webm 1
21,20:28:58inf: Status filekey not null CONTINUE 99,9997% uploaded; last chunk 1.024 bytes uploaded, 2 secs, served by mw1357.eqiad.wmnet
21,20:28:58fyi: Uploading chunk [13 of 16] of 'Piss-In%2C_Pee_for_Free_2022_Berlin_03.webm.uiirjbbuiir.116091891.uploadrevision' filekey 192ky40fpfc8.qacyv7.6080484.webm Piss-In,_Pee_for_Free_2022_Berlin_03.webm 1
21,20:29:01inf: Status filekey not null CONTINUE 99,9998% uploaded; last chunk 1.024 bytes uploaded, 2 secs, served by mw1357.eqiad.wmnet
21,20:29:01fyi: Uploading chunk [14 of 16] of 'Piss-In%2C_Pee_for_Free_2022_Berlin_03.webm.uiirjbbuiir.116091891.uploadrevision' filekey 192ky40fpfc8.qacyv7.6080484.webm Piss-In,_Pee_for_Free_2022_Berlin_03.webm 1
21,20:29:03inf: Status filekey not null CONTINUE 99,9999% uploaded; last chunk 1.024 bytes uploaded, 2 secs, served by mw1358.eqiad.wmnet
21,20:29:03fyi: Uploading chunk [15 of 16] of 'Piss-In%2C_Pee_for_Free_2022_Berlin_03.webm.uiirjbbuiir.116091891.uploadrevision' filekey 192ky40fpfc8.qacyv7.6080484.webm Piss-In,_Pee_for_Free_2022_Berlin_03.webm 1
21,20:29:05inf: Status filekey not null CONTINUE 100,0000% uploaded; last chunk 1.024 bytes uploaded, 1 secs, served by mw1449.eqiad.wmnet
21,20:29:05fyi: Uploading chunk [16 of 16] of 'Piss-In%2C_Pee_for_Free_2022_Berlin_03.webm.uiirjbbuiir.116091891.uploadrevision' filekey 192ky40fpfc8.qacyv7.6080484.webm Piss-In,_Pee_for_Free_2022_Berlin_03.webm 1
5er Response: 504
Contentlength 24
upstream request timeout
{"error":{"code":"missingresult","info":"No result in status data.","*":"See https://commons.wikimedia.org/w/api.php for API usage. Subscribe to the mediawiki-api-announce mailing list at <https://lists.wikimedia.org/postorius/lists/mediawiki-api-announce.lists.wikimedia.org/> for notice of API deprecations and breaking changes."},"servedby":"mw1444"}
21,20:30:10inf: Status filekey not null MISSINGRESULT 100,0000% uploaded; last chunk 0 bytes uploaded, 65 secs, served by "mw1444"}
21,20:30:10err: upload failed - missingresult - No result in status data. - served by "mw1444"}
21,20:30:10err: Bad response from server: 504 0
21,20:30:10err: Encountered an error, retrying - 0 java.lang.IllegalStateException: closed
{"error":{"code":"missingresult","info":"No result in status data.","*":"See https://commons.wikimedia.org/w/api.php for API usage. Subscribe to the mediawiki-api-announce mailing list at <https://lists.wikimedia.org/postorius/lists/mediawiki-api-announce.lists.wikimedia.org/> for notice of API deprecations and breaking changes."},"servedby":"mw1424"}
21,20:30:10inf: Status filekey not null MISSINGRESULT 100,0000% uploaded; last chunk 0 bytes uploaded, 65 secs, served by "mw1424"}
21,20:30:10err: upload failed - missingresult - No result in status data. - served by "mw1424"}
21,20:30:10inf: Uploaded Chunk - filekey 192ky40fpfc8.qacyv7.6080484.webm null 1 Response{protocol=h2, code=200, message=, url=https://commons.wikimedia.org/w/api.php?action=upload} {"error":{"code":"uploadstash-file-not-found","info":"Key \"192ky40fpfc8.qacyv7.6080484.webm\" not found in stash.","*":"See https://commons.wikimedia.org/w/api.php for API usage. Subscribe to the mediawiki-api-announce mailing list at <https://lists.wikimedia.org/postorius/lists/mediawiki-api-announce.lists.wikimedia.org/> for notice of API deprecations and breaking changes."},"servedby":"mw1361"}
{"error":{"code":"missingresult","info":"No result in status data.","*":"See https://commons.wikimedia.org/w/api.php for API usage. Subscribe to the mediawiki-api-announce mailing list at <https://lists.wikimedia.org/postorius/lists/mediawiki-api-announce.lists.wikimedia.org/> for notice of API deprecations and breaking changes."},"servedby":"mw1359"}
21,20:30:11inf: Status filekey not null MISSINGRESULT 100,0000% uploaded; last chunk 0 bytes uploaded, 65 secs, served by "mw1359"}
21,20:30:11err: upload failed - missingresult - No result in status data. - served by "mw1359"}
21,20:30:11inf: Uploaded Chunk - filekey 192ky40fpfc8.qacyv7.6080484.webm null 2 Response{protocol=h2, code=200, message=, url=https://commons.wikimedia.org/w/api.php?action=upload} {"error":{"code":"uploadstash-file-not-found","info":"Key \"192ky40fpfc8.qacyv7.6080484.webm\" not found in stash.","*":"See https://commons.wikimedia.org/w/api.php for API usage. Subscribe to the mediawiki-api-announce mailing list at <https://lists.wikimedia.org/postorius/lists/mediawiki-api-announce.lists.wikimedia.org/> for notice of API deprecations and breaking changes."},"servedby":"mw1358"}
{"error":{"code":"missingresult","info":"No result in status data.","*":"See https://commons.wikimedia.org/w/api.php for API usage. Subscribe to the mediawiki-api-announce mailing list at <https://lists.wikimedia.org/postorius/lists/mediawiki-api-announce.lists.wikimedia.org/> for notice of API deprecations and breaking changes."},"servedby":"mw1421"}
21,20:30:11inf: Status filekey not null MISSINGRESULT 100,0000% uploaded; last chunk 0 bytes uploaded, 66 secs, served by "mw1421"}
21,20:30:11err: upload failed - missingresult - No result in status data. - served by "mw1421"}
21,20:30:11inf: Uploaded Chunk - filekey 192ky40fpfc8.qacyv7.6080484.webm null 3 Response{protocol=h2, code=200, message=, url=https://commons.wikimedia.org/w/api.php?action=upload} {"error":{"code":"uploadstash-file-not-found","info":"Key \"192ky40fpfc8.qacyv7.6080484.webm\" not found in stash.","*":"See https://commons.wikimedia.org/w/api.php for API usage. Subscribe to the mediawiki-api-announce mailing list at <https://lists.wikimedia.org/postorius/lists/mediawiki-api-announce.lists.wikimedia.org/> for notice of API deprecations and breaking changes."},"servedby":"mw1400"}
{"error":{"code":"missingresult","info":"No result in status data.","*":"See https://commons.wikimedia.org/w/api.php for API usage. Subscribe to the mediawiki-api-announce mailing list at <https://lists.wikimedia.org/postorius/lists/mediawiki-api-announce.lists.wikimedia.org/> for notice of API deprecations and breaking changes."},"servedby":"mw1382"}
21,20:30:11inf: Status filekey not null MISSINGRESULT 100,0000% uploaded; last chunk 0 bytes uploaded, 66 secs, served by "mw1382"}
21,20:30:11err: upload failed - missingresult - No result in status data. - served by "mw1382"}
21,20:30:11inf: Uploaded Chunk - filekey 192ky40fpfc8.qacyv7.6080484.webm null 4 Response{protocol=h2, code=200, message=, url=https://commons.wikimedia.org/w/api.php?action=upload} {"error":{"code":"uploadstash-file-not-found","info":"Key \"192ky40fpfc8.qacyv7.6080484.webm\" not found in stash.","*":"See https://commons.wikimedia.org/w/api.php for API usage. Subscribe to the mediawiki-api-announce mailing list at <https://lists.wikimedia.org/postorius/lists/mediawiki-api-announce.lists.wikimedia.org/> for notice of API deprecations and breaking changes."},"servedby":"mw1425"}
read 0 bytes
{"error":{"code":"missingresult","info":"No result in status data.","*":"See https://commons.wikimedia.org/w/api.php for API usage. Subscribe to the mediawiki-api-announce mailing list at <https://lists.wikimedia.org/postorius/lists/mediawiki-api-announce.lists.wikimedia.org/> for notice of API deprecations and breaking changes."},"servedby":"mw1312"}
21,20:30:11inf: Unstashing '192ky40fpfc8.qacyv7.6080484.webm' as 'Piss-In,_Pee_for_Free_2022_Berlin_03.webm' 1
{"error":{"code":"uploadstash-file-not-found","info":"Key \"192ky40fpfc8.qacyv7.6080484.webm\" not found in stash.","*":"See https://commons.wikimedia.org/w/api.php for API usage. Subscribe to the mediawiki-api-announce mailing list at <https://lists.wikimedia.org/postorius/lists/mediawiki-api-announce.lists.wikimedia.org/> for notice of API deprecations and breaking changes."},"servedby":"mw1314"}
21,20:30:12err: Encountered an error while unstashing, retrying - 0 ActionResult FILENOTFOUND
{"error":{"code":"missingresult","info":"No result in status data.","*":"See https://commons.wikimedia.org/w/api.php for API usage. Subscribe to the mediawiki-api-announce mailing list at <https://lists.wikimedia.org/postorius/lists/mediawiki-api-announce.lists.wikimedia.org/> for notice of API deprecations and breaking changes."},"servedby":"mw1347"}

Event Timeline

Many uploads stop after the first chunk (using https://commons.wikimedia.org/wiki/User:Rillke/bigChunkedUpload.js ). These are PDF files from 100 to 200 MB. Is it because of this bug?

@C.Suthorn When you say consistently do you mean. Consistently for this one file, or for all files (or all files of this type) which you attempted to upload ?

Also, which browser did you use ?

@TheDJ As far as I can see, this is related to file size. Files up to 60MB upload fine. Files up to 600MB can be uploaded in most cases. Files up to 1.2GB can sometimes be uploaded. Larger filed can be uploadd with the Rillke script, if you try 1-4 times.

Is there a statistic quantifying the number and size of large uploaded files over time (and omiting Fae's uploads, as them used them own tools)?