Page MenuHomePhabricator

500, Internal Server Error on Commons for images at specified size
Closed, ResolvedPublicBUG REPORT

Description

Trying to access, for example:

https://upload.wikimedia.org/wikipedia/commons/thumb/5/51/Allison_Littlejohn_-_2020-02-26_-_Disruptive_Media_Learning_Lab.png/640px-Allison_Littlejohn_-_2020-02-26_-_Disruptive_Media_Learning_Lab.png

(upload ~3.5 hours ago) returns:

Our servers are currently under maintenance or experiencing a technical problem. Please try again in a few minutes
[...]
Request from 2.29.195.22 via cp3061 frontend, Varnish XID 981081286
Upstream caches: cp3061 int
Error: 500, Internal Server Error at Tue, 14 Apr 2020 17:28:25 GMT

as does trying to access other sizes of the same image. This has been happening for over an hour.

Event Timeline

fgiunchedi triaged this task as Medium priority.Apr 15 2020, 8:44 AM

Request/response details, might be useful to help diagnosing the issue:

**  << BeReq    >> 193204670 
--  Begin          bereq 193204669 fetch
--  Timestamp      Start: 1589268431.461412 0.000000 0.000000
--  BereqMethod    GET
--  BereqURL       /wikipedia/commons/thumb/5/51/Allison_Littlejohn_-_2020-02-26_-_Disruptive_Media_Learning_Lab.png/640px-Allison_Littlejohn_-_2020-02-26_-_Disruptive_Media_Learning_Lab.png
--  BereqProtocol  HTTP/1.1
--  BereqHeader    User-Agent: curl/7.68.0
--  BereqHeader    Accept: */*
--  BereqHeader    X-Client-IP: REDACTED
--  BereqHeader    X-Connection-Properties: H2=1; SSR=0; SSL=TLSv1.3; C=TLS_AES_256_GCM_SHA384; EC=X25519;
--  BereqHeader    X-Forwarded-Proto: https
--  BereqHeader    X-Forwarded-For: REDACTED, 10.20.0.51
--  BereqHeader    via-nginx: 1
--  BereqHeader    Host: upload.wikimedia.org
--  BereqHeader    X-WMF-NOCOOKIES: 1
--  BereqHeader    X-CDIS: miss
--  BereqHeader    Accept-Encoding: gzip
--  BereqHeader    X-Varnish: 193204670
--  VCL_call       BACKEND_FETCH
--  VCL_return     fetch
--  BackendOpen    1998 vcl-3133dbb4-8884-4613-9c40-2b04e04bef56.be_cp3063_esams_wmnet 10.20.0.63 3128 10.20.0.51 52671
--  BackendStart   10.20.0.63 3128
--  Timestamp      Bereq: 1589268431.461454 0.000042 0.000042
--  Timestamp      Beresp: 1589268432.667746 1.206334 1.206292
--  BerespProtocol HTTP/1.1
--  BerespStatus   500
--  BerespReason   Internal Error
--  BerespHeader   Date: Tue, 12 May 2020 07:27:12 GMT
--  BerespHeader   Content-Type: text/html; charset=UTF-8
--  BerespHeader   Content-Length: 0
--  BerespHeader   Thumbor-Request-Id: 0A400027:33EC_0A020218:2260_5EBA4FCF_777377F:1C88
--  BerespHeader   Thumbor-Memcache-Get-Time: 0
--  BerespHeader   Thumbor-Request-Date: Tue, 12 May 2020 07:27:11 GMT
--  BerespHeader   X-Upstream: 127.0.0.1:8805
--  BerespHeader   Cache-Control: no-cache
--  BerespHeader   Thumbor-Swift-Original-Success-Time: 565
--  BerespHeader   Server: TornadoServer/4.4.3
--  BerespHeader   Thumbor-Poolcounter-Time: 6
--  BerespHeader   Thumbor-Vips-Time: 85, 52
--  BerespHeader   Thumbor-Swift-Thumbnail-Miss-Time: 20
--  BerespHeader   Proxy-Response-Date: 12/May/2020:07:27:11 +0000
--  BerespHeader   Thumbor-Exiftool-Time: 292
--  BerespHeader   Thumbor-Memcache-Set-Time: 0
--  BerespHeader   Proxy-Request-Date: 12/May/2020:07:27:11 +0000
--  BerespHeader   Thumbor-Engine: wikimedia_thumbor.engine.vips
--  BerespHeader   X-Trans-Id: txf7fd3493882b4ceca2948-005eba4fcf
--  BerespHeader   Age: 1
--  BerespHeader   Connection: keep-alive
--  BerespHeader   X-Cache-Int: cp3063 miss
--  BerespHeader   X-ATS-Timestamp: 1589268432
--  BerespHeader   X-MediaWiki-Original: /wikipedia/commons/5/51/Allison_Littlejohn_-_2020-02-26_-_Disruptive_Media_Learning_Lab.png
--  TTL            RFC -1 10 0 1589268433 1589268432 1589268432 0 0
--  VCL_call       BACKEND_RESPONSE
--  TTL            VCL 1 10 0 1589268432
--  VCL_return     deliver
--  Storage        malloc s0
--  ObjProtocol    HTTP/1.1
--  ObjStatus      500
--  ObjReason      Internal Error
--  ObjHeader      Date: Tue, 12 May 2020 07:27:12 GMT
--  ObjHeader      Content-Type: text/html; charset=UTF-8
--  ObjHeader      Content-Length: 0
--  ObjHeader      Thumbor-Request-Id: 0A400027:33EC_0A020218:2260_5EBA4FCF_777377F:1C88
--  ObjHeader      Thumbor-Memcache-Get-Time: 0
--  ObjHeader      Thumbor-Request-Date: Tue, 12 May 2020 07:27:11 GMT
--  ObjHeader      X-Upstream: 127.0.0.1:8805
--  ObjHeader      Cache-Control: no-cache
--  ObjHeader      Thumbor-Swift-Original-Success-Time: 565
--  ObjHeader      Server: TornadoServer/4.4.3
--  ObjHeader      Thumbor-Poolcounter-Time: 6
--  ObjHeader      Thumbor-Vips-Time: 85, 52
--  ObjHeader      Thumbor-Swift-Thumbnail-Miss-Time: 20
--  ObjHeader      Proxy-Response-Date: 12/May/2020:07:27:11 +0000
--  ObjHeader      Thumbor-Exiftool-Time: 292
--  ObjHeader      Thumbor-Memcache-Set-Time: 0
--  ObjHeader      Proxy-Request-Date: 12/May/2020:07:27:11 +0000
--  ObjHeader      Thumbor-Engine: wikimedia_thumbor.engine.vips
--  ObjHeader      X-Trans-Id: txf7fd3493882b4ceca2948-005eba4fcf
--  ObjHeader      X-Cache-Int: cp3063 miss
--  ObjHeader      X-ATS-Timestamp: 1589268432
--  ObjHeader      X-MediaWiki-Original: /wikipedia/commons/5/51/Allison_Littlejohn_-_2020-02-26_-_Disruptive_Media_Learning_Lab.png
--  Fetch_Body     0 none -
--  BackendReuse   1998 vcl-3133dbb4-8884-4613-9c40-2b04e04bef56.be_cp3063_esams_wmnet
--  Timestamp      BerespBody: 1589268432.667824 1.206413 0.000078
--  Length         0
--  BereqAcct      534 0 534 952 0 952
--  End
Marostegui subscribed.

This works now. I am going to consider this resolved, maybe it was a one time thing?
If you feel this needs to keep being open, please reopen!
Thank you for the report.