Page MenuHomePhabricator
Create Task
Maniphest T131012

SVGs without XML prolog (<?xml ... ?>) served with Content-Type text/html from upload.wikimedia.org
Open, LowPublic
Actions

Description

Request context: Loading SVG as background image from this CSS file.

$ curl -I 'https://upload.wikimedia.org/wikipedia/commons/archive/c/c9/20160327111940!Ballot-sprite.svg'
HTTP/1.1 200 OK
Date: Sun, 27 Mar 2016 13:25:03 GMT
Content-Type: text/html
Connection: keep-alive
X-Object-Meta-Sha1base36: k1h4wypkf9tobg8qw2dymx0qab6s6on
Last-Modified: Sun, 27 Mar 2016 11:19:42 GMT
Etag: 8a196dc538b917f2153323c7e91bd8ca
X-Timestamp: 1459077581.66301
X-Trans-Id: txb8a16672748b4be7a5baf-0056f7df2e
X-Varnish: 3801160535, 3256140095, 2826967039
Via: 1.1 varnish, 1.1 varnish, 1.1 varnish
Age: 0
X-Cache: cp1062 miss(0), cp3037 miss(0), cp3035 frontend miss(0)
Strict-Transport-Security: max-age=31536000
Set-Cookie: WMF-Last-Access=27-Mar-2016;Path=/;HttpOnly;Expires=Thu, 28 Apr 2016 12:00:00 GMT
X-Analytics: https=1;nocookies=1
X-Client-IP: 91.218.200.230
Access-Control-Allow-Origin: *
Access-Control-Expose-Headers: Age, Date, Content-Length, Content-Range, X-Content-Duration, X-Cache, X-Varnish
Timing-Allow-Origin: *

Expected: Content-Type: image/svg+xml

Therefore, I can't use uploaded SVGs as background images for POTY. Firefox simply doesn't display it. It says an error occurred somewhere on some background property but the developer tools are currently broken and do not display the correct location (always show something in OOjs UI).

Related Objects
Search...

Event Timeline

Rillke created this task.Mar 26 2016, 10:50 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMar 26 2016, 10:50 PM
Rillke updated the task description. (Show Details)Mar 26 2016, 10:53 PM
Peachey88 added a project: MediaWiki-File-management.Mar 26 2016, 10:57 PM
Restricted Application added projects: Multimedia, Commons. · View Herald TranscriptMar 26 2016, 10:57 PM
Restricted Application added a subscriber: Steinsplitter. · View Herald Transcript
Peachey88 updated the task description. (Show Details)Mar 26 2016, 11:00 PM
Restricted Application added a subscriber: Matanya. · View Herald TranscriptMar 26 2016, 11:00 PM
matmarex subscribed.Mar 27 2016, 1:58 AM

I can reproduce:

$ curl -I https://upload.wikimedia.org/wikipedia/commons/c/c9/Ballot-sprite.svg
HTTP/1.1 200 OK
Date: Sun, 27 Mar 2016 01:55:57 GMT
Content-Type: text/html
Connection: keep-alive
X-Object-Meta-Sha1base36: k1h4wypkf9tobg8qw2dymx0qab6s6on
Last-Modified: Sat, 26 Mar 2016 22:19:52 GMT
Etag: 8a196dc538b917f2153323c7e91bd8ca
X-Timestamp: 1459030791.20288
X-Trans-Id: txef394c2f19eb4001ac440-0056f70b27
X-Varnish: 3427899152, 1369810714 1336490883, 2690276095 2690257490
Via: 1.1 varnish, 1.1 varnish, 1.1 varnish
Age: 12933
X-Cache: cp1050 miss(0), cp3049 hit(3), cp3035 frontend hit(1)
Strict-Transport-Security: max-age=31536000
Set-Cookie: WMF-Last-Access=27-Mar-2016;Path=/;HttpOnly;Expires=Thu, 28 Apr 2016 00:00:00 GMT
X-Analytics: https=1;nocookies=1
X-Client-IP: 91.218.200.230
Access-Control-Allow-Origin: *
Access-Control-Expose-Headers: Age, Date, Content-Length, Content-Range, X-Content-Duration, X-Cache, X-Varnish
Timing-Allow-Origin: *

But not for a different file:

$ curl -I https://upload.wikimedia.org/wikipedia/commons/2/28/Information.svg
HTTP/1.1 200 OK
Date: Sun, 27 Mar 2016 01:55:34 GMT
Content-Type: image/svg+xml
Connection: keep-alive
X-Object-Meta-Sha1base36: 69nihwcga0f31wljnlxxv0zcpikni5k
Last-Modified: Mon, 14 Oct 2013 22:22:12 GMT
Etag: 34ce71403dcf6c7b3e9e55a75b5d8e7b
X-Timestamp: 1381789331.37070
X-Trans-Id: txe690913510da4538b6af4-0056f5bf56
X-Varnish: 2887756974 2883147041, 2371719403 2091834454, 2690222811 2690184231
Via: 1.1 varnish, 1.1 varnish, 1.1 varnish
Age: 97856
X-Cache: cp1048 hit(1), cp3048 hit(8), cp3035 frontend hit(1)
Strict-Transport-Security: max-age=31536000
Set-Cookie: WMF-Last-Access=27-Mar-2016;Path=/;HttpOnly;Expires=Thu, 28 Apr 2016 00:00:00 GMT
X-Analytics: https=1;nocookies=1
X-Client-IP: 91.218.200.230
Access-Control-Allow-Origin: *
Access-Control-Expose-Headers: Age, Date, Content-Length, Content-Range, X-Content-Duration, X-Cache, X-Varnish
Timing-Allow-Origin: *
matmarex added a comment.Mar 27 2016, 2:01 AM

Your SVG image doesn't have an XML prolog (something like <?xml version="1.0" encoding="UTF-8" standalone="no"?>), such SVGs have confused various tools in the past (T61234). Perhaps something is mis-detecting the MIME type. Try adding it and see if that fixes it.

Krenair subscribed.Mar 27 2016, 2:23 AM
Rillke added a comment.EditedMar 27 2016, 11:30 AM
In T131012#2153604, @matmarex wrote:

Perhaps something is mis-detecting the MIME type. Try adding it and see if that fixes it.

Interesting. Thanks, this did it. Is this still considered an issue with the MIME type detection?

BTW, now one has to fetch an old version

$ curl -I https://upload.wikimedia.org/wikipedia/commons/archive/c/c9/20160327111940!Ballot-sprite.svg

for reproducing.

matmarex added a comment.Mar 27 2016, 1:24 PM
In T131012#2153738, @Rillke wrote:

Interesting. Thanks, this did it. Is this still considered an issue with the MIME type detection?

I'd say it's still a bug. SVG files are allowed not to have the XML prolog (if they weren't, MediaWiki shouldn't allow you to upload one).

matmarex renamed this task from SVGs from upload.wikimedia.org served as content-type text/html to SVGs without XML prolog (<?xml ... ?>) served with Content-Type text/html from upload.wikimedia.org.Mar 27 2016, 1:26 PM
matmarex updated the task description. (Show Details)
matmarex edited projects, added Wikimedia-Apache-configuration, SRE; removed Commons, Multimedia, MediaWiki-File-management.Mar 27 2016, 1:28 PM

I'm not sure if this is an Apache configuration problem or what, I'm really using this to mean "The Servers" and hoping somebody can figure out what's producing the incorrect header. ;)

Krenair edited projects, added SRE-swift-storage; removed Wikimedia-Apache-configuration.Mar 27 2016, 2:01 PM

from upload? I don't think it can be apache

krenair@tin:~$ set +H
krenair@tin:~$ curl -I -H "Host: upload.wikimedia.org" "http://ms-fe.svc.eqiad.wmnet/wikipedia/commons/archive/c/c9/20160327111940!Ballot-sprite.svg"
HTTP/1.1 200 OK
Content-Length: 4159
X-Object-Meta-Sha1base36: k1h4wypkf9tobg8qw2dymx0qab6s6on
Accept-Ranges: bytes
Last-Modified: Sun, 27 Mar 2016 11:19:42 GMT
Etag: 8a196dc538b917f2153323c7e91bd8ca
X-Timestamp: 1459077581.66301
Content-Type: text/html
Access-Control-Allow-Origin: *
X-Trans-Id: tx11949a4f60ee45869ddbc-0056f7e726
Date: Sun, 27 Mar 2016 13:59:02 GMT
BBlack added a subscriber: fgiunchedi.Mar 27 2016, 4:12 PM
faidon edited projects, added MediaWiki-File-management; removed SRE-swift-storage, SRE.Mar 27 2016, 4:38 PM
faidon subscribed.

Swift just serves whatever Content-Type it was set to the object when it was uploaded to it by MediaWiki — it never performs any content sniffing. For that file above, this was indeed set to text/html:

root@ms-fe1001:~# swift stat wikipedia-commons-local-public.c9 'archive/c/c9/20160327111940!Ballot-sprite.svg'
       Account: AUTH_mw
     Container: wikipedia-commons-local-public.c9
        Object: archive/c/c9/20160327111940!Ballot-sprite.svg
  Content Type: text/html
Content Length: 4159
 Last Modified: Sun, 27 Mar 2016 11:19:42 GMT
          ETag: 8a196dc538b917f2153323c7e91bd8ca
Meta Sha1Base36: k1h4wypkf9tobg8qw2dymx0qab6s6on
 Accept-Ranges: bytes
   X-Timestamp: 1459077581.66301
    X-Trans-Id: txe252e85f575840e2868d2-0056f80bf0
Restricted Application added a project: Multimedia. · View Herald TranscriptMar 27 2016, 4:38 PM
matmarex added a subscriber: aaron.Mar 27 2016, 8:52 PM
matmarex added a comment.Mar 27 2016, 9:57 PM

Ugh… apparently SwiftFileBackend does its own MIME type detection from scratch, instead of using the type that MediaWiki already knows. (This is new as of de290cd02db7150549da5cc66c9af3de6933a68b.)

  • SwiftFileBackend::doCreateInternal() and SwiftFileBackend::doStoreInternal() both call FileBackendStore::getContentType()
  • FileBackendStore::getContentType() uses either:
    • $this->mimeCallback, if present, which AFAICS can only be set to FileBackendGroup::guessMimeInternal (in FileBackendGroup::get())
    • finfo_file() otherwise

As FileBackendGroup::guessMimeInternal() will normally just look at the file extension (if there is one), my guess is that something is causing mimeCallback to not be set, and the code using the finfo_file() fallback. I'm not sure if it's a bug in de290cd02db7150549da5cc66c9af3de6933a68b or some more recent change – @faidon, is it possible to ask Swift about the oldest SVG files with text/html content-type that it has?

matmarex added a comment.Mar 27 2016, 9:58 PM

And the finfo_file() fallback is definitely subpar, the last issue described in T61234 was probably fixed when we switched to HHVM (or recently when we upgraded to 5.5), but here's what I get locally with file 5.04:

$ file Ballot-sprite.svg
Ballot-sprite.svg: SVG Scalable Vector Graphics image

$ file "20160327111940!Ballot-sprite.svg"
20160327111940!Ballot-sprite.svg: HTML document text
matmarex mentioned this in T130513: BMP images are served with Content-Type: unknown/unknown.Mar 27 2016, 10:09 PM
faidon added a comment.Mar 28 2016, 4:04 AM
In T131012#2154137, @matmarex wrote:

@faidon, is it possible to ask Swift about the oldest SVG files with text/html content-type that it has?

There is no such operation, but container listings do list the content-type of the objects underneath them, which would avoid a (very expensive) stat call against each object. You'd basically need to write something to list all container shards for all projects and then filter on name (ending in .svg) and content-type. It wouldn't take much time to write and run but it won't be instant.

matmarex unsubscribed.Mar 29 2016, 5:15 PM
Rillke added a comment.May 10 2016, 9:55 AM

Something new:

https://upload.wikimedia.org/wikipedia/commons/c/c5/1929_wall_street_crash_graph.svg

Content-Type application/xml

Note the lack of +svg

Rillke added a parent task: T5593: [Epic] SVG client side rendering.May 10 2016, 9:56 AM
Danny_B subscribed.May 10 2016, 10:16 AM
In T131012#2279879, @Rillke wrote:

Something new:

https://upload.wikimedia.org/wikipedia/commons/c/c5/1929_wall_street_crash_graph.svg

Content-Type application/xml

Note the lack of +svg

There is no application/xml+svg MIME type, only image/xml+svg (or of course generic application/xml and text/xml)

Rillke added a comment.May 10 2016, 2:50 PM

Wrong or too generic MIME type causes browser not to render svgs in <img> tags.

Ricordisamoa subscribed.May 11 2016, 4:11 PM
MarkTraceur triaged this task as Medium priority.Dec 5 2016, 9:19 PM
MarkTraceur moved this task from Untriaged to Triaged on the Multimedia board.
matthiasmullie lowered the priority of this task from Medium to Low.Jun 27 2017, 1:54 PM
matthiasmullie raised the priority of this task from Low to Medium.
matthiasmullie moved this task from Triaged to Needs code review on the Multimedia board.
matthiasmullie moved this task from Needs code review to Next up on the Multimedia board.
TheDJ mentioned this in T155320: Implement strict mime type detection and media type inferring of audio/video files.Jun 28 2017, 11:04 AM
MarkTraceur lowered the priority of this task from Medium to Low.Aug 28 2017, 4:48 PM
MarkTraceur moved this task from Next up to Triaged on the Multimedia board.
BBlack mentioned this in T179787: upload.wikimedia.org reports wrong mimetype for svg.Nov 5 2017, 4:01 PM
zhuyifei1999 subscribed.Nov 5 2017, 8:50 PM
fgiunchedi mentioned this in T178849: Click on fullImageLink <a> for PDF on File: page no longer rendering in browser.Nov 6 2017, 9:45 AM
• MZMcBride subscribed.Jan 27 2018, 1:26 AM
Krenair mentioned this in T164047: Captchas sent with wrong mime type on beta.Mar 3 2018, 10:45 PM
Glrx mentioned this in T251702: SVG Translate shows misleading "Only SVG files are supported" error on SVG files without XML and DOCTYPE declarations.Apr 20 2021, 10:02 PM
RP88 subscribed.Aug 6 2021, 7:46 AM
Krzysiek_123456789 subscribed.Aug 6 2021, 12:26 PM
JoKalliauer mentioned this in T327446: SVG from 2016 without XML prolog (<?xml ... ?>) served with MIME-Type text/plain instead of image/svg+xml.Jan 19 2023, 8:38 PM
JoKalliauer subscribed.
LucasWerkmeister updated the task description. (Show Details)Jan 3 2024, 8:34 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL