Page MenuHomePhabricator

Add an Amazon AWS domain to wgCopyUploadsDomains whitelist
Closed, ResolvedPublic

Description

please add the following domain(s) to the wgCopyUploadsDomains whitelist: http://aws.amazon.com/s3/

I would like to use this cloud storage site as a source for images to upload to Wikimedia Commons using the GlamWikiToolset, which requires an URL as source. I am Wikipedian in special residence, presently at the Peace Palace Library at The Hague, to upload 4500 images to Wikimedia Commons. IT staff there suggested the Amazon-site.

Thanks!


Version: wmf-deployment
Severity: enhancement

Details

Reference
bz64053

Event Timeline

bzimport raised the priority of this task from to Normal.
bzimport set Reference to bz64053.
bzimport added a subscriber: Unknown Object (MLST).
hoo added a comment.Apr 19 2014, 3:43 PM

I don't think we really want to whitelist amazon's s3 as everyone can upload content to it and there are many non-free images on it (probably).

(In reply to Marius Hoch from comment #1)

I don't think we really want to whitelist amazon's s3 as everyone can upload
content to it and there are many non-free images on it (probably).

I had similar concerns. In any case, I think that's the wrong endpint for s3?

Please have your staff set up a CNAME from a more specific domain to a specific s3 bucket. Or else we can patch to allow filtering on path prefix in addition to domain name. But we'd still need to limit to a single bucket.

(The current examples at http://mediawiki.org/wiki/Manual:$wgCopyUploadsDomains don't filter on path)

(In reply to jeremyb from comment #2)

(In reply to Marius Hoch from comment #1)
> I don't think we really want to whitelist amazon's s3 as everyone can upload
> content to it and there are many non-free images on it (probably).

I had similar concerns. In any case, I think that's the wrong endpint for s3?

Please have your staff set up a CNAME from a more specific domain to a
specific s3 bucket. Or else we can patch to allow filtering on path prefix
in addition to domain name. But we'd still need to limit to a single bucket.

(The current examples at
http://mediawiki.org/wiki/Manual:$wgCopyUploadsDomains don't filter on path)

Would this suffice: wikipedian-in-residence.s3-website-eu-west-1.amazonaws.com
Example link
Test link:

http://wikipedian-in-residence.s3-website-eu-west-1.amazonaws.com/Wikipedian-in-Residence%20Sessie%202014-01-16/Tydsgn%20213%20051504510%20_MG_8631%20kleurenkaart.tif

Kind regards, hans muller ~~~~
(In reply to jeremyb from comment #2)

(In reply to Marius Hoch from comment #1)
> I don't think we really want to whitelist amazon's s3 as everyone can upload
> content to it and there are many non-free images on it (probably).

I had similar concerns. In any case, I think that's the wrong endpint for s3?

Please have your staff set up a CNAME from a more specific domain to a
specific s3 bucket. Or else we can patch to allow filtering on path prefix
in addition to domain name. But we'd still need to limit to a single bucket.

(The current examples at
http://mediawiki.org/wiki/Manual:$wgCopyUploadsDomains don't filter on path)

(In reply to jeremyb from comment #2)

(In reply to Marius Hoch from comment #1)
> I don't think we really want to whitelist amazon's s3 as everyone can upload
> content to it and there are many non-free images on it (probably).

I had similar concerns. In any case, I think that's the wrong endpint for s3?

Please have your staff set up a CNAME from a more specific domain to a
specific s3 bucket. Or else we can patch to allow filtering on path prefix
in addition to domain name. But we'd still need to limit to a single bucket.

(The current examples at
http://mediawiki.org/wiki/Manual:$wgCopyUploadsDomains don't filter on path)

Dear bureaucrats,

Something went wrong with my last post, so that it seems to be answeredalready (which is not the case)

  • Would the following domain suffice:
  • wikipedian-in-residence.s3-website-eu-west-1.amazonaws.com
  • ??

Test link:

http://wikipedian-in-residence.s3-website-eu-west-1.amazonaws.com/Wikipedian-in-Residence%20Sessie%202014-01-16/Tydsgn%20213%20051504510%20_MG_8631%20kleurenkaart.tif

Hope to hear from you, thank you, kind regards,

hans muller,
wikipedian in residence Peace Palace Library

Today I requested whitelisting of the domain of my institution peacepalacelibrary.nl in bug report 64372(https://bugzilla.wikimedia.org/show_bug.cgi?id=64372).

Approval of that request would make the present request 64053 obsolete.
Kind regards, hans muller

  • This bug has been marked as a duplicate of bug 64372 ***

Yeah, let's do it as 64372 then.