nadezhda.durova wrote:

Example: http://durova.blogspot.com/2009/10/good-news-about-booker-t-washington.html

Other examples available upon request.

Should be pretty trivial to add a new userright that's not subject to the size checking limits, or is subject to a higher limit.

New groups can easily be added to WMF config once the right exists.

Does anyone have any idea if such a usergroup is going to be created in a foreseeable future?

I've been uploading many videos to the Commons in the past few months, and asking a developer every time and wasting his time to deal with Bugzilla bugs hasn't been very handy.

This would make much more sense once chunked uploading is introduced and uploading such large files over HTTP(S) is actually technically feasible.

rd232 wrote:

Question: if upload-by-url is enabled (Bug 20512 - Enable $wgAllowCopyUploads (upload by URL)), would it make sense to allow users with access to upload-by-url to upload large files by URL? Server-to-server uploads ought to be stable enough for large files.

#1 upload-by-url will only work within the MW-cluster
#2 chunked upload was buggy; is it fixed now?

Known problems with chunked upload have been fixed; we've got an opt-in option ready to go soon to test it in production.

Beware that currently, chunked uploads will only work in reasonably recentish WebKit and Mozilla-based browsers [there's a tweak in review which also makes it work on IE 10].

It might be nice to be able to cap the number of such uploads by a given user in some short period of time, not because we want to keep out such material, but so that we can manage capacity if this suddenly becomes a popular feature. For the initial rollout it shouldn't be a deal-breaker.

(In reply to comment #8)

It might be nice to be able to cap the number of such uploads by a given user
in some short period of time, not because we want to keep out such material,
but so that we can manage capacity if this suddenly becomes a popular feature.
For the initial rollout it shouldn't be a deal-breaker.

The User::pingLimiter function should probably make this easy enough to do

(In reply to comment #7)

Beware that currently, chunked uploads will only work in reasonably recentish WebKit and Mozilla-based browsers

I am using the API. Does it mean I can't compose the multi-part message myself? Do I have to set the User-Agent to mozilla when using my personal implementation? I don't think so -- it's just for users using UpWiz, right?

BTW: A bit more documentation on how to use that feature (e.g. what parameters are required or recommended initially, with each chunk and finally and what possible responses, I have to expect) would be nice; not only for me - finally I got it working - but for all who want to improve their upload bots.

I would suggest against a cap, at least for bots. It can be the case where the bot has a large freely licensed video archive to copy to commons.

For instance LOC probably has a fair number of war-era videos that could be processed and uploaded in bulk.

Just my 2 cents.

(In reply to comment #10)

(In reply to comment #7)

Beware that currently, chunked uploads will only work in reasonably recentish WebKit and Mozilla-based browsers

I am using the API. Does it mean I can't compose the multi-part message myself?

If you're an API user, then you can construct your requests however you wish -- chunked upload capabilities simply exist in the API and you can use them at any time.

The limitation is in the UploadWizard front-end, which needs to know it has support for a version of Blob.slice() that acts as expected. (Ideally it would detect this by trying it, rather than checking browser engine versions.)

BTW: A bit more documentation on how to use that feature (e.g. what parameters
are required or recommended initially, with each chunk and finally and what
possible responses, I have to expect) would be nice; not only for me - finally
I got it working - but for all who want to improve their upload bots.

Documentation would be nice, yes. :) I'll see if I can find or improve some...

Adding docs here:
https://www.mediawiki.org/wiki/API:Upload#Chunked_uploading

So there is no upload limit if one uses the API?

(In reply to comment #14)

So there is no upload limit if one uses the API?

No, the same limits apply, but the API allows chunked uploading (upload the file in smaller chunks that are recombined server-side. There is now an experimental preference that you can enable that will make UploadWizard use chunked uploading as well. There is no support for chunked uploading in Special:Upload.

For this bug, we would add a new user right that allows users to upload large (define large? up to 1 GB?) files. Chunked upload is the only way to upload files larger than 100MB, that's why the two are linked. Now that chunked upload seems to be working and deployed (experimentally, but still), that's something we could work on.

I'd say 4.5GB (the size of a DVD) as I am trying to put in a 1.4GB file (video) already.

Also a progress bar would be more than helpful.

I'd support a 4.5 GB limit. That's more than sufficient for the videos I'm trying to upload. Also, anyone interested in this bug should take notice of https://bugzilla.wikimedia.org/show_bug.cgi?id=36829. Chunked uploads with Upload Wizard chokes up on files >300mb

By the way, the user by default now can upload <= 500 Mb files, instead 100 Mb at bug opening.

• Bug 36687 has been marked as a duplicate of this bug. ***

Adding bug 35925 (tracking), isn't hard to found book digitizations larger than the current upload limit

(In reply to 555 from comment #20)

Adding bug 35925 (tracking), isn't hard to found book digitizations larger
than the current upload limit

Not to mention video, where only a few minutes of 1080p HD quickly exceeds 1GB

Which actual problem is this task about nowadays? Uploading files bigger than 1 GiB (because https://commons.wikimedia.org/wiki/Help:Server-side_upload that's possible nowadays)?

Also see T76614: Raise max upload limit above 1GB which is related.