Page MenuHomePhabricator

dbenjaminmiller
User

Projects

User does not belong to any projects.

Today

  • No visible events.

Tomorrow

  • No visible events.

Wednesday

  • No visible events.

User Details

User Since
Sep 5 2018, 10:14 PM (375 w, 4 d)
Availability
Available
LDAP User
Unknown
MediaWiki User
D. Benjamin Miller [ Global Accounts ]

Recent Activity

May 5 2025

dbenjaminmiller closed T391158: Server-side upload request for D. Benjamin Miller as Resolved.
May 5 2025, 11:50 AM · Server-side-upload-request
dbenjaminmiller added a comment to T391158: Server-side upload request for D. Benjamin Miller.

Solved by update to MW.

May 5 2025, 11:49 AM · Server-side-upload-request
dbenjaminmiller added a comment to T391473: Common API upload failures with very large files.

Seems to work!

May 5 2025, 11:49 AM · MW-1.44-notes (1.44.0-wmf.27; 2025-04-29), MediaWiki-File-management, Commons, MediaWiki-Uploading

Apr 12 2025

dbenjaminmiller added a comment to T391755: Async upload by url should use a longer timeout.

The only thing I will mention on this is that archive.org, which is one of the main sources for URL-based uploading, can have slow (sometimes extremely slow) download times. So perhaps the download stage, when the size of the file has been announced by the host from which it is being downloaded, should be allowed to proceed until the download has completed (for async jobs).

Apr 12 2025, 9:57 PM · MediaWiki-Uploading

Apr 11 2025

dbenjaminmiller added a comment to T391473: Common API upload failures with very large files.

Even if the speed of the connection to IA had been unlimited (or there had been no timeout for that portion), wouldn't the operation still fail at the publication stage?

Apr 11 2025, 10:49 PM · MW-1.44-notes (1.44.0-wmf.27; 2025-04-29), MediaWiki-File-management, Commons, MediaWiki-Uploading
dbenjaminmiller added a comment to T391473: Common API upload failures with very large files.

@Bawolff To be clear, I first tried async publication, and only later tried a non-async to see if it would work. But async from stash is what I was trying multiple times and it just didn't work. I also tried async from archive.org, too, but (unsurprisingly) that didn't work either.

Apr 11 2025, 5:45 PM · MW-1.44-notes (1.44.0-wmf.27; 2025-04-29), MediaWiki-File-management, Commons, MediaWiki-Uploading

Apr 10 2025

dbenjaminmiller added a comment to T236446: Cloud Services shared IP (static NAT for external communications) often rate limited by YouTube for video downloads.

The notion that YouTube videos must be converted to a free format is a misconception. YouTube already prefers VP9/Opus in WebM as its delivery format. Also, YouTube Premium, though it allows downloading of videos, doesn't allow for them to be downloaded as files on the user's filesystem, whereas yt-dlp does. So those two points aren't material.

Apr 10 2025, 6:03 AM · cloud-services-team, Tool-spacemedia, Upstream, Cloud-VPS, video2commons
dbenjaminmiller added a comment to T353659: V2C should be integrated into MW.

The "according to the same reasoning almost everywhere" is doing a lot of work, because it is far from established that any other court (in a different country, with different laws) would necessarily come to the same conclusions.

Apr 10 2025, 5:48 AM · video2commons, Commons

Apr 9 2025

dbenjaminmiller added a comment to T391529: Spike test proposal: upload transformations/conversions.

I would suggest, by the way, that the original file be conserved on the server side, in part to allow for potential better re-encodes in the future (as well as release of the original, once the codecs are free).

Apr 9 2025, 9:12 PM · TimedMediaHandler-Transcode, MediaWiki-Uploading
dbenjaminmiller added a comment to T391473: Common API upload failures with very large files.

Btw, when this goes live (on Commons and on enwiki), can you let me know?

Apr 9 2025, 3:54 PM · MW-1.44-notes (1.44.0-wmf.27; 2025-04-29), MediaWiki-File-management, Commons, MediaWiki-Uploading
dbenjaminmiller added a comment to T353659: V2C should be integrated into MW.

@C.Suthorn, I think you're conflating two issues here (and this makes some sense, because V2C does two separate things which might be problamtic).

Apr 9 2025, 1:56 PM · video2commons, Commons
dbenjaminmiller added a comment to T391158: Server-side upload request for D. Benjamin Miller.

I also frequently get

Apr 9 2025, 6:17 AM · Server-side-upload-request
dbenjaminmiller added a comment to T391158: Server-side upload request for D. Benjamin Miller.

Anecdotally (from uploading some large videos), I find that somewhere between 4 and 5 GB, the failure rate goes from pretty low to ~100%. Like, I have no issue uploading a 3.85 GB video. I can't upload a 4.85 GB video. Basically, this is really just a problem when I am uploading my AV1 encodes of feature films, which can really benefit from getting as close to 5 GB as possible.

Apr 9 2025, 6:10 AM · Server-side-upload-request

Apr 8 2025

dbenjaminmiller added a comment to T391158: Server-side upload request for D. Benjamin Miller.

Another typical error:

Apr 8 2025, 10:23 PM · Server-side-upload-request
dbenjaminmiller added a comment to T391158: Server-side upload request for D. Benjamin Miller.

I've tried numerous times with the chunked uploader. I am able to get the files to upload to the stash perfectly reliably, but every attempt to get the file to publish (via async + MW API sandbox) fails. Always just fails at the publish stage. I've tried a bunch of times over the past few days, and so I'd hope that it would work, but I just couldn't get it to... I keep getting stashfailed timeouts when trying to publish. This is probably because these files are large (close to, but not above, the upload limit).

Apr 8 2025, 9:29 PM · Server-side-upload-request

Apr 5 2025

dbenjaminmiller created T391158: Server-side upload request for D. Benjamin Miller.
Apr 5 2025, 12:27 AM · Server-side-upload-request

Jan 2 2025

dbenjaminmiller added a comment to T357215: AV1 with film grain encoding causes ffmpeg crash due to memory leak.

It can't be using grain synth in the output, because it is encoding VP9 (and some other non-AV1 codecs), which doesn't have a grain synthesis feature like AV1.

Jan 2 2025, 4:42 PM · TimedMediaHandler-Transcode

Feb 16 2024

dbenjaminmiller added a comment to T257719: Add support for AVIF: allow uploading AVIF files to Wikimedia servers.

As a photographer who has a few thousand of his own photos on Commons: I'd support adding AVIF, and I would use it if available.

Feb 16 2024, 5:24 PM · Thumbor, Wikimedia-Site-requests

Feb 13 2024

dbenjaminmiller added a comment to T357215: AV1 with film grain encoding causes ffmpeg crash due to memory leak.

Might the issue be related to which decoder ffmpeg uses for AV1 (libdav1d or libaom-av1)? I've been using libaom-av1 for decode in the build of ffmpeg I'm using locally.

Feb 13 2024, 7:06 PM · TimedMediaHandler-Transcode
dbenjaminmiller added a comment to T357215: AV1 with film grain encoding causes ffmpeg crash due to memory leak.

Uploaded a 1-minute test file (AV1 with FGS). Video transcodes all error out (on both enwiki and commons).

Feb 13 2024, 6:53 PM · TimedMediaHandler-Transcode
dbenjaminmiller added a comment to T357215: AV1 with film grain encoding causes ffmpeg crash due to memory leak.

Yes, the film grain features of AV1 were used in encoding. I had no issue using ffmpeg with this clip on my local machine; could this be an issue in an older version of ffmpeg deployed on WMF servers?

Feb 13 2024, 4:31 PM · TimedMediaHandler-Transcode

Feb 12 2024

dbenjaminmiller added a comment to T357215: AV1 with film grain encoding causes ffmpeg crash due to memory leak.

Don't know if it is AV1 that is causing the issue, but for comparison, https://commons.wikimedia.org/wiki/File:The_Kid_(1921).webm is also an AV1 file (actually, both a larger file overall and with almost 5 times the bitrate) and it transcoded just fine (uploaded on January 12).

Feb 12 2024, 6:21 PM · TimedMediaHandler-Transcode

Feb 11 2024

dbenjaminmiller added a comment to T355031: Server-side upload request for D. Benjamin Miller.

Please add

Feb 11 2024, 5:37 PM · Internet-Archive, Server-side-upload-request, Wikimedia-Site-requests

Feb 10 2024

dbenjaminmiller created T357215: AV1 with film grain encoding causes ffmpeg crash due to memory leak.
Feb 10 2024, 8:10 PM · TimedMediaHandler-Transcode
dbenjaminmiller added a comment to T357200: Chunked uploads failing over and over.

For non-stash and async... here's an example of a failed upload (same error occurs whether the chunk size is large or small).

Feb 10 2024, 7:57 PM · MediaWiki-Uploading, Commons
dbenjaminmiller added a comment to T355031: Server-side upload request for D. Benjamin Miller.

Not sure such an upload would be fair use.

Feb 10 2024, 3:40 PM · Internet-Archive, Server-side-upload-request, Wikimedia-Site-requests
dbenjaminmiller added a comment to T355031: Server-side upload request for D. Benjamin Miller.

<edit> I added another file, but got it to upload myself after multiple tries.

Feb 10 2024, 7:56 AM · Internet-Archive, Server-side-upload-request, Wikimedia-Site-requests
dbenjaminmiller created T357200: Chunked uploads failing over and over.
Feb 10 2024, 7:55 AM · MediaWiki-Uploading, Commons

Feb 8 2024

dbenjaminmiller added a comment to T355031: Server-side upload request for D. Benjamin Miller.

To add:

Feb 8 2024, 8:35 PM · Internet-Archive, Server-side-upload-request, Wikimedia-Site-requests

Jan 16 2024

dbenjaminmiller updated the task description for T355031: Server-side upload request for D. Benjamin Miller.
Jan 16 2024, 2:42 AM · Internet-Archive, Server-side-upload-request, Wikimedia-Site-requests

Jan 15 2024

dbenjaminmiller created T355031: Server-side upload request for D. Benjamin Miller.
Jan 15 2024, 5:18 AM · Internet-Archive, Server-side-upload-request, Wikimedia-Site-requests

Jan 11 2024

dbenjaminmiller created T354901: Server-side upload request for D. Benjamin Miller.
Jan 11 2024, 7:52 PM · Internet-Archive, Server-side-upload-request, Wikimedia-Site-requests

Sep 5 2018

dbenjaminmiller updated the task description for T203614: Timidity++: burst of sound (I have the fix!).
Sep 5 2018, 10:22 PM · MediaWiki-extensions-Score
dbenjaminmiller created T203614: Timidity++: burst of sound (I have the fix!).
Sep 5 2018, 10:21 PM · MediaWiki-extensions-Score