Temporarily unassign 'transcode-reset' user right from Commons autoconfirmed and sysop groups
Closed, DeclinedPublic
Actions

Assigned To

Authored By

	zhuyifei1999
	Jan 6 2017, 1:34 AM

Description

Due to abusive transcode resets, the queue has increased from low 2k+ the day before yesterday, to 2800+ yesterday, then 3100+ now.

Many of the transcodes will run for 8 hours for nothing, as they will fail due to timeout.

The issue was discussed on IRC and I issued a note at T153488#2920246. However the increase in queue did not stop. @Dereckson said there are no server logs to check to find out who's doing this. As a short term measure, the right shall be unassigned to prevent further abuse.

For emergency uses, the right shall be kept for confirmed user group. Admins can assign the group to themselves or other users in emergency.

Details

	Subject	Repo	Branch	Lines +/-
	Unassign 'transcode-reset' from Commons autoconfirmed and sysop groups	operations/mediawiki-config	master	+4 -0

Customize query in gerrit

Related Objects
Search...

Status	Assigned	Task
Duplicate	None	T153357 Please upload large file to Wikimedia Commons
Duplicate	None	T153137 Please upload large file to Wikimedia Commons
Duplicate	None	T153136 Please upload large file to Wikimedia Commons
Duplicate	None	T152969 Please upload large file to Wikimedia Commons
Duplicate	None	T152943 Please upload large file to Wikimedia Commons
Resolved	Dereckson	T152938 Server side upload for Jasonanaggie
Resolved	Dereckson	T153572 Please upload large file to Wikimedia Commons
Resolved	Dereckson	T153809 Server side upload for Jasonanaggie
Resolved	Dereckson	T153931 Please upload large file to Wikimedia Commons
Declined	Dereckson	T152942 Please upload large file to Wikimedia Commons
Resolved	Dereckson	T154101 Server side upload for Jasonanaggie
Resolved	Dereckson	T154102 Server side upload for Sporti
Resolved	hoo	T154186 Certain videos on Commons do not start at all or have interruptions
Resolved	Revent	T153488 Commons video transcoders have over 6500 tasks in the backlog.
Declined	Dereckson	T154733 Temporarily unassign 'transcode-reset' user right from Commons autoconfirmed and sysop groups

Event Timeline

zhuyifei1999 created this task.Jan 6 2017, 1:34 AM

Change 330835 had a related patch set uploaded (by Zhuyifei1999):
Unassign 'transcode-reset' from Commons autoconfirmed and sysop groups

https://gerrit.wikimedia.org/r/330835

gerritbot added a project: Patch-For-Review.Jan 6 2017, 1:48 AM

@Dereckson said he will take care of SWAT.

zhuyifei1999 added a project: Wikimedia-Site-requests.Jan 6 2017, 2:08 AM

Dzahn unsubscribed.Jan 6 2017, 2:17 AM

(For the record, this has been announced by @Revent at Village Pump)

zhuyifei1999 mentioned this in T154737: Add entries to Special:Log regarding use of transcode resets.Jan 6 2017, 3:24 AM

Dereckson moved this task from Backlog to To deploy on the Wikimedia-Site-requests board.Jan 6 2017, 4:19 AM

So what is going on with the transcoding servers? I went to the page to see what is transcoding and it seems to be halted from taking anything from the queue.

In T154733#2925417, @Jasonanaggie wrote:

So what is going on with the transcoding servers?

Possible side effect of T154780

For how long is this planned to be in operation?

@Jasonanaggie There are other issues with the special page not correctly showing some tasks that are actually 'running'. Transcodes are being run, and the queue is going down noticeably, it's just that a significant number of the remaining ones are multi-GB files.

@tomasz I think that it's important to prevent anything but 'new uploads' being thrown in the queue at least until it's actually completely caught up, and it's hard to estimate because it will depend on just how long the remaining ones take to be run. The queue is now down to 1393 transcodes, but it's also effectively been sorted by all this to many of the worst 'time intense' transcodes.... I have seen probably close to a dozen in there that are over 3GB in size. They will probably fail, but they need time to do so to get out the the queue.

None of this will help much, however, if we merely re-enable the ability for huge numbers of transcodes to just be thrown back in again.

@Dereckson When do you think this can be deployed?

Queue seems to be clear now. If the button does not get abuse again in a few days, feel free to close this as declined.

Please reopen if needed. T154737: Add entries to Special:Log regarding use of transcode resets is the long-term solution.

Change 330835 abandoned by Dereckson:
Unassign 'transcode-reset' from Commons autoconfirmed and sysop groups

Reason:
Not needed anymore.