Page MenuHomePhabricator

Support dynamic rates for ChangeProp
Closed, DeclinedPublic

Description

The deduplication of the jobs in the new queue work better if there's some "reasonable" backlog in the queue, but the new queue is too fast for that. Reducing the concurrency statically is dangerous cause it can quickly explode the waiting time for the job and hard to figure out the right numbers.

It's better to make dynamic concurrencies to make it maintain a certain level of the backlog for better deduplication.

Event Timeline

Pchelolo triaged this task as Medium priority.Mar 1 2018, 9:13 PM
Pchelolo created this task.
Restricted Application added a project: Analytics. · View Herald TranscriptMar 1 2018, 9:13 PM
Restricted Application added a subscriber: Aklapper. · View Herald Transcript
fdans moved this task from Incoming to Radar on the Analytics board.Mar 5 2018, 5:33 PM
Pchelolo closed this task as Declined.Jul 31 2019, 9:39 PM

This is definitely overcomplication of the system.