Page MenuHomePhabricator

Decrease processMediaModeration job concurrency
Closed, ResolvedPublic

Description

Currently if a large enough batch of images is scanned we can hit PhotoDNA rate limits. We need to decrease the concurrency of the processMediaModeration job to low enough value that we'd be able to avoid rate limits.

Event Timeline

Change 615572 had a related patch set uploaded (by Ppchelko; owner: Ppchelko):
[operations/deployment-charts@master] Limit concurrency for processMediaModeration job

https://gerrit.wikimedia.org/r/615572

Change 615572 merged by jenkins-bot:
[operations/deployment-charts@master] Limit concurrency for processMediaModeration job

https://gerrit.wikimedia.org/r/615572

Deployed. Verified the ratelimit is not hit anymore with big continuous batch scans.