Page MenuHomePhabricator
Create Task
Maniphest T151844

Optimize phabricator repository updates
Closed, ResolvedPublic
Actions

Description

Phabricator repository polling has gotten really slow since we started importing all of refs/changes/* from gerrit.

It's gotten so bad that rMW and rOPUP are running for up to 2 minutes on iridium then immediately starting again because those repos are polled every 15 seconds.

This situation must improve.

Revisions and Commits

rPHAB Phabricator
ClosedD478 Drasticly improve performance when importing large repos

Related Objects

Event Timeline

mmodell created this task.Nov 29 2016, 6:44 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptNov 29 2016, 6:44 AM
mmodell claimed this task.Nov 29 2016, 6:44 AM
mmodell triaged this task as High priority.
mmodell added a revision: D478: Drasticly improve performance when importing large repos.
Paladox added a subscriber: Paladox.Nov 29 2016, 7:24 AM
gerritbot added a subscriber: gerritbot.Nov 29 2016, 7:33 AM

Change 324030 had a related patch set uploaded (by Paladox):
Revert "Update skin.json to manifest_version version 2"

https://gerrit.wikimedia.org/r/324030

gerritbot added a project: Patch-For-Review.Nov 29 2016, 7:33 AM

Change 324031 had a related patch set uploaded (by Paladox):
Revert "Update skin.json to manifest_version version 2"

https://gerrit.wikimedia.org/r/324031

Paladox added a comment.Nov 29 2016, 7:34 AM

Whoops sorry wrong task

Paladox edited projects, added Phabricator, Diffusion; removed Patch-For-Review.Nov 29 2016, 7:37 AM
Restricted Application added a subscriber: TerraCodes. · View Herald TranscriptNov 29 2016, 7:37 AM
Aklapper added a project: Performance Issue.Nov 29 2016, 9:42 AM
Stashbot added a subscriber: Stashbot.Nov 29 2016, 8:05 PM

Mentioned in SAL (#wikimedia-operations) [2016-11-29T20:05:17Z] <twentyafterfour> deploying D478 (refs T151844 )

mmodell closed this task as Resolved.Nov 29 2016, 8:05 PM
mmodell added a comment.Nov 29 2016, 8:13 PM

Nice, runtime of repository update rMW and repository update rOPUP in production reduced:

previously> 2 minutes
now< 1 minute
Content licensed under Creative Commons Attribution-ShareAlike 3.0 (CC-BY-SA) unless otherwise noted; code licensed under GNU General Public License (GPL) or other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL