Page MenuHomePhabricator
Create Task
Maniphest T169937

Services Q1 2017/18 goal: Begin migrating job queue processing to multi-DC enabled eventbus infrastructure.
Closed, ResolvedPublic
Actions

Description

Tracking task for our quarterly goal. See also https://www.mediawiki.org/wiki/Wikimedia_Technology/Goals/2017-18_Q1#Services.

Annual plan:
Program 8: Multi-datacenter support
Outcome 2: Backend infrastructure works reliably across data centers
Objective 1: Reliable, multi-DC job processing

Quarterly objective

Begin migrating job queue processing to multi-DC enabled eventbus infrastructure.

  • Implement ChangeProp deduplication and rate limiting.
  • Start migrating job queue use cases.

Related Objects
Search...

Event Timeline

• GWicke created this task.Jul 6 2017, 10:45 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJul 6 2017, 10:45 PM
• mobrovac added projects: User-Elukey, User-Joe.Jul 7 2017, 3:25 PM
• mobrovac added a project: SRE.
• Pchelolo added a subtask: T157088: [EPIC] Develop a JobQueue backend based on EventBus.Jul 11 2017, 5:10 PM
• Pchelolo created subtask T170296: End of July milestone: Begin migrating job queue processing to multi-DC enabled eventbus infrastructure..Jul 11 2017, 5:12 PM
• Pchelolo created subtask T170319: End of August milestone: Begin migrating job queue processing to multi-DC enabled eventbus infrastructure..Jul 11 2017, 8:07 PM
• Pchelolo closed subtask T170296: End of July milestone: Begin migrating job queue processing to multi-DC enabled eventbus infrastructure. as Resolved.Jul 28 2017, 7:37 PM
elukey moved this task from Backlog to Keep an eye on it on the User-Elukey board.Aug 4 2017, 3:09 PM
• GWicke triaged this task as Medium priority.Aug 8 2017, 5:51 PM
• GWicke mentioned this in T175206: 2017/18 Annual Plan Program 8: Multi-datacenter support.Sep 6 2017, 7:55 PM
• Pchelolo created subtask T175210: Select candidate jobs for transferring to the new infrastucture.Sep 6 2017, 8:02 PM
• GWicke mentioned this in T175213: 2017/18 Annual Plan Program 8: Multi-datacenter support, Q2 goals.Sep 6 2017, 8:06 PM
• Pchelolo created subtask T175316: Very large jobs posted by Wikidata.Sep 7 2017, 11:08 PM
• GWicke created subtask T175637: End of September milestone: Migrate first production use case.Sep 11 2017, 9:59 PM
• GWicke closed subtask T170319: End of August milestone: Begin migrating job queue processing to multi-DC enabled eventbus infrastructure. as Resolved.
• mobrovac closed subtask T175210: Select candidate jobs for transferring to the new infrastucture as Resolved.Sep 13 2017, 2:53 PM
• mobrovac reopened subtask T175210: Select candidate jobs for transferring to the new infrastucture as Open.Sep 14 2017, 1:18 PM
• Pchelolo closed subtask T175316: Very large jobs posted by Wikidata as Resolved.Sep 19 2017, 12:11 PM
• mobrovac closed subtask T175637: End of September milestone: Migrate first production use case as Resolved.Oct 23 2017, 2:55 PM
• mobrovac closed this task as Resolved.Oct 25 2017, 10:13 AM
• mobrovac removed a subtask: T157088: [EPIC] Develop a JobQueue backend based on EventBus.
• mobrovac added a parent task: T157088: [EPIC] Develop a JobQueue backend based on EventBus.
• mobrovac edited projects, added Services (done); removed Services (doing).
• mobrovac subscribed.

The objective has been achieved. Resolving.

• mobrovac removed a subtask: T175210: Select candidate jobs for transferring to the new infrastucture.Apr 4 2018, 7:26 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL