Page MenuHomePhabricator

End of July milestone: Begin migrating job queue processing to multi-DC enabled eventbus infrastructure.
Closed, ResolvedPublic

Description

  • T163379 Create JobQueue implementation that posts to EventBus - DONE
  • T163380 Support posting Jobs to EventBus simultaneously with normal job processing - DONE
  • T157090 Generalise deduplication in ChangeProp - PR in review

Event Timeline

Pchelolo created this task.Jul 11 2017, 5:12 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJul 11 2017, 5:12 PM
Pchelolo renamed this task from End of July milestone to End of July milestone: Begin migrating job queue processing to multi-DC enabled eventbus infrastructure..Jul 11 2017, 5:13 PM
Pchelolo updated the task description. (Show Details)Jul 11 2017, 8:03 PM
Pchelolo updated the task description. (Show Details)Jul 28 2017, 7:35 PM

Overall I would say the milestone have been achieved. The new implementation of the JobQueueEventBus has been merged, duplicated job processing is being tested in labs and to be deployed to group0 wikis next week. The generalized reduplication in change-prop is under the review here https://github.com/wikimedia/change-propagation/pull/197

Pchelolo closed this task as Resolved.Jul 28 2017, 7:37 PM