Page MenuHomePhabricator
Create Task
Maniphest T350185

Estimate cirrus streaming updater's usage of MWAPI
Closed, InvalidPublic
Actions

Description

The current Search Update pipeline [FIXME:link to diagram] uses about 1/2 of the capacity of the JobRunners . When we deploy the new Search Update Pipeline, we'll be hitting the mw-api-int-async-ro API instead. Per T342252 , cirrus-streaming updater will access the mwapi through mw-on-k8s. As mentioned in the linked ticket, we need to estimate the number of rps the cirrus streaming updater will use. (See this dashboard for an example of a similar flink app causing 20x RPS increase during its backfill).

Creating this ticket to:

  • Estimate the number of RPS the streaming updater will use.
  • Determine if there are other important usage metrics (payload size?) and estimate these as well.

Related Objects
Search...

Event Timeline

bking created this task.Oct 31 2023, 6:57 PM
bking updated the task description. (Show Details)Oct 31 2023, 7:12 PM
bking updated the task description. (Show Details)Oct 31 2023, 7:28 PM
bking updated the task description. (Show Details)Oct 31 2023, 9:19 PM
bking added a comment.Nov 1 2023, 2:40 PM

Met with @pfischer today about this topic. He pointed out that we're doing a phased rollout (gradually increasing the number of wikis) , so we'll be able to estimate our resource usage much more clearly then.

As such, I'm removing the "current work" tag and we'll revisit this as we get closer to rollout.

bking edited projects, added Discovery-Search; removed Discovery-Search (Current work).Nov 1 2023, 2:43 PM
bking updated the task description. (Show Details)
Gehel triaged this task as High priority.Nov 3 2023, 10:29 AM
Gehel moved this task from Incoming to Ready for Work on the Data-Platform-SRE board.
Gehel edited projects, added Discovery-Search (Current work); removed Discovery-Search.Nov 3 2023, 10:33 AM
Gehel moved this task from Incoming to Blocked/Waiting on the Discovery-Search (Current work) board.
bking updated the task description. (Show Details)Nov 8 2023, 7:39 PM
bking closed this task as Invalid.Nov 8 2023, 8:28 PM
bking moved this task from Ready for Work to Done on the Data-Platform-SRE board.

Upon further review, I'm declining this as invalid. We do need to track resource usage, but that shouldn't be limited to MWAPI. Other resource-related issues will turn up as we roll out in staging (T347075) and test a backfill (T350826) , so we can add new subtasks off these tickets as needed.

bking removed projects: Discovery-Search (Current work), serviceops-radar.Nov 8 2023, 8:28 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits