Page MenuHomePhabricator

[DeepCat] Investigate CirrusSearch limits and how to raise them
Closed, ResolvedPublic3 Estimated Story Points

Event Timeline

KasiaWMDE raised the priority of this task from to Medium.
KasiaWMDE updated the task description. (Show Details)
KasiaWMDE set Security to None.
KasiaWMDE edited a custom field.
KasiaWMDE moved this task from Incoming to Sprint ready on the German-Community-Wishlist board.

Results of the investigation:
Limits on Cirrus/Elastic side (from https://github.com/wmde/DeepCat-Gadget/issues/13#issuecomment-111508131):

  • $wgCirrusSearchMaxIncategoryOptions, which limits the categories per incategory: invocation (i.e. per deepcat: keyword invocation). This is currently set to 100 in CirrusSearch.php. Changing it would involve another patch to Cirrus.
  • The number of subcategories which can be handled by Cirrus and Elastic with good performance. This is a soft limit we have to figure out by testing, probably also have to talk to ops.
Tobi_WMDE_SW claimed this task.