Page MenuHomePhabricator

Backend work for cross-wiki search results: centralize document id and namespace generation
Closed, DeclinedPublic

Description

As part of the cross-wiki search results new functionality, we'll need to figure out how to centralize document id and namespace generation:

  • see T139496
  • primary keys are page IDs
    • will overlap between wikis
  • possible solution:
    • prefix IDs with wikiname (e.g., enwiki|12345)

Event Timeline

debt created this task.Sep 26 2016, 11:12 PM

In our upcoming reindex of the cluster to support bm25 we could, before starting the reindex, turn on the flag that prefixes all doc id's with the prefix. This will give people some duplicate results while the reindex is running, but once it is complete we will be in a much better place to merge indices.

@dcausse thoughts?

EBernhardson closed this task as Declined.Feb 2 2017, 9:57 PM

After running the interwiki load test we decided merging indices was a premature optimization and this is no longer necessary.