Page MenuHomePhabricator

Backend work for cross-wiki search results: centralize document id and namespace generation
Closed, DeclinedPublic

Description

As part of the cross-wiki search results new functionality, we'll need to figure out how to centralize document id and namespace generation:

  • see T139496
  • primary keys are page IDs
    • will overlap between wikis
  • possible solution:
    • prefix IDs with wikiname (e.g., enwiki|12345)

Event Timeline

In our upcoming reindex of the cluster to support bm25 we could, before starting the reindex, turn on the flag that prefixes all doc id's with the prefix. This will give people some duplicate results while the reindex is running, but once it is complete we will be in a much better place to merge indices.

@dcausse thoughts?

After running the interwiki load test we decided merging indices was a premature optimization and this is no longer necessary.