Page MenuHomePhabricator

Add a second suggest field to the CirrusSearch mapping
Closed, ResolvedPublic

Description

We would like to AB test the did-you-mean phrase suggester with the default title/redirect.title configuration vs an extended configuration that also includes the opening_text. To facilitate we need to update CirrusSearch such that it creates a second field and populates it with the appropriate data.

AC:

  • Production search indices have two suggest fields, one of which is populated with opening_text data.

Event Timeline

Change #1159581 had a related patch set uploaded (by Ebernhardson; author: Ebernhardson):

[mediawiki/extensions/CirrusSearch@master] Add `suggest_variant` field

https://gerrit.wikimedia.org/r/1159581

Change #1159581 merged by jenkins-bot:

[mediawiki/extensions/CirrusSearch@master] Add `suggest_variant` field

https://gerrit.wikimedia.org/r/1159581

This will require a full-cluster reindex operation, which is actually pending for a number of reasons (various language analysis chain updates, regex trigram indexing changes, etc.)

Change #1162061 had a related patch set uploaded (by Ebernhardson; author: Ebernhardson):

[mediawiki/extensions/CirrusSearch@master] Limit suggest_variant to only opening_text

https://gerrit.wikimedia.org/r/1162061

Change #1162061 merged by jenkins-bot:

[mediawiki/extensions/CirrusSearch@master] Limit suggest_variant to only opening_text

https://gerrit.wikimedia.org/r/1162061

turns out we did not have this enabled when the recent reindex was run, will need to keep waiting on this.

Change #1180610 had a related patch set uploaded (by Ebernhardson; author: Ebernhardson):

[operations/mediawiki-config@master] cirrus: Enable phrase suggester variant

https://gerrit.wikimedia.org/r/1180610

Change #1180610 merged by jenkins-bot:

[operations/mediawiki-config@master] cirrus: Enable phrase suggester variant

https://gerrit.wikimedia.org/r/1180610

Mentioned in SAL (#wikimedia-operations) [2025-08-25T20:18:31Z] <ebernhardson@deploy1003> Started scap sync-world: Backport for [[gerrit:1154300|EventStream: Enable hive ingestion for wcqs-external.sparql-query (T391383)]], [[gerrit:1180610|cirrus: Enable phrase suggester variant (T397083)]]

Mentioned in SAL (#wikimedia-operations) [2025-08-25T20:23:53Z] <ebernhardson@deploy1003> ebernhardson: Backport for [[gerrit:1154300|EventStream: Enable hive ingestion for wcqs-external.sparql-query (T391383)]], [[gerrit:1180610|cirrus: Enable phrase suggester variant (T397083)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

Mentioned in SAL (#wikimedia-operations) [2025-08-25T20:31:36Z] <ebernhardson@deploy1003> Finished scap sync-world: Backport for [[gerrit:1154300|EventStream: Enable hive ingestion for wcqs-external.sparql-query (T391383)]], [[gerrit:1180610|cirrus: Enable phrase suggester variant (T397083)]] (duration: 13m 04s)

Ran a reindex last week, can see now we have the suggest_variant field everywhere and should be ready to construct an AB test.

Gehel added a project: Essential-Work.