Page MenuHomePhabricator

Reindex Bengali wikis to enable new analyzer
Closed, ResolvedPublic2 Estimated Story Points


Once T294067 is deployed (probably in MediaWiki_1.39/wmf.23), we can reindex the relevant wikis, to activate the new analyzer!

Current counts are: Bengali (7 wikis)

Acceptance Criteria

  • All wikis in the relevant languages are reindexed
  • A before-and-after analysis for each language's Wikipedia is provided

Event Timeline

TJones moved this task from Incoming to In Progress on the Discovery-Search (Current work) board.
TJones set the point value for this task to 2.

Reindexing is done. Write up on Mediawiki.

Summary: Bengali Wikipedia had a very high zero-results rate (49.0%), and introducing stemming (and other changes—but mostly stemming) provided results for about ⅐ of zero-results queries, lowering the zero-results rate to 42.3%—which is still very high, but definitely better.