Page MenuHomePhabricator
Paste P61631

Single letter tokens suffixed to article text in search
ActivePublic

Authored by EBernhardson on May 1 2024, 4:41 PM.
On https://en.wikipedia.org/wiki/Waiting_at_the_Royal the indexed `text` field is suffixed with `v t e v t e`. This creates single letter tokens that end up getting used by morelike. There is no immediately obvious reason for these tokens from looking at the rendered webpage, likely something in the parser html -> plaintext conversion is incorrect.