Page MenuHomePhabricator

Update search experience by offering semantically related articles
Closed, ResolvedPublic

Description

At the moment, recommend.wmflabs.org tool and the article recommendation api give recommendations based on the morelike feature. We have tested some alternatives and we know we can improve the exploration experience by offering semantically related articles when a seed is provided. This task is to track the implementation of this feature.

Event Timeline

leila moved this task from Backlog to Next Up on the GapFinder board.
schana moved this task from Next Up to in-progress on the GapFinder board.

I'm working on bringing over the new functionality from https://github.com/ewulczyn/wiki-readmore into its own recommendation type, tentatively 'semantic' (just a placeholder - can be changed to whatever fits best).

Change 326058 had a related patch set uploaded (by Nschaaf):
Add related articles recommendation type

https://gerrit.wikimedia.org/r/326058

I'm trying to surface this at recommend-related-articles-test.wmflabs.org . Once it's more stable we can start to get the plumbing in place between translation recommendations and related-articles

Change 326411 had a related patch set uploaded (by Nschaaf):
Update wheels for related articles

https://gerrit.wikimedia.org/r/326411

Change 326411 merged by Nschaaf:
Update wheels for related articles

https://gerrit.wikimedia.org/r/326411

Change 326058 merged by jenkins-bot:
Add related articles recommendation type

https://gerrit.wikimedia.org/r/326058

Change 326903 had a related patch set uploaded (by Nschaaf):
Use related-articles in translation recommendation

https://gerrit.wikimedia.org/r/326903

Change 326903 merged by jenkins-bot:
Use related-articles in translation recommendation

https://gerrit.wikimedia.org/r/326903

Using the embedding (is this the right terminology?) from here takes about 5 minutes to ingest when starting up the uwsgi process before recommendations can be served. This is now operational.

Change 333122 had a related patch set uploaded (by Nschaaf):
Speed up loading the embedding and chunking wikidata queries

https://gerrit.wikimedia.org/r/333122

Change 333122 merged by jenkins-bot:
Speed up loading the embedding and chunking wikidata queries

https://gerrit.wikimedia.org/r/333122