The Python version of the recommendation API uses navigation vectors to compute cosine similarity between Wikidata items. In order to do so, a big matrix (over a GB in size) needs to sit in memory and be used for computation. We can do better and pre-compute consine similarities and serve them from a database. This helps us get rid of the second instance of the recommendation API service and use the first instance for serving both translation and related articles based recommendations. We can later use the pre-computed data in the JS version of the recommendation API once T193746 is resolved.
Description
Description
Related Objects
Related Objects
Status | Subtype | Assigned | Task | ||
---|---|---|---|---|---|
Declined | None | T193748 Pre compute consine similarity of Wikidata items from navigation vectors | |||
Declined | None | T193751 Generate fresh set of navigation vectors |
- Mentioned Here
- T193746: Create abstraction for services to access database
Event Timeline
• Vvjjkkii renamed this task from Pre compute consine similarity of Wikidata items from navigation vectors to fpdaaaaaaa.Jul 1 2018, 1:12 AM2018-07-01 01:12:12 (UTC+0)
CommunityTechBot renamed this task from fpdaaaaaaa to Pre compute consine similarity of Wikidata items from navigation vectors.Jul 1 2018, 7:19 AM2018-07-01 07:19:15 (UTC+0)
CommunityTechBot raised the priority of this task from High to Needs Triage.Jul 3 2018, 2:06 AM2018-07-03 02:06:18 (UTC+0)
leila edited projects, added Research-Freezer; removed Research.Jul 11 2019, 3:39 PM2019-07-11 15:39:24 (UTC+0)