Page MenuHomePhabricator
Create Task
Maniphest T261396

Add a link: engineering tasks for initial release
Closed, ResolvedPublic
Actions

Description

This is a parent task to collect engineering work related to the initial release.

Infrastructure notes: https://wikitech.wikimedia.org/wiki/Add_Link

Related Objects
Search...

StatusSubtypeAssignedTask
 ResolvedMMiller_WMFT252822 [EPIC] Growth: "add a link" structured task 1.0
 ResolvedkostajhT266437 Add a link engineering: backend product specifications
 ResolvedkostajhT261396 Add a link: engineering tasks for initial release
 DuplicateNoneT261399 Add a link engineering: Investigate adding a third mode to VisualEditor's read / edit modes
 DeclinedNoneT261401 Add a link: Set up link recommendation testing environment with Cloud VPS and existing notebook code
 ResolvedkostajhT258978 Service operations setup for Add a Link project
 ResolvedkostajhT265345 Calculate estimated requests per second to mwaddlink-query
 ResolvedTgrT261408 Add a link engineering: Maintenance script for retrieving, caching, and updating search index
 ResolvedkostajhT261411 Add a link engineering: Determine format for accessing and storing link recommendations
 ResolvedTgrT261410 Add a link engineering: Create MySQL table for caching link recommendations
 ResolvedTgrT261407 Add a link engineering: Create event for event gate to update search index after obtaining link recommendations
 ResolvedTgrT261409 Add a link engineering: update search index on page edit
 ResolveddcausseT273508 CirrusSearch should expose a function to reset its weighted_tags for a particular tag category
 ResolvedEBernhardsonT274583 Reload ORES data into weighted_tags
 ResolvedTgrT279128 Add a link engineering: exclude disambiguation pages
 DeclinedNoneT279130 Add a link engineering: exclude good and featured articles
 InvalidNoneT261412 Add a link engineering: Specify format for storing user feedback
 DeclinedNoneT261413 Add a link engineering: Handle nuances with FlaggedRevs
 ResolvedkostajhT259035 Add a link: Parsing challenges (input and output)
 ResolvedkostajhT265603 Add Link engineering: Link recommendation service setup
 ResolvedMGerlachT261403 Move dedcode/mwaddlink from github to gerrit
 ResolvedMGerlachT265605 Add Link engineering: Consolidate dedcode/addlink and mgerlach/mwaddlink-query into single repository
 ResolvedkostajhT265610 Add Link engineering: Convert mwaddlink to read/write to MySQL instead of SQLite
 ResolvedkostajhT268901 Add Link engineering: Remove linkmodel.json from tmp-folder after retraining/updating link recommendation model
 ResolvedkostajhT265893 Add Link engineering: Deployment Pipeline setup
 ResolvedkostajhT266110 Add Link engineering: Codehealth integration
 ResolvedkostajhT274491 xgboost fails to build, docker image is not published
 ResolvedkostajhT265894 Add Link engineering: Local environment setup
 ResolvedTgrT266490 Add Link engineering: Vagrant role
 ResolvedTgrT266737 Set up Python 3.7 on MediaWiki-Vagrant
 ResolvedkostajhT266540 Add Link engineering: Add HTTP API
 ResolvedkostajhT266826 Add Link engineering: Pipeline for moving MySQL database(s) from stats1008 to production MySQL server
 ResolvedTgrT267329 Add Link engineering: Output format for link recommendation format
 ResolvedkostajhT272419 Add Link engineering: Script for updating datasets used by the mwaddlink service
 ResolvedTgrT266443 Add Link engineering: On-wiki configuration
 ResolvedTgrT266446 Add Link engineering: Provide a mechanism for storing data about which link recommendations were rejected by the user
 ResolvedTgrT266473 Add Link engineering: Provide a mechanism for recording credit to a user if they review all link recommendations with "no" or "skip"
 DeclinedNoneT283537 Add a link: log when user skips all suggestions
 Resolved• RileychT266474 Add Link engineering: Edit tag for link recommendations tasks
 ResolvedTgrT277518 Add Links: edits from VE/source editor tagged as Suggested: add links
 ResolvedTgrT267179 Add a link engineering: MediaWiki API for retrieving recommendations
 ResolvedMarosteguiT267214 Add a link engineering: Database for link recommendation service
 ResolvedkostajhT267549 Add Link engineering: nltk punkt library not found
 ResolvedTgrT269366 Add Link engineering: Refactor task handling backend to make adding new task types easier
 ResolvedhnowlanT269581 Add Link engineering: Allow external traffic to linkrecommendation service
 ResolvedkostajhT276217 Use Envoy for making GET requests to lang.wikipedia.org/api.php
 ResolvedTgrT271604 Add a link: instance_occurrence should be based on plaintext, not wikitext
 ResolvedMGerlachT273664 run-pipeline.sh fails on larger wikis
 ResolvedTgrT275790 Add a link engineering: clean up old entries in growthexperiments_link_recommendations
 InvalidNoneT276436 Ensure MediaWiki sets the X-Request-Id header on linkrecommendation service requests, and mwaddlink includes it in its logs
 OpenkevinbaziraT276438 Establish processes for running the dataset pipeline
 ResolvedMGerlachT278679 Unable to run pipeline due to permissions errors
 ResolvedMGerlachT290067 Improve the documentation in the README of the mwaddlink-repo
 ResolvedkostajhT276768 Logstash dashboard for linkrecommendation service
 ResolvedkostajhT276769 Create Grafana dashboard for link recommendation service and document it on wikitech
 ResolvedkostajhT276795 Monitoring for GrowthExperiments link recommendation task pool
 ResolvedBUG REPORT• mewophT277228 VE plugin fails to load on desktop article target
 InvalidNoneT277270 Help panel CTA interferes with Add Link plugin
 OpenNoneT278103 Parallelize GrowthExperiments' refreshLinkRecommendations.php
 ResolvedTgrT278710 Add a link: production deployment
 ResolvedTgrT266913 Add a link engineering: create tables in Wikimedia production
 ResolvedTgrT278411 Statsd implementation of suggested edits task pool
 ResolvedTgrT278123 Provide capability for A/B testing task types
 DuplicateNoneT278130 Add a link: add hidden preference to allow opting in to link recommendation UX
 ResolvedkostajhT279037 Character encoding issues in MySQL anchor dictionaries for viwiki
 ResolvedMGerlachT279508 run-pipeline.sh fails for enwiki

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
kostajh removed subscribers: MMiller_WMF, MBinder_WMF, RHo and 11 others.Aug 27 2020, 12:09 PM
kostajh changed the status of subtask T261401: Add a link: Set up link recommendation testing environment with Cloud VPS and existing notebook code from Open to Stalled.Aug 27 2020, 12:22 PM
kostajh updated the task description. (Show Details)Aug 27 2020, 12:45 PM
kostajh added a subtask: T258978: Service operations setup for Add a Link project.Aug 27 2020, 1:02 PM
kostajh changed the status of subtask T261410: Add a link engineering: Create MySQL table for caching link recommendations from Open to Stalled.Sep 24 2020, 10:32 AM
kostajh added a subtask: T259035: Add a link: Parsing challenges (input and output).Sep 30 2020, 3:34 PM
kostajh changed the status of subtask T261398: Add a link engineering: Prototype the recommended link plugin in VisualEditor using phrase matching approach from Open to Stalled.Oct 13 2020, 10:49 AM
kostajh closed subtask T261401: Add a link: Set up link recommendation testing environment with Cloud VPS and existing notebook code as Declined.Oct 13 2020, 11:10 AM
kostajh closed subtask T259035: Add a link: Parsing challenges (input and output) as Resolved.Oct 15 2020, 1:36 PM
kostajh added a project: Add-Link.
kostajh removed a subtask: T261403: Move dedcode/mwaddlink from github to gerrit.Oct 15 2020, 1:38 PM
kostajh changed the status of subtask T261398: Add a link engineering: Prototype the recommended link plugin in VisualEditor using phrase matching approach from Stalled to Open.Oct 15 2020, 1:42 PM
MMiller_WMF renamed this task from Add a link: Engineering tasks for intial release to Add a link: ngineering tasks for intial release.Oct 19 2020, 3:44 AM
MMiller_WMF added subscribers: Etonkovidova, RHo, Trizek-WMF and 2 others.
MMiller_WMF renamed this task from Add a link: ngineering tasks for intial release to Add a link: engineering tasks for initial release.Oct 19 2020, 4:13 AM
kostajh edited parent tasks, added: T266437: Add a link engineering: backend product specifications; removed: T252822: [EPIC] Growth: "add a link" structured task 1.0.Oct 26 2020, 8:48 AM
kostajh closed subtask T261412: Add a link engineering: Specify format for storing user feedback as Invalid.Oct 26 2020, 2:12 PM
kostajh changed the status of subtask T261410: Add a link engineering: Create MySQL table for caching link recommendations from Stalled to Open.Oct 26 2020, 2:23 PM
kostajh changed the status of subtask T261409: Add a link engineering: update search index on page edit from Open to Stalled.Oct 26 2020, 2:33 PM
Etonkovidova closed subtask T261410: Add a link engineering: Create MySQL table for caching link recommendations as Resolved.Oct 30 2020, 11:52 PM
Tgr added a subtask: T266913: Add a link engineering: create tables in Wikimedia production.Oct 31 2020, 12:05 AM
Tgr changed the status of subtask T266913: Add a link engineering: create tables in Wikimedia production from Open to Stalled.
Tgr added a subtask: T267179: Add a link engineering: MediaWiki API for retrieving recommendations.Nov 4 2020, 6:38 AM
kostajh added a subtask: T267214: Add a link engineering: Database for link recommendation service.Nov 5 2020, 2:39 PM
kostajh closed subtask T267549: Add Link engineering: nltk punkt library not found as Resolved.Nov 16 2020, 6:22 PM
Etonkovidova closed subtask T267179: Add a link engineering: MediaWiki API for retrieving recommendations as Resolved.Nov 19 2020, 10:54 PM
MMiller_WMF closed subtask T261411: Add a link engineering: Determine format for accessing and storing link recommendations as Resolved.Nov 24 2020, 5:49 AM
Marostegui closed subtask T267214: Add a link engineering: Database for link recommendation service as Resolved.Dec 2 2020, 12:54 PM
Tgr closed subtask T261407: Add a link engineering: Create event for event gate to update search index after obtaining link recommendations as Resolved.Dec 2 2020, 9:07 PM
Tgr added a subtask: T269366: Add Link engineering: Refactor task handling backend to make adding new task types easier.Dec 3 2020, 3:58 PM
kostajh added a subtask: T269581: Add Link engineering: Allow external traffic to linkrecommendation service.Dec 7 2020, 1:38 PM
Tgr added a subtask: T271603: Add a link engineering: Recommendation version.Jan 9 2021, 3:25 AM
Tgr added a subtask: T271604: Add a link: instance_occurrence should be based on plaintext, not wikitext.Jan 9 2021, 3:31 AM
kostajh closed subtask T271604: Add a link: instance_occurrence should be based on plaintext, not wikitext as Resolved.Jan 18 2021, 2:43 PM
kostajh removed a subtask: T271603: Add a link engineering: Recommendation version.Jan 18 2021, 3:40 PM
Tgr closed subtask T261398: Add a link engineering: Prototype the recommended link plugin in VisualEditor using phrase matching approach as Resolved.Jan 22 2021, 8:34 AM
Tgr changed the status of subtask T261409: Add a link engineering: update search index on page edit from Stalled to Open.Feb 7 2021, 7:15 PM
MMiller_WMF added a subtask: T273664: run-pipeline.sh fails on larger wikis.Feb 12 2021, 3:59 AM
kostajh reopened subtask T267214: Add a link engineering: Database for link recommendation service as Open.Feb 15 2021, 4:45 PM
kostajh closed subtask T267214: Add a link engineering: Database for link recommendation service as Resolved.Feb 16 2021, 9:18 AM
kostajh closed subtask T265603: Add Link engineering: Link recommendation service setup as Resolved.Feb 16 2021, 12:08 PM
kostajh closed subtask T258978: Service operations setup for Add a Link project as Resolved.Feb 16 2021, 12:12 PM
kostajh edited projects, added Growth-Team (Sprint 0 (Growth Team)); removed Growth-Team.
kostajh moved this task from Incoming to Epics In Progress on the Growth-Team (Sprint 0 (Growth Team)) board.
Etonkovidova closed subtask T269366: Add Link engineering: Refactor task handling backend to make adding new task types easier as Resolved.Feb 17 2021, 11:22 PM
Tgr changed the status of subtask T266913: Add a link engineering: create tables in Wikimedia production from Stalled to Open.Feb 21 2021, 9:49 PM
Tgr changed the status of subtask T266913: Add a link engineering: create tables in Wikimedia production from Open to Stalled.Feb 23 2021, 2:27 PM
kostajh added a subtask: T275790: Add a link engineering: clean up old entries in growthexperiments_link_recommendations.Feb 26 2021, 8:48 AM
kostajh added a subtask: T276436: Ensure MediaWiki sets the X-Request-Id header on linkrecommendation service requests, and mwaddlink includes it in its logs.Mar 4 2021, 11:01 AM
kostajh added a subtask: T276438: Establish processes for running the dataset pipeline.Mar 4 2021, 11:17 AM
Tgr added a subtask: T276795: Monitoring for GrowthExperiments link recommendation task pool.Mar 8 2021, 3:17 PM
Tgr changed the status of subtask T266913: Add a link engineering: create tables in Wikimedia production from Stalled to Open.Mar 11 2021, 2:32 PM
Tgr changed the status of subtask T266913: Add a link engineering: create tables in Wikimedia production from Open to Stalled.Mar 11 2021, 9:26 PM
kostajh closed subtask T273664: run-pipeline.sh fails on larger wikis as Resolved.Mar 11 2021, 9:29 PM
kostajh added a subtask: T277270: Help panel CTA interferes with Add Link plugin.Mar 12 2021, 8:27 AM
kostajh closed subtask T277270: Help panel CTA interferes with Add Link plugin as Invalid.Mar 12 2021, 9:56 AM
kostajh closed subtask T269581: Add Link engineering: Allow external traffic to linkrecommendation service as Resolved.Mar 15 2021, 2:49 PM
Etonkovidova closed subtask T266443: Add Link engineering: On-wiki configuration as Resolved.Mar 16 2021, 12:29 AM
• Rileych closed subtask T266474: Add Link engineering: Edit tag for link recommendations tasks as Resolved.Mar 19 2021, 8:31 PM
kostajh added a subtask: T278103: Parallelize GrowthExperiments' refreshLinkRecommendations.php.Mar 22 2021, 10:28 AM
kostajh removed a subtask: T261400: Generic framework for implementing suggestions in VisualEditor.Mar 22 2021, 10:33 AM
kostajh closed subtask T276436: Ensure MediaWiki sets the X-Request-Id header on linkrecommendation service requests, and mwaddlink includes it in its logs as Invalid.Mar 22 2021, 10:42 AM
kostajh removed a subtask: T261398: Add a link engineering: Prototype the recommended link plugin in VisualEditor using phrase matching approach.Mar 22 2021, 10:49 AM
kostajh added a project: Epic.Mar 22 2021, 1:36 PM
kostajh moved this task from Backlog to Epics on the Add-Link board.
kostajh closed subtask T276769: Create Grafana dashboard for link recommendation service and document it on wikitech as Resolved.Mar 24 2021, 11:24 AM
kostajh closed subtask T276768: Logstash dashboard for linkrecommendation service as Resolved.Mar 24 2021, 11:55 AM
Tgr added a subtask: T278710: Add a link: production deployment.Mar 29 2021, 5:45 PM
Tgr removed a subtask: T266913: Add a link engineering: create tables in Wikimedia production.
MGerlach added a subtask: T279037: Character encoding issues in MySQL anchor dictionaries for viwiki.Apr 1 2021, 7:26 AM
kostajh changed the status of subtask T278710: Add a link: production deployment from Open to Stalled.Apr 6 2021, 7:42 AM
MGerlach added a subtask: T279508: run-pipeline.sh fails for enwiki.Apr 7 2021, 9:09 AM
MGerlach closed subtask T279508: run-pipeline.sh fails for enwiki as Resolved.Apr 8 2021, 10:08 AM
Etonkovidova closed subtask T277228: VE plugin fails to load on desktop article target as Resolved.Apr 9 2021, 3:56 PM
MBinder_WMF added a project: Growth-Team-Filtering.Apr 15 2021, 6:47 PM
• Rileych removed a project: Growth-Team-Filtering.Apr 20 2021, 4:41 PM
Etonkovidova closed subtask T279037: Character encoding issues in MySQL anchor dictionaries for viwiki as Resolved.Apr 27 2021, 12:11 AM
Etonkovidova closed subtask T275790: Add a link engineering: clean up old entries in growthexperiments_link_recommendations as Resolved.Apr 27 2021, 12:30 AM
Etonkovidova closed subtask T276795: Monitoring for GrowthExperiments link recommendation task pool as Resolved.Apr 27 2021, 12:33 AM
Tgr changed the status of subtask T278710: Add a link: production deployment from Stalled to Open.May 3 2021, 10:51 AM
• Rileych removed projects: Epic, Growth-Team (Sprint 0 (Growth Team)).May 4 2021, 1:29 PM
• Rileych subscribed.

Work is tracked under T252822.

Etonkovidova closed subtask T266473: Add Link engineering: Provide a mechanism for recording credit to a user if they review all link recommendations with "no" or "skip" as Resolved.May 7 2021, 8:15 PM
EBernhardson reopened subtask T261407: Add a link engineering: Create event for event gate to update search index after obtaining link recommendations as Open.May 24 2021, 3:36 PM
kostajh triaged this task as Medium priority.May 27 2021, 11:55 AM
kostajh closed this task as Resolved.Jun 7 2021, 7:27 AM
kostajh claimed this task.

We did the initial release, so I'm closing this task. cc @Rileych @MMiller_WMF

Etonkovidova closed subtask T278710: Add a link: production deployment as Resolved.Jun 15 2021, 12:22 AM
Tgr mentioned this in T288796: Add Image: backend tasks for initial release.Aug 13 2021, 6:13 AM
Gehel closed subtask T261407: Add a link engineering: Create event for event gate to update search index after obtaining link recommendations as Resolved.Aug 16 2021, 2:43 PM
kostajh closed subtask T261413: Add a link engineering: Handle nuances with FlaggedRevs as Declined.Sep 20 2021, 8:37 AM
Etonkovidova closed subtask T266446: Add Link engineering: Provide a mechanism for storing data about which link recommendations were rejected by the user as Resolved.Oct 19 2021, 12:14 AM
Etonkovidova closed subtask T261409: Add a link engineering: update search index on page edit as Resolved.Oct 28 2021, 10:40 PM
Etonkovidova closed subtask T261408: Add a link engineering: Maintenance script for retrieving, caching, and updating search index as Resolved.Oct 28 2021, 10:52 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL