Page MenuHomePhabricator
Create Task
Maniphest T112245

[Task] Configure wikidata.org to rely on the wb_changes_subscription table for dispatching.
Closed, ResolvedPublic
Actions

Description

Currently, wikidata.org is configured to use hybrid dispatch mode (we have 'subscriptionLookupMode' => 'subscriptions+sitelinks' in the settings). Since T110339 is now closed, we should switch to using only the new subscription table, by setting 'subscriptionLookupMode' => 'subscriptions' in the settings.

This alone should improve performance, but more importantly, it allows us to work towards a completely new and more efficient filtering process for dispatching, see T110528.

Details

SubjectRepoBranchLines +/-
Switch dispatcher subscriptionLookupMode to subscriptions onlyoperations/mediawiki-configmaster+0 -6
Customize query in gerrit

Related Objects
Search...

StatusSubtypeAssignedTask
 InvalidNoneT108944 [Epic] Improve change dispatching
 InvalidNoneT110528 [Task] Use JOIN to find changes relevant for a given wiki
 ResolvedhooT118265 Remove sitelinks and subscriptions+sitelinks lookup modes in change dispatcher
 ResolvedaudeT112245 [Task] Configure wikidata.org to rely on the wb_changes_subscription table for dispatching.
 ResolvedNoneT110339 [Task] Deploy usage tracking on all client wikis on the Wikimedia cluster
 ResolvedaudeT107999 [Task] Enable Phase 2 for Wikibooks
 ResolvedNoneT98286 [Task] Deploy usage tracking and arbitrary access to zhwiki
 ResolvedLydia_PintscherT89002 multi-lingual label usage [Tracking]
 ResolveddanielT90563 Discuss: multi-lingual label usage tracking
 ResolveddanielT92288 Increase width of the eu_aspect column to allow inclusion of language codes.
 ResolveddanielT93055 Implement tracking of label use per parser target language
 ResolveddanielT93056 Include fallback languages in label tracking.
 ResolveddanielT93057 add eu_page_touched field to wbc_entity_usage_tracking
 ResolveddanielT93066 Investigate tracking update mechanism for "non-standard language" views.
 ResolveddanielT96373 Usage tracking update / purging on edit and re-parse (tracking)
 ResolvedNoneT96374 Track "touched" timestamp for each entry in the usage tracking table.
 InvaliddanielT99509 [Task] Ignore stale usage entries when processing changes
 ResolveddanielT99510 UsageTracking: Use LinksUpdateComplete hook instead ArticleEditUpdates
 ResolveddanielT99512 UsageTracking: Use new ParserCacheSaveComplete hook to track usage info.
 ResolveddanielT99513 UsageTracking: split the "update" operation for usage entries into "add" and "prune".
 ResolveddanielT99511 Introduce ParserCacheSave hook
 ResolveddanielT99693 UsageTracking: create integration test for usage tracking updates
 ResolveddanielT99774 Track usage in all namespaces, since arbitrary access allows data access from any page.
 ResolvedhooT101253 [RFC] How to track description usage
 DuplicateNoneT101280 Render labels in the user language on the client (via Lua or parser function), split parser cache
 ResolvedhooT75460 [Story] Make Lua functions default to the user's language on multilingual wikis
 ResolvedaudeT111142 Enable usage tracking on wikinews, wikibooks, and commons

Event Timeline

daniel created this task.Sep 11 2015, 10:06 AM
daniel raised the priority of this task from to Medium.
daniel updated the task description. (Show Details)
daniel added projects: Wikidata, Wikimedia-Site-requests, Wikidata.org.
daniel added subscribers: Ricordisamoa, JanZerebecki, Aklapper, daniel.
Restricted Application added a subscriber: Matanya. · View Herald TranscriptSep 11 2015, 10:06 AM
daniel updated the task description. (Show Details)Sep 11 2015, 10:07 AM
daniel set Security to None.
JanZerebecki renamed this task from Configure wikidata.org to rely on the wb_changes_subscription table for dispatching. to [Task] Configure wikidata.org to rely on the wb_changes_subscription table for dispatching..Sep 11 2015, 10:43 AM
JanZerebecki moved this task from incoming to ready to go on the Wikidata board.
daniel mentioned this in T118162: Wikibase dispatchChanges.php runs slow, creates an absurd amount of database connections.Nov 10 2015, 11:23 AM
aude added a subtask: T110339: [Task] Deploy usage tracking on all client wikis on the Wikimedia cluster.Nov 10 2015, 11:29 AM
gerritbot subscribed.Nov 10 2015, 11:32 AM

Change 252204 had a related patch set uploaded (by Aude):
Switch dispatcher subscriptionLookupMode to subscriptions only

https://gerrit.wikimedia.org/r/252204

gerritbot added a project: Patch-For-Review.Nov 10 2015, 11:32 AM
aude claimed this task.Nov 10 2015, 11:32 AM
aude edited projects, added Wikidata-Sprint-2015-11-03; removed Patch-For-Review.
aude moved this task from Proposed to Review on the Wikidata-Sprint-2015-11-03 board.
aude removed a subscriber: gerritbot.
aude mentioned this in T118265: Remove sitelinks and subscriptions+sitelinks lookup modes in change dispatcher.Nov 10 2015, 3:29 PM
aude added a parent task: T118265: Remove sitelinks and subscriptions+sitelinks lookup modes in change dispatcher.
gerritbot added a comment.Nov 10 2015, 4:43 PM

Change 252204 merged by jenkins-bot:
Switch dispatcher subscriptionLookupMode to subscriptions only

https://gerrit.wikimedia.org/r/252204

aude closed this task as Resolved.Nov 10 2015, 4:48 PM
aude moved this task from Review to Done on the Wikidata-Sprint-2015-11-03 board.
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits