Page MenuHomePhabricator
Create Task
Maniphest T176445

Systematically test load speeds of Watchlist and Recent Changes
Closed, DeclinedPublic
Actions

Description

To get a handle on whether and how much the New Filters are slowing down Watchlist and Recent Changes, we will make tests and publish them to a wiki page.

Testing Plan

Results will be the average of 5 page loads
All tests to be performed

  1. for Recent Changes and Watchlist both
  2. with cold cache versus hot cache both
  3. On English Wikipedia (which, as the biggest, should show up any differences the most)

Test on old and new UX for comparison

  • Default filter sets (see below).
  • Default filter sets + "Experienced users", "Learners", "#Blanking" and ":User talk" (intended to see if adding more standard filters makes a difference).

Test new UX only

  • "Typical" ORES filter set" (see below)
  • "Rare" (slower) ORES filter set" (see below)

Results table example

To clarify the various tests involved, I prepared a results table that can be a model for how the results might be published.

Typical ORES filter set

https://en.wikipedia.org/wiki/Special:RecentChanges?hidebots=1&hidecategorization=1&hideWikibase=1&hidelog=1&highlight=1&limit=250&days=14&urlversion=2&damaging=maybebad&damaging__likelybad_color=c3&damaging__verylikelybad_color=c4&goodfaith__verylikelybad_color=c5

Rare ORES filter set (note short search period and low result limit)

https://en.wikipedia.org/wiki/Special:RecentChanges?hidebots=1&hidecategorization=1&hideWikibase=1&hidelog=1&highlight=1&limit=50&days=3&urlversion=2&damaging__verylikelybad_color=c4&damaging=likelybad&goodfaith=likelygood

Current Default Settings

The following are the pre-New Filters default preferences for RC and WL. The preferences here are described as they will be implemented in the New Filters UX, except for those that do not exist in the new UX and will continue to be presented on the Preferences page.

Recent Changes
  • 7 days, 50 results.
  • Active filters = Logged edits, page creations, page edits, human (not bot)
Watchlist ( existing defaults)
  • 3 days, 250 maximum results
  • Active filters: Latest revision, Logged edits, page creations, page edits. [Note: unlike RC page, “Human (not bot)” is NOT a default]
  • Active WL pref page options: "Add pages I create and files I upload to my watchlist", "Add new files I upload to my watchlist"

Related Objects
Search...

Event Timeline

• jmatazzoni created this task.Sep 21 2017, 10:10 PM
• jmatazzoni updated the task description. (Show Details)
• jmatazzoni removed Catrope as the assignee of this task.Sep 21 2017, 10:13 PM

@Catrope, you signed yourself up to create a way to turn off Live Update. Whoever is taking on this task should be able to get going without that, but please coordinate with whomever you assign.

Catrope added a comment.Sep 21 2017, 10:18 PM
In T176445#3625843, @jmatazzoni wrote:

@Catrope, you signed yourself up to create a way to turn off Live Update. Whoever is taking on this task should be able to get going without that, but please coordinate with whomever you assign.

I ended up convincing @SBisson to make that kill switch instead, because he was already going to touch other stuff in the LU area.

Catrope added a comment.Sep 21 2017, 10:19 PM

...and he's already done it: https://gerrit.wikimedia.org/r/#/c/379664/ . I will review shortly.

• jmatazzoni updated the task description. (Show Details)Sep 21 2017, 10:19 PM
IKhitron unsubscribed.Sep 21 2017, 10:48 PM
• jmatazzoni updated the task description. (Show Details)Sep 21 2017, 11:02 PM
• jmatazzoni added a comment.Sep 22 2017, 12:44 AM

Roan pointed out that turning Live Update off and on should not affect the different UIs differently, so that element has been removed from testing. If we think we need to test whether Live Update is slowing everything down. We'll have to make a time when we can do that for an entire site.

• jmatazzoni updated the task description. (Show Details)Sep 22 2017, 1:15 AM
mark added a project: SRE.Sep 22 2017, 9:41 AM
mark subscribed.
• jmatazzoni moved this task from Untriaged to Ready for Pickup on the Collaboration-Team-Triage (Collab-Team-This-Quarter) board.Sep 22 2017, 4:58 PM
• jmatazzoni mentioned this in T157642: Graduate New Filters UX out of beta on Recent Changes on ALL wikis.
Krinkle unsubscribed.Sep 22 2017, 6:07 PM
• jmatazzoni updated the task description. (Show Details)Sep 22 2017, 6:41 PM
• jmatazzoni updated the task description. (Show Details)Sep 22 2017, 8:28 PM
• jmatazzoni updated the task description. (Show Details)Sep 22 2017, 8:32 PM
• jmatazzoni mentioned this in T164489: Announce and follow up with communities about the New Filters for Recent changes by default deployment.Sep 22 2017, 9:29 PM
• jmatazzoni assigned this task to Catrope.Sep 25 2017, 5:16 PM
• jmatazzoni moved this task from Ready for Pickup to In Development on the Collaboration-Team-Triage (Collab-Team-This-Quarter) board.
Catrope mentioned this in T176652: Performance review of RCFilters feature.Sep 25 2017, 5:34 PM
• jmatazzoni reassigned this task from Catrope to • Mattflaschen-WMF.Sep 25 2017, 6:51 PM
• jmatazzoni added a parent task: T176652: Performance review of RCFilters feature.Sep 26 2017, 3:48 AM
• jmatazzoni reassigned this task from • Mattflaschen-WMF to Catrope.Sep 26 2017, 5:18 PM
• Mattflaschen-WMF added a project: Collaboration-Feature-Rollouts (Collaboration-WL-Graduated-Everywhere).Oct 3 2017, 12:42 AM
• Mattflaschen-WMF moved this task from Collaboration-WL-Graduated-Everywhere to Collaboration-RC-Graduated-Everywhere on the Collaboration-Feature-Rollouts board.Oct 3 2017, 1:37 AM
• Mattflaschen-WMF edited projects, added Collaboration-Feature-Rollouts (Collaboration-RC-Graduated-Everywhere); removed Collaboration-Feature-Rollouts (Collaboration-WL-Graduated-Everywhere).
• Mattflaschen-WMF moved this task from Collaboration-RC-Graduated-Everywhere to Collaboration-WL-Graduated-Everywhere on the Collaboration-Feature-Rollouts board.
• Mattflaschen-WMF edited projects, added Collaboration-Feature-Rollouts (Collaboration-WL-Graduated-Everywhere); removed Collaboration-Feature-Rollouts (Collaboration-RC-Graduated-Everywhere).
• jmatazzoni mentioned this in T176456: ORES on Watchlist causes big slowdown—especially with 'Last revision' filter turned on.Oct 12 2017, 9:13 PM
Etonkovidova subscribed.EditedOct 16 2017, 10:44 PM

enwiki (wmf.3) testing the 'Rare ORES filter set' test query: https://en.wikipedia.org/wiki/Special:RecentChanges?hidebots=1&hidecategorization=1&hideWikibase=1&hidelog=1&highlight=1&limit=50&days=3&urlversion=2&damaging__verylikelybad_color=c4&damaging=likelybad&goodfaith=likelygood

got [WeUxIQpAIDMAAF3faqwAAAAH] 2017-10-16 22:23:25: Fatal exception of type "Wikimedia\Rdbms\DBQueryTimeoutError"
Looking at the https://logstash.wikimedia.org/app/kibana#/dashboard/DBQuery?_g=h@44136fa&_a=h@3f5e6c9

reqId	   	WeUxIQpAIDMAAF3faqwAAAAH
server	   	en.wikipedia.org
shard	   	s1

SELECT  /*! STRAIGHT_JOIN */ rc_id,rc_timestamp,rc_user,rc_user_text,rc_namespace,rc_title,rc_minor,rc_bot,rc_new,rc_cur_id,rc_this_oldid,rc_last_oldid,rc_type,rc_source,rc_patrolled,rc_ip,rc_old_len,rc_new_len,rc_deleted,rc_logid,rc_log_type,rc_log_action,rc_params,rc_comment AS `rc_comment_text`,NULL AS `rc_comment_data`,NULL AS `rc_comment_cid`,wl_user,wl_notificationtimestamp,page_latest,(SELECT  GROUP_CONCAT(ct_tag SEPARATOR ',')  FROM `change_tag`    WHERE ct_rc_id=rc_id  ) AS `ts_tags`,fp_stable,fp_pending_since,ores_damaging_cls.oresc_probability AS `ores_damaging_score`,ores_goodfaith_cls.oresc_probability AS `ores_goodfaith_score`  FROM `recentchanges` LEFT JOIN `watchlist` ON (wl_user = '22858399' AND (wl_title=rc_title) AND (wl_namespace=rc_namespace)) LEFT JOIN `page` ON ((rc_cur_id=page_id)) LEFT JOIN `flaggedpages` ON ((fp_page_id = rc_cur_id)) LEFT JOIN `ores_model` `ores_damaging_mdl` ON (ores_damaging_mdl.oresm_is_current = '1' AND ores_damaging_mdl.oresm_name = 'damaging') LEFT JOIN `ores_classification` `ores_damaging_cls` ON ((ores_damaging_cls.oresc_model = ores_damaging_mdl.oresm_id) AND (rc_this_oldid = ores_damaging_cls.oresc_rev) AND ores_damaging_cls.oresc_class = '1') LEFT JOIN `ores_model` `ores_goodfaith_mdl` ON (ores_goodfaith_mdl.oresm_is_current = '1' AND ores_goodfaith_mdl.oresm_name = 'goodfaith') LEFT JOIN `ores_classification` `ores_goodfaith_cls` ON ((ores_goodfaith_cls.oresc_model = ores_goodfaith_mdl.oresm_id) AND (rc_this_oldid = ores_goodfaith_cls.oresc_rev) AND ores_goodfaith_cls.oresc_class = '1')   WHERE (rc_bot = 0) AND (rc_type != '3') AND (rc_type != '6') AND (rc_source != 'wb') AND ((ores_damaging_cls.oresc_probability BETWEEN 0.828 AND 1)) AND (rc_type NOT IN ('3','5')) AND ((ores_goodfaith_cls.oresc_probability BETWEEN 0.569 AND 1)) AND (rc_type NOT IN ('3','5')) AND (rc_timestamp >= '20171013222225') AND rc_new IN ('0','1')   ORDER BY rc_timestamp DESC LIMIT 50
Bawolff subscribed.Oct 16 2017, 10:52 PM
• jmatazzoni created subtask T178880: Slow load times on Recent Changes for Firefox.Oct 24 2017, 10:27 AM
Etonkovidova closed subtask T178880: Slow load times on Recent Changes for Firefox as Invalid.Nov 13 2017, 10:53 PM
Izno subscribed.Dec 28 2017, 1:52 PM

50 changes is not very realistic for RC, especially if you are using the enhanced RC/WL Javascript collapsing.

Secondly, it would be good to profile ORES (damage profile) and Wikidata load times, either here or elsewhere.

Catrope closed this task as Declined.Jul 3 2018, 6:17 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL