Echo DB writes on page views
Closed, ResolvedPublic
Actions

Description

Seeing lots of these in the logs:

Expectation (writes <= 0) by MediaWiki::main not met:
query-m: UPDATE echo_notification SET notification_read_timestamp = 'X' AND notification_read_timestamp IS NULL
TransactionProfiler.php line 311 calls wfBacktrace()
TransactionProfiler.php line 200 calls TransactionProfiler->reportExpectationViolated()
Database.php line 1006 calls TransactionProfiler->recordQueryCompletion()
Database.php line 2001 calls DatabaseBase->query()
UserNotificationGateway.php line 56 calls DatabaseBase->update()
NotifUser.php line 338 calls EchoUserNotificationGateway->markRead()
Hooks.php line 657 calls MWEchoNotifUser->markRead()
Hooks.php line 204 calls EchoHooks::onPersonalUrls()
SkinTemplate.php line 688 calls Hooks::run()
SkinTemplate.php line 455 calls SkinTemplate->buildPersonalUrls()
SkinTemplate.php line 240 calls SkinTemplate->prepareQuickTemplate()
OutputPage.php line 2305 calls SkinTemplate->outputPage()
MediaWiki.php line 677 calls OutputPage->output()
MediaWiki.php line 474 calls MediaWiki->main()
index.php line 41 calls MediaWiki->run()
index.php line 3 calls include()

Details

Related Changes in Gerrit:

	Subject	Repo	Branch	Lines +/-
	Defer onPersonalUrls() DB writes to post-send (try #2)	mediawiki/extensions/Echo	master	+55 -15
	Defer onPersonalUrls() DB writes to post-send	mediawiki/extensions/Echo	master	+51 -13

Customize query in gerrit

Related Objects

Mentioned Here: T129299: BadMethodCall in PersonalUrls

Event Timeline

aaron created this task.Nov 3 2015, 11:09 AM

aaron raised the priority of this task from to Needs Triage.

aaron updated the task description. (Show Details)

aaron added projects: Notifications (Echo), Performance Issue.

aaron subscribed.

Restricted Application added a project: Collaboration-Team-Triage. · View Herald TranscriptNov 3 2015, 11:09 AM

Restricted Application added a subscriber: Aklapper. · View Herald Transcript

I think these are inherently from read actions (e.g. visiting a topic marks that topic notification read), so probably need to use some workaround, e.g. EnqueueJob.

Restricted Application added a subscriber: StudiesWorld. · View Herald TranscriptNov 3 2015, 6:33 PM

Any reason not to just use DeferredUpdates::addCallableUpdate()? I see there is a comment saying it should be deferred and was wondering if there was some problem with doing so.

In T117531#1778313, @aaron wrote:

Any reason not to just use DeferredUpdates::addCallableUpdate()? I see there is a comment saying it should be deferred and was wondering if there was some problem with doing so.

I think we use that somewhere else already, and it works fine except that it causes the number of unread notifs to be slightly out of date? @Legoktm would know better than me.

I assume the change would affect the code below:

$notifUser = MWEchoNotifUser::newFromUser( $user );
$msgCount = $notifUser->getMessageCount();
$alertCount = $notifUser->getAlertCount();

The $notifUser->markRead( $eventIds ) updates the master and resets the new cache values. This code then sees them in cache. So viewing a page might still show notifications for that page as unread until the *next* page view. Not sure how well this works with multiple datacenters even now. It mostly would since the user would stay on the closest DC, so the cluster-local set() would normally be seen. OTOH, then a user edits and sticks to the master DC for a while, they'd start using the other DC memcached clusters, so the counts would be wrong.

Change 250761 had a related patch set uploaded (by Aaron Schulz):
Defer onPersonalUrls() DB writes to post-send

https://gerrit.wikimedia.org/r/250761

gerritbot added a project: Patch-For-Review.Nov 3 2015, 8:31 PM

Change 250761 merged by jenkins-bot:
Defer onPersonalUrls() DB writes to post-send

https://gerrit.wikimedia.org/r/250761

ReleaseTaggerBot added a project: MW-1.27-release (WMF-deploy-2016-03-08_(1.27.0-wmf.16)).Mar 8 2016, 2:00 AM

Legoktm closed this task as Resolved.Mar 8 2016, 6:05 PM

Legoktm claimed this task.

Change 276240 had a related patch set uploaded (by Legoktm):
Defer onPersonalUrls() DB writes to post-send (try #2)

https://gerrit.wikimedia.org/r/276240