Page MenuHomePhabricator

enwiki_p database replica has stopped updating
Closed, ResolvedPublic

Description

The issue
Per https://replag.toolforge.org/, the enwiki database lag is currently over 21 hours and steadily increasing.

What happens?:
Tools such as AFD stats and xtools which rely on database replicas are showing out-of-date information

What should have happened instead?:
Replica lag should be measured in seconds, not hours.

Other information:
This issue was reported by enwiki users Liz and Maile66, so please direct queries for more info to them. TheTechie may be able to provide more information.

Event Timeline

Please see https://afdstats.toolforge.org/afdstats.py?name=Maile66&max=&startdate=&altname=

The above has not updated since yesterday. I am not the only editor affected, so you might be hearing from other Wikipedia editors.

The Voting matrix above is a template reflecting the individual editor. Under normal circumstances, the user can reload the page, and the totals will update. This has not updated since at least yesterday. And reloading the page brings no results.

Additional issue might be related: Normal articles have a place at the top that says something like,
::"125 revisions since 2010-04-24 (+18 days), 24 editors, 1,792 pageviews (30 days), created by: Maile66 (139,571) · See full page statistics"
::What I'm seeing now on all new articles is, "Unable to fetch revision data. 0 pageviews (30 days) · See full page statistics"

I can't run any of my Quarry queries and all of the bots I use for editing purposes aren't updating as well. When will this system update be complete and the system lag catch up? Tonight? Tomorrow morning? Next week?

JJMC89 subscribed.

This is expected due to replica database lag from T352010. See https://replag.toolforge.org.

JJMC89 changed the subtype of this task from "Bug Report" to "Task".Wed, Apr 17, 6:38 AM

It seems the entirety of Xtools is struggling from this. My Mainspace edit count on Xtools isn't updating either.

Ahecht renamed this task from AFD stats update delay to enwiki_p database replica has stopped updating.Wed, Apr 17, 2:37 PM
Ahecht updated the task description. (Show Details)
Ahecht subscribed.

I updated the description. Any tools that rely on database replicas, including all toolforge tools that rely on data not available through the API, are affected by this.

Updated it again as some info that I previously had was redundant.

I updated the description. Any tools that rely on database replicas, including all toolforge tools that rely on data not available through the API, are affected by this.

Thank you. Now a lag of 23 hours.

The lag will go up until the schema changes (linked above) finish applying, and after that it will go back down. Commenting about the lag here (or doing anything else at this point, really) will not magically make it faster :-)

And also a reminder that this is expected every once in a while. It even has it's own page https://en.wikipedia.org/wiki/Wikipedia:Replication_lag

Nintendofan885 claimed this task.
Nintendofan885 subscribed.

Looks like it's finally caught up now

Yeah! Life returns to normal.