Page MenuHomePhabricator

Special pages on cswiki not updated for longer than usual (since May 12th 6am)
Closed, DeclinedPublic

Description

Special pages on cswiki are 4 days outdated (since May 12th 6am). Usually they are updated every day, therefore I filled in a bug.

  1. Go to e.g. Special:Uncategorized templates (or any other page list in Special namespace).
  2. See a 3 days old date of last update.
  1. Click e.g. on any Fb * template at the bottom of the page.
  2. They were categorized about 3 days ago. They should have some categories, null edits were made there, but still in lists of uncategorized.

Event Timeline

Thanks for reporting this.
Please provide specific steps to reproduce. See https://mediawiki.org/wiki/How_to_report_a_bug

Aklapper renamed this task from Special pages are outdated to Special pages on cswiki have not received updates for 3 days.May 15 2016, 9:20 AM

@Aklapper Thank you for the link, I hope I made the description better.

Peachey88 added subscribers: Reedy, Peachey88.

These are controlled via a Cron job iirc, That might need to be checked on

Joe triaged this task as High priority.May 16 2016, 11:47 AM
Joe added a project: MediaWiki-General.
Joe subscribed.
Dvorapa updated the task description. (Show Details)

Doesn't the cron job only run every 3 days?

I don't know, but right now it is 4.5 days

Dvorapa renamed this task from Special pages on cswiki have not received updates for 3 days to Special pages on cswiki have not received updates for 4 days.May 16 2016, 1:53 PM
Dvorapa updated the task description. (Show Details)

The Job gets run every three days, but can take more than a day to get through the list. Although usually everything goes fast right up until the point it hits enwiki in the list. cswiki is alphabetically before enwiki, so you might be right that something is wrong.

Last wiki that appears to be sucessfully updated was ckbwiki at 7:37 - https://ckb.wikipedia.org/wiki/special:UnusedTemplates?uselang=en

Danny_B renamed this task from Special pages on cswiki have not received updates for 4 days to Special pages on cswiki not updated for longer than usual (since May 12th 6am).May 16 2016, 4:17 PM
Danny_B subscribed.

Updated on 2016-05-17 17:** UTC

There were some issue with dewiki vslow db host recently, now solved, could be related.

There were some issue with dewiki vslow db host recently, now solved, could be related.

In theory, I wouldn't expect something wrong with dewiki to affect the script until it reaches dewiki.

I didn't realize before, that alphabetically, commonswiki (which is a very large wiki) comes between ckbwiki and cswiki.

  • ckbwiki - 07:37, 16 May 2016 UTC
  • cnwikimedia 15:37, 16 May 2016 Singapore (After adjusting for timezone 7:37 may 16 UTC)
  • collabwiki - unknown due to being private wiki
  • commonswiki - 08:53, 17 May 2016 UTC

So there is a 25 hour delay between cnwikimedia and commons being done. Commons is one of the largest wiki. Its not outside the realm of possibility that generating these special pages on commons takes 25 hours (Although that is much longer then I would expect). For comparision, looking at the timestamp between emlwiki and enwiki, english wikipedia takes 2.5 hours to generate the special pages (But some of the really expensive one's are skipped on enwiki, so the comparision is a bit apples to oranges).

As an aside, timing information is recorded in /var/log/mediawiki/updateSpecialPages.log . If someone was super curious they could look at that.

Digging further, here are some timings for expensive special pages:

  • Special:ListRedirects: 08:17, 16 May 2016 UTC
  • Special:LonelyPages 08:18, 16 May 2016 (So LonelyPages takes 1 hour)
  • [some omitted]
  • Special:Mostlinkedtemplates 13:57, 16 May 2016
  • Special:UncategorizedCategories 16:43, 16 May 2016 ( 3 hours)
  • Special:UncategorizedPages 16:45, 16 May 2016
  • Special:UncategorizedFiles 21:22, 16 May 2016 (4.5 hours)
  • Special:UnusedCategories 21:24, 16 May 2016
  • Special:UnusedFiles 03:36, 17 May 2016 (6 hours)
  • [some omitted]
  • Special:Wantedfiles 06:30, 17 May 2016
  • Special:WantedTemplates 08:51, 17 May 2016 (2.5 hours)
  • [some omitted]
  • Special:WithoutInterwiki 08:56, 17 May 2016
  • Special:MostGloballyLinkedFiles 13:04, 17 May 2016 (4 hours)
  • Special:GloballyWantedFiles 17:12, 17 May 2016 (5 hours)

So it seems like nothing was stalled, they were just proceeding slowly.

If the update begins to really start taking too long, we could move some of the commons special page refreshes to run less often, like enwiki. Special:UnusedFiles seems like a good candiate for that, since it is one of the longest running pages, and doesn't take globalusage into account, so is pretty useless.

If there is not any problem with any time consuming wiki or slow cron job step, then thank you for closing this.

Whether is any problem with script or whatever, it is not an issue of cswiki, thus new task has to be opened for that...