Page MenuHomePhabricator

Commons category updates are very slow. Commons job queue very large.
Closed, DuplicatePublic

Description

Commons seems be experiencing a large lag with the propagation of categories. Possibly related: the Commons job queue has ~5.6 million entries (at https://commons.wikimedia.org/w/api.php?action=query&meta=siteinfo&siprop=statistics).

See: Commons:Village_pump#Large_lag_with_categories

Event Timeline

Is this different from T173710? If not, would you merge this task via Edit Related TasksClose As Duplicate...?

I>>! In T178840#3706240, @Aklapper wrote:

Is this different from T173710?

I don't know. Is it abnormal for the Commons job queue to have 5.6 million entries? Could that cause a multi-day lag in forcerecursivelinkupdate API calls? I recall something similar happening ~2 years ago being triggered by a bug (see T116001), but I don't immediately see the similarity with T173710 besides the size of the job queue.

The large queue was indeed linked to T173710, but II'm not sure what you mean with "multi-day lag in forcerecursivelinkupdate API calls".

Can you please explain more extensively what are you seeing?

The linked discussion is now archived at Commons:Village_pump/Archive/2017/11#Large_lag_with_categories. The category mentioned in that discussion, Category:Images from the Geograph British Isles project, was moved on 16 October 2017 and the move is still not complete after 40 days. Is that expected behavior?

With regard to my mention of "multi-day lag in forcerecursivelinkupdate API calls", this was in response to @Aklapper asking if the problem of the multi-day lag in category changes was related to T173710. Since I didn't know, my attempt to provide more information was me mentioning that at the time that I noticed changes to categories were taking many days to complete I had also noticed that it was taking many days for the processing of a forcerecursivelinkupdate API call to complete. These two problems may not have been related.