Page MenuHomePhabricator

SMW update jobs forced to single thread
Closed, DeclinedPublic

Description

At translatewiki.net, if I initiate refresh data, then run runJobs.php with --procs=3, I see the other two threads to stop running immediately.

This might also be a problem with the core jobqueue, but I don't remember having this issue for other type of jobs.


Version: master
Severity: normal

Details

Reference
bz45321

Event Timeline

bzimport raised the priority of this task from to Needs Triage.Nov 22 2014, 1:20 AM
bzimport set Reference to bz45321.
bzimport added a subscriber: Unknown Object (MLST).

To clarify it first run only lots of SMWRefreshJobs. After that reached prog=1 it started running both SMWRefreshJobs (with smaller prog) and lots of SMWUpdateJobs with multiple threads.

Unknown Object (User) added a comment.Oct 23 2013, 6:40 PM

What is the status on this ticket? If the problem still persists with the current master, are they any suggestions how to solve this issue?

This is still the case. Unfortunately I do not know how to fix it. Adding Aaron to CC in case he has ideas.

Unknown Object (User) added a comment.Oct 23 2013, 7:27 PM

Just to clarify, since we have to support MW 1.19 we can't do any fancy stuff that is implemented by the new JobQueue class (as in 1.21/1.22) therefore the current code is as simple as:

class SMWRefreshJob extends Job {
...

$nextjob = new SMWRefreshJob( $this->title, array( ... ) );
$nextjob->insert();

...
}

Aklapper subscribed.

The Semantic MediaWiki developers requested in https://phabricator.wikimedia.org/T64114 to move their task tracking to https://github.com/SemanticMediaWiki/SemanticMediaWiki/issues and to close remaining tasks in Wikimedia Phabricator. If you still face the problem reported in this task in a supported version of SMW, please feel free to transfer your report to https://github.com/SemanticMediaWiki/SemanticMediaWiki/issues . We are sorry for the inconvenience.