Page MenuHomePhabricator

refreshLinks.php will not work with cache turned on
Closed, DeclinedPublic

Description

Running refreshLinks.php results in a hang as soon as it reaches certain pages in the database.
I have updated the script to report every 1 page, and added a timestamp to it as well.
Refreshing the Redirect Table processes 625 pages in under 5 seconds total
When It starts refreshing links table, it stalls on page 2 (IT_BIBLE, which is a table of contents for one section, and it has links). I have let it hang at that one page for as long as 8 hours before killing the process.
When I turn off Caching in localsettings.php (comment out all caching lines), it takes 30 seconds to complete page 2, and 7 hours for all 625 pages. the longest single page I could find was 89, Template:Infobox/doc (imported from wikipedia)

Note: I have the same issue with runjobs.php. If Caching is turned on, it hangs indefinitely. I turn it off and it processes fine. I can submit a second bug report on that one, but I haven't diagnosed to the same depth. However, wanted to note the same workaround affects both processes.

Environment: Windows server 2012 R2
IIS v8.5

Product Version
MediaWiki 1.23.0
PHP 5.5.22 (cgi-fcgi)
MySQL 5.1.72-community
Lua 5.1.4
Note:Semantic Mediawiki is installed

Installed extensions

Semantic extensions
Extension Version License Description Authors
Semantic Compound Queries 0.3.4 A parser function that displays multiple semantic queries at the same time Yaron Koren
Semantic Drilldown 1.4 License A drilldown interface for navigating through semantic data Yaron Koren and others
Semantic Extra Special Properties 1.2.0 Adds some extra special properties to all pages Leo Wallentin, James Hong Kong and others
Semantic Forms 2.7 License Forms for adding and editing semantic data Yaron Koren, Stephan Gambke and others
Semantic Forms Inputs 0.7 License Additional input types for Semantic Forms Stephan Gambke and others
Semantic Glossary 1.1.0 GPL-2.0+ A glossary extension with a Semantic MediaWiki backend Stephan Gambke and James Hong Kong
Semantic Image Input 0.3.0 alpha License Adds an image input that pulls images from Wikipedia to Semantic Forms Jeroen De Dauw
Semantic Maps 3.0.4 License Provides the ability to view and edit coordinate data stored with the Semantic MediaWiki extension Jeroen De Dauw
Semantic MediaWiki 1.9.2 License Making your wiki more accessible - for machines and humans (online documentation) Markus Krötzsch, Jeroen De Dauw, James Hong Kong and others
Semantic Result Formats 1.9.1 License Additional result formats for Semantic MediaWiki queries James Hong Kong, Stephan Gambke, Jeroen De Dauw, Yaron Koren and others
Special pages
Extension Version License Description Authors
Admin Links 0.1.8 Adds a special page that holds helpful links for administrators Yaron Koren
Data Transfer 0.4.1 License Allows for importing and exporting data contained in template calls Yaron Koren
Flagged Revisions – (5235070) GPL-2.0+ Gives Editors the ability to review revisions and stabilize pages Aaron Schulz and Joerg Baach
PageTriage 0.2.0 (3ed75b9) Facilitates reviewing and approving new pages Ryan Kaldari, Benny Situ, Ian Baker and Andrew Garrett
Replace Text 0.9.7 Provides a special page to allow administrators to do a global string find-and-replace on all the content pages of a wiki Yaron Koren and Niklas Laxström
UserPageViewTracker 0.4.0 Tracks the page views per page per user and displays it Kimon Andreou and Luis Felipe Schenone
Parser hooks
Extension Version License Description Authors
Arrays 2.0rc3 alpha License Store and compute named arrays Li Ding, Jie Bao and Daniel Werner
External Data 1.6.4 Allows for retrieving structured data from external URLs, databases and other sources Yaron Koren, Michael Dale and David Macdonald
Lingo 1.2.0 (42e98a6) GPL-2.0+ Provides hover-over tool tips on pages from words defined on the Terminology page Barry Coughlan, Stephan Gambke and others
Maps 3.0.1 License Enables embedding of dynamic maps into wiki pages, geocoding of addresses and other geographical operations. Jeroen De Dauw
MsCatSelect 6.1 GPLv2+ Allows to add a page to an existing or newly creatable category via a drop-down list Martin Schwindl, Martin Keyler and Luis Felipe Schenone
MsLinks 4.0 GPLv2+ Creates links to view or download files using icons appropriate to the file type Martin Schwindl, Martin Keyler and Luis Felipe Schenone
MsUpload 10 GPLv2+ Enables easy uploads (when available also via drag&drop) for one or multiple files simultaneously Martin Schwindl and Luis Felipe Schenone
Page Schemas 0.4.3 License Defines the data structure for all pages in a category using XML Yaron Koren, Ankit Garg and others
ParserFunctions 1.6.0 License Enhance parser with logical functions Tim Starling, Robert Rohde, Ross McClure and Juraj Simlovic
Scribunto – Framework for embedding scripting languages into MediaWiki pages Victor Vasiliev and Tim Starling
UserFunctions 2.5.0 Enhance parser with user functions Algorithm , Toniher, Kghbln, Wikinaut, Reedy and others
Media handlers
Extension Version License Description Authors
NativeSvgHandler 1.2 Serves SVG images directly to clients Povilas Kanapickas, Ilaï Deutel
DataValues
Extension Version License Description Authors
DataValues 1.0 GPL-2.0+ Collection of objects representing various kinds of values Jeroen De Dauw
DataValues Common 0.2.3 GPL-2.0+ Contains common implementations of the interfaces defined by DataValuesInterfaces Jeroen De Dauw
DataValues Interfaces 0.1.5 GPL-2.0+ Defines interfaces for ValueParsers, ValueFormatters and ValueValidators Jeroen De Dauw
DataValues Validators 0.1.2 GPL-2.0+ Contains common ValueValidator implementations Jeroen De Dauw and The Wikidata team
Other
Extension Version License Description Authors
Approved Revs 0.7 Set a single revision of a page as approved Yaron Koren and others
EmailToWiki 2.2.9, 2012-05-16 Allows emails to be sent to the wiki and added to an existing or new article User:Nad
LDAP Authentication Plugin 2.1.0 License LDAP authentication plugin with support for multiple LDAP authentication methods Ryan Lane
Liquid Threads 2.2-alpha License Add threading discussions to talk pages David McCabe and Andrew Garrett
MsInsert 3.0 GPL-2.0+ Adds a dropdown menu for inserting into the editor the content of certain pages Martin Schwindl, Martin Keyler and Luis Felipe Schenone
MsWikiEditor 2.0 GPL-2.0+ Easily add or remove buttons to the WikiEditor Martin Schwindl, Martin Keyler and Luis Felipe Schenone
Validator 1.0.0.1 License Declarative parameter processing library Jeroen De Dauw
WikiEditor 0.3.1 Provides an extendable wikitext editing interface and many feature-providing modules Trevor Parscal, Roan Kattouw, Nimish Gautam and Adam Miller
WYSIWYG extension 1.5.6_0 [B551], CKEditor 3.6 (revision 6902) Allow editing using the WYSIWYG editor CKEditor Frederico Caldeira Knabben, Wiktor Walc, others, Jack Phoenix and ontoprise GmbH |

Event Timeline

Sdsolutions raised the priority of this task from to Needs Triage.
Sdsolutions updated the task description. (Show Details)
Sdsolutions subscribed.
Aklapper triaged this task as Medium priority.Mar 6 2015, 10:18 AM

MediaWiki 1.23.0

Unrelated here, but I'd highly recommend updating to a secure version (1.23.8).

Ciencia_Al_Poder subscribed.

This was reported on 1.23 which is now unsupported. This no longer happens, apparently (I've tested with redis caching and no caching). Please reopen if this is still an issue and provide details of the caching configuration being used