Page MenuHomePhabricator
Create Task
Maniphest T177996

Article concatenation not resilient to curl errors
Closed, InvalidPublic
Actions

Description

  • After long wait, see the following error:
There were errors while trying to fetch page contents:

Fetching /restbase/local/v1/page/html/Selenium_diff_test_0.03643953972108016/371074 failed: (curl error: no status set)

This can also impact smaller books with slightly different curl error messages:
e.g.

Screen Shot 2017-10-13 at 2.08.36 PM.png (267×771 px, 70 KB)

Related Objects
Search...

StatusSubtypeAssignedTask
 Resolved• JKatzWMFT150871 [EPIC] (Proposal) Replicate core OCG features and sunset OCG service
 InvalidNoneT186740 [EPIC] It should be possible to print a book using the Proton service
 InvalidNoneT178095 [EPIC] Fix problems with the PHP concatenation special page service
 ResolvedPRODUCTION ERRORphuedxT177988 Warning: Invalid argument supplied for foreach() in /srv/mediawiki/php-1.31.0-wmf.2/extensions/Collection/includes/DataProvider.php on line 152
 InvalidJdlrobsonT175868 Deploy and test new book rendering (Remex + Electron)
 ResolvedNoneT175882 Requesting access to scb* and pdfrender-admin for tgr
 InvalidJdlrobsonT178036 Book rendering database query error
 ResolvedJdlrobsonT178289 Restrict access to the testing URL for the new book rendering workflow
 StalledNoneT174670 Remove banner from saved books
 InvalidNoneT171832 Deploy new book renderer to all projects
 DuplicateNoneT171833 Deploy new book renderer to all projects side by side with OCG
 DeclinedNoneT173018 Add an option in Special:Book to download PDFs generated by ElectronPdfService
 InvalidNoneT173015 Use PDF post-processing service to generate final PDF
 InvalidNoneT173579 Expose PDF post-processing scripts as a stateless web service
 Resolved• bmansurovT171965 [Spike - 8 hours] How should the PDF post-processing script be exposed for use by Extension:Collection
 InvalidovasilevaT171960 Create a library to post-process PDF and add page numbers and table of contents
 ResolvedovasilevaT168871 Introduct toc with page numbers during pdf post-processing
 ResolvedJdlrobsonT176463 [Spike 8hrs] Investigate libraries for post-processing without non-JS dependencies
 ResolvedpmiazgaT171838 Build out article concatenation according to requirements for books
 ResolvedovasilevaT175856 Implement changes to article concatenation based on books requirements
 InvalidNoneT177993 Article concatenation fails on large books
 ResolvedovasilevaT177994 Book generation fails for articles with '/' character in title
 InvalidNoneT177996 Article concatenation not resilient to curl errors
 InvalidNoneT182230 [Spike] Explore ways of creating a stateless web service in Python
 Resolved• dpatrickT173014 Security review of pdfrw

Event Timeline

Jdlrobson created this task.Oct 11 2017, 8:15 PM
Jdlrobson removed the point value for this task.
Jdlrobson moved this task from Incoming to 2017-18 Q2 on the Web-Team-Backlog board.Oct 11 2017, 10:05 PM
ovasileva renamed this task from [subtask] Article concatenation fails with curl error no status set (cause unknown) to Article concatenation fails with curl error no status set (cause unknown).Oct 12 2017, 5:27 PM
ovasileva removed a project: Readers-Web-Kanbanana-Board-Old.
Jdlrobson added a parent task: T178095: [EPIC] Fix problems with the PHP concatenation special page service.Oct 12 2017, 5:30 PM
Tgr subscribed.Oct 12 2017, 8:56 PM

The concatenation code uses parallel fetch via MultiHttpClient, which is not used that much, so maybe something related to that (such as exhausting some kind of connection pool)?

Jdlrobson moved this task from 2017-18 Q2 to Upcoming on the Web-Team-Backlog board.Oct 13 2017, 12:13 AM
Jdlrobson renamed this task from Article concatenation fails with curl error no status set (cause unknown) to Article concatenation not resilient to curl errors.Oct 13 2017, 5:23 PM
Jdlrobson mentioned this in T175856: Implement changes to article concatenation based on books requirements.
Jdlrobson updated the task description. (Show Details)
Jdlrobson updated the task description. (Show Details)
Jdlrobson moved this task from Upcoming to Needs Prioritization on the Web-Team-Backlog board.Oct 18 2017, 11:08 PM
Jdlrobson changed the task status from Open to Stalled.Oct 30 2017, 11:27 PM

Until we have time to talk through T178095

Jdlrobson moved this task from Needs Prioritization to Tracking on the Web-Team-Backlog board.Feb 7 2018, 7:20 PM
Jdlrobson edited projects, added Web-Team-Backlog (Tracking); removed Web-Team-Backlog.
Jdlrobson added a parent task: T186740: [EPIC] It should be possible to print a book using the Proton service.Feb 7 2018, 7:23 PM
• bmansurov unsubscribed.Feb 7 2018, 8:02 PM
pmiazga added a project: OCG-General.Feb 16 2018, 1:22 PM
ovasileva closed this task as Invalid.Apr 9 2018, 2:44 PM

Closing as per T184772#4116906. Pediapress will be taking on rendering of PDF books.

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits