Page MenuHomePhabricator

Kelson (Kelson)
User

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Monday

  • Clear sailing ahead.

User Details

User Since
Oct 7 2014, 7:43 AM (397 w, 4 d)
Availability
Available
IRC Nick
kelson
LDAP User
Kelson
MediaWiki User
Kelson [ Global Accounts ]

Recent Activity

Mon, May 16

Kelson closed T308292: The tragedy of mwoffliner4 as Resolved.
Mon, May 16, 6:13 PM · affects-Kiwix-and-openZIM, cloud-services-team (Kanban), VPS-Projects
Kelson added a comment to T308292: The tragedy of mwoffliner4.

@Andrew VM recreated.

Mon, May 16, 6:12 PM · affects-Kiwix-and-openZIM, cloud-services-team (Kanban), VPS-Projects

Fri, May 13

Kelson added a project to T308292: The tragedy of mwoffliner4: affects-Kiwix-and-openZIM.
Fri, May 13, 4:51 AM · affects-Kiwix-and-openZIM, cloud-services-team (Kanban), VPS-Projects
Kelson added a comment to T308292: The tragedy of mwoffliner4.

@Andrew OK, shit happends time to time, I will recreate the VM during the WE.

Fri, May 13, 4:50 AM · affects-Kiwix-and-openZIM, cloud-services-team (Kanban), VPS-Projects

Sun, May 8

Kelson closed T306082: Cloud VPS "mwoffliner" project Stretch deprecation as Resolved.
Sun, May 8, 2:54 PM · affects-Kiwix-and-openZIM, Cloud-VPS (Debian Stretch Deprecation)
Kelson added a comment to T306082: Cloud VPS "mwoffliner" project Stretch deprecation.

@Andrew Old our VMs have been migrated to Debian-bullseye. Therefore this ticket can be closed

Sun, May 8, 2:53 PM · affects-Kiwix-and-openZIM, Cloud-VPS (Debian Stretch Deprecation)

Sat, May 7

Kelson added a comment to T298011: JPEG image is reported with the wrong mime-type application/octet-stream.

@Reedy Thank you!

Sat, May 7, 6:24 PM · Wikimedia-Site-requests, SRE-swift-storage, Commons, affects-Kiwix-and-openZIM
Kelson updated subscribers of T298011: JPEG image is reported with the wrong mime-type application/octet-stream.

@Reedy Would you be able please to help here?

Sat, May 7, 3:16 PM · Wikimedia-Site-requests, SRE-swift-storage, Commons, affects-Kiwix-and-openZIM

Sun, May 1

Kelson moved T306082: Cloud VPS "mwoffliner" project Stretch deprecation from TRIAGE to TOP on the affects-Kiwix-and-openZIM board.
Sun, May 1, 2:28 PM · affects-Kiwix-and-openZIM, Cloud-VPS (Debian Stretch Deprecation)
Kelson moved T305384: Server error on https://de.wikipedia.org/wiki/Bild_(Zeitung) due to {{Auflagen-Diagramm}} from TOP to NORMAL on the affects-Kiwix-and-openZIM board.
Sun, May 1, 2:28 PM · affects-Kiwix-and-openZIM, Patch-For-Review, Performance-Team (Radar), MediaWiki-Parser, Performance Issue, Wikimedia-production-error
Kelson moved T305384: Server error on https://de.wikipedia.org/wiki/Bild_(Zeitung) due to {{Auflagen-Diagramm}} from TRIAGE to TOP on the affects-Kiwix-and-openZIM board.
Sun, May 1, 2:28 PM · affects-Kiwix-and-openZIM, Patch-For-Review, Performance-Team (Radar), MediaWiki-Parser, Performance Issue, Wikimedia-production-error
Kelson added a project to T306082: Cloud VPS "mwoffliner" project Stretch deprecation: affects-Kiwix-and-openZIM.
Sun, May 1, 2:27 PM · affects-Kiwix-and-openZIM, Cloud-VPS (Debian Stretch Deprecation)
Kelson added a comment to T306082: Cloud VPS "mwoffliner" project Stretch deprecation.

We have only one VM left, which should be destroyed within the next 2 weeks.

Sun, May 1, 2:27 PM · affects-Kiwix-and-openZIM, Cloud-VPS (Debian Stretch Deprecation)
Kelson added a comment to T270833: Span node title attribute not (always?) rendered properly in mobile.

@vadim-kovalenko Thx for coming back with this insightfull comment. Does that mean that the Wikipedians behind this template have chosen to do so... or does that mean this is not their choice (it's a feature/bug in Mediawiki) and they complain as well about it?

Sun, May 1, 2:26 PM · Product-Infrastructure-Team-Backlog, Mobile-Content-Service, Parsoid (Tracking), affects-Kiwix-and-openZIM
Kelson added a comment to T306332: Request increased disk quota for mwoffliner Cloud VPS project.

@Andrew Thank you, meanwhile, almost all VMs have been newly set!

Sun, May 1, 2:18 PM · Cloud-VPS (Quota-requests)
Kelson added a comment to T306592: Add Kiwix Serve to translatewiki.net.

@abi_ Thank you very much!

Sun, May 1, 2:09 PM · affects-Kiwix-and-openZIM, Language-Team (Language-2022-April-June), translatewiki.net

Apr 21 2022

Kelson added a project to T306615: https://de.wikipedia.org/wiki/Der_Patriot_(Tageszeitung) refuses to render: Parsoid-Rendering.
Apr 21 2022, 1:51 PM · Parsoid-Rendering, affects-Kiwix-and-openZIM
Kelson moved T306615: https://de.wikipedia.org/wiki/Der_Patriot_(Tageszeitung) refuses to render from TRIAGE to TOP on the affects-Kiwix-and-openZIM board.
Apr 21 2022, 1:49 PM · Parsoid-Rendering, affects-Kiwix-and-openZIM
Kelson created T306615: https://de.wikipedia.org/wiki/Der_Patriot_(Tageszeitung) refuses to render.
Apr 21 2022, 1:49 PM · Parsoid-Rendering, affects-Kiwix-and-openZIM
Kelson moved T306592: Add Kiwix Serve to translatewiki.net from TRIAGE to NORMAL on the affects-Kiwix-and-openZIM board.
Apr 21 2022, 5:42 AM · affects-Kiwix-and-openZIM, Language-Team (Language-2022-April-June), translatewiki.net
Kelson added a project to T306592: Add Kiwix Serve to translatewiki.net: affects-Kiwix-and-openZIM.
Apr 21 2022, 5:42 AM · affects-Kiwix-and-openZIM, Language-Team (Language-2022-April-June), translatewiki.net

Apr 20 2022

Kelson added a comment to T306332: Request increased disk quota for mwoffliner Cloud VPS project.

mwoffliner1 -> 300GB
mwoffliner2 -> 300GB
mwoffliner3 -> 300GB
mwoffliner4 -> 300GB
mwcurator -> 200GB

Apr 20 2022, 7:10 AM · Cloud-VPS (Quota-requests)

Apr 18 2022

Kelson added a comment to T306082: Cloud VPS "mwoffliner" project Stretch deprecation.

@Andrew Done at https://phabricator.wikimedia.org/T306332

Apr 18 2022, 8:33 AM · affects-Kiwix-and-openZIM, Cloud-VPS (Debian Stretch Deprecation)
Kelson created T306332: Request increased disk quota for mwoffliner Cloud VPS project.
Apr 18 2022, 8:32 AM · Cloud-VPS (Quota-requests)

Apr 17 2022

Kelson updated subscribers of T306082: Cloud VPS "mwoffliner" project Stretch deprecation.

@Andrew I have deleted mwoffliner3 instance (is stateless and anyway we need to recreate it with debian-11.0-bullseye too) and then recreate the same kind of VM (but based on debian-11.0-bullseye) to welcome the migrated instance of wp1. This new instance is called mwcurator (we have been talking since year anyway for a better name thant "WP1"). The VM has been created but we suffer now of 0 free disk quota. Now that the volumes are handled separatly we need more/one. Actually considering that all old mwoffliner VMs (mwoffliner1, mwoffliner2 and mwoffliner3) will be migrated soon, we need 1.1 TB to be able to recreate 100% of our VM with the similar hardware like before. Would you be able to change that please?

Apr 17 2022, 5:30 PM · affects-Kiwix-and-openZIM, Cloud-VPS (Debian Stretch Deprecation)
Kelson assigned T306082: Cloud VPS "mwoffliner" project Stretch deprecation to Audiodude.
Apr 17 2022, 5:21 PM · affects-Kiwix-and-openZIM, Cloud-VPS (Debian Stretch Deprecation)

Apr 2 2022

Kelson added a comment to T304581: Upgrade cloudvirt-wdqs servers to Debian Bullseye.

@Andrew I recreated mwoffliner4. I guess it should be OK now for you.

Apr 2 2022, 1:14 AM · Cloud-VPS, cloud-services-team (Kanban)

Mar 29 2022

Kelson added a comment to T304814: MWoffliner scrapes slowed down by Thumbor failure throttling 429s.

Of the 4 Thumbor throttles, only 1 is per-IP address. The other three are based on the original file (failure or concurrency) or filetype. RFC 6585 explicitly does not define how users or requests should be counted. We've also used 429 with "too many" being 1 elsewhere in the Wikimedia infrastructure, though that's largely been replaced with 403s for media at least. Using 503 (with or without Retry-After) would be an option, but I don't really see it as necessarily better than 429.

Mar 29 2022, 3:42 AM · SRE, Traffic, Thumbor, affects-Kiwix-and-openZIM

Mar 28 2022

Kelson added a comment to T304814: MWoffliner scrapes slowed down by Thumbor failure throttling 429s.

429 is returned when the thumbnail hits one of four ratelimits (see https://wikitech.wikimedia.org/wiki/Thumbor#Throttling). That includes a ratelimit on requests for thumbnails that have recently failed to generate. 429 is used because the request should not be retried at that point. This task is largely a duplicate of T175512.

Mar 28 2022, 3:03 PM · SRE, Traffic, Thumbor, affects-Kiwix-and-openZIM
Kelson added a comment to T57503: Mirror more Kiwix downloads directories.

@ArielGlenn Sorry, I meant T286588

Mar 28 2022, 9:02 AM · Cloud-Services, affects-Kiwix-and-openZIM, SRE, Datasets-General-or-Unknown
Kelson added a comment to T57503: Mirror more Kiwix downloads directories.

@ArielGlenn Hi, I already come back to you! T299993 is hidden to me and I have no visibility on it. Is that already implemented. If "no", in which timeline are we moving in?

Mar 28 2022, 8:55 AM · Cloud-Services, affects-Kiwix-and-openZIM, SRE, Datasets-General-or-Unknown
Kelson moved T298011: JPEG image is reported with the wrong mime-type application/octet-stream from TRIAGE to NORMAL on the affects-Kiwix-and-openZIM board.
Mar 28 2022, 8:41 AM · Wikimedia-Site-requests, SRE-swift-storage, Commons, affects-Kiwix-and-openZIM
Kelson moved T304814: MWoffliner scrapes slowed down by Thumbor failure throttling 429s from TRIAGE to TOP on the affects-Kiwix-and-openZIM board.
Mar 28 2022, 8:40 AM · SRE, Traffic, Thumbor, affects-Kiwix-and-openZIM
Kelson created T304814: MWoffliner scrapes slowed down by Thumbor failure throttling 429s.
Mar 28 2022, 8:40 AM · SRE, Traffic, Thumbor, affects-Kiwix-and-openZIM

Mar 24 2022

Kelson added a comment to T304581: Upgrade cloudvirt-wdqs servers to Debian Bullseye.

@Andrew Yes it would kill the process and I would have to restart everything.

Mar 24 2022, 1:57 PM · Cloud-VPS, cloud-services-team (Kanban)
Kelson added a comment to T304581: Upgrade cloudvirt-wdqs servers to Debian Bullseye.

@Andrew I don't know what is a "special-purpose wdqs server", I suspect this is by mistake. This server as a "special" profile, I remember asking you specifically this config.

Mar 24 2022, 7:40 AM · Cloud-VPS, cloud-services-team (Kanban)

Mar 18 2022

Kelson updated subscribers of T302969: Wikiversity DE, FR, EN API HTTP 5xx errors.

@Arlolra Indeed, sorry for the duplicate

Mar 18 2022, 8:32 AM · Parsoid, affects-Kiwix-and-openZIM
Kelson added a comment to T275505: Timeout on pages with lots of templates.

Case with zh.wikisource.org) seems fixed, but look at T302969 for new cases.
From the symptom, can look similar to T288889.

Mar 18 2022, 8:31 AM · affects-Kiwix-and-openZIM, Performance Issue, Parsoid

Mar 4 2022

Kelson added a comment to T274359: Mobile REST API delivers year old+ content for very select pages.

@Aklapper I wondered if no priorisation and keeping "Open, needs triage", although a team/someone works on a solution, might somehow misleads or impair at some point the development of the ticket.

Mar 4 2022, 11:43 AM · User-TheresNoTime, Patch-For-Review, Platform Engineering, Page Content Service, Product-Infrastructure-Team-Backlog, Wikipedia-Android-App-Backlog, RESTBase-API, affects-Kiwix-and-openZIM
Kelson added a comment to T274359: Mobile REST API delivers year old+ content for very select pages.

@Aklapper I thought you are in charge of the triage. What would be the proper thing to do?

Mar 4 2022, 8:20 AM · User-TheresNoTime, Patch-For-Review, Platform Engineering, Page Content Service, Product-Infrastructure-Team-Backlog, Wikipedia-Android-App-Backlog, RESTBase-API, affects-Kiwix-and-openZIM
Kelson added a comment to T274359: Mobile REST API delivers year old+ content for very select pages.

@Aklapper This still needs triage?

Mar 4 2022, 7:27 AM · User-TheresNoTime, Patch-For-Review, Platform Engineering, Page Content Service, Product-Infrastructure-Team-Backlog, Wikipedia-Android-App-Backlog, RESTBase-API, affects-Kiwix-and-openZIM

Mar 3 2022

Kelson created T302969: Wikiversity DE, FR, EN API HTTP 5xx errors.
Mar 3 2022, 11:50 AM · Parsoid, affects-Kiwix-and-openZIM

Feb 3 2022

Kelson added a comment to T43716: [EPIC] Support language variant conversion in Parsoid.

This ticket is important for the openZIM/Kiwix community and in particular its Chinese audience, see https://github.com/openzim/mwoffliner/issues/840

Feb 3 2022, 7:40 AM · Parsoid-Rendering, affects-Kiwix-and-openZIM, Parsoid, Platform Team Legacy (Watching / External), Services (watching), Epic, MediaWiki-Language-converter, Chinese-Sites, I18n
Kelson added a comment to T19189: Create also 'stable versions only' dumps for wikis with FlaggedRevs.

I have created a similar ticket at MWoffliner level https://github.com/openzim/mwoffliner/issues/1587.

Feb 3 2022, 7:37 AM · Dumps-Generation

Jan 27 2022

Kelson added a comment to T57503: Mirror more Kiwix downloads directories.

@ArielGlenn Thank you for putting WMCS in the loop. In which timeline this refresh should happen? I guess nothing will be done as far as this is not done.

Jan 27 2022, 10:07 AM · Cloud-Services, affects-Kiwix-and-openZIM, SRE, Datasets-General-or-Unknown
Kelson closed T299993: https://dumps.wikimedia.org/kiwix/ is no synced anymore as Resolved.
Jan 27 2022, 10:05 AM · Dumps-Generation, Datasets-General-or-Unknown, affects-Kiwix-and-openZIM
Kelson added a comment to T299993: https://dumps.wikimedia.org/kiwix/ is no synced anymore.

@ArielGlenn Thank you! It seems to me the problem has been fixed now. I see (again) recent ZIM files in https://dumps.wikimedia.org/kiwix/ and the Kiwix mirror manager too, see https://download.kiwix.org/zim/wikipedia/wikipedia_ab_all_nopic_2022-01.zim.mirrorlist.

Jan 27 2022, 10:05 AM · Dumps-Generation, Datasets-General-or-Unknown, affects-Kiwix-and-openZIM

Jan 25 2022

Kelson added a comment to T299993: https://dumps.wikimedia.org/kiwix/ is no synced anymore.

wikipedia_nan_all_maxi_2022-01.zim for example is not listed in https://dumps.wikimedia.org/other/kiwix/zim/wikipedia/... really strange!

Jan 25 2022, 11:01 AM · Dumps-Generation, Datasets-General-or-Unknown, affects-Kiwix-and-openZIM
Kelson added a comment to T57503: Mirror more Kiwix downloads directories.

@ArielGlenn Thank you for your feedback. I have created an other task here https://phabricator.wikimedia.org/T299993

Jan 25 2022, 7:12 AM · Cloud-Services, affects-Kiwix-and-openZIM, SRE, Datasets-General-or-Unknown
Kelson moved T57503: Mirror more Kiwix downloads directories from TRIAGE to TOP on the affects-Kiwix-and-openZIM board.
Jan 25 2022, 7:11 AM · Cloud-Services, affects-Kiwix-and-openZIM, SRE, Datasets-General-or-Unknown
Kelson created T299993: https://dumps.wikimedia.org/kiwix/ is no synced anymore.
Jan 25 2022, 7:11 AM · Dumps-Generation, Datasets-General-or-Unknown, affects-Kiwix-and-openZIM

Dec 23 2021

Kelson updated the task description for T57503: Mirror more Kiwix downloads directories.
Dec 23 2021, 6:45 PM · Cloud-Services, affects-Kiwix-and-openZIM, SRE, Datasets-General-or-Unknown
Kelson added a project to T57503: Mirror more Kiwix downloads directories: affects-Kiwix-and-openZIM.
Dec 23 2021, 6:44 PM · Cloud-Services, affects-Kiwix-and-openZIM, SRE, Datasets-General-or-Unknown
Kelson added a comment to T57503: Mirror more Kiwix downloads directories.

@ArielGlenn Any chance this ticket could be implemented some time? It seems as well that the Wikimedia does not mirror since at least a month because all the Wikipedia ZIM files are older than a month.

Dec 23 2021, 6:44 PM · Cloud-Services, affects-Kiwix-and-openZIM, SRE, Datasets-General-or-Unknown

Dec 19 2021

Kelson updated the task description for T298011: JPEG image is reported with the wrong mime-type application/octet-stream.
Dec 19 2021, 3:29 PM · Wikimedia-Site-requests, SRE-swift-storage, Commons, affects-Kiwix-and-openZIM
Kelson added projects to T298011: JPEG image is reported with the wrong mime-type application/octet-stream: affects-Kiwix-and-openZIM, Commons.
Dec 19 2021, 3:08 PM · Wikimedia-Site-requests, SRE-swift-storage, Commons, affects-Kiwix-and-openZIM
Kelson created T298011: JPEG image is reported with the wrong mime-type application/octet-stream.
Dec 19 2021, 3:07 PM · Wikimedia-Site-requests, SRE-swift-storage, Commons, affects-Kiwix-and-openZIM

Dec 14 2021

Kelson added a comment to T297563: Request increased quota for mwoffliner Cloud VPS project.

thx

Dec 14 2021, 7:41 AM · Cloud-VPS (Quota-requests)

Dec 12 2021

Kelson created T297563: Request increased quota for mwoffliner Cloud VPS project.
Dec 12 2021, 2:55 PM · Cloud-VPS (Quota-requests)

Dec 5 2021

Kelson added a comment to T226931: Parsoid cache invalidation for mobile-sections seems not reliable.

@TheDJ I have no stats, but the problem is common enough that we regularly get bug reports at Kiwix because of this sole bug. My guess is that this is at the same time pretty old and impacting a pretty large number of pages.

Dec 5 2021, 10:06 AM · affects-Kiwix-and-openZIM, ChangeProp, RESTBase
Kelson updated subscribers of T288889: Parsoid API not able to deliver HTML (HTTP 504) for certain (big) articles.

@Arlolra @tstarling The situation on this front has improved *a lot* these last months. I'm not sure to know who to thank you for that but please transmit my "thank you". That said the situation is not fully sanitised. I went through the past buggy examples and have added a few new ones which make recipes failing at https://farm.openzim.org:

Dec 5 2021, 9:51 AM · Parsoid, affects-Kiwix-and-openZIM

Oct 10 2021

Kelson added a comment to T274359: Mobile REST API delivers year old+ content for very select pages.

@Samtar Not that I'm aware of... and this is a pretty annoying one. We regularly have users (at Kiwix) complaining because of an old revision of an article because the REST API cache is not refreshed properly.

Oct 10 2021, 3:53 PM · User-TheresNoTime, Patch-For-Review, Platform Engineering, Page Content Service, Product-Infrastructure-Team-Backlog, Wikipedia-Android-App-Backlog, RESTBase-API, affects-Kiwix-and-openZIM

Oct 5 2021

Sunpriat2 awarded T274359: Mobile REST API delivers year old+ content for very select pages a Burninate token.
Oct 5 2021, 7:05 PM · User-TheresNoTime, Patch-For-Review, Platform Engineering, Page Content Service, Product-Infrastructure-Team-Backlog, Wikipedia-Android-App-Backlog, RESTBase-API, affects-Kiwix-and-openZIM

Oct 2 2021

TheresNoTime awarded T274359: Mobile REST API delivers year old+ content for very select pages a The World Burns token.
Oct 2 2021, 11:54 PM · User-TheresNoTime, Patch-For-Review, Platform Engineering, Page Content Service, Product-Infrastructure-Team-Backlog, Wikipedia-Android-App-Backlog, RESTBase-API, affects-Kiwix-and-openZIM

Oct 1 2021

Kelson added a comment to T271157: https://fr.wikipedia.org/wiki/MediaWiki:Common.js makes use of image alt text, which Parsoid doesn't output.

@Arlolra Thank you very much!

Oct 1 2021, 6:48 AM · Parsoid-Read-Views (Phase 0 - Parsoid-Media-Structure), Parsoid, Parsoid-Media-Structure

Sep 26 2021

Kelson added a project to T291779: Wikivoyage mobile picture caption rendering seems broken with REST API: Mobile-Content-Service.
Sep 26 2021, 2:05 PM · Mobile-Content-Service, Product-Infrastructure-Team-Backlog, affects-Kiwix-and-openZIM, Mobile, Parsoid
Kelson moved T291779: Wikivoyage mobile picture caption rendering seems broken with REST API from TRIAGE to NORMAL on the affects-Kiwix-and-openZIM board.
Sep 26 2021, 2:04 PM · Mobile-Content-Service, Product-Infrastructure-Team-Backlog, affects-Kiwix-and-openZIM, Mobile, Parsoid
Kelson created T291779: Wikivoyage mobile picture caption rendering seems broken with REST API.
Sep 26 2021, 2:04 PM · Mobile-Content-Service, Product-Infrastructure-Team-Backlog, affects-Kiwix-and-openZIM, Mobile, Parsoid

Sep 15 2021

Kelson added a comment to T206040: Timeout parsing largish page.

@tstarling Makes sense. Considering the age of this ticket, I focus myself on T288889 which is more recent and with a clearer symptom. I monitor it and update it time to time with new pages which don't render.

Sep 15 2021, 6:43 AM · affects-Kiwix-and-openZIM, Parsoid

Sep 14 2021

Kelson added a comment to T288889: Parsoid API not able to deliver HTML (HTTP 504) for certain (big) articles.

Another case with WPFR:

 time curl -sI "https://fr.wikipedia.org/api/rest_v1/page/mobile-sections/Liste_des_cantons_fran%C3%A7ais_depuis_2015" | grep 504
HTTP/2 504
Sep 14 2021, 7:05 AM · Parsoid, affects-Kiwix-and-openZIM
Kelson added a comment to T288889: Parsoid API not able to deliver HTML (HTTP 504) for certain (big) articles.

Other case:

$ time curl -sI "https://id.wikipedia.org/api/rest_v1/page/mobile-sections/Daftar_tokoh_Wales" | grep 504
HTTP/2 504 
Sep 14 2021, 6:58 AM · Parsoid, affects-Kiwix-and-openZIM

Sep 1 2021

Kelson added a comment to T284734: Parsoid rendering API returns (non-existing) redirect loops.

@Arlolra Thank you for the explanation. WPFI scrape now works fine, see https://farm.openzim.org/pipeline/742bcb9b43e0eecc7177e216

Sep 1 2021, 6:35 AM · Platform Team Workboards (Platform Engineering Reliability), RESTBase, Parsoid (Tracking), RESTBase-API, affects-Kiwix-and-openZIM

Aug 31 2021

Kelson added a comment to T284734: Parsoid rendering API returns (non-existing) redirect loops.

@Arlolra How to know when this fix will be deploy on production? Here and in general?

Aug 31 2021, 6:37 PM · Platform Team Workboards (Platform Engineering Reliability), RESTBase, Parsoid (Tracking), RESTBase-API, affects-Kiwix-and-openZIM

Aug 29 2021

Kelson added a comment to T289921: Gallery seems not always parsed properly.

For the reference, problem was reported first at https://github.com/openzim/mwoffliner/issues/1520

Aug 29 2021, 8:08 AM · Parsoid-Rendering, affects-Kiwix-and-openZIM
Kelson added a comment to T289921: Gallery seems not always parsed properly.

@ssastry Thx, should have seen myself.

Aug 29 2021, 8:07 AM · Parsoid-Rendering, affects-Kiwix-and-openZIM

Aug 28 2021

Kelson moved T289921: Gallery seems not always parsed properly from TRIAGE to NORMAL on the affects-Kiwix-and-openZIM board.
Aug 28 2021, 2:34 PM · Parsoid-Rendering, affects-Kiwix-and-openZIM
Kelson created T289921: Gallery seems not always parsed properly.
Aug 28 2021, 2:34 PM · Parsoid-Rendering, affects-Kiwix-and-openZIM
Kelson added a comment to T281125: Incorrect image dimension received in HTML fetched using mobile version of rest api.

@Aklapper The problem is clearly visible (from a user perspective) on the REST desktop HTML as well, look at:
https://ru.wikipedia.org/api/rest_v1/page/html/%D0%A2%D0%AD%D0%9C2#%D0%93%D0%B0%D0%BB%D0%B5%D1%80%D0%B5%D1%8F

Aug 28 2021, 2:31 PM · RESTBase-API, affects-Kiwix-and-openZIM
Kelson added a comment to T217540: After renaming image files on Commons, MCS still points to old 404 thumbnail URLs.

A user newly reported to us about missing images in the REST API HTML output because of this bug:

Aug 28 2021, 2:06 PM · Parsoid (Tracking), affects-Kiwix-and-openZIM, ChangeProp, Product-Infrastructure-Team-Backlog

Aug 20 2021

Kelson moved T206040: Timeout parsing largish page from TRIAGE to TOP on the affects-Kiwix-and-openZIM board.
Aug 20 2021, 7:23 AM · affects-Kiwix-and-openZIM, Parsoid
Kelson moved T275505: Timeout on pages with lots of templates from TRIAGE to TOP on the affects-Kiwix-and-openZIM board.
Aug 20 2021, 7:23 AM · affects-Kiwix-and-openZIM, Performance Issue, Parsoid
Kelson added a comment to T275505: Timeout on pages with lots of templates.

Here probably an other case:

$ time curl -sI "https://zh.wikisource.org/api/rest_v1/page/html/%E6%98%8E%E6%9C%AC%E6%8E%92%E5%AD%97%E4%B9%9D%E7%B6%93%E7%9B%B4%E9%9F%B3_(%E5%9B%9B%E5%BA%AB%E5%85%A8%E6%9B%B8%E6%9C%AC)%2F%E5%8D%B7%E4%B8%8B" | grep 504
HTTP/2 504 
Aug 20 2021, 7:23 AM · affects-Kiwix-and-openZIM, Performance Issue, Parsoid
Kelson added a project to T275505: Timeout on pages with lots of templates: affects-Kiwix-and-openZIM.
Aug 20 2021, 7:22 AM · affects-Kiwix-and-openZIM, Performance Issue, Parsoid

Aug 19 2021

Kelson added a comment to T284693: Wikimedia\Assert\InvariantException: Invariant failed: Bad UTF-8 at end of string (3 byte sequence).

@Krinkle Thx

Aug 19 2021, 12:57 PM · Parsoid-Read-Views, Parsoid, Wikimedia-production-error
Kelson added a comment to T288889: Parsoid API not able to deliver HTML (HTTP 504) for certain (big) articles.

Other case:

$ time curl -sI "https://de.wikisource.org/api/rest_v1/page/html/Schwere%2C_Elektricit%C3%A4t_und_Magnetismus%2FErster_Theil" | grep 504
HTTP/2 504 
Aug 19 2021, 12:54 PM · Parsoid, affects-Kiwix-and-openZIM
Kelson added a comment to T288889: Parsoid API not able to deliver HTML (HTTP 504) for certain (big) articles.

Other case:

$ time curl -sI "https://zh.wikisource.org/api/rest_v1/page/html/%E6%98%8E%E6%9C%AC%E6%8E%92%E5%AD%97%E4%B9%9D%E7%B6%93%E7%9B%B4%E9%9F%B3_(%E5%9B%9B%E5%BA%AB%E5%85%A8%E6%9B%B8%E6%9C%AC)%2F%E5%8D%B7%E4%B8%8B" | grep 504
HTTP/2 504 
Aug 19 2021, 12:52 PM · Parsoid, affects-Kiwix-and-openZIM
Kelson added a comment to T288889: Parsoid API not able to deliver HTML (HTTP 504) for certain (big) articles.

@Arlolra Sounds good. Overall situation with Wiki timeouts/errors has been improved over the past months, but we still have problems to fully scrape many of them, mostly the big ones. Will keep trying to attach our MWoffliner tickets to Phabricator tickets so info keep percolating up to you :)

Aug 19 2021, 10:58 AM · Parsoid, affects-Kiwix-and-openZIM
Kelson added a comment to T284734: Parsoid rendering API returns (non-existing) redirect loops.

@Arlolra Thank you for enlighting a bit all this server errors and help us to have a differentiated view on the global problem.

Aug 19 2021, 10:55 AM · Platform Team Workboards (Platform Engineering Reliability), RESTBase, Parsoid (Tracking), RESTBase-API, affects-Kiwix-and-openZIM
Kelson added a comment to T238285: Pages whose title ends with semicolon (;) are intermittently inaccessible (likely due to ATS).

This seems to be the root cause of:
https://el.wikipedia.org/api/rest_v1/page/mobile-sections/%CE%A5%CF%80%CE%AC%CF%81%CF%87%CE%BF%CF%85%CE%BD_%CE%A7%CF%81%CF%85%CF%83%CF%8C%CF%88%CE%B1%CF%81%CE%B1_%CE%95%CE%B4%CF%8E%3B

Aug 19 2021, 10:48 AM · Traffic-Icebox, affects-Kiwix-and-openZIM, WMF-General-or-Unknown, SRE, User-DannyS712
Kelson added a comment to T206040: Timeout parsing largish page.

Kiwix users are continously reporting oddities regarding content and content formating. We are challenged to identify if the problem is in MWoffliner or upstream. To help identify where things go wrong, earlier this year, MWoffliner has started to be stricter regarding the Mediawiki backend HTTP responses. For example if we get HTTP 5xx errors, MWoffliner now dies. If the Parsoid does not deliver because of performance issue(s), then it will probably ends with an HTTP 504 or 502 error at the API backend level. This is why this ticket and all the siblings of that kind are really important to us. For the moment, one of this case within the 6M articles of WPEN, and MWoffliner just stops the whole scrape.

Aug 19 2021, 6:15 AM · affects-Kiwix-and-openZIM, Parsoid
Kelson added a project to T206040: Timeout parsing largish page: affects-Kiwix-and-openZIM.
Aug 19 2021, 6:07 AM · affects-Kiwix-and-openZIM, Parsoid

Aug 18 2021

Kelson added a comment to T284734: Parsoid rendering API returns (non-existing) redirect loops.

@Arlolra The problem with https://fi.wikipedia.org/api/rest_v1/page/mobile-sections/S%C3%A4teily%C2%ADpaine is still there, so if this is a cache problem, it does not disappear quickly :(

Aug 18 2021, 2:28 PM · Platform Team Workboards (Platform Engineering Reliability), RESTBase, Parsoid (Tracking), RESTBase-API, affects-Kiwix-and-openZIM
Kelson added a comment to T284734: Parsoid rendering API returns (non-existing) redirect loops.

This impacts many wikis, here an other example with WPEL:
https://el.wikipedia.org/api/rest_v1/page/mobile-sections/%CE%A5%CF%80%CE%AC%CF%81%CF%87%CE%BF%CF%85%CE%BD_%CE%A7%CF%81%CF%85%CF%83%CF%8C%CF%88%CE%B1%CF%81%CE%B1_%CE%95%CE%B4%CF%8E%3B

Aug 18 2021, 2:25 PM · Platform Team Workboards (Platform Engineering Reliability), RESTBase, Parsoid (Tracking), RESTBase-API, affects-Kiwix-and-openZIM
Kelson added a comment to T288889: Parsoid API not able to deliver HTML (HTTP 504) for certain (big) articles.

An other example https://fr.wikipedia.org/api/rest_v1/page/mobile-sections/Liste_des_cantons_fran%C3%A7ais_depuis_2015

Aug 18 2021, 10:26 AM · Parsoid, affects-Kiwix-and-openZIM

Aug 15 2021

Kelson added a comment to T274359: Mobile REST API delivers year old+ content for very select pages.

New case with https://github.com/openzim/mwoffliner/issues/1526

Aug 15 2021, 4:15 PM · User-TheresNoTime, Patch-For-Review, Platform Engineering, Page Content Service, Product-Infrastructure-Team-Backlog, Wikipedia-Android-App-Backlog, RESTBase-API, affects-Kiwix-and-openZIM
Kelson added a comment to T274359: Mobile REST API delivers year old+ content for very select pages.

Might be the same root cause as T226931

Aug 15 2021, 4:13 PM · User-TheresNoTime, Patch-For-Review, Platform Engineering, Page Content Service, Product-Infrastructure-Team-Backlog, Wikipedia-Android-App-Backlog, RESTBase-API, affects-Kiwix-and-openZIM
Kelson renamed T226931: Parsoid cache invalidation for mobile-sections seems not reliable from Parsoid cache invalidation seems not reliable to Parsoid cache invalidation seems not reliable (only on mobile API?).
Aug 15 2021, 4:04 PM · affects-Kiwix-and-openZIM, ChangeProp, RESTBase
Kelson added a comment to T226931: Parsoid cache invalidation for mobile-sections seems not reliable.

Could we do something to avoid the API to release months old pages. I wonder a bit that since two years, this ticket is not even triaged.

Aug 15 2021, 4:03 PM · affects-Kiwix-and-openZIM, ChangeProp, RESTBase

Aug 14 2021

Kelson updated subscribers of T288889: Parsoid API not able to deliver HTML (HTTP 504) for certain (big) articles.

@Arlolra HTTP error code is not the same but otherwise looks for me to be a similar problem like https://phabricator.wikimedia.org/T280381

Aug 14 2021, 2:55 PM · Parsoid, affects-Kiwix-and-openZIM
Kelson renamed T288889: Parsoid API not able to deliver HTML (HTTP 504) for certain (big) articles from Parsoid API not able to deliver for certain (big) article to Parsoid API not able to deliver HTML (HTTP 504) for certain (big) articles.
Aug 14 2021, 2:54 PM · Parsoid, affects-Kiwix-and-openZIM