Page MenuHomePhabricator

Kelson (Kelson)
User

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Thursday

  • Clear sailing ahead.

User Details

User Since
Oct 7 2014, 7:43 AM (345 w, 4 h)
Availability
Available
IRC Nick
kelson
LDAP User
Kelson
MediaWiki User
Kelson [ Global Accounts ]

Recent Activity

Fri, May 14

Kelson added a comment to T280381: 413 error while trying to fetch using desktop api.

@Arlolra Thank you for the quick move. In an attempt to help you diagnose the problem (or verify the patch works fine), here is a list of other URLS suffering for the same symptom:

Fri, May 14, 1:16 PM · Patch-For-Review, Parsoid, Services, affects-Kiwix-and-openZIM, RESTBase-API

Sun, May 9

Kelson added a project to T239841: Parsoid resource limits and metrics use mb_strlen, which is (a) inconsistent w/ Parser.php and (b) slow: affects-Kiwix-and-openZIM.
Sun, May 9, 12:40 PM · affects-Kiwix-and-openZIM, Parsoid
Kelson added a project to T254522: Set appropriate wikitext limits for Parsoid to ensure it doesn't OOM: affects-Kiwix-and-openZIM.
Sun, May 9, 12:38 PM · affects-Kiwix-and-openZIM, Parsoid
Kelson added a project to T211946: Bump parsoid resource limits in production: affects-Kiwix-and-openZIM.
Sun, May 9, 12:38 PM · affects-Kiwix-and-openZIM, Parsoid
Kelson added a comment to T280381: 413 error while trying to fetch using desktop api.

@Arlorla Thank you so much for your effort. I'm not sure if this (kind of) problem is old or if this is a regression because at the same time we tend to make MWoffliner more strict. What is sure is that it impacts maybe 40% of all wikis and that we barelly can scrape fully a big Wikipedia anymore.

Sun, May 9, 12:35 PM · Patch-For-Review, Parsoid, Services, affects-Kiwix-and-openZIM, RESTBase-API

Sat, May 8

Kelson updated subscribers of T280381: 413 error while trying to fetch using desktop api.

@Arlolra I allow myself to ping you on this as the impact is super high for us and I don't know who else to ping. That said, not sure if this is an error in Parsoid or in the API service itself.

Sat, May 8, 1:46 PM · Patch-For-Review, Parsoid, Services, affects-Kiwix-and-openZIM, RESTBase-API

Mon, May 3

Kelson added a comment to T260223: Kiwix rsyncs not completing and stacking up on labstore1006,7.

I have move from 6 slots to 10, hopefully this won't destabalised the server.

Mon, May 3, 7:30 PM · affects-Kiwix-and-openZIM, Dumps-Generation, cloud-services-team (Kanban)
Kelson moved T162360: Differences in Parsoid HTML compared to PHP parser output breaks javascript that is tailored ot the PHP parser output from TRIAGE to NICE TO HAVE on the affects-Kiwix-and-openZIM board.
Mon, May 3, 7:35 AM · affects-Kiwix-and-openZIM, Parsoid
Kelson moved T244494: Retain custom attributes added to the resource tag for AndroidXmlFFS from TRIAGE to NICE TO HAVE on the affects-Kiwix-and-openZIM board.
Mon, May 3, 7:34 AM · affects-Kiwix-and-openZIM, MediaWiki-extensions-Translate
Kelson moved T245106: Character recommendation validator from TRIAGE to NICE TO HAVE on the affects-Kiwix-and-openZIM board.
Mon, May 3, 7:34 AM · affects-Kiwix-and-openZIM, MediaWiki-extensions-Translate
Kelson moved T260223: Kiwix rsyncs not completing and stacking up on labstore1006,7 from TRIAGE to NICE TO HAVE on the affects-Kiwix-and-openZIM board.
Mon, May 3, 7:34 AM · affects-Kiwix-and-openZIM, Dumps-Generation, cloud-services-team (Kanban)
Kelson added a comment to T260223: Kiwix rsyncs not completing and stacking up on labstore1006,7.

@ArielGlenn Still a problem?

Mon, May 3, 7:34 AM · affects-Kiwix-and-openZIM, Dumps-Generation, cloud-services-team (Kanban)
Kelson moved T263528: Specific article not available via REST API from TRIAGE to NORMAL on the affects-Kiwix-and-openZIM board.
Mon, May 3, 7:32 AM · RESTBase-API, affects-Kiwix-and-openZIM
Kelson moved T270833: Span node title attribute not (always?) rendered properly in mobile from TRIAGE to TOP on the affects-Kiwix-and-openZIM board.
Mon, May 3, 7:32 AM · affects-Kiwix-and-openZIM, Parsoid-Rendering
Kelson moved T281125: Incorrect image dimension received in HTML fetched using mobile version of rest api from TRIAGE to NORMAL on the affects-Kiwix-and-openZIM board.
Mon, May 3, 7:32 AM · RESTBase-API, affects-Kiwix-and-openZIM
Kelson moved T281652: Incorrect Mobile rest api response: <style> element's "width" attribute contains a location string from TRIAGE to NORMAL on the affects-Kiwix-and-openZIM board.
Mon, May 3, 7:32 AM · Parsoid, Product-Infrastructure-Team-Backlog, Mobile-Content-Service, affects-Kiwix-and-openZIM
Kelson added a comment to T281652: Incorrect Mobile rest api response: <style> element's "width" attribute contains a location string.

The root problem is in the wiki code (free text in place of size in pixel)... but probably Parsoid should not generated broken HTML of it.

Mon, May 3, 7:30 AM · Parsoid, Product-Infrastructure-Team-Backlog, Mobile-Content-Service, affects-Kiwix-and-openZIM

Sat, May 1

Kelson added a comment to T280381: 413 error while trying to fetch using desktop api.

@Aklapper This bug is a serious one for the Kiwix team as it impacts many (proeminent) Wikimedia wikis and make our whole scraping dying because the backend does not deliver. Any chance someone could have a look why such given URLs simply fail in the backend?

Sat, May 1, 7:24 PM · Patch-For-Review, Parsoid, Services, affects-Kiwix-and-openZIM, RESTBase-API
Kelson updated the task description for T280381: 413 error while trying to fetch using desktop api.
Sat, May 1, 7:17 PM · Patch-For-Review, Parsoid, Services, affects-Kiwix-and-openZIM, RESTBase-API
Kelson added a comment to T280381: 413 error while trying to fetch using desktop api.

Mobile API is impacted as well, see for example https://de.wikipedia.org/api/rest_v1/page/mobile-sections/Chronik_der_COVID-19-Pandemie_in_den_Vereinigten_Staaten_2020

Sat, May 1, 7:16 PM · Patch-For-Review, Parsoid, Services, affects-Kiwix-and-openZIM, RESTBase-API

Mon, Apr 26

Kelson added a project to T281125: Incorrect image dimension received in HTML fetched using mobile version of rest api: affects-Kiwix-and-openZIM.
Mon, Apr 26, 12:12 PM · RESTBase-API, affects-Kiwix-and-openZIM
Kelson moved T280381: 413 error while trying to fetch using desktop api from TRIAGE to TOP on the affects-Kiwix-and-openZIM board.
Mon, Apr 26, 8:36 AM · Patch-For-Review, Parsoid, Services, affects-Kiwix-and-openZIM, RESTBase-API
Kelson added a project to T280381: 413 error while trying to fetch using desktop api: affects-Kiwix-and-openZIM.
Mon, Apr 26, 8:36 AM · Patch-For-Review, Parsoid, Services, affects-Kiwix-and-openZIM, RESTBase-API

Apr 6 2021

Kelson added a comment to T257344: The #categorytree magic word doesn't seem to work in VisualEditor.

@ssastry thx a lot!

Apr 6 2021, 2:23 PM · affects-Kiwix-and-openZIM, Editing-team (Tracking), Parsoid, VisualEditor, MediaWiki-extensions-CategoryTree
Kelson added a comment to T257344: The #categorytree magic word doesn't seem to work in VisualEditor.

@arlorla Great to see a patch here. Thx! A few users had reported the problem on our side over the years. What is the timeline for prod? https://ru.wikipedia.org/api/rest_v1/page/html/%D0%9D%D0%B0%D0%BC%D0%B8%D0%B1%D0%B8%D1%8F#mwAdg seems to be still buggy.

Apr 6 2021, 11:48 AM · affects-Kiwix-and-openZIM, Editing-team (Tracking), Parsoid, VisualEditor, MediaWiki-extensions-CategoryTree

Apr 4 2021

Kelson added a comment to T56668: Parsoid problem with the <pages> tag, wrong navigation links.

@Arlolra Indeed and it seems to work fine in the ZIM as well http://library.kiwix.org/wikisource_fr_all_maxi/A/De_la_litt%C3%A9rature_des_n%C3%A8gres/4. Thx.

Apr 4 2021, 3:15 PM · Parsoid
Kelson added a comment to T278061: API does not list ResourceLoader Mathjax module when needed.

@Krinkle Thx, I'm still in touch with a developer of this custom version of MathJax extension and he will try to load the MathJax js code within the ResourceLoader.

Apr 4 2021, 2:20 PM · MediaWiki-ResourceLoader, Performance-Team, affects-Kiwix-and-openZIM

Mar 28 2021

Kelson added a comment to T278061: API does not list ResourceLoader Mathjax module when needed.

@Krinkle I have mailed someone at Proofwiki and it was given to me the following link (seems to be and older Version of the MathJax extension) https://www.mediawiki.org/w/index.php?title=Extension:MathJax&oldid=1184913. Not sure what would be the next step. Would that simply work if they update the extension to the latest version?

Mar 28 2021, 1:42 PM · MediaWiki-ResourceLoader, Performance-Team, affects-Kiwix-and-openZIM

Mar 27 2021

Kelson added a comment to T257292: API should return HTTP 404 in case of missing Graphoid picture.

Might that be that this ticket has been invalided by the deprecation of server-side Graphoid charts rendering?

Mar 27 2021, 3:10 PM · affects-Kiwix-and-openZIM, RESTBase-API, Graphoid

Mar 26 2021

Kelson moved T209277: Mobile View MathML Fallback Image doesn't have `alt` property from TRIAGE to TOP on the affects-Kiwix-and-openZIM board.
Mar 26 2021, 8:20 AM · affects-Kiwix-and-openZIM, Parsoid
Kelson added a comment to T209277: Mobile View MathML Fallback Image doesn't have `alt` property.
Mar 26 2021, 7:50 AM · affects-Kiwix-and-openZIM, Parsoid
Kelson renamed T209277: Mobile View MathML Fallback Image doesn't have `alt` property from Mobile View MathML Fallback Image doesn't have `alttext` property to Mobile View MathML Fallback Image doesn't have `alt` property.
Mar 26 2021, 7:49 AM · affects-Kiwix-and-openZIM, Parsoid
Kelson added a comment to T209277: Mobile View MathML Fallback Image doesn't have `alt` property.

A few days ago a user has open a third ticket (https://github.com/openzim/mwoffliner/issues/1402) about that on MWoffliner. I don't really understand why this old bug, which seems easy to fix, has not been tackled so far.

Mar 26 2021, 7:48 AM · affects-Kiwix-and-openZIM, Parsoid
Kelson added a project to T209277: Mobile View MathML Fallback Image doesn't have `alt` property: affects-Kiwix-and-openZIM.
Mar 26 2021, 7:47 AM · affects-Kiwix-and-openZIM, Parsoid

Mar 25 2021

Kelson added a project to T162360: Differences in Parsoid HTML compared to PHP parser output breaks javascript that is tailored ot the PHP parser output: affects-Kiwix-and-openZIM.
Mar 25 2021, 7:55 AM · affects-Kiwix-and-openZIM, Parsoid

Mar 23 2021

Kelson added a comment to T278061: API does not list ResourceLoader Mathjax module when needed.

@Krinkle I thought first from https://proofwiki.org/wiki/Special:Version that it was https://www.mediawiki.org/wiki/Extension:MathJax... but now I have a big doubt.

Mar 23 2021, 7:49 AM · MediaWiki-ResourceLoader, Performance-Team, affects-Kiwix-and-openZIM

Mar 21 2021

Kelson moved T238285: Pages whose title ends with semicolon (;) are intermittently inaccessible (likely due to ATS) from TRIAGE to NORMAL on the affects-Kiwix-and-openZIM board.
Mar 21 2021, 6:40 PM · affects-Kiwix-and-openZIM, Wikimedia-General-or-Unknown, SRE, Traffic, User-DannyS712
Kelson moved T274359: (Wiktionary) Mobile REST API does not (always) deliver HTML for latest revid from TRIAGE to TOP on the affects-Kiwix-and-openZIM board.
Mar 21 2021, 6:40 PM · RESTBase-API, affects-Kiwix-and-openZIM
Kelson moved T278061: API does not list ResourceLoader Mathjax module when needed from TRIAGE to NORMAL on the affects-Kiwix-and-openZIM board.
Mar 21 2021, 6:40 PM · MediaWiki-ResourceLoader, Performance-Team, affects-Kiwix-and-openZIM
Kelson created T278061: API does not list ResourceLoader Mathjax module when needed.
Mar 21 2021, 6:38 PM · MediaWiki-ResourceLoader, Performance-Team, affects-Kiwix-and-openZIM

Mar 18 2021

Kelson added a comment to T199070: Some nested refs not handled properly in Parsoid?.

@Arlolra Thx for the patch. Hopefuly soon in prod!

Mar 18 2021, 2:21 PM · affects-Kiwix-and-openZIM, Parsoid-Rendering, Parsoid, Cite

Feb 18 2021

Kelson added a project to T238285: Pages whose title ends with semicolon (;) are intermittently inaccessible (likely due to ATS): affects-Kiwix-and-openZIM.
Feb 18 2021, 9:09 AM · affects-Kiwix-and-openZIM, Wikimedia-General-or-Unknown, SRE, Traffic, User-DannyS712

Feb 10 2021

Kelson updated the task description for T274359: (Wiktionary) Mobile REST API does not (always) deliver HTML for latest revid.
Feb 10 2021, 1:10 PM · RESTBase-API, affects-Kiwix-and-openZIM
Kelson added a project to T274359: (Wiktionary) Mobile REST API does not (always) deliver HTML for latest revid: RESTBase-API.
Feb 10 2021, 1:09 PM · RESTBase-API, affects-Kiwix-and-openZIM
Kelson created T274359: (Wiktionary) Mobile REST API does not (always) deliver HTML for latest revid.
Feb 10 2021, 1:08 PM · RESTBase-API, affects-Kiwix-and-openZIM

Jan 26 2021

Kelson added a comment to T244494: Retain custom attributes added to the resource tag for AndroidXmlFFS.

We came back to this ticket on Kiwix side with https://github.com/kiwix/kiwix-android/pull/2562#issuecomment-767382951

Jan 26 2021, 12:17 PM · affects-Kiwix-and-openZIM, MediaWiki-extensions-Translate

Jan 21 2021

Kelson added a comment to T269609: Ensure all ToolsDB databases comply with current naming conventions.

@Audiodude and me are the maintainers. I got an email to inform me about this ticket.

Jan 21 2021, 6:45 PM · Developer-Advocacy (Apr-Jun 2021), cloud-services-team (Kanban), Data-Services

Jan 5 2021

Kelson added a project to T257344: The #categorytree magic word doesn't seem to work in VisualEditor: affects-Kiwix-and-openZIM.
Jan 5 2021, 8:38 AM · affects-Kiwix-and-openZIM, Editing-team (Tracking), Parsoid, VisualEditor, MediaWiki-extensions-CategoryTree
Kelson moved T257344: The #categorytree magic word doesn't seem to work in VisualEditor from TRIAGE to NORMAL on the affects-Kiwix-and-openZIM board.
Jan 5 2021, 8:38 AM · affects-Kiwix-and-openZIM, Editing-team (Tracking), Parsoid, VisualEditor, MediaWiki-extensions-CategoryTree
Kelson updated subscribers of T257344: The #categorytree magic word doesn't seem to work in VisualEditor.
Jan 5 2021, 8:36 AM · affects-Kiwix-and-openZIM, Editing-team (Tracking), Parsoid, VisualEditor, MediaWiki-extensions-CategoryTree
Kelson added a comment to T257344: The #categorytree magic word doesn't seem to work in VisualEditor.

An other example: here is the Classic rendering:
https://ru.wikipedia.org/wiki/%D0%9D%D0%B0%D0%BC%D0%B8%D0%B1%D0%B8%D1%8F#%D0%A1%D0%BC._%D1%82%D0%B0%D0%BA%D0%B6%D0%B5

Jan 5 2021, 8:36 AM · affects-Kiwix-and-openZIM, Editing-team (Tracking), Parsoid, VisualEditor, MediaWiki-extensions-CategoryTree

Jan 3 2021

Kelson added a comment to T227851: LI Wiktionary Main page returned incorrectly.

Someone has fixed the problem in the wiki source at https://li.wiktionary.org/w/index.php?title=Wiktionary%3AVeurblaad&type=revision&diff=645102&oldid=628893.

Jan 3 2021, 2:37 PM · affects-Kiwix-and-openZIM, Parsoid

Jan 1 2021

Kelson added a comment to T217540: Mobile-Sections returns missing images.

Still a new case here: https://es.wikipedia.org/api/rest_v1/page/html/Anexo:Baloncesto_en_los_Juegos_Mediterr%C3%A1neos_de_1951, 15 days after image renaming on Commons (https://commons.wikimedia.org/w/index.php?title=Special:Log&page=File%3AFlag+of+Egypt+%281922%E2%80%931958%29.svg), the rendered HTML still points to a the wrong/old/404 thumbnail.

Jan 1 2021, 3:28 PM · affects-Kiwix-and-openZIM, ChangeProp, Product-Infrastructure-Team-Backlog

Dec 26 2020

Kelson updated the task description for T270833: Span node title attribute not (always?) rendered properly in mobile.
Dec 26 2020, 10:47 AM · affects-Kiwix-and-openZIM, Parsoid-Rendering
Kelson created T270833: Span node title attribute not (always?) rendered properly in mobile.
Dec 26 2020, 10:45 AM · affects-Kiwix-and-openZIM, Parsoid-Rendering
Kelson added a comment to T227851: LI Wiktionary Main page returned incorrectly.

@ssastry Thank you very much for the analysis.

Dec 26 2020, 10:27 AM · affects-Kiwix-and-openZIM, Parsoid

Dec 24 2020

Kelson added a project to T227851: LI Wiktionary Main page returned incorrectly: affects-Kiwix-and-openZIM.
Dec 24 2020, 3:28 PM · affects-Kiwix-and-openZIM, Parsoid
Kelson added a comment to T227851: LI Wiktionary Main page returned incorrectly.

@Aklapper I tend to think the problem is real but maybe has been wrongly reported.

Dec 24 2020, 3:27 PM · affects-Kiwix-and-openZIM, Parsoid

Dec 9 2020

Kelson added a comment to T269513: Leaked enwp10 replica.my.cnf/WP 1.0 bot botpassword credentials to Github.

I have found the password for "WP 1.0 bot" (Thank you backup!)

Dec 9 2020, 8:01 AM · cloud-services-team (Kanban), Security

Oct 8 2020

Kelson moved T265006: HTTP Mime-Type now always returned properly if "If-None-Match" request header used from TRIAGE to NICE TO HAVE on the affects-Kiwix-and-openZIM board.
Oct 8 2020, 10:32 AM · Thumbor, SRE-swift-storage, affects-Kiwix-and-openZIM, Commons
Kelson created T265006: HTTP Mime-Type now always returned properly if "If-None-Match" request header used.
Oct 8 2020, 10:27 AM · Thumbor, SRE-swift-storage, affects-Kiwix-and-openZIM, Commons

Sep 26 2020

Kelson added a comment to T263528: Specific article not available via REST API.

@ArielGlenn Oh yes... sounds a good candidate. Thx for linking both tickets!

Sep 26 2020, 3:08 PM · RESTBase-API, affects-Kiwix-and-openZIM

Sep 23 2020

Kelson added a comment to T263528: Specific article not available via REST API.

@ArielGlenn Seems you are right. Indeed Stripped from the link, see https://el.wikibooks.org/api/rest_v1/page/html/inux_%CE%B3%CE%B9%CE%B1_%CE%B1%CF%81%CF%87%CE%AC%CF%81%CE%B9%CE%BF%CF%85%CF%82%2F%CE%93%CE%B9%CE%B1%CF%84%CE%AF_Linux%3B

Sep 23 2020, 12:34 PM · RESTBase-API, affects-Kiwix-and-openZIM
Kelson added a comment to T263528: Specific article not available via REST API.

@ArielGlenn I have put the online link as a reference. It is not deleted and if there is a typo, where (I can not find it)? You can see the problem differently: how to get the Parsoid output via REST api for this very specific article?

Sep 23 2020, 7:47 AM · RESTBase-API, affects-Kiwix-and-openZIM

Sep 22 2020

Kelson updated the task description for T263528: Specific article not available via REST API.
Sep 22 2020, 9:32 AM · RESTBase-API, affects-Kiwix-and-openZIM
Kelson created T263528: Specific article not available via REST API.
Sep 22 2020, 9:31 AM · RESTBase-API, affects-Kiwix-and-openZIM

Jul 27 2020

Kelson added a comment to T253836: Update quotas for MWoffliner VPS.

@Andrew mwoffliner1 & mwoffliner3 have been re-created. Hope this solves your problem :)

Jul 27 2020, 7:18 AM · Cloud-VPS (Quota-requests), affects-Kiwix-and-openZIM

Jul 21 2020

Kelson added a comment to T256217: Swift sends ETAG without double-quotes.

@ema not really this is case which had to be handled in MWoffliner. This is all.

Jul 21 2020, 1:40 PM · SRE-swift-storage, SRE, Traffic, affects-Kiwix-and-openZIM

Jul 16 2020

Kelson added a comment to T253836: Update quotas for MWoffliner VPS.

@Andrew Then good to me. Would deleting the instance and recreating them be good enough to solve our problem? Or should we follow an other procedure?

Jul 16 2020, 7:20 AM · Cloud-VPS (Quota-requests), affects-Kiwix-and-openZIM

Jul 15 2020

Kelson added a comment to T253836: Update quotas for MWoffliner VPS.

@Andrew Hi Andrew. About which VMs are with talking about exactly? mwoffliner1, mwoffliner2 and mwoffliner3? It is possible for us to invest time to recreate them but I would like to secure with you than we won't get weaker hardware. This is really critical point for us that they get really similar hardware (like mwoffliner5).

Jul 15 2020, 10:00 AM · Cloud-VPS (Quota-requests), affects-Kiwix-and-openZIM

Jul 7 2020

Kelson moved T236892: Communicate transition of Graph/Graphoid to client-side only JavaScript feature from TRIAGE to NICE TO HAVE on the affects-Kiwix-and-openZIM board.
Jul 7 2020, 8:53 AM · CommRel-Specialists-Support (Oct-Dec-2020), affects-Kiwix-and-openZIM
Kelson added a project to T236892: Communicate transition of Graph/Graphoid to client-side only JavaScript feature: affects-Kiwix-and-openZIM.
Jul 7 2020, 8:53 AM · CommRel-Specialists-Support (Oct-Dec-2020), affects-Kiwix-and-openZIM
Kelson moved T257292: API should return HTTP 404 in case of missing Graphoid picture from TRIAGE to NORMAL on the affects-Kiwix-and-openZIM board.
Jul 7 2020, 8:47 AM · affects-Kiwix-and-openZIM, RESTBase-API, Graphoid
Kelson created T257292: API should return HTTP 404 in case of missing Graphoid picture.
Jul 7 2020, 8:46 AM · affects-Kiwix-and-openZIM, RESTBase-API, Graphoid

Jun 24 2020

Kelson moved T256217: Swift sends ETAG without double-quotes from TRIAGE to NORMAL on the affects-Kiwix-and-openZIM board.
Jun 24 2020, 10:09 AM · SRE-swift-storage, SRE, Traffic, affects-Kiwix-and-openZIM
Kelson created T256217: Swift sends ETAG without double-quotes.
Jun 24 2020, 10:09 AM · SRE-swift-storage, SRE, Traffic, affects-Kiwix-and-openZIM

Jun 21 2020

Legoktm awarded T255392: August 2020 Wikimedia Technical Talk: openZIM/Kiwix ETL toolchain for Wikipedia dumping a Love token.
Jun 21 2020, 1:30 AM · Wikimedia-Tech-Talks, User-srodlund, Developer-Advocacy (Jul-Sep 2020), affects-Kiwix-and-openZIM, Documentation

Jun 17 2020

Kelson added a comment to T255524: HTML Dumps 429 error on RESTBase endpoints.

@CDanis We get many HTTP 429 errors from the rest(base) API if we scrape with nodes outside the VPS cluster. Really a hassle to deal with. It seems to me we are impacted... But maybe I get something wrong.

Jun 17 2020, 10:23 AM · Traffic, SRE

Jun 16 2020

chasemp awarded T255392: August 2020 Wikimedia Technical Talk: openZIM/Kiwix ETL toolchain for Wikipedia dumping a Mountain of Wealth token.
Jun 16 2020, 8:37 PM · Wikimedia-Tech-Talks, User-srodlund, Developer-Advocacy (Jul-Sep 2020), affects-Kiwix-and-openZIM, Documentation
Kelson moved T255524: HTML Dumps 429 error on RESTBase endpoints from TRIAGE to TOP on the affects-Kiwix-and-openZIM board.
Jun 16 2020, 11:09 AM · Traffic, SRE
Kelson added a project to T255524: HTML Dumps 429 error on RESTBase endpoints: affects-Kiwix-and-openZIM.
Jun 16 2020, 11:09 AM · Traffic, SRE

Jun 15 2020

Kelson added a comment to T254275: HTML Dumps - June/2020.

FYI: Because it seems there is a knowledge/communication gap about openZIM/Kiwix dumping solution, a Tech talk is currently being planned (probably in August) https://phabricator.wikimedia.org/T255392. If you have questions/concerns/remarks, please make comments on that ticket. I will secure that the presentation address them.

Jun 15 2020, 6:48 AM · Okapi [Wikimedia Enterprise], Analytics-Radar, Platform Engineering, Dumps-Generation
Kelson renamed T255392: August 2020 Wikimedia Technical Talk: openZIM/Kiwix ETL toolchain for Wikipedia dumping from Proposal for 2020 Wikimedia Technical Talk to Proposal for 2020 Wikimedia Technical Talk: openZIM/Kiwix ETL toolchain for Wikipedia dumping.
Jun 15 2020, 6:44 AM · Wikimedia-Tech-Talks, User-srodlund, Developer-Advocacy (Jul-Sep 2020), affects-Kiwix-and-openZIM, Documentation
Kelson moved T255392: August 2020 Wikimedia Technical Talk: openZIM/Kiwix ETL toolchain for Wikipedia dumping from TRIAGE to TOP on the affects-Kiwix-and-openZIM board.
Jun 15 2020, 6:37 AM · Wikimedia-Tech-Talks, User-srodlund, Developer-Advocacy (Jul-Sep 2020), affects-Kiwix-and-openZIM, Documentation
Kelson added a project to T255392: August 2020 Wikimedia Technical Talk: openZIM/Kiwix ETL toolchain for Wikipedia dumping: affects-Kiwix-and-openZIM.
Jun 15 2020, 6:37 AM · Wikimedia-Tech-Talks, User-srodlund, Developer-Advocacy (Jul-Sep 2020), affects-Kiwix-and-openZIM, Documentation
Kelson created T255392: August 2020 Wikimedia Technical Talk: openZIM/Kiwix ETL toolchain for Wikipedia dumping.
Jun 15 2020, 6:37 AM · Wikimedia-Tech-Talks, User-srodlund, Developer-Advocacy (Jul-Sep 2020), affects-Kiwix-and-openZIM, Documentation

Jun 8 2020

Kelson added a comment to T254275: HTML Dumps - June/2020.

I can only emphasis that a ticket which does not transparently explain the problem which is tried to be solved is going to be successfuly only by chance. Therefore, this is probably my last comment on this as we run here a discussion being blind. One of thing I heard is that that dumps might have to include the Parsoid sementic tags, which is not the case for the dumps issued by MWoffliner (MWoffliner remove them). If this is the case, a POC can be done within a few hours to avoid remove them, we can ever just store the raw HTML issued from the API JSON.

Jun 8 2020, 7:30 AM · Okapi [Wikimedia Enterprise], Analytics-Radar, Platform Engineering, Dumps-Generation

Jun 5 2020

Kelson added a comment to T254275: HTML Dumps - June/2020.

I believe I don't understand why additional HTML dumps are necessary, but like @ArielGlenn has written we do all of this already on a monthly base:

Jun 5 2020, 9:48 AM · Okapi [Wikimedia Enterprise], Analytics-Radar, Platform Engineering, Dumps-Generation

Jun 4 2020

Kelson added a comment to T253836: Update quotas for MWoffliner VPS.

@aborrero Thank you very much. Everything works like a charm now!

Jun 4 2020, 7:14 PM · Cloud-VPS (Quota-requests), affects-Kiwix-and-openZIM
Kelson added a comment to T253836: Update quotas for MWoffliner VPS.

@Andrew I have been able to recreate mwoffliner2 properly. I believe 4 VCPUs and 8GB or RAM are missing in the quota.

Jun 4 2020, 6:34 AM · Cloud-VPS (Quota-requests), affects-Kiwix-and-openZIM
Kelson added a comment to T253836: Update quotas for MWoffliner VPS.

@Andrew Thank your very much for this! I have been able to delete mwoffliner1 and recreate it successfully with a xlarge-xtradisk profile. The VM is up and running. I wanted to recreate mwoffliner3 the same way, deleted it but failed to create a new xlarge-xtradisk instance. It seems the quota is not proper (too low). Do I'm wrong somewhere?

Jun 4 2020, 6:13 AM · Cloud-VPS (Quota-requests), affects-Kiwix-and-openZIM

May 28 2020

Kelson added a comment to T253836: Update quotas for MWoffliner VPS.

@Aklapper Thx for pointing me to this, I have updated the task with the expected information.

May 28 2020, 10:55 AM · Cloud-VPS (Quota-requests), affects-Kiwix-and-openZIM
Kelson updated the task description for T253836: Update quotas for MWoffliner VPS.
May 28 2020, 10:54 AM · Cloud-VPS (Quota-requests), affects-Kiwix-and-openZIM
Kelson moved T253836: Update quotas for MWoffliner VPS from TRIAGE to NORMAL on the affects-Kiwix-and-openZIM board.
May 28 2020, 8:24 AM · Cloud-VPS (Quota-requests), affects-Kiwix-and-openZIM
Kelson created T253836: Update quotas for MWoffliner VPS.
May 28 2020, 8:23 AM · Cloud-VPS (Quota-requests), affects-Kiwix-and-openZIM

May 19 2020

geraki awarded T73660: Add ZIM format support to OCG a Like token.
May 19 2020, 6:33 AM · affects-Kiwix-and-openZIM, OCG-General

May 9 2020

Kelson moved T116154: Support WebVTT subtitling from TRIAGE to NORMAL on the affects-Kiwix-and-openZIM board.
May 9 2020, 6:14 AM · affects-Kiwix-and-openZIM, Patch-For-Review, TimedMediaHandler-TimedText
Kelson added a project to T116154: Support WebVTT subtitling: affects-Kiwix-and-openZIM.
May 9 2020, 6:12 AM · affects-Kiwix-and-openZIM, Patch-For-Review, TimedMediaHandler-TimedText

May 4 2020

Kelson added a comment to T251483: Add Kiwix Desktop 2.0 with Translatewiki.

@abi_ Thank you!

May 4 2020, 6:04 PM · Patch-For-Review, affects-Kiwix-and-openZIM, Language-Team (Language-2020-Focus-Sprint), translatewiki.net

Apr 30 2020

Kelson moved T251483: Add Kiwix Desktop 2.0 with Translatewiki from TRIAGE to TOP on the affects-Kiwix-and-openZIM board.
Apr 30 2020, 8:00 AM · Patch-For-Review, affects-Kiwix-and-openZIM, Language-Team (Language-2020-Focus-Sprint), translatewiki.net