Page MenuHomePhabricator

Kelson (Kelson)
User

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Thursday

  • Clear sailing ahead.

User Details

User Since
Oct 7 2014, 7:43 AM (493 w, 15 m)
Availability
Available
IRC Nick
kelson
LDAP User
Kelson
MediaWiki User
Kelson [ Global Accounts ]

Recent Activity

Tue, Mar 5

Kelson created T359187: Impossible to render "Mediawiki:Sidebar" via VE API.
Tue, Mar 5, 4:10 PM · MediaWiki-REST-API, affects-Kiwix-and-openZIM

Dec 17 2023

Kelson moved T348226: Read-only access to Wikimedia mirror of Kiwix data in dumps.wikimedia.org/kiwix/ from TRIAGE to NORMAL on the affects-Kiwix-and-openZIM board.
Dec 17 2023, 6:36 PM · cloud-services-team, affects-Kiwix-and-openZIM
Kelson added a comment to T351949: Add Kiwix for iOS/macOS to translatewiki.net.

@abi_ Thank you! Seems to work fine!

Dec 17 2023, 6:35 PM · Patch-For-Review, Unplanned-Sprint-Work, Localization Infrastructure FY2023-24, Language-Team (Language-2023-October-December), affects-Kiwix-and-openZIM, translatewiki.net

Dec 8 2023

Kelson added a comment to T351949: Add Kiwix for iOS/macOS to translatewiki.net.

Error is in the config file: git@git@github.com:kiwix/apple.git, this is not a valid address.

Dec 8 2023, 9:55 AM · Patch-For-Review, Unplanned-Sprint-Work, Localization Infrastructure FY2023-24, Language-Team (Language-2023-October-December), affects-Kiwix-and-openZIM, translatewiki.net
Kelson added a comment to T351949: Add Kiwix for iOS/macOS to translatewiki.net.

@abi_ I'm a bit puzzled by the situation. Translatewiki bot has access to the whole Kiwix organisation on Github and have good permissions for the kiwix/apple

image.png (810×2 px, 139 KB)

Dec 8 2023, 9:54 AM · Patch-For-Review, Unplanned-Sprint-Work, Localization Infrastructure FY2023-24, Language-Team (Language-2023-October-December), affects-Kiwix-and-openZIM, translatewiki.net

Dec 6 2023

Kelson added a comment to T351949: Add Kiwix for iOS/macOS to translatewiki.net.

@Kelson Our current implementation of Apple file format does not support multiline strings such as these

"loc-external-alert" = "An external link is tapped. \
However, your current setting does not allow it to be loaded.";
"loc-article-cell-template" = "Lorem ipsum dolor sit amet, consectetur adipiscing elit, \
sed do eiusmod tempor incididunt ut labore et dolore magna aliqua.";
"loc-ZimFileDetail-Alert-Delete" = "The zim file and all bookmarked articles \
linked to this zim file will be deleted.";

Would it be easy to avoid using of these literal new lines?

Dec 6 2023, 5:29 PM · Patch-For-Review, Unplanned-Sprint-Work, Localization Infrastructure FY2023-24, Language-Team (Language-2023-October-December), affects-Kiwix-and-openZIM, translatewiki.net

Dec 2 2023

Kelson added a comment to T351949: Add Kiwix for iOS/macOS to translatewiki.net.
  1. Once the project is added on translatewiki, please add message documentation for the project.

I have created the ticket at https://github.com/kiwix/apple/issues/561. Do we have an example of macOS/iOS software with that?

See: https://github.com/wikimedia/wikipedia-ios/tree/main/Wikipedia/Localizations/qqq.lproj

Currently blocked on this due to: T352300: Newlines in "Apple" format not supported

Dec 2 2023, 12:04 PM · Patch-For-Review, Unplanned-Sprint-Work, Localization Infrastructure FY2023-24, Language-Team (Language-2023-October-December), affects-Kiwix-and-openZIM, translatewiki.net
Kelson added a comment to T351949: Add Kiwix for iOS/macOS to translatewiki.net.

@abi_ We are working on it. See https://github.com/kiwix/apple/issues/571. I will come back to you within a few days when this will be done.

Dec 2 2023, 11:58 AM · Patch-For-Review, Unplanned-Sprint-Work, Localization Infrastructure FY2023-24, Language-Team (Language-2023-October-December), affects-Kiwix-and-openZIM, translatewiki.net

Nov 27 2023

Kelson added a comment to T351949: Add Kiwix for iOS/macOS to translatewiki.net.
  1. Do you want translatewiki to commit to feature branch and then create a PR to main branch?
Nov 27 2023, 3:15 PM · Patch-For-Review, Unplanned-Sprint-Work, Localization Infrastructure FY2023-24, Language-Team (Language-2023-October-December), affects-Kiwix-and-openZIM, translatewiki.net

Nov 25 2023

Kelson created T351949: Add Kiwix for iOS/macOS to translatewiki.net.
Nov 25 2023, 10:39 AM · Patch-For-Review, Unplanned-Sprint-Work, Localization Infrastructure FY2023-24, Language-Team (Language-2023-October-December), affects-Kiwix-and-openZIM, translatewiki.net

Nov 23 2023

Kelson updated the task description for T349972: REST API `mobile-html` end-point thumbnails resolution are too big.
Nov 23 2023, 5:42 PM · Essential-Work, Content-Transform-Team-WIP, Mobile-Content-Service, Page Content Service, affects-Kiwix-and-openZIM, API Platform

Nov 11 2023

Kelson updated the task description for T349972: REST API `mobile-html` end-point thumbnails resolution are too big.
Nov 11 2023, 6:50 PM · Essential-Work, Content-Transform-Team-WIP, Mobile-Content-Service, Page Content Service, affects-Kiwix-and-openZIM, API Platform
Kelson updated the task description for T349972: REST API `mobile-html` end-point thumbnails resolution are too big.
Nov 11 2023, 6:50 PM · Essential-Work, Content-Transform-Team-WIP, Mobile-Content-Service, Page Content Service, affects-Kiwix-and-openZIM, API Platform

Nov 7 2023

Kelson added a project to T348321: Some articles in Abkhazian wiki don't have response when use Wikimedia API: affects-Kiwix-and-openZIM.
Nov 7 2023, 6:33 PM · affects-Kiwix-and-openZIM, Essential-Work, Page Content Service, Content-Transform-Team-WIP, RESTBase
Kelson added a comment to T350117: Action API with action=visualeditor returns rate limit error for articles in Mediawiki namespace.

@matmarex Thank you very much for this fix!

Nov 7 2023, 6:29 PM · Content-Transform-Team, API Platform, MediaWiki-REST-API

Oct 30 2023

Kelson added a comment to T329779: Explore moving MWOffliner/Kiwix from API calls to Wikimedia Enterprise HTML dumps.

Yes, this is on the radar, but we face pretty much difficulties around mobile-html new end-point for the moment. So not a TOP prio our side. I honestly don't think we will be able to tackle this before 2024.

Oct 30 2023, 7:11 PM · affects-Kiwix-and-openZIM, Wikimedia Enterprise

Oct 29 2023

Kelson added a project to T264671: Deprecate and remove MCS endpoints from RESTBase: affects-Kiwix-and-openZIM.
Oct 29 2023, 3:00 PM · affects-Kiwix-and-openZIM, API Platform (RESTbase Deprecation Roadmap), Code-Health-Objective, Mobile-Content-Service, Platform Engineering Roadmap, Product-Infrastructure-Team-Backlog-Deprecated, Platform Engineering Roadmap Decision Making
Kelson added a comment to T264671: Deprecate and remove MCS endpoints from RESTBase.

No sure what is the exact status here, but on the size of Kiwix we have implemented the support of the new mobile-html REST end-point. Unfortunately we are not really able to create ZIM files because of https://phabricator.wikimedia.org/T349972. We still rely therefore on the mobile-section end-point.

Oct 29 2023, 2:59 PM · affects-Kiwix-and-openZIM, API Platform (RESTbase Deprecation Roadmap), Code-Health-Objective, Mobile-Content-Service, Platform Engineering Roadmap, Product-Infrastructure-Team-Backlog-Deprecated, Platform Engineering Roadmap Decision Making
Kelson moved T349972: REST API `mobile-html` end-point thumbnails resolution are too big from TRIAGE to TOP on the affects-Kiwix-and-openZIM board.
Oct 29 2023, 2:55 PM · Essential-Work, Content-Transform-Team-WIP, Mobile-Content-Service, Page Content Service, affects-Kiwix-and-openZIM, API Platform
Kelson created T349972: REST API `mobile-html` end-point thumbnails resolution are too big.
Oct 29 2023, 2:55 PM · Essential-Work, Content-Transform-Team-WIP, Mobile-Content-Service, Page Content Service, affects-Kiwix-and-openZIM, API Platform

Oct 15 2023

Kelson added a project to T347948: Title param in Wikimedia REST API offline resources has implicit behavior.: affects-Kiwix-and-openZIM.
Oct 15 2023, 7:04 PM · affects-Kiwix-and-openZIM, RESTBase Sunsetting, Page Content Service, RESTBase

Oct 13 2023

Kelson added a project to T348529: Add ability to change image size per request in page/mobile-html endpoint: affects-Kiwix-and-openZIM.
Oct 13 2023, 12:25 PM · affects-Kiwix-and-openZIM, Page Content Service, Content-Transform-Team, RESTBase
Kelson added a comment to T348529: Add ability to change image size per request in page/mobile-html endpoint.

Actually this ticket should be a bug, image resolutions are far too big for a mobile end-point and seems to be a waste of bandwidth. I have open a ticket at https://phabricator.wikimedia.org/T349972

Oct 13 2023, 12:24 PM · affects-Kiwix-and-openZIM, Page Content Service, Content-Transform-Team, RESTBase

Sep 26 2023

Kelson added a comment to T256217: Swift sends ETAG without double-quotes.

@MatthewVernon That would be welcome on MWoffliner side! For the rest I can not say, but respecting the RFC sounds here quite important.

Sep 26 2023, 2:40 PM · Wikimedia-Performance-recommendation, Traffic-Icebox, SRE-swift-storage, SRE, affects-Kiwix-and-openZIM

Aug 27 2023

Kelson moved T339366: Address potential impact of Kiwix crawling on ParserCache before MCS decommissioning from TRIAGE to TOP on the affects-Kiwix-and-openZIM board.
Aug 27 2023, 3:26 AM · affects-Kiwix-and-openZIM, RESTBase Sunsetting, MediaWiki-REST-API, Parsoid
Kelson updated subscribers of T339366: Address potential impact of Kiwix crawling on ParserCache before MCS decommissioning.

@ssastry AFAIK what is described seemscorrect to me. @vadim-kovalenko and @cscott would certainly be able to tell more as they both know MWoffliner and the Wikimedia backend infra.

Aug 27 2023, 3:26 AM · affects-Kiwix-and-openZIM, RESTBase Sunsetting, MediaWiki-REST-API, Parsoid
Kelson added a comment to T340036: Setup allowed list for MCS decom.

@MSantos Thank you very much

Aug 27 2023, 3:09 AM · affects-Kiwix-and-openZIM, Content-Transform-Team-WIP, RESTBase Sunsetting, SRE, serviceops, Traffic, Mobile-Content-Service

Aug 8 2023

Kelson added a comment to T340036: Setup allowed list for MCS decom.

@akosiaris @MSantos May I underline Vadim's request: carifying if we (at Kiwix) can still benefit from the mobile-sections API until we finish with the MWoffliner code update is an important and relatively time-dependant question.

Aug 8 2023, 5:50 AM · affects-Kiwix-and-openZIM, Content-Transform-Team-WIP, RESTBase Sunsetting, SRE, serviceops, Traffic, Mobile-Content-Service
Kelson added a project to T340036: Setup allowed list for MCS decom: affects-Kiwix-and-openZIM.
Aug 8 2023, 5:45 AM · affects-Kiwix-and-openZIM, Content-Transform-Team-WIP, RESTBase Sunsetting, SRE, serviceops, Traffic, Mobile-Content-Service

Jun 19 2023

Kelson added a comment to T324711: UnexpectedValueException: Parsoid does not support content model proofread-index.

@daniel Thank you! Things are clearer now for me. At the core of my problem is that we have always been using $wgContentNamespaces to know which namespaces should be scraped... and here it does not work that well (anymore).

Jun 19 2023, 7:07 AM · affects-Kiwix-and-openZIM, RESTBase Sunsetting, MW-1.40-notes (1.40.0-wmf.14; 2022-12-12), Parsoid, Wikimedia-production-error
Kelson added a project to T317018: Make HtmlOutputRendererHelper use ParserOutputAccess: affects-Kiwix-and-openZIM.
Jun 19 2023, 7:06 AM · Content-Transform-Team, Technical-Debt, RESTBase Sunsetting, Platform Team Workboards (MW Expedition)
Kelson added a project to T330772: Mobile-html switchover to REST API (from RESTBase) should account for http 400 response for non-wikitext content models: affects-Kiwix-and-openZIM.
Jun 19 2023, 7:06 AM · affects-Kiwix-and-openZIM, Content-Transform-Team-WIP, Wikipedia-iOS-App-Backlog, Wikipedia-Android-App-Backlog, RESTBase Sunsetting, Page Content Service, MediaWiki-REST-API

Jun 16 2023

Kelson added a comment to T324711: UnexpectedValueException: Parsoid does not support content model proofread-index.

@Arlolra Thank you for your technical explanation but I have a hard time to use it to answer my questions which are:

Jun 16 2023, 9:16 AM · affects-Kiwix-and-openZIM, RESTBase Sunsetting, MW-1.40-notes (1.40.0-wmf.14; 2022-12-12), Parsoid, Wikimedia-production-error

Jun 10 2023

Kelson added a project to T324711: UnexpectedValueException: Parsoid does not support content model proofread-index: affects-Kiwix-and-openZIM.
Jun 10 2023, 2:15 PM · affects-Kiwix-and-openZIM, RESTBase Sunsetting, MW-1.40-notes (1.40.0-wmf.14; 2022-12-12), Parsoid, Wikimedia-production-error
Kelson updated subscribers of T324711: UnexpectedValueException: Parsoid does not support content model proofread-index.

@cscott @ssastry Really sure this is fixed? Assuming this has been deployed, this is still failing https://id.wikipedia.org/api/rest_v1/page/html/Story%3AWisata_Wajib_di_Toraja. Actually this bug seems to be the reason why we can not generated ZIM offline snapshot of id.wikipedia.org since two quarters. More details about the bug at MWoffliner level at https://github.com/openzim/mwoffliner/issues/1853.

Jun 10 2023, 2:15 PM · affects-Kiwix-and-openZIM, RESTBase Sunsetting, MW-1.40-notes (1.40.0-wmf.14; 2022-12-12), Parsoid, Wikimedia-production-error

May 20 2023

Kelson added a project to T337125: nrm.wikipedia.org language configuration: affects-Kiwix-and-openZIM.
May 20 2023, 1:35 PM · affects-Kiwix-and-openZIM, MediaWiki-Configuration
Kelson created T337125: nrm.wikipedia.org language configuration.
May 20 2023, 1:35 PM · affects-Kiwix-and-openZIM, MediaWiki-Configuration

Apr 18 2023

Kelson added a comment to T320312: Archive wikifr-l Mailing list.

@Ladsgroup Thank you!

Apr 18 2023, 6:04 AM · SRE, Wikimedia-Mailing-lists

Apr 16 2023

Kelson updated subscribers of T320312: Archive wikifr-l Mailing list.

@Dzahn I reopen the task because it seems people can still post and subscribe to the mailing list. This should not be the case (and as moderator I would like to not get notices for this).

Apr 16 2023, 12:13 PM · SRE, Wikimedia-Mailing-lists
Kelson reopened T320312: Archive wikifr-l Mailing list as "Open".
Apr 16 2023, 12:12 PM · SRE, Wikimedia-Mailing-lists

Apr 5 2023

Kelson added a project to T333122: Wrong rendering of gallery images (img width=250 vs gallerybox width=155): affects-Kiwix-and-openZIM.
Apr 5 2023, 1:01 PM · affects-Kiwix-and-openZIM, MediaWiki-Gallery

Mar 16 2023

Kelson added a comment to T331816: Add Gutenberg scraper to translatewiki.net.

@abi_ Thank you for confirming, we will work on this in the next days. Thank you in advance for your patience.

Mar 16 2023, 4:41 PM · translatewiki.net, affects-Kiwix-and-openZIM

Mar 12 2023

Kelson updated the task description for T331816: Add Gutenberg scraper to translatewiki.net.
Mar 12 2023, 1:10 PM · translatewiki.net, affects-Kiwix-and-openZIM
Kelson added a comment to T331816: Add Gutenberg scraper to translatewiki.net.

@abi_ Kind of suspect that the strings should be stored in multiple files (like one per language)

Mar 12 2023, 1:10 PM · translatewiki.net, affects-Kiwix-and-openZIM
Kelson updated the task description for T331816: Add Gutenberg scraper to translatewiki.net.
Mar 12 2023, 1:09 PM · translatewiki.net, affects-Kiwix-and-openZIM
Kelson created T331816: Add Gutenberg scraper to translatewiki.net.
Mar 12 2023, 1:08 PM · translatewiki.net, affects-Kiwix-and-openZIM

Mar 3 2023

Kelson updated the task description for T331120: Article with DOM node tags in <title> value (REST API).
Mar 3 2023, 12:00 PM · Parsoid, affects-Kiwix-and-openZIM
Kelson moved T329779: Explore moving MWOffliner/Kiwix from API calls to Wikimedia Enterprise HTML dumps from TRIAGE to NORMAL on the affects-Kiwix-and-openZIM board.
Mar 3 2023, 11:59 AM · affects-Kiwix-and-openZIM, Wikimedia Enterprise
Kelson moved T331120: Article with DOM node tags in <title> value (REST API) from TRIAGE to NICE TO HAVE on the affects-Kiwix-and-openZIM board.
Mar 3 2023, 11:59 AM · Parsoid, affects-Kiwix-and-openZIM
Kelson created T331120: Article with DOM node tags in <title> value (REST API).
Mar 3 2023, 11:58 AM · Parsoid, affects-Kiwix-and-openZIM

Feb 19 2023

Kelson added a comment to T329779: Explore moving MWOffliner/Kiwix from API calls to Wikimedia Enterprise HTML dumps.

@RBrounley_WMF Thank you for opening this ticket, I will follow up.

Feb 19 2023, 1:50 PM · affects-Kiwix-and-openZIM, Wikimedia Enterprise
Kelson added a project to T329779: Explore moving MWOffliner/Kiwix from API calls to Wikimedia Enterprise HTML dumps: affects-Kiwix-and-openZIM.
Feb 19 2023, 1:49 PM · affects-Kiwix-and-openZIM, Wikimedia Enterprise

Feb 7 2023

Kelson added a comment to T328554: Add MWoffliner to translatewiki.net.

@abi_ THX!!!

Feb 7 2023, 9:05 AM · Unplanned-Sprint-Work, Language-Team (Language-2023-January-March), affects-Kiwix-and-openZIM, translatewiki.net

Feb 6 2023

Kelson added a comment to T328554: Add MWoffliner to translatewiki.net.

@abi_ I confirm that the github "translatewiki" has write access to the repository and I have just created the qqq.jsonfile, see https://github.com/openzim/mwoffliner/pull/1771.

Feb 6 2023, 9:42 AM · Unplanned-Sprint-Work, Language-Team (Language-2023-January-March), affects-Kiwix-and-openZIM, translatewiki.net

Feb 1 2023

Kelson added a comment to T260223: Kiwix rsyncs not completing and stacking up on Clouddumps1001,2.

We are cursed...

Feb 1 2023, 1:28 PM · cloud-services-team, affects-Kiwix-and-openZIM, Dumps-Generation
Kelson moved T328554: Add MWoffliner to translatewiki.net from TRIAGE to NICE TO HAVE on the affects-Kiwix-and-openZIM board.
Feb 1 2023, 1:16 PM · Unplanned-Sprint-Work, Language-Team (Language-2023-January-March), affects-Kiwix-and-openZIM, translatewiki.net
Kelson created T328554: Add MWoffliner to translatewiki.net.
Feb 1 2023, 1:16 PM · Unplanned-Sprint-Work, Language-Team (Language-2023-January-March), affects-Kiwix-and-openZIM, translatewiki.net

Jan 25 2023

Kelson added a comment to T260223: Kiwix rsyncs not completing and stacking up on Clouddumps1001,2.

@Rgaudin Do you have any hint about this last comment from @Hokwelum?

Jan 25 2023, 2:05 PM · cloud-services-team, affects-Kiwix-and-openZIM, Dumps-Generation

Jan 22 2023

Kelson added a comment to T103084: Have a cron job delete files that haven't been modified in the last X days / months in /data/scratch.

Just FYI, no need anymore on MWoffliner side as we use an online object cache meanwhile.

Jan 22 2023, 10:59 AM · cloud-services-team, Data-Services

Jan 19 2023

Kelson moved T324866: large amount of traffic to the action=parse API from MWOffliner from TRIAGE to TOP on the affects-Kiwix-and-openZIM board.
Jan 19 2023, 9:53 AM · Wikimedia-Performance-recommendation, Wikimedia-Hackathon-2023, serviceops, affects-Kiwix-and-openZIM, Wikimedia Enterprise
Kelson moved T322982: What are the expected HTTP status codes of the Wikidata Query Service? from TRIAGE to TOP on the affects-Kiwix-and-openZIM board.
Jan 19 2023, 9:53 AM · Wikidata, affects-Kiwix-and-openZIM, Wikidata-Query-Service
Kelson moved T320733: Support and document how language conversion work with multidirectional wikitext <=> HTML conversion on language-conversion-supported extensions. from TRIAGE to NORMAL on the affects-Kiwix-and-openZIM board.
Jan 19 2023, 9:53 AM · Parsoid-Read-Views, Parsoid-Rendering, affects-Kiwix-and-openZIM, Parsoid, Services (watching), Epic, MediaWiki-Language-converter, Chinese-Sites, I18n
Kelson moved T161278: Add default gadget styling to Parsoid's output from TRIAGE to TOP on the affects-Kiwix-and-openZIM board.
Jan 19 2023, 9:53 AM · Patch-Needs-Improvement, affects-Kiwix-and-openZIM, Parsoid-Rendering, Platform Engineering, Parsoid, MediaWiki-extensions-Gadgets, MediaWiki-Action-API
Kelson moved T124960: Labs bandwidth is aleatory/low from TRIAGE to NICE TO HAVE on the affects-Kiwix-and-openZIM board.
Jan 19 2023, 9:53 AM · affects-Kiwix-and-openZIM, cloud-services-team, Cloud-VPS
Kelson added a project to T124960: Labs bandwidth is aleatory/low: affects-Kiwix-and-openZIM.
Jan 19 2023, 9:53 AM · affects-Kiwix-and-openZIM, cloud-services-team, Cloud-VPS
Kelson added a comment to T124960: Labs bandwidth is aleatory/low.

This ticket is really old. We have made many improvement in our toolchain software and infrastructure (many backoff strategies) in the meantime. I can not assess if the problem is still there or if it has been fixed; but whatever the current status, we don't suffer of it anymore. I would be fine to close it.

Jan 19 2023, 9:52 AM · affects-Kiwix-and-openZIM, cloud-services-team, Cloud-VPS

Jan 16 2023

Kelson added a comment to T326040: Add PhET scraper to translatewiki.net (sub-project Kiwix).

@abi_ Thank you for the PR, currently under review!

Jan 16 2023, 7:36 PM · Language-Team (Language-2023-January-March), affects-Kiwix-and-openZIM, translatewiki.net
Kelson added a comment to T324866: large amount of traffic to the action=parse API from MWOffliner.

At MWoffliner we have started to study the problem. Because of this ticket but as well because our unstable experience with the usage of this end-point. See https://github.com/openzim/mwoffliner/issues/1730. Hopefuly Wikimedia does provide other better end-points allowing us to retrieve the same information.

Jan 16 2023, 9:39 AM · Wikimedia-Performance-recommendation, Wikimedia-Hackathon-2023, serviceops, affects-Kiwix-and-openZIM, Wikimedia Enterprise

Jan 10 2023

Kelson added a comment to T326040: Add PhET scraper to translatewiki.net (sub-project Kiwix).

@abi_ Thank you! I will create a qqq.json and remove the metadata. When can we expect a first PR from Translatewiki to check the process works fine?

Jan 10 2023, 5:41 PM · Language-Team (Language-2023-January-March), affects-Kiwix-and-openZIM, translatewiki.net

Dec 31 2022

Amire80 awarded T326040: Add PhET scraper to translatewiki.net (sub-project Kiwix) a Love token.
Dec 31 2022, 11:57 AM · Language-Team (Language-2023-January-March), affects-Kiwix-and-openZIM, translatewiki.net
Amire80 awarded T326040: Add PhET scraper to translatewiki.net (sub-project Kiwix) a Mountain of Wealth token.
Dec 31 2022, 11:24 AM · Language-Team (Language-2023-January-March), affects-Kiwix-and-openZIM, translatewiki.net
Kelson moved T326040: Add PhET scraper to translatewiki.net (sub-project Kiwix) from TRIAGE to TOP on the affects-Kiwix-and-openZIM board.
Dec 31 2022, 11:18 AM · Language-Team (Language-2023-January-March), affects-Kiwix-and-openZIM, translatewiki.net
Kelson renamed T326040: Add PhET scraper to translatewiki.net (sub-project Kiwix) from Add {PROJECT} to translatewiki.net to Add PhET scraper to translatewiki.net (sub-project Kiwix).
Dec 31 2022, 11:18 AM · Language-Team (Language-2023-January-March), affects-Kiwix-and-openZIM, translatewiki.net
Kelson created T326040: Add PhET scraper to translatewiki.net (sub-project Kiwix).
Dec 31 2022, 11:17 AM · Language-Team (Language-2023-January-March), affects-Kiwix-and-openZIM, translatewiki.net

Dec 23 2022

Kelson added a comment to T319725: Migrate enwp10 from Toolforge GridEngine to Toolforge Kubernetes.

I guess this ticket can be closed?

Dec 23 2022, 7:58 AM · affects-Kiwix-and-openZIM, Grid-Engine-to-K8s-Migration

Dec 12 2022

Kelson added a comment to T324866: large amount of traffic to the action=parse API from MWOffliner.

I can think of several (I don't know the details of your system and might have missed something):

Dec 12 2022, 9:55 AM · Wikimedia-Performance-recommendation, Wikimedia-Hackathon-2023, serviceops, affects-Kiwix-and-openZIM, Wikimedia Enterprise
Kelson added a comment to T324866: large amount of traffic to the action=parse API from MWOffliner.

@Ladsgroup The MWoffliner scraper has already been quite optimised over years. I have no obvious improvement in mind for the moment but we will consider any concrete new proposal.

Dec 12 2022, 7:59 AM · Wikimedia-Performance-recommendation, Wikimedia-Hackathon-2023, serviceops, affects-Kiwix-and-openZIM, Wikimedia Enterprise
Kelson added a comment to T324866: large amount of traffic to the action=parse API from MWOffliner.

Would that https://github.com/openzim/mwoffliner/issues/1664 fix the issue, so far we are really not familiar with this new API end-point?

Dec 12 2022, 7:47 AM · Wikimedia-Performance-recommendation, Wikimedia-Hackathon-2023, serviceops, affects-Kiwix-and-openZIM, Wikimedia Enterprise

Dec 1 2022

Kelson added a comment to T284693: Wikimedia\Assert\InvariantException: Invariant failed: Bad UTF-8 at end of string (3 byte sequence).

On my end, this looks better now. Thx!

Dec 1 2022, 11:20 AM · Content-Transform-Team-WIP, Parsoid-Read-Views (Phase 2 - testwiki Main namespace support), Parsoid, Wikimedia-production-error

Nov 28 2022

Kelson added a comment to T317011: HTTP 500 against api.php?action=parse API on tr.wikipedia.org.

The reported bug seems indeed to have "vanished". Thank you for the good work.

Nov 28 2022, 3:27 PM · SRE, Traffic, affects-Kiwix-and-openZIM

Nov 13 2022

Kelson added a project to T322982: What are the expected HTTP status codes of the Wikidata Query Service?: affects-Kiwix-and-openZIM.
Nov 13 2022, 6:15 PM · Wikidata, affects-Kiwix-and-openZIM, Wikidata-Query-Service

Nov 2 2022

Kelson added a comment to T320312: Archive wikifr-l Mailing list.

If you can delete the whole thread https://lists.wikimedia.org/hyperkitty/list/wikifr-l@lists.wikimedia.org/thread/J2FU23D4C5ERWIK2LWBYUBTYK3O6KP6Y/, then problem would be solved. It's a pity we can not hide it. I don't like that we manipulate the archive.

Nov 2 2022, 12:54 PM · SRE, Wikimedia-Mailing-lists

Oct 31 2022

Dzahn awarded T57503: Mirror more Kiwix downloads directories a Like token.
Oct 31 2022, 2:25 PM · cloud-services-team (Kanban), Cloud-Services, affects-Kiwix-and-openZIM, SRE, Datasets-General-or-Unknown

Oct 30 2022

Kelson added a comment to T320312: Archive wikifr-l Mailing list.

@Ladsgroup Thank you but I don't see these two options below the "Add to favorites"... although I'm owner on the list.

Oct 30 2022, 7:13 PM · SRE, Wikimedia-Mailing-lists

Oct 29 2022

Kelson added a comment to T284693: Wikimedia\Assert\InvariantException: Invariant failed: Bad UTF-8 at end of string (3 byte sequence).

See also https://github.com/openzim/mwoffliner/issues/1482

Oct 29 2022, 1:06 PM · Content-Transform-Team-WIP, Parsoid-Read-Views (Phase 2 - testwiki Main namespace support), Parsoid, Wikimedia-production-error
Kelson closed T57503: Mirror more Kiwix downloads directories, a subtask of T302981: Q3:(Need By: TBD) rack/setup/install 2 new labstore hosts, as Resolved.
Oct 29 2022, 1:02 PM · Patch-For-Review, Infrastructure-Foundations, SRE, ops-eqiad, netops, cloud-services-team (Hardware), DC-Ops
Kelson closed T57503: Mirror more Kiwix downloads directories as Resolved.
Oct 29 2022, 1:02 PM · cloud-services-team (Kanban), Cloud-Services, affects-Kiwix-and-openZIM, SRE, Datasets-General-or-Unknown
Kelson added a comment to T57503: Mirror more Kiwix downloads directories.

@Dzahn Great, thank you very much!

Oct 29 2022, 1:01 PM · cloud-services-team (Kanban), Cloud-Services, affects-Kiwix-and-openZIM, SRE, Datasets-General-or-Unknown

Oct 24 2022

Kelson added a comment to T320312: Archive wikifr-l Mailing list.

I have achieved to create account an retrieve admin access to the list, but really no clue how to remove the few messages (from the public archive). Not even sure this is possible at all. As a consequence, I have put the whole ml archive in private. Unfortunately, this seems to fail, archive is still accessible at https://lists.wikimedia.org/hyperkitty/list/wikifr-l@lists.wikimedia.org/latest

Oct 24 2022, 5:38 PM · SRE, Wikimedia-Mailing-lists
Kelson updated subscribers of T260223: Kiwix rsyncs not completing and stacking up on Clouddumps1001,2.

During September we have detected that one of the mirror was full and therefore rsync client was keeping download and redownloading things. As a consequence a significant part of the bandwidth and the rsync daemon slots were always busy. We still lack of monitoring solution for this on our side honestly. We should figure a tool and a process to better monitor the server/service. If you have propositions, they are welcome.

Hello Kelson, We would like to know if the space problem has been resolved as we received the same error message today.

Oct 24 2022, 5:27 PM · cloud-services-team, affects-Kiwix-and-openZIM, Dumps-Generation
Kelson added a comment to T57503: Mirror more Kiwix downloads directories.

@nskaggs Not sure this is a question to me, but in the case it needed, could you please change the ZIM mirroring rsync command to:

  • request on master.download.kiwix.org in place of download.kiwix.org
  • sync the following repositories in addition to wikipedia: wikibooks, wikinews, wikiquote, wikisource, wikiversity, wiktionary, wikivoyage
Oct 24 2022, 5:24 PM · cloud-services-team (Kanban), Cloud-Services, affects-Kiwix-and-openZIM, SRE, Datasets-General-or-Unknown

Oct 16 2022

Kelson added a comment to T161278: Add default gadget styling to Parsoid's output.

It seem that this bug partly explains why ZIM files of Wiktionary in English are crappy, see https://github.com/openzim/mwoffliner/pull/1665

Oct 16 2022, 8:10 AM · Patch-Needs-Improvement, affects-Kiwix-and-openZIM, Parsoid-Rendering, Platform Engineering, Parsoid, MediaWiki-extensions-Gadgets, MediaWiki-Action-API
Kelson added a project to T161278: Add default gadget styling to Parsoid's output: affects-Kiwix-and-openZIM.
Oct 16 2022, 8:09 AM · Patch-Needs-Improvement, affects-Kiwix-and-openZIM, Parsoid-Rendering, Platform Engineering, Parsoid, MediaWiki-extensions-Gadgets, MediaWiki-Action-API

Oct 15 2022

Kelson added a comment to T226931: Parsoid cache invalidation for mobile-sections seems not reliable.

It seems the bug reported in T274359 is the same as this one, so reputting here the bug description:

Oct 15 2022, 4:11 PM · Page Content Service, Content-Transform-Team-WIP, serviceops, Parsoid, affects-Kiwix-and-openZIM, ChangeProp, RESTBase
Kelson added a comment to T274359: Mobile REST API delivers year old+ content for very select pages.

@matmarex Strange to close this ticket considering the bug described in the ticket is not fixed!

Oct 15 2022, 4:10 PM · RESTBase Sunsetting, User-TheresNoTime, Page Content Service, Wikipedia-Android-App-Backlog, RESTBase-API, affects-Kiwix-and-openZIM

Oct 8 2022

Kelson added a comment to T260223: Kiwix rsyncs not completing and stacking up on Clouddumps1001,2.

During September we have detected that one of the mirror was full and therefore rsync client was keeping download and redownloading things. As a consequence a significant part of the bandwidth and the rsync daemon slots were always busy. We still lack of monitoring solution for this on our side honestly. We should figure a tool and a process to better monitor the server/service. If you have propositions, they are welcome.

Oct 8 2022, 6:10 PM · cloud-services-team, affects-Kiwix-and-openZIM, Dumps-Generation
Kelson added a comment to T319725: Migrate enwp10 from Toolforge GridEngine to Toolforge Kubernetes.

@komla What would be the way to proceed:

  • Can you delete everything except the DB (no sure what is the same BTW)?
  • Should we somehow migrate the DB first?
Oct 8 2022, 6:07 PM · affects-Kiwix-and-openZIM, Grid-Engine-to-K8s-Migration
Kelson created T320312: Archive wikifr-l Mailing list.
Oct 8 2022, 9:13 AM · SRE, Wikimedia-Mailing-lists
Kelson moved T319725: Migrate enwp10 from Toolforge GridEngine to Toolforge Kubernetes from TRIAGE to TOP on the affects-Kiwix-and-openZIM board.
Oct 8 2022, 8:04 AM · affects-Kiwix-and-openZIM, Grid-Engine-to-K8s-Migration
Kelson added a project to T319725: Migrate enwp10 from Toolforge GridEngine to Toolforge Kubernetes: affects-Kiwix-and-openZIM.
Oct 8 2022, 8:04 AM · affects-Kiwix-and-openZIM, Grid-Engine-to-K8s-Migration