Page MenuHomePhabricator

Kelson (Kelson)
User

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Monday

  • Clear sailing ahead.

User Details

User Since
Oct 7 2014, 7:43 AM (442 w, 4 d)
Availability
Available
IRC Nick
kelson
LDAP User
Kelson
MediaWiki User
Kelson [ Global Accounts ]

Recent Activity

Thu, Mar 16

Kelson added a comment to T331816: Add Gutenberg scraper to translatewiki.net.

@abi_ Thank you for confirming, we will work on this in the next days. Thank you in advance for your patience.

Thu, Mar 16, 4:41 PM · translatewiki.net, affects-Kiwix-and-openZIM

Sun, Mar 12

Kelson updated the task description for T331816: Add Gutenberg scraper to translatewiki.net.
Sun, Mar 12, 1:10 PM · translatewiki.net, affects-Kiwix-and-openZIM
Kelson added a comment to T331816: Add Gutenberg scraper to translatewiki.net.

@abi_ Kind of suspect that the strings should be stored in multiple files (like one per language)

Sun, Mar 12, 1:10 PM · translatewiki.net, affects-Kiwix-and-openZIM
Kelson updated the task description for T331816: Add Gutenberg scraper to translatewiki.net.
Sun, Mar 12, 1:09 PM · translatewiki.net, affects-Kiwix-and-openZIM
Kelson created T331816: Add Gutenberg scraper to translatewiki.net.
Sun, Mar 12, 1:08 PM · translatewiki.net, affects-Kiwix-and-openZIM

Fri, Mar 3

Kelson updated the task description for T331120: Article with DOM node tags in <title> value (REST API).
Fri, Mar 3, 12:00 PM · Parsoid, affects-Kiwix-and-openZIM
Kelson moved T329779: Explore moving MWOffliner/Kiwix from API calls to Wikimedia Enterprise HTML dumps from TRIAGE to NORMAL on the affects-Kiwix-and-openZIM board.
Fri, Mar 3, 11:59 AM · affects-Kiwix-and-openZIM, Wikimedia Enterprise
Kelson moved T331120: Article with DOM node tags in <title> value (REST API) from TRIAGE to NICE TO HAVE on the affects-Kiwix-and-openZIM board.
Fri, Mar 3, 11:59 AM · Parsoid, affects-Kiwix-and-openZIM
Kelson created T331120: Article with DOM node tags in <title> value (REST API).
Fri, Mar 3, 11:58 AM · Parsoid, affects-Kiwix-and-openZIM

Feb 19 2023

Kelson added a comment to T329779: Explore moving MWOffliner/Kiwix from API calls to Wikimedia Enterprise HTML dumps.

@RBrounley_WMF Thank you for opening this ticket, I will follow up.

Feb 19 2023, 1:50 PM · affects-Kiwix-and-openZIM, Wikimedia Enterprise
Kelson added a project to T329779: Explore moving MWOffliner/Kiwix from API calls to Wikimedia Enterprise HTML dumps: affects-Kiwix-and-openZIM.
Feb 19 2023, 1:49 PM · affects-Kiwix-and-openZIM, Wikimedia Enterprise

Feb 7 2023

Kelson added a comment to T328554: Add MWoffliner to translatewiki.net.

@abi_ THX!!!

Feb 7 2023, 9:05 AM · Unplanned-Sprint-Work, Language-Team (Language-2023-January-March), affects-Kiwix-and-openZIM, translatewiki.net

Feb 6 2023

Kelson added a comment to T328554: Add MWoffliner to translatewiki.net.

@abi_ I confirm that the github "translatewiki" has write access to the repository and I have just created the qqq.jsonfile, see https://github.com/openzim/mwoffliner/pull/1771.

Feb 6 2023, 9:42 AM · Unplanned-Sprint-Work, Language-Team (Language-2023-January-March), affects-Kiwix-and-openZIM, translatewiki.net

Feb 1 2023

Kelson added a comment to T260223: Kiwix rsyncs not completing and stacking up on Clouddumps1001,2.

We are cursed...

Feb 1 2023, 1:28 PM · cloud-services-team, affects-Kiwix-and-openZIM, Dumps-Generation
Kelson moved T328554: Add MWoffliner to translatewiki.net from TRIAGE to NICE TO HAVE on the affects-Kiwix-and-openZIM board.
Feb 1 2023, 1:16 PM · Unplanned-Sprint-Work, Language-Team (Language-2023-January-March), affects-Kiwix-and-openZIM, translatewiki.net
Kelson created T328554: Add MWoffliner to translatewiki.net.
Feb 1 2023, 1:16 PM · Unplanned-Sprint-Work, Language-Team (Language-2023-January-March), affects-Kiwix-and-openZIM, translatewiki.net

Jan 25 2023

Kelson added a comment to T260223: Kiwix rsyncs not completing and stacking up on Clouddumps1001,2.

@Rgaudin Do you have any hint about this last comment from @Hokwelum?

Jan 25 2023, 2:05 PM · cloud-services-team, affects-Kiwix-and-openZIM, Dumps-Generation

Jan 22 2023

Kelson added a comment to T103084: Have a cron job delete files that haven't been modified in the last X days / months in /data/scratch.

Just FYI, no need anymore on MWoffliner side as we use an online object cache meanwhile.

Jan 22 2023, 10:59 AM · cloud-services-team, Data-Services

Jan 19 2023

Kelson moved T324866: large amount of traffic to the action=parse API from MWOffliner from TRIAGE to TOP on the affects-Kiwix-and-openZIM board.
Jan 19 2023, 9:53 AM · Performance-Team (Radar), serviceops, affects-Kiwix-and-openZIM, Wikimedia Enterprise
Kelson moved T322982: What are the expected HTTP status codes of the Wikidata Query Service? from TRIAGE to TOP on the affects-Kiwix-and-openZIM board.
Jan 19 2023, 9:53 AM · Wikidata, affects-Kiwix-and-openZIM, Wikidata-Query-Service
Kelson moved T320733: Support and document how language conversion work with multidirectional wikitext <=> HTML conversion on language-conversion-supported extensions. from TRIAGE to NORMAL on the affects-Kiwix-and-openZIM board.
Jan 19 2023, 9:53 AM · Parsoid-Read-Views, Parsoid-Rendering, affects-Kiwix-and-openZIM, Parsoid, Services (watching), Epic, MediaWiki-Language-converter, Chinese-Sites, I18n
Kelson moved T161278: Add default gadget styling to Parsoid's output from TRIAGE to TOP on the affects-Kiwix-and-openZIM board.
Jan 19 2023, 9:53 AM · affects-Kiwix-and-openZIM, Performance-Team (Radar), Parsoid-Rendering, Platform Engineering, Parsoid, Patch-For-Review, MediaWiki-extensions-Gadgets, MediaWiki-Action-API
Kelson moved T124960: Labs bandwidth is aleatory/low from TRIAGE to NICE TO HAVE on the affects-Kiwix-and-openZIM board.
Jan 19 2023, 9:53 AM · affects-Kiwix-and-openZIM, cloud-services-team, Cloud-VPS
Kelson added a project to T124960: Labs bandwidth is aleatory/low: affects-Kiwix-and-openZIM.
Jan 19 2023, 9:53 AM · affects-Kiwix-and-openZIM, cloud-services-team, Cloud-VPS
Kelson added a comment to T124960: Labs bandwidth is aleatory/low.

This ticket is really old. We have made many improvement in our toolchain software and infrastructure (many backoff strategies) in the meantime. I can not assess if the problem is still there or if it has been fixed; but whatever the current status, we don't suffer of it anymore. I would be fine to close it.

Jan 19 2023, 9:52 AM · affects-Kiwix-and-openZIM, cloud-services-team, Cloud-VPS

Jan 16 2023

Kelson added a comment to T326040: Add PhET scraper to translatewiki.net (sub-project Kiwix).

@abi_ Thank you for the PR, currently under review!

Jan 16 2023, 7:36 PM · Language-Team (Language-2023-January-March), affects-Kiwix-and-openZIM, translatewiki.net
Kelson added a comment to T324866: large amount of traffic to the action=parse API from MWOffliner.

At MWoffliner we have started to study the problem. Because of this ticket but as well because our unstable experience with the usage of this end-point. See https://github.com/openzim/mwoffliner/issues/1730. Hopefuly Wikimedia does provide other better end-points allowing us to retrieve the same information.

Jan 16 2023, 9:39 AM · Performance-Team (Radar), serviceops, affects-Kiwix-and-openZIM, Wikimedia Enterprise

Jan 10 2023

Kelson added a comment to T326040: Add PhET scraper to translatewiki.net (sub-project Kiwix).

@abi_ Thank you! I will create a qqq.json and remove the metadata. When can we expect a first PR from Translatewiki to check the process works fine?

Jan 10 2023, 5:41 PM · Language-Team (Language-2023-January-March), affects-Kiwix-and-openZIM, translatewiki.net

Dec 31 2022

Amire80 awarded T326040: Add PhET scraper to translatewiki.net (sub-project Kiwix) a Love token.
Dec 31 2022, 11:57 AM · Language-Team (Language-2023-January-March), affects-Kiwix-and-openZIM, translatewiki.net
Amire80 awarded T326040: Add PhET scraper to translatewiki.net (sub-project Kiwix) a Mountain of Wealth token.
Dec 31 2022, 11:24 AM · Language-Team (Language-2023-January-March), affects-Kiwix-and-openZIM, translatewiki.net
Kelson moved T326040: Add PhET scraper to translatewiki.net (sub-project Kiwix) from TRIAGE to TOP on the affects-Kiwix-and-openZIM board.
Dec 31 2022, 11:18 AM · Language-Team (Language-2023-January-March), affects-Kiwix-and-openZIM, translatewiki.net
Kelson renamed T326040: Add PhET scraper to translatewiki.net (sub-project Kiwix) from Add {PROJECT} to translatewiki.net to Add PhET scraper to translatewiki.net (sub-project Kiwix).
Dec 31 2022, 11:18 AM · Language-Team (Language-2023-January-March), affects-Kiwix-and-openZIM, translatewiki.net
Kelson created T326040: Add PhET scraper to translatewiki.net (sub-project Kiwix).
Dec 31 2022, 11:17 AM · Language-Team (Language-2023-January-March), affects-Kiwix-and-openZIM, translatewiki.net

Dec 23 2022

Kelson added a comment to T319725: Migrate enwp10 from Toolforge GridEngine to Toolforge Kubernetes.

I guess this ticket can be closed?

Dec 23 2022, 7:58 AM · affects-Kiwix-and-openZIM, Grid-Engine-to-K8s-Migration

Dec 12 2022

Kelson added a comment to T324866: large amount of traffic to the action=parse API from MWOffliner.

I can think of several (I don't know the details of your system and might have missed something):

Dec 12 2022, 9:55 AM · Performance-Team (Radar), serviceops, affects-Kiwix-and-openZIM, Wikimedia Enterprise
Kelson added a comment to T324866: large amount of traffic to the action=parse API from MWOffliner.

@Ladsgroup The MWoffliner scraper has already been quite optimised over years. I have no obvious improvement in mind for the moment but we will consider any concrete new proposal.

Dec 12 2022, 7:59 AM · Performance-Team (Radar), serviceops, affects-Kiwix-and-openZIM, Wikimedia Enterprise
Kelson added a comment to T324866: large amount of traffic to the action=parse API from MWOffliner.

Would that https://github.com/openzim/mwoffliner/issues/1664 fix the issue, so far we are really not familiar with this new API end-point?

Dec 12 2022, 7:47 AM · Performance-Team (Radar), serviceops, affects-Kiwix-and-openZIM, Wikimedia Enterprise

Dec 1 2022

Kelson added a comment to T284693: Wikimedia\Assert\InvariantException: Invariant failed: Bad UTF-8 at end of string (3 byte sequence).

On my end, this looks better now. Thx!

Dec 1 2022, 11:20 AM · Content-Transform-Team-WIP, Parsoid-Read-Views (Phase 2 - testwiki Main namespace support), Parsoid, Wikimedia-production-error

Nov 28 2022

Kelson added a comment to T317011: HTTP 500 against api.php?action=parse API on tr.wikipedia.org.

The reported bug seems indeed to have "vanished". Thank you for the good work.

Nov 28 2022, 3:27 PM · SRE, Traffic, affects-Kiwix-and-openZIM

Nov 13 2022

Kelson added a project to T322982: What are the expected HTTP status codes of the Wikidata Query Service?: affects-Kiwix-and-openZIM.
Nov 13 2022, 6:15 PM · Wikidata, affects-Kiwix-and-openZIM, Wikidata-Query-Service

Nov 2 2022

Kelson added a comment to T320312: Archive wikifr-l Mailing list.

If you can delete the whole thread https://lists.wikimedia.org/hyperkitty/list/wikifr-l@lists.wikimedia.org/thread/J2FU23D4C5ERWIK2LWBYUBTYK3O6KP6Y/, then problem would be solved. It's a pity we can not hide it. I don't like that we manipulate the archive.

Nov 2 2022, 12:54 PM · SRE, Wikimedia-Mailing-lists

Oct 31 2022

Dzahn awarded T57503: Mirror more Kiwix downloads directories a Like token.
Oct 31 2022, 2:25 PM · cloud-services-team (Kanban), Cloud-Services, affects-Kiwix-and-openZIM, SRE, Datasets-General-or-Unknown

Oct 30 2022

Kelson added a comment to T320312: Archive wikifr-l Mailing list.

@Ladsgroup Thank you but I don't see these two options below the "Add to favorites"... although I'm owner on the list.

Oct 30 2022, 7:13 PM · SRE, Wikimedia-Mailing-lists

Oct 29 2022

Kelson added a comment to T284693: Wikimedia\Assert\InvariantException: Invariant failed: Bad UTF-8 at end of string (3 byte sequence).

See also https://github.com/openzim/mwoffliner/issues/1482

Oct 29 2022, 1:06 PM · Content-Transform-Team-WIP, Parsoid-Read-Views (Phase 2 - testwiki Main namespace support), Parsoid, Wikimedia-production-error
Kelson closed T57503: Mirror more Kiwix downloads directories, a subtask of T302981: Q3:(Need By: TBD) rack/setup/install 2 new labstore hosts, as Resolved.
Oct 29 2022, 1:02 PM · Patch-For-Review, Infrastructure-Foundations, SRE, ops-eqiad, netops, cloud-services-team (Hardware), DC-Ops
Kelson closed T57503: Mirror more Kiwix downloads directories as Resolved.
Oct 29 2022, 1:02 PM · cloud-services-team (Kanban), Cloud-Services, affects-Kiwix-and-openZIM, SRE, Datasets-General-or-Unknown
Kelson added a comment to T57503: Mirror more Kiwix downloads directories.

@Dzahn Great, thank you very much!

Oct 29 2022, 1:01 PM · cloud-services-team (Kanban), Cloud-Services, affects-Kiwix-and-openZIM, SRE, Datasets-General-or-Unknown

Oct 24 2022

Kelson added a comment to T320312: Archive wikifr-l Mailing list.

I have achieved to create account an retrieve admin access to the list, but really no clue how to remove the few messages (from the public archive). Not even sure this is possible at all. As a consequence, I have put the whole ml archive in private. Unfortunately, this seems to fail, archive is still accessible at https://lists.wikimedia.org/hyperkitty/list/wikifr-l@lists.wikimedia.org/latest

Oct 24 2022, 5:38 PM · SRE, Wikimedia-Mailing-lists
Kelson updated subscribers of T260223: Kiwix rsyncs not completing and stacking up on Clouddumps1001,2.

During September we have detected that one of the mirror was full and therefore rsync client was keeping download and redownloading things. As a consequence a significant part of the bandwidth and the rsync daemon slots were always busy. We still lack of monitoring solution for this on our side honestly. We should figure a tool and a process to better monitor the server/service. If you have propositions, they are welcome.

Hello Kelson, We would like to know if the space problem has been resolved as we received the same error message today.

Oct 24 2022, 5:27 PM · cloud-services-team, affects-Kiwix-and-openZIM, Dumps-Generation
Kelson added a comment to T57503: Mirror more Kiwix downloads directories.

@nskaggs Not sure this is a question to me, but in the case it needed, could you please change the ZIM mirroring rsync command to:

  • request on master.download.kiwix.org in place of download.kiwix.org
  • sync the following repositories in addition to wikipedia: wikibooks, wikinews, wikiquote, wikisource, wikiversity, wiktionary, wikivoyage
Oct 24 2022, 5:24 PM · cloud-services-team (Kanban), Cloud-Services, affects-Kiwix-and-openZIM, SRE, Datasets-General-or-Unknown

Oct 16 2022

Kelson added a comment to T161278: Add default gadget styling to Parsoid's output.

It seem that this bug partly explains why ZIM files of Wiktionary in English are crappy, see https://github.com/openzim/mwoffliner/pull/1665

Oct 16 2022, 8:10 AM · affects-Kiwix-and-openZIM, Performance-Team (Radar), Parsoid-Rendering, Platform Engineering, Parsoid, Patch-For-Review, MediaWiki-extensions-Gadgets, MediaWiki-Action-API
Kelson added a project to T161278: Add default gadget styling to Parsoid's output: affects-Kiwix-and-openZIM.
Oct 16 2022, 8:09 AM · affects-Kiwix-and-openZIM, Performance-Team (Radar), Parsoid-Rendering, Platform Engineering, Parsoid, Patch-For-Review, MediaWiki-extensions-Gadgets, MediaWiki-Action-API

Oct 15 2022

Kelson added a comment to T226931: Parsoid cache invalidation for mobile-sections seems not reliable.

It seems the bug reported in T274359 is the same as this one, so reputting here the bug description:

Oct 15 2022, 4:11 PM · Page Content Service, Content-Transform-Team-WIP, serviceops, Parsoid, affects-Kiwix-and-openZIM, ChangeProp, RESTBase
Kelson added a comment to T274359: Mobile REST API delivers year old+ content for very select pages.

@matmarex Strange to close this ticket considering the bug described in the ticket is not fixed!

Oct 15 2022, 4:10 PM · User-TheresNoTime, Platform Engineering, Page Content Service, Product-Infrastructure-Team-Backlog-Deprecated, Wikipedia-Android-App-Backlog, RESTBase-API, affects-Kiwix-and-openZIM

Oct 8 2022

Kelson added a comment to T260223: Kiwix rsyncs not completing and stacking up on Clouddumps1001,2.

During September we have detected that one of the mirror was full and therefore rsync client was keeping download and redownloading things. As a consequence a significant part of the bandwidth and the rsync daemon slots were always busy. We still lack of monitoring solution for this on our side honestly. We should figure a tool and a process to better monitor the server/service. If you have propositions, they are welcome.

Oct 8 2022, 6:10 PM · cloud-services-team, affects-Kiwix-and-openZIM, Dumps-Generation
Kelson added a comment to T319725: Migrate enwp10 from Toolforge GridEngine to Toolforge Kubernetes.

@komla What would be the way to proceed:

  • Can you delete everything except the DB (no sure what is the same BTW)?
  • Should we somehow migrate the DB first?
Oct 8 2022, 6:07 PM · affects-Kiwix-and-openZIM, Grid-Engine-to-K8s-Migration
Kelson created T320312: Archive wikifr-l Mailing list.
Oct 8 2022, 9:13 AM · SRE, Wikimedia-Mailing-lists
Kelson moved T319725: Migrate enwp10 from Toolforge GridEngine to Toolforge Kubernetes from TRIAGE to TOP on the affects-Kiwix-and-openZIM board.
Oct 8 2022, 8:04 AM · affects-Kiwix-and-openZIM, Grid-Engine-to-K8s-Migration
Kelson added a project to T319725: Migrate enwp10 from Toolforge GridEngine to Toolforge Kubernetes: affects-Kiwix-and-openZIM.
Oct 8 2022, 8:04 AM · affects-Kiwix-and-openZIM, Grid-Engine-to-K8s-Migration
Kelson updated subscribers of T319725: Migrate enwp10 from Toolforge GridEngine to Toolforge Kubernetes.

@Audiodude You are better informed about the current situation but AFAIK, we only still the DB that we use in the VPS we have now, all the rest could be deleted. Can you confirm?

Oct 8 2022, 8:03 AM · affects-Kiwix-and-openZIM, Grid-Engine-to-K8s-Migration

Oct 3 2022

Kelson moved T179879: Provide a 5-minute timeout in WDQS for trusted users using OAuth from TRIAGE to TOP on the affects-Kiwix-and-openZIM board.
Oct 3 2022, 6:37 AM · affects-Kiwix-and-openZIM, Discovery-ARCHIVED, Wikidata, Wikidata-Query-Service
Kelson moved T319151: Pagination through Wikidata Query Service results from TRIAGE to TOP on the affects-Kiwix-and-openZIM board.
Oct 3 2022, 6:37 AM · affects-Kiwix-and-openZIM, Wikidata-Query-Service, Wikidata
Kelson added a comment to T319151: Pagination through Wikidata Query Service results.

This ticket is a kind of blocker for new Kiwix/openZIM selection tools based on Wikidata https://github.com/openzim/wp1/issues/519 and therefore Wikipedia on Demand project https://meta.wikimedia.org/wiki/Kiwix/Wikipedia_on_demand

Oct 3 2022, 6:36 AM · affects-Kiwix-and-openZIM, Wikidata-Query-Service, Wikidata
Kelson added a project to T319151: Pagination through Wikidata Query Service results: affects-Kiwix-and-openZIM.
Oct 3 2022, 6:36 AM · affects-Kiwix-and-openZIM, Wikidata-Query-Service, Wikidata
Kelson added a comment to T179879: Provide a 5-minute timeout in WDQS for trusted users using OAuth.

This ticket is a kind of blocker for new Kiwix/openZIM selection tools based on Wikidata https://github.com/openzim/wp1/issues/519 and therefore Wikipedia on Demand project https://meta.wikimedia.org/wiki/Kiwix/Wikipedia_on_demand

Oct 3 2022, 6:36 AM · affects-Kiwix-and-openZIM, Discovery-ARCHIVED, Wikidata, Wikidata-Query-Service
Kelson added a project to T179879: Provide a 5-minute timeout in WDQS for trusted users using OAuth: affects-Kiwix-and-openZIM.
Oct 3 2022, 6:31 AM · affects-Kiwix-and-openZIM, Discovery-ARCHIVED, Wikidata, Wikidata-Query-Service

Sep 18 2022

Kelson added a comment to T238285: Pages whose title ends with semicolon (;) are intermittently inaccessible (likely due to ATS).

Same problem with an article of WPJA. Whereas it works fine for human interface:

$curl -L 'https://ja.wikipedia.org/wiki/%E3%81%8A%E3%81%A7%E3%81%8B%E3%81%91%E3%83%AC%E3%82%B9%E3%82%BF%E3%83%BC%E3%82%8C%E3%82%8C%E3%82%8C%E3%81%AE%E3%82%8C(%5E%5E%3B'
Sep 18 2022, 9:21 AM · Traffic-Icebox, affects-Kiwix-and-openZIM, WMF-General-or-Unknown, SRE, User-DannyS712

Sep 5 2022

Kelson added a comment to T41651: Internal ZIM URLs must be relative.

For the record, this 10 years old ticket, has been a real bug. It happened at the time we discovered we had to have relative links in HTML inside the ZIM to allow a certain flexibility in the way how the ZIM could be "mounted". This was and is particulary true with kiwix-serve. I believe this bug to have been open at a time the libzim tracker was in Phabricator, so the bug was at the right place. Unfortunately, the tagging seemed wrong and this ticket has - looks like - not been closed at the time the libzim bug tracker has been moved to openZIM organisation (which is already a long time ago). Obviously, since years, ZIM should provide (and provide) HTML content with relative URLs.

Sep 5 2022, 5:45 PM · Collection
Kelson added a comment to T317011: HTTP 500 against api.php?action=parse API on tr.wikipedia.org.

Cannot reproduce the problem here (central Europe):

Sep 5 2022, 5:41 PM · SRE, Traffic, affects-Kiwix-and-openZIM
Kelson moved T317011: HTTP 500 against api.php?action=parse API on tr.wikipedia.org from TOP to NORMAL on the affects-Kiwix-and-openZIM board.
Sep 5 2022, 8:20 AM · SRE, Traffic, affects-Kiwix-and-openZIM
Kelson moved T317011: HTTP 500 against api.php?action=parse API on tr.wikipedia.org from TRIAGE to TOP on the affects-Kiwix-and-openZIM board.
Sep 5 2022, 8:20 AM · SRE, Traffic, affects-Kiwix-and-openZIM
Kelson created T317011: HTTP 500 against api.php?action=parse API on tr.wikipedia.org.
Sep 5 2022, 8:20 AM · SRE, Traffic, affects-Kiwix-and-openZIM

Sep 4 2022

Kelson added a comment to T57503: Mirror more Kiwix downloads directories.

@nskaggs @Aklapper Not sure to fully understand the question. The answer has been posted earlier this year at https://phabricator.wikimedia.org/T57503#7655695 (but you should not mirror "wikihow"). So just remove the "wikipedia" folder (which is already mirrored) and you will have the answer, which is a bit less than 0.5 TB.

Sep 4 2022, 2:55 PM · cloud-services-team (Kanban), Cloud-Services, affects-Kiwix-and-openZIM, SRE, Datasets-General-or-Unknown

Jul 10 2022

Kelson added a comment to T226523: Template in wikilink target position also returns pipe separated params.

@Arlolra @ssastry Have checked again this and the bug is still valid. Almost 3 years have passed and I wonder if you are not far enough to decide either you will fix it or close it as WONTFIX (But then a kind of communication/measure should probably be taken to inform Wiki editors.. and fix the few articles concerned).

Jul 10 2022, 8:15 AM · affects-Kiwix-and-openZIM, Mobile-Content-Service, Product-Infrastructure-Team-Backlog-Deprecated, Parsoid

Jun 12 2022

Kelson added a comment to T275505: Timeout on pages with lots of templates.

Here an other MWoffliner ticket open by a user but for an other page https://github.com/openzim/mwoffliner/issues/1617

Jun 12 2022, 12:08 PM · affects-Kiwix-and-openZIM, Performance Issue, Parsoid

Jun 8 2022

Kelson added a comment to T226931: Parsoid cache invalidation for mobile-sections seems not reliable.

Bug still there:

Jun 8 2022, 8:51 AM · Page Content Service, Content-Transform-Team-WIP, serviceops, Parsoid, affects-Kiwix-and-openZIM, ChangeProp, RESTBase
Kelson added a comment to T274359: Mobile REST API delivers year old+ content for very select pages.

As far as I can check the ticket is not fixed. Here an example:

Jun 8 2022, 8:50 AM · User-TheresNoTime, Platform Engineering, Page Content Service, Product-Infrastructure-Team-Backlog-Deprecated, Wikipedia-Android-App-Backlog, RESTBase-API, affects-Kiwix-and-openZIM

Jun 4 2022

Kelson moved T295556: Image requests sending neither "Last-Modified" nor "ETag" HTTP headers. from TRIAGE to TOP on the affects-Kiwix-and-openZIM board.
Jun 4 2022, 5:08 PM · affects-Kiwix-and-openZIM, Performance-Team (Radar), Traffic
Kelson added a comment to T57503: Mirror more Kiwix downloads directories.

Looping in @Andrew. @Kelson note that yes, we are installing new, more capable machines that have more capacity than in years past. Once they are up and running, we can explore mirroring this additional data.

Jun 4 2022, 5:04 PM · cloud-services-team (Kanban), Cloud-Services, affects-Kiwix-and-openZIM, SRE, Datasets-General-or-Unknown

May 27 2022

Kelson added a comment to T57503: Mirror more Kiwix downloads directories.

@ArielGlenn Can you please reassign the ticket? I have no clue who - concretly - is WMCS?

May 27 2022, 5:48 AM · cloud-services-team (Kanban), Cloud-Services, affects-Kiwix-and-openZIM, SRE, Datasets-General-or-Unknown

May 26 2022

Kelson updated subscribers of T295556: Image requests sending neither "Last-Modified" nor "ETag" HTTP headers..

Learning only now about this bug thank to @Krinkle. From MWoffliner perspective this has a serious impact on the way how it works. The reason: without the ETAG, we have no way to compare it to our media cache, therefore each media file will be downloaded again from the Wikimedia backend (in place of the MWoffliner S3 cache). For us, the performance impact is probably not that big (we download everything from Wikimedia backend instead of balancing things between the S3 cache and Wikimedia. But for the Wikimedia backend, this is not the same story.

May 26 2022, 8:31 PM · affects-Kiwix-and-openZIM, Performance-Team (Radar), Traffic
Kelson added a project to T295556: Image requests sending neither "Last-Modified" nor "ETag" HTTP headers.: affects-Kiwix-and-openZIM.
May 26 2022, 8:25 PM · affects-Kiwix-and-openZIM, Performance-Team (Radar), Traffic
Kelson added a comment to T302981: Q3:(Need By: TBD) rack/setup/install 2 new labstore hosts.

@Andrew Thank you for finally completing this task!

May 26 2022, 8:18 PM · Patch-For-Review, Infrastructure-Foundations, SRE, ops-eqiad, netops, cloud-services-team (Hardware), DC-Ops
Kelson added a comment to T57503: Mirror more Kiwix downloads directories.

@ArielGlenn It seems that T302981 has just been implemented. Does that mean you have no blocker anymore for this task?

May 26 2022, 8:17 PM · cloud-services-team (Kanban), Cloud-Services, affects-Kiwix-and-openZIM, SRE, Datasets-General-or-Unknown
Kelson added a subtask for T302981: Q3:(Need By: TBD) rack/setup/install 2 new labstore hosts: T57503: Mirror more Kiwix downloads directories.
May 26 2022, 8:12 PM · Patch-For-Review, Infrastructure-Foundations, SRE, ops-eqiad, netops, cloud-services-team (Hardware), DC-Ops
Kelson added a parent task for T57503: Mirror more Kiwix downloads directories: T302981: Q3:(Need By: TBD) rack/setup/install 2 new labstore hosts.
May 26 2022, 8:12 PM · cloud-services-team (Kanban), Cloud-Services, affects-Kiwix-and-openZIM, SRE, Datasets-General-or-Unknown
Kelson added a member for affects-Kiwix-and-openZIM: StephaneKiwix.
May 26 2022, 2:57 PM
Kelson added a member for affects-Kiwix-and-openZIM: Rgaudin.
May 26 2022, 2:56 PM
Kelson added a comment to T260223: Kiwix rsyncs not completing and stacking up on Clouddumps1001,2.

@ArielGlenn What is the status here? We have kept a bit more slots and we have as moved to a stronger server, 2 months ago.

May 26 2022, 2:44 PM · cloud-services-team, affects-Kiwix-and-openZIM, Dumps-Generation
Kelson added a comment to T265006: upload.wikimedia.org HTTP 304 responses lack a Content-Type header.

@Krinkle I have rechecked this bug/ticket with the given example and now it works. Might that be that the bug has been fixed?

May 26 2022, 2:42 PM · Performance-Team (Radar), Thumbor, SRE-swift-storage, affects-Kiwix-and-openZIM, Commons
Kelson moved T305384: Server error on https://de.wikipedia.org/wiki/Bild_(Zeitung) due to {{Auflagen-Diagramm}} from NORMAL to TOP on the affects-Kiwix-and-openZIM board.
May 26 2022, 2:38 PM · MW-1.39-notes (1.39.0-wmf.16; 2022-06-13), affects-Kiwix-and-openZIM, Patch-For-Review, Performance-Team (Radar), MediaWiki-Parser, Performance Issue, Wikimedia-production-error
Kelson added a comment to T288889: Parsoid API not able to deliver HTML (HTTP 504) for certain (big) articles.

I have rechecked these 4 URLs posted in my lastest comment 6 months again. I can confirmed that all the four of them still failed with a HTTP 504 error.

May 26 2022, 2:34 PM · Parsoid, affects-Kiwix-and-openZIM

May 16 2022

Kelson closed T308292: The tragedy of mwoffliner4 as Resolved.
May 16 2022, 6:13 PM · affects-Kiwix-and-openZIM, cloud-services-team (Kanban), VPS-Projects
Kelson added a comment to T308292: The tragedy of mwoffliner4.

@Andrew VM recreated.

May 16 2022, 6:12 PM · affects-Kiwix-and-openZIM, cloud-services-team (Kanban), VPS-Projects

May 13 2022

Kelson added a project to T308292: The tragedy of mwoffliner4: affects-Kiwix-and-openZIM.
May 13 2022, 4:51 AM · affects-Kiwix-and-openZIM, cloud-services-team (Kanban), VPS-Projects
Kelson added a comment to T308292: The tragedy of mwoffliner4.

@Andrew OK, shit happends time to time, I will recreate the VM during the WE.

May 13 2022, 4:50 AM · affects-Kiwix-and-openZIM, cloud-services-team (Kanban), VPS-Projects

May 8 2022

Kelson closed T306082: Cloud VPS "mwoffliner" project Stretch deprecation as Resolved.
May 8 2022, 2:54 PM · affects-Kiwix-and-openZIM, Cloud-VPS (Debian Stretch Deprecation)
Kelson added a comment to T306082: Cloud VPS "mwoffliner" project Stretch deprecation.

@Andrew All our VMs have been migrated to Debian-bullseye. Therefore this ticket can be closed

May 8 2022, 2:53 PM · affects-Kiwix-and-openZIM, Cloud-VPS (Debian Stretch Deprecation)

May 7 2022

Kelson added a comment to T298011: JPEG image is reported with the wrong mime-type application/octet-stream.

@Reedy Thank you!

May 7 2022, 6:24 PM · Wikimedia-Site-requests, SRE-swift-storage, Commons, affects-Kiwix-and-openZIM
Kelson updated subscribers of T298011: JPEG image is reported with the wrong mime-type application/octet-stream.

@Reedy Would you be able please to help here?

May 7 2022, 3:16 PM · Wikimedia-Site-requests, SRE-swift-storage, Commons, affects-Kiwix-and-openZIM