Gather data on:
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Declined | Dbrant | T163706 [Spike] [4hrs] Investigate loading a random page from a zim file using an interceptor | |||
| Resolved | RHo | T166599 [EPIC] Create the user interface flow for readers to use offline content packs | |||
| Resolved | • Mholloway | T163714 Create a page content pack info client | |||
| Invalid | None | T172732 Create a production-ready zim content pack generation and upload service | |||
| Invalid | • Fjalapeno | T170841 Determine where to generate Zim content packs using Production WMF infrastructure | |||
| Invalid | • Fjalapeno | T172734 Collect data on zim file generation and upload times |
I'll keep collecting stats as we generate more files, but to give a preliminary figure, generating the 50,000 most-read file (nopic, novid) with full-text search indexing last night took ~6h.
Indexing takes quite a bit of time as the files become large; I've added more granular per-step timing for subsequent runs so we can get a sense of how much time is being spent in each operation.