Our first pickle_storage volume (that contains en, de, es, eu and tr) is 98% full. We need to move some languages to pickle_storage02 which is 57% full. I'm thinking the first volume can be more or less solely reserved for English, as that's the biggest and will grow the quickest.
After some of the non-English languages are moved to the 2nd volume, we should be safe for while, maybe… but overall I think it's probably time to re-invest in WikiWho and devise a more effective storage system than Python pickles.
As of 2025-11-01:
| Language | Size (GB) | Article count | Location |
|---|---|---|---|
| English (en) | ~3,200 | 7,083,607 | pickles |
| French (fr) | 703 | 2,717,846 | pickles-02 |
| German (de) | 702 | 3,064,852 | pickles |
| Spanish (es) | 535 | 2,071,519 | pickles |
| Italian (it) | 455 | 1,942,311 | pickles-02 |
| Japanese (ja) | 360 | 1,478,586 | pickles-02 |
| Polish (pl) | 247 | 1,673,469 | pickles-02 |
| Portuguese (pt) | 240 | 1,158,983 | pickles-02 |
| Dutch (nl) | 189 | 2,200,912 | pickles-02 |
| Arabic (ar) | 174 | 1,284,342 | pickles-02 |
| Turkish (tr) | 105 | 650,610 | pickles |
| Hungarian (hu) | 97 | 562,287 | pickles-02 |
| Indonesian (id) | 90 | 748,314 | pickles-02 |
| Basque (eu) | 32 | 474,423 | pickles |