The fundraising production database has been growing at very roughly 50% per year, and is currently about 1.6. The data partition on our database machines ranges from 3.6T to 5.2T. frdev1001 is approaching capacity fairly quickly since it hosts a live replica of the civi/drupal/fredge/pgehres/faulkner/smashpig database (~1.6TB) plus several dev databases (~970GB). We need to start planning for a refactor of some kind.
Current database footprint:
| 2020-06-29 | 2020-11-17 | 2021-02-17 | |
| smashpig | 2G | 6G | 5.8G |
| geonames | 6G | 6G | 5.8G |
| fredge | 39G | 51G | 57G |
| drupal | 56G | 70G | 77G |
| pgehres | 293G | (migrated to frdb1003) | - |
| faulkner | 354G | (migrated to frdb1003) | - |
| civicrm | 820G | 840G | 950G |
Data partition (/srv) capacity varies by server according to when we bought them:
| host | /srv | purchase | refresh | dc | notes |
| frdb1002 | 3.6T | 2017-02-24 | FY21-22 | eqiad | standard civi/drupal db (master) |
| frdb2001 | 5.2T | 2020-02-14 | FY24-25 | codfw | standard civi/drupal db |
| frdb2002 | 5.2T | 2019-12-03 | FY24-25 | codfw | standard civi/drupal db |
| frdev1001 | 3.6T | 2017-02-24 | FY21-22 | eqiad | dev database (eqiad, also includes civi etc) |
| frdb1003 | 5.2T | 2019-11-01 | FY24-25 | eqiad | analytics (also includes civi etc) |
| frdb1004 | 5.2T* | 2020-09-21 | FY25-26 | eqiad | standard civi/drupal db |
Rough growth numbers for the civicrm database and projections on when database footprint will exceed working capacity are here https://docs.google.com/spreadsheets/d/1FqQtn4XnXBnAIH8_FjFEp0mDty5RD85gJvWBh2xXyyY/edit?usp=sharing