At this time, the event database holds unsanitized data up to 90 days plus long retained data like mediawiki events (they are public).
The events_sanitized database holds data that is been sanitized.
Options:
- Main events database has all longterm data, including sanitized stuff, and event_fresh* or event_private (TBD) database has recent unsanitized data. This would encourage folks to use the main events database by default, and only go to the unsanitized one when necessary.
- Have the main events database hold data that is less <90 days old and an event_longterm database where we hold sanitized data but also data from events , like mediawiki's that are public.
Either way, we should make the retention settings consistent in these different databases.
Perhaps in a new Iceberg world future, we will not need two different databases?