As of now, each update of the database updates all covered events (20 as time of writing). But while updating very often (say, every 10 minutes) monuments2018 while WLM 2018 is running, we don’t really need to do the same for eg WLM 2014.
Especially given how we got into trouble with overloading the DB servers (T180566 & T180014).
The tool should be able to operate a different frequency on subsets of the whole data.
$ crontab -l */15 * * * * jsub -l release=trusty -mem 1000m -once -j y -o /data/project/wikiloves/logs/update-database.log -N update_database_high /data/project/wikiloves/wikiloves/bin/update_database.sh monuments2018 >> /data/project/wikiloves/logs/crontab.log 56 0 * * * jsub -l release=trusty -mem 1000m -once -j y -o /data/project/wikiloves/logs/update-database.log -N update_database_low /data/project/wikiloves/wikiloves/bin/update_database.sh >> /data/project/wikiloves/logs/crontab.log
monuments2018 will update every 15 minutes ; the entire dataset will update once a day.