If a reload is being done, all the cron jobs on that server need stopping.
How can this be done?
If a reload is being done, all the cron jobs on that server need stopping.
How can this be done?
The [[ https://github.com/wikimedia/puppet/blob/production/modules/profile/manifests/maps/osm_master.pp#L14 | profile::maps::osm_master ]] provides the disable_replication_cron variable which we can set to false to disable replication.
The three process-osm-data tasks that need to be regularly run are static-update, planet-update, database-update. Each of the tasks has a base cost that they always take regardless of how much they have to update.
database-update has a base cost of a few seconds, and the data it's pulling updates every minute. I suggest running every 1-5 minutes. The longer between runs, the longer reach run takes. This task updates the database, which updates *most* of the stuff and also invalidates tiles.
planet-update has a base cost of half an hour or so, and the data it's pulling updates every minute. It updates the borders. I suggest running every 6-24 hours. The longer between runs, the longer reach run takes, but most of the time is the base cost.
static-update has a base cost of seconds, and the data its pulling updates every day. It takes the same amount of time to run if it's been a day or a month. I suggest running every hour, as it's cheap, and it avoids *just* missing a data update.
A fourth task is T194787: Set up cron task to regenerate low-zoom vector tiles which is probably weekly or monthy.
Change 433625 had a related patch set uploaded (by Gehel; owner: Gehel):
[operations/puppet@production] maps: add crons for different update types
Change 433626 had a related patch set uploaded (by Gehel; owner: Gehel):
[operations/puppet@production] maps: disable OSM synchronisation while testing
Change 433625 merged by Gehel:
[operations/puppet@production] maps: add crons for different update types
Change 433626 merged by Gehel:
[operations/puppet@production] maps: disable OSM synchronisation while testing
Change 433628 had a related patch set uploaded (by Gehel; owner: Gehel):
[operations/puppet@production] maps: fix typo in cron hours
Change 433628 merged by Gehel:
[operations/puppet@production] maps: fix typo in cron hours
Change 433629 had a related patch set uploaded (by Gehel; owner: Gehel):
[operations/puppet@production] maps: fix typo in cron hours
Change 433629 merged by Gehel:
[operations/puppet@production] maps: fix typo in cron hours
Change 433631 had a related patch set uploaded (by Gehel; owner: Gehel):
[operations/puppet@production] maps: disable crons for maps-test2004
Change 433631 merged by Gehel:
[operations/puppet@production] maps: disable crons for maps-test2004