Page MenuHomePhabricator

Reimport OSM data on eqiad
Open, HighPublic

Description

As a fallout of T243609, we need to reset our Postgres DB to a sane state.

The process:

  • 1) disable tilerator
  • 2) depool maps1004
  • 3) isolate maps1004 from the rest of the cluster [MrG]
  • 4) delete postgres data, recreate the empty DB [MrG]
  • 5) run script to reimport data from OSM, needs to run from root [MrG]
osm-initial-import \
   -d 200525 \ latest dump
   -s  https://planet.openstreetmap.org/replication/hour/000/067/571.state.txt \ hourly replication
   -x webproxy.eqiad.wmnet:8080
  • 6) enable replication and check at least one cycle of OSM replication
  • 7) repool maps1004
  • 8) re-init all slaves (cookbook)
  • 9) enable tilerator

Event Timeline

MSantos created this task.May 29 2020, 2:35 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMay 29 2020, 2:35 PM
MSantos updated the task description. (Show Details)May 29 2020, 2:40 PM
Gehel updated the task description. (Show Details)Jun 22 2020, 7:55 PM
Gehel triaged this task as High priority.Jun 26 2020, 8:02 AM

Change 608459 had a related patch set uploaded (by Ryan Kemper; owner: Ryan Kemper):
[operations/puppet@production] Temporarily disable tilerator

https://gerrit.wikimedia.org/r/c/operations/puppet/ /608459

Change 608726 had a related patch set uploaded (by Ryan Kemper; owner: Ryan Kemper):
[operations/puppet@production] Enable replication in eqiad

https://gerrit.wikimedia.org/r/c/operations/puppet/ /608726

Change 608729 had a related patch set uploaded (by Ryan Kemper; owner: Ryan Kemper):
[operations/puppet@production] Isolate eqiad master maps1004 from cluster

https://gerrit.wikimedia.org/r/c/operations/puppet/ /608729

mxn added a subscriber: mxn.Thu, Jul 16, 9:11 PM