Page MenuHomePhabricator

Reimport OSM data on codfw
Closed, ResolvedPublic

Description

As a fallout of T243609, we need to reset our Postgres DB to a sane state.

The process:

  • -1) add option to puppet to disable tilerator
  • 0) depool maps2004
  • 1) isolate maps2004 from the rest of the cluster [MrG]
  • 2) delete postgres data, recreate the empty DB [MrG]
  • 3) run script to reimport data from OSM, needs to run from root [MrG]
osm-initial-import \
   -d 200323 \ latest dump
   -p <password_file> \ (might not be needed)
   -s  https://planet.openstreetmap.org/replication/hour/000/066/063.state.txt \ hourly replication
   -x webproxy.eqiad.wmnet:8080
  • 4) disable tilerator
  • 5) enable replication
  • 6) check how replication is doing
  • 7) repool maps2004
  • 8) re-init all slaves (cookbook)
  • 9) enable tilerator

Event Timeline

Change 585128 had a related patch set uploaded (by Gehel; owner: Gehel):
[operations/puppet@production] maps: add parameter to disable tilerator

https://gerrit.wikimedia.org/r/585128

Change 585141 had a related patch set uploaded (by Gehel; owner: Gehel):
[operations/puppet@production] maps: disable tilerator in codfw for data reload

https://gerrit.wikimedia.org/r/585141

Change 585153 had a related patch set uploaded (by Gehel; owner: Gehel):
[operations/puppet@production] maps: isolate osm master from the codfw maps cluster

https://gerrit.wikimedia.org/r/585153

Change 585128 merged by Gehel:
[operations/puppet@production] maps: add parameter to disable tilerator

https://gerrit.wikimedia.org/r/585128

Change 585141 merged by Gehel:
[operations/puppet@production] maps: disable tilerator in codfw for data reload

https://gerrit.wikimedia.org/r/585141

Mentioned in SAL (#wikimedia-operations) [2020-04-02T09:40:33Z] <gehel> depool wdqs2004 for data reimport - T249086

Change 585153 merged by Gehel:
[operations/puppet@production] maps: isolate osm master from the codfw maps cluster

https://gerrit.wikimedia.org/r/585153

Mentioned in SAL (#wikimedia-operations) [2020-04-02T09:40:48Z] <gehel> CORRECTION: depool maps2004 for data reimport - T249086

Mentioned in SAL (#wikimedia-operations) [2020-04-02T13:32:45Z] <gehel> OSM data reimport on maps2004 - T249086

MSantos triaged this task as High priority.Apr 8 2020, 3:49 PM

Change 591028 had a related patch set uploaded (by MSantos; owner: MSantos):
[operations/puppet@production] Re-enable OSM replication

https://gerrit.wikimedia.org/r/591028

MSantos updated the task description. (Show Details)

Change 591028 merged by Gehel:
[operations/puppet@production] Re-enable OSM replication

https://gerrit.wikimedia.org/r/591028

Change 598962 had a related patch set uploaded (by Gehel; owner: Gehel):
[operations/puppet@production] maps: remove useless hiera config

https://gerrit.wikimedia.org/r/598962

Change 598963 had a related patch set uploaded (by Gehel; owner: Gehel):
[operations/puppet@production] maps: maps2003 rejoins master

https://gerrit.wikimedia.org/r/598963

Change 598965 had a related patch set uploaded (by Gehel; owner: Gehel):
[operations/puppet@production] maps: maps2001 rejoins master

https://gerrit.wikimedia.org/r/598965

Change 598964 had a related patch set uploaded (by Gehel; owner: Gehel):
[operations/puppet@production] maps: maps2002 rejoins master

https://gerrit.wikimedia.org/r/598964

Change 598962 merged by Gehel:
[operations/puppet@production] maps: remove useless hiera config

https://gerrit.wikimedia.org/r/598962

Change 598963 merged by Gehel:
[operations/puppet@production] maps: maps2003 rejoins master

https://gerrit.wikimedia.org/r/598963

Change 598964 merged by Gehel:
[operations/puppet@production] maps: maps2002 rejoins master

https://gerrit.wikimedia.org/r/598964

Change 598965 merged by Gehel:
[operations/puppet@production] maps: maps2001 rejoins master

https://gerrit.wikimedia.org/r/598965

MSantos renamed this task from Reimport OSM data on maps servers to Reimport OSM data on codfw.May 29 2020, 2:28 PM
MSantos closed this task as Resolved.
MSantos updated the task description. (Show Details)

This is now resolved in codfw, and for eqiad it will be tracked here T254014: Reimport OSM data on eqiad