Page MenuHomePhabricator

[Maps] Reduce Map Sync Latency with OpenStreetMaps (OSM)
Open, MediumPublic

Description

Context

  • Overlays (aka GeoShapes) are predefined objects on the map that are tied to latitude/longitude coordinates.
  • These polygons and way objects (countries, roads, parks, etc.) are defined in OpenStreetMaps (OSM) and replicated to appear on the maps in wiki projects. (see an example below)
  • Because these map overlays are defined in OpenStreetMap, they need to be synced with our infrastructure in order to display the objects and stylings in Wikimedia projects.
  • There has been a substantial lag in the syncing of these 2 systems mainly due to a failure in the OSM replication tool, osm2pgsql, that performs the database updates.


Map overlay of Central Park in New York City

Why

  • For the community to provide a consistent experience of map overlays for all Wikimedia projects
  • For the foundation, in order to reduce the cost of maintenance for the overall maps stack

Key Metics

HypothesisMetricTarget
Map overlay latency reducesOSM Sync Lag< 3 days (99% of the time by EOFY)
Maintence effort reducesFull-time Engineer effort on *incidents< 10% (per quarter)

*incidents only consider outages and do not include general maintenance or big fixes

Resources

Related Objects

StatusSubtypeAssignedTask
Opensdkim
ResolvedNone
ResolvedMSantos
Resolvedhnowlan
ResolvedMSantos
ResolvedMSantos
ResolvedMSantos
Openhnowlan
Resolvedsdkim
Openhnowlan
OpenMSantos
ResolvedMSantos
ResolvedMSantos
ResolvedMSantos
ResolvedMSantos
OpenMSantos
OpenMSantos
OpenBUG REPORTMSantos
OpenMSantos

Event Timeline

sdkim created this task.Aug 14 2020, 7:27 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptAug 14 2020, 7:27 PM

Hi @sdkim, welcome to Wikimedia Phabricator! Assuming this task is about Maps, hence adding that project tag so other people who don't know or don't care about WMF team tags can also find this task when searching via projects. Thanks! :)

sdkim updated the task description. (Show Details)Aug 14 2020, 7:52 PM
sdkim updated the task description. (Show Details)Aug 14 2020, 7:55 PM
sdkim updated the task description. (Show Details)Aug 17 2020, 7:09 PM
sdkim updated the task description. (Show Details)
LGoto triaged this task as Medium priority.Aug 19 2020, 3:55 PM
sdkim renamed this task from [OSM] Reduce Map Overlay Latency to Reduce Map Sync Latency with OpenStreetMaps (OSM).Sep 18 2020, 7:00 PM
sdkim renamed this task from Reduce Map Sync Latency with OpenStreetMaps (OSM) to [Maps] Reduce Map Sync Latency with OpenStreetMaps (OSM).Sep 25 2020, 2:53 PM