Page MenuHomePhabricator

[Maps] Reduce Map Sync Latency with OpenStreetMaps (OSM)
Open, MediumPublic

Description

Context

  • Overlays (aka GeoShapes) are predefined objects on the map that are tied to latitude/longitude coordinates.
  • These polygons and way objects (countries, roads, parks, etc.) are defined in OpenStreetMaps (OSM) and replicated to appear on the maps in wiki projects. (see an example below)
  • Because these map overlays are defined in OpenStreetMap, they need to be synced with our infrastructure in order to display the objects and stylings in Wikimedia projects.
  • There has been a substantial lag in the syncing of these 2 systems mainly due to a failure in the OSM replication tool, osm2pgsql, that performs the database updates.

image.png (660×664 px, 275 KB)

Map overlay of Central Park in New York City

Why

  • For the community to provide a consistent experience of map overlays for all Wikimedia projects
  • For the foundation, in order to reduce the cost of maintenance for the overall maps stack

Key Metics

HypothesisMetricTarget
Map overlay latency reducesOSM Sync Lag< 3 days (99% of the time by EOFY)
Maintence effort reducesFull-time Engineer effort on *incidents< 10% (per quarter)

*incidents only consider outages and do not include general maintenance or big fixes

Resources

Related Objects

StatusSubtypeAssignedTask
ResolvedBUG REPORTNone
OpenNone
ResolvedNone
ResolvedMSantos
Resolvedhnowlan
ResolvedMSantos
ResolvedMSantos
ResolvedMSantos
Resolvedhnowlan
Resolved sdkim
Resolvedhnowlan
OpenNone
ResolvedMSantos
ResolvedMSantos
ResolvedMSantos
ResolvedMSantos
ResolvedMSantos
ResolvedMSantos
ResolvedBUG REPORTMSantos
ResolvedMSantos
DuplicateBUG REPORTJgiannelos
ResolvedJgiannelos
ResolvedJgiannelos
ResolvedMSantos
ResolvedBUG REPORTMSantos
ResolvedMSantos
Resolveddcaro
Resolvedhnowlan
Resolved Cmjohnson
Resolved Cmjohnson
Resolved Cmjohnson
Resolved Cmjohnson

Event Timeline

Hi @sdkim, welcome to Wikimedia Phabricator! Assuming this task is about Maps, hence adding that project tag so other people who don't know or don't care about WMF team tags can also find this task when searching via projects. Thanks! :)

sdkim updated the task description. (Show Details)
LGoto triaged this task as Medium priority.Aug 19 2020, 3:55 PM
sdkim renamed this task from [OSM] Reduce Map Overlay Latency to Reduce Map Sync Latency with OpenStreetMaps (OSM).Sep 18 2020, 7:00 PM
sdkim renamed this task from Reduce Map Sync Latency with OpenStreetMaps (OSM) to [Maps] Reduce Map Sync Latency with OpenStreetMaps (OSM).Sep 25 2020, 2:53 PM

I would guess this is the fundamental cause of Hjuston appearing instead of Houston?

"Hjuston" comes from label node 27526178. I'm afraid it's not covered here. See T230013: LanguagePicker's handling of script suffixes is broken.

Removing inactive task assignee.