Maniphest T260949

[OSM] Repurpose OSM data sync scripts
Closed, ResolvedPublic1 Estimated Story Points
Actions

Assigned To

Authored By

	MSantos
	Aug 20 2020, 9:45 PM

Tags

Referenced Files

None

Subscribers

Description

Background information

To fully migrate from osm2pgsql to imposm3, the initial import script and replication script.

What

TBD

How

In the process of the sync scripts changes, a side-effect will leverage another improvement T168704: Decouple osm2pgsql updates from tile expiry processing

Open questions

...

Acceptance criteria

scripts are adapted to imposm3 API
scripts can run on the beta cluster

Details

	Subject	Repo	Branch	Lines +/-
	start using imposm as OSM sync tool	operations/puppet	production	+651 -501

Customize query in gerrit

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Resolved	BUG REPORT	None	T312751 Geoline never shows up after OSM and Wikidata entries have been updated
		Open		None	T260456 [Maps] Reduce Map Sync Latency with OpenStreetMaps (OSM)
		Resolved		MSantos	T260949 [OSM] Repurpose OSM data sync scripts
		Resolved		MSantos	T168704 Decouple osm2pgsql updates from tile expiry processing

Event Timeline

MSantos created this task.Aug 20 2020, 9:45 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptAug 20 2020, 9:45 PM

MSantos mentioned this in T238554: [Spike] Consider using imposm3 as the OSM replication system.Aug 20 2020, 9:56 PM

MSantos added a parent task: T260456: [Maps] Reduce Map Sync Latency with OpenStreetMaps (OSM).Aug 20 2020, 10:01 PM

• sdkim moved this task from Needs triage to Upcoming on the Product-Infrastructure-Team-Backlog-Deprecated board.Aug 26 2020, 3:37 PM

MSantos triaged this task as Medium priority.Aug 26 2020, 3:40 PM

MSantos moved this task from All map-related tasks to Production Infrastructure on the Maps board.Sep 24 2020, 10:43 AM

• sdkim updated the task description. (Show Details)Sep 29 2020, 4:14 PM

MSantos set the point value for this task to 1.Oct 6 2020, 11:08 AM

MSantos moved this task from Upcoming to Kanban on the Product-Infrastructure-Team-Backlog-Deprecated board.Nov 9 2020, 6:44 PM

MSantos edited projects, added Product-Infrastructure-Team-Backlog-Deprecated (Kanban); removed Product-Infrastructure-Team-Backlog-Deprecated.

• sdkim assigned this task to MSantos.Nov 17 2020, 4:07 PM

• sdkim moved this task from To Do to Doing on the Product-Infrastructure-Team-Backlog-Deprecated (Kanban) board.

MSantos mentioned this in T137225: Investigate the use of osm replication script to replace our replication cronjob for Maps.Nov 25 2020, 11:06 AM

MSantos added a subtask: T168704: Decouple osm2pgsql updates from tile expiry processing.Nov 25 2020, 2:49 PM

MSantos updated the task description. (Show Details)Nov 25 2020, 2:51 PM

Change 644482 had a related patch set uploaded (by MSantos; owner: MSantos):
[operations/puppet@production] WIP: start using imposm as OSM sync tool

https://gerrit.wikimedia.org/r/644482

gerritbot added a project: Patch-For-Review.Dec 1 2020, 11:12 AM

MSantos moved this task from Doing to Blocked on the Product-Infrastructure-Team-Backlog-Deprecated (Kanban) board.Dec 14 2020, 10:28 AM

MSantos moved this task from Blocked to Doing on the Product-Infrastructure-Team-Backlog-Deprecated (Kanban) board.Jan 18 2021, 8:16 AM

MSantos moved this task from Doing to Sign off on the Product-Infrastructure-Team-Backlog-Deprecated (Kanban) board.Feb 2 2021, 12:17 PM

MSantos updated the task description. (Show Details)Feb 17 2021, 2:43 PM

MSantos moved this task from Sign off to To Deploy on the Product-Infrastructure-Team-Backlog-Deprecated (Kanban) board.Feb 19 2021, 9:48 PM

Change 644482 merged by Hnowlan:
[operations/puppet@production] start using imposm as OSM sync tool

https://gerrit.wikimedia.org/r/644482

Maintenance_bot removed a project: Patch-For-Review.Feb 23 2021, 12:10 PM

Deployment will be tracked in T269582: [OSM] perform imposm3 migration in production

MSantos closed subtask T168704: Decouple osm2pgsql updates from tile expiry processing as Resolved.Feb 23 2021, 1:01 PM