Page MenuHomePhabricator
Create Task
Maniphest T138501

Ensure Maps servers can be installed easily (automation + documentation)
Closed, ResolvedPublic
Actions

Description

Currently there are a few issues with our puppet code for maps, and a few steps needing manual intervention. Things like initial data load needs to be well documented as they are not part of our puppet automation. We need to be in a place where installing a new maps server is:

  1. assign the proper puppet role
  2. run puppet
  3. run a single (or a small number of) scripts to do initial data load / configuration
  4. profit...

The above steps need to be documented enough so that anyone with reasonable understanding of the WMF infrastructure can follow them.

Details

SubjectRepoBranchLines +/-
Maps - initial data importoperations/puppetproduction+55 -15
Maps - initial import scriptoperations/puppetproduction+1 -1
Actually create initial import script for OSM dataoperations/puppetproduction+8 -0
Script to do the initial data load from OSM for Maps projectoperations/puppetproduction+144 -1
Customize query in gerrit

Related Objects
Search...

Event Timeline

Gehel created this task.Jun 23 2016, 3:10 PM
Restricted Application added subscribers: Zppix, Aklapper. · View Herald TranscriptJun 23 2016, 3:10 PM
Yurik added a project: Maps-Sprint.Jun 23 2016, 3:18 PM
Yurik moved this task from All map-related tasks to Maps-data on the Maps board.Jun 26 2016, 8:17 PM
Yurik added a project: Maps (Maps-data).Jun 26 2016, 8:24 PM
MaxSem moved this task from Backlog to In progress on the Maps-Sprint board.Jul 18 2016, 6:25 PM
gerritbot subscribed.Jul 20 2016, 4:17 PM

Change 293105 had a related patch set uploaded (by Gehel):
Script to do the initial data load from OSM for Maps project

https://gerrit.wikimedia.org/r/293105

gerritbot added a project: Patch-For-Review.Jul 20 2016, 4:17 PM
Gehel mentioned this in rOPUP129fc2c84d81: Script to do the initial data load from OSM for Maps project.Jul 20 2016, 4:20 PM
Gehel mentioned this in rOPUP9cb394540a46: Script to do the initial data load from OSM for Maps project.Jul 21 2016, 8:09 PM
gerritbot added a comment.Jul 21 2016, 8:09 PM

Change 293105 merged by Gehel:
Script to do the initial data load from OSM for Maps project

https://gerrit.wikimedia.org/r/293105

gerritbot added a comment.Jul 21 2016, 9:00 PM

Change 300410 had a related patch set uploaded (by Gehel):
Actually create initial import script for OSM data

https://gerrit.wikimedia.org/r/300410

Gehel mentioned this in rOPUPd3546e47b5ec: Actually create initial import script for OSM data.Jul 21 2016, 9:07 PM
gerritbot added a comment.Jul 21 2016, 9:10 PM

Change 300410 merged by Gehel:
Actually create initial import script for OSM data

https://gerrit.wikimedia.org/r/300410

gerritbot added a comment.Jul 21 2016, 9:18 PM

Change 300423 had a related patch set uploaded (by Gehel):
Maps - initial import script

https://gerrit.wikimedia.org/r/300423

Gehel mentioned this in rOPUPcd3a4561a142: Maps - initial import script.Jul 21 2016, 9:21 PM
gerritbot added a comment.Jul 21 2016, 9:26 PM

Change 300423 merged by Gehel:
Maps - initial import script

https://gerrit.wikimedia.org/r/300423

gerritbot added a comment.Jul 22 2016, 4:32 PM

Change 300572 had a related patch set uploaded (by Gehel):
Maps - initial data import

https://gerrit.wikimedia.org/r/300572

Gehel mentioned this in rOPUP5bdc8c8d957a: Maps - initial data import.Jul 22 2016, 4:39 PM
Gehel mentioned this in rOPUP464d4a27b638: Maps - initial data import.Aug 2 2016, 9:17 AM
Gehel mentioned this in rOPUPb84243f894d1: Maps - initial data import.Aug 2 2016, 3:19 PM
Gehel mentioned this in rOPUP832b89d7ceae: Maps - initial data import.Aug 2 2016, 7:16 PM
Gehel mentioned this in rOPUP9bbdcf100910: Maps - initial data import.Aug 3 2016, 2:11 PM
Gehel mentioned this in rOPUP6e72591597cc: Maps - initial data import.Aug 3 2016, 2:58 PM
gerritbot added a comment.Aug 3 2016, 8:17 PM

Change 300572 merged by Gehel:
Maps - initial data import

https://gerrit.wikimedia.org/r/300572

Gehel mentioned this in rOPUP6e3f3c832db2: Maps - initial data import.Aug 3 2016, 8:17 PM
Gehel mentioned this in rOPUP3477921b7e8c: Maps - initial data import.
Gehel closed this task as Resolved.Oct 12 2016, 6:17 PM

Procedure is being tested again on the reimage of maps-test servers. This seems to work well enough, resolving this task.

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL