Page MenuHomePhabricator

Upgrade node to version 10 on Beta Cluster for maps
Closed, ResolvedPublic

Description

As a follow-up of Audiences Platform Sync and since is not possible yet to migrate node 10 for maps infrastructure it is desirable to migrate it to node 8. Preliminary and local tests showed that it is possible, we should now test it in the Beta Cluster.

New tests with a forked version of node-mapnik provided by @Mholloway shows that is possible to run the current stack with node 10.

Event Timeline

It looks like we don't have a packaged nodejs 8 available. So if we want to upgrade to nodejs 8 before upgrading to nodejs 10, we'll also need to create the appropriate debian package. @MoritzMuehlenhoff maybe can help.

MSantos renamed this task from Upgrade node to version 8 on Beta Cluster for maps to Upgrade node to version 10 on Beta Cluster for maps.Mar 7 2019, 5:25 PM
MSantos renamed this task from Upgrade node to version 10 on Beta Cluster for maps to Upgrade node to version 8 on Beta Cluster for maps.Mar 7 2019, 5:35 PM
MSantos renamed this task from Upgrade node to version 8 on Beta Cluster for maps to Upgrade node to version 10 on Beta Cluster for maps.Mar 8 2019, 3:10 PM
MSantos updated the task description. (Show Details)
MSantos added a subscriber: Mholloway.

Change 495735 had a related patch set uploaded (by MSantos; owner: MSantos):
[operations/puppet@production] Pass flag use_nodejs10 for maps services

https://gerrit.wikimedia.org/r/495735

Change 495735 had a related patch set uploaded (by MSantos; owner: MSantos):
[operations/puppet@production] Pass flag use_nodejs10 for maps services

https://gerrit.wikimedia.org/r/495735

Change 495735 merged by Gehel:
[operations/puppet@production] Pass flag use_nodejs10 for maps services

https://gerrit.wikimedia.org/r/495735

@Mholloway and @Gehel, the beta cluster is set up with the alpha version recently created, see:

Maps

http://maps-beta.wmflabs.org/#8/31.494/35.261

Snapshot

http://maps-beta.wmflabs.org/img/osm-intl,8,31.494,35.261,250x250.png
http://maps-beta.wmflabs.org/img/osm-intl,8,31.494,35.261,250x250@2x.png
http://maps-beta.wmflabs.org/img/osm-intl,8,31.494,35.261,250x250@2x.png?lang=en

Geoshapes

http://maps-beta.wmflabs.org/geoshape?getgeojson=1&ids=Q36755

For posteriority, the setup was recreated from scratch:

  1. OSM data reloaded
  2. Cassandra keyspaces dropped and recreated
  3. Tiles re-generated until z12

Node version (10.15.2~dfsg-1+wmf)

@deployment-maps04:/srv/downloads$ dpkg -l nodejs
Desired=Unknown/Install/Remove/Purge/Hold
| Status=Not/Inst/Conf-files/Unpacked/halF-conf/Half-inst/trig-aWait/Trig-pend
|/ Err?=(none)/Reinst-required (Status,Err: uppercase=bad)
||/ Name                        Version            Architecture       Description
+++-===========================-==================-==================-============================================================
ii  nodejs                      10.15.2~dfsg-1+wmf amd64              evented I/O for V8 javascript - runtime executable

Next steps for production deploy

I appreciate any review, tests and QA you think is valid to approve this alpha version deployed at the Beta Cluster, also we need to push forward the discussion about how to publish and version source code at github, see PR.

Let me know if you have any questions and/or concerns.