Page MenuHomePhabricator

Migrate to nginx-light
Closed, ResolvedPublic

Description

We're currently using nginx-full which also includes the Image filter module. It links against a wide range of media libraries:

linux-vdso.so.1 (0x00007ffcc07e0000)
libgd.so.3 => /usr/lib/x86_64-linux-gnu/libgd.so.3 (0x00007f1ace787000)
libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x00007f1ace3dc000)
libjpeg.so.62 => /usr/lib/x86_64-linux-gnu/libjpeg.so.62 (0x00007f1ace184000)
libz.so.1 => /lib/x86_64-linux-gnu/libz.so.1 (0x00007f1acdf69000)
libpng12.so.0 => /lib/x86_64-linux-gnu/libpng12.so.0 (0x00007f1acdd42000)
libfreetype.so.6 => /usr/lib/x86_64-linux-gnu/libfreetype.so.6 (0x00007f1acda97000)
libfontconfig.so.1 => /usr/lib/x86_64-linux-gnu/libfontconfig.so.1 (0x00007f1acd85a000)
libXpm.so.4 => /usr/lib/x86_64-linux-gnu/libXpm.so.4 (0x00007f1acd648000)
libX11.so.6 => /usr/lib/x86_64-linux-gnu/libX11.so.6 (0x00007f1acd304000)
libvpx.so.1 => /usr/lib/x86_64-linux-gnu/libvpx.so.1 (0x00007f1accf0c000)
libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x00007f1accc0b000)
libtiff.so.5 => /usr/lib/x86_64-linux-gnu/libtiff.so.5 (0x00007f1acc995000)
/lib64/ld-linux-x86-64.so.2 (0x0000562181c27000)
libexpat.so.1 => /lib/x86_64-linux-gnu/libexpat.so.1 (0x00007f1acc76c000)
libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0 (0x00007f1acc54e000)
libxcb.so.1 => /usr/lib/x86_64-linux-gnu/libxcb.so.1 (0x00007f1acc32c000)
libdl.so.2 => /lib/x86_64-linux-gnu/libdl.so.2 (0x00007f1acc128000)
liblzma.so.5 => /lib/x86_64-linux-gnu/liblzma.so.5 (0x00007f1acbf04000)
libjbig.so.0 => /usr/lib/x86_64-linux-gnu/libjbig.so.0 (0x00007f1acbcf5000)
libXau.so.6 => /usr/lib/x86_64-linux-gnu/libXau.so.6 (0x00007f1acbaf1000)
libXdmcp.so.6 => /usr/lib/x86_64-linux-gnu/libXdmcp.so.6 (0x00007f1acb8eb000)

We don't use the module in our nginx.conf, but it still triggers a lot of spurious restart warnings for nginx whenever one of those libs are updated.

This isn't important enough to have a round of nginx builds/deployments by itself, but the next time we update nginx for other reasons (say TLS 1.3), I'd like to piggyback that change.

In addition to the systems using tlsproxy, there's also a few systems using nginx-extras or nginx-full, which could be reviewed/migrated:

  • thumbor
  • francium
  • labstore1006/1007
  • install*
  • sodium
  • archiva1001

Details

SubjectRepoBranchLines +/-
operations/puppetproduction+1 -14
operations/puppetproduction+2 -2
operations/puppetproduction+10 -10
operations/puppetproduction+9 -8
operations/puppetproduction+17 -18
operations/puppetproduction+1 -0
operations/puppetproduction+2 -4
operations/puppetproduction+4 -0
operations/puppetproduction+2 -0
operations/puppetproduction+5 -4
operations/puppetproduction+2 -0
operations/puppetproduction+2 -0
operations/puppetproduction+2 -0
operations/puppetproduction+5 -4
operations/puppetproduction+1 -1
operations/puppetproduction+1 -0
operations/puppetproduction+3 -6
operations/puppetproduction+34 -21
operations/puppetproduction+1 -0
operations/puppetproduction+4 -3
operations/puppetproduction+2 -0
operations/puppetproduction+6 -8
operations/puppetproduction+1 -0
operations/puppetproduction+3 -0
operations/puppetproduction+1 -2
operations/puppetproduction+1 -2
operations/puppetproduction+11 -10
operations/puppetproduction+8 -9
operations/puppetproduction+1 -0
operations/puppetproduction+1 -0
operations/puppetproduction+9 -10
operations/puppetproduction+8 -10
operations/puppetproduction+1 -0
operations/puppetproduction+1 -0
operations/puppetproduction+6 -5
operations/puppetproduction+36 -0
operations/puppetproduction+0 -16
operations/puppetproduction+1 -1
Show related patches Customize query in gerrit

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes

apt.wikimedia.org (apt1001/apt2001) switched to nginx-light today

Change 697623 had a related patch set uploaded (by Jbond; author: John Bond):

[operations/puppet@production] C:puppetmaster::puppetdb: drop filter_id hack

https://gerrit.wikimedia.org/r/697623

Change 697623 merged by Jbond:

[operations/puppet@production] C:puppetmaster::puppetdb: drop filter_id hack

https://gerrit.wikimedia.org/r/697623

Change 697625 had a related patch set uploaded (by Jbond; author: John Bond):

[operations/puppet@production] P:nginx: add an nginx profile

https://gerrit.wikimedia.org/r/697625

Change 697626 had a related patch set uploaded (by Jbond; author: John Bond):

[operations/puppet@production] O:puppetmaster::puppetdb: add nginx profile to puppetdb

https://gerrit.wikimedia.org/r/697626

Change 697627 had a related patch set uploaded (by Jbond; author: John Bond):

[operations/puppet@production] O:puppetmatser::puppetdb: switch puppetdb to use nginx-light

https://gerrit.wikimedia.org/r/697627

Change 697625 merged by Jbond:

[operations/puppet@production] P:nginx: add an nginx profile

https://gerrit.wikimedia.org/r/697625

Change 697626 merged by Jbond:

[operations/puppet@production] O:puppetmaster::puppetdb: add nginx profile to puppetdb

https://gerrit.wikimedia.org/r/697626

Mentioned in SAL (#wikimedia-operations) [2021-06-02T11:54:26Z] <jbond> disable puppet fleet wide. changing puppetdb to use nginx-light #T164456

Change 697627 merged by Jbond:

[operations/puppet@production] O:puppetmatser::puppetdb: switch puppetdb to use nginx-light

https://gerrit.wikimedia.org/r/697627

Mentioned in SAL (#wikimedia-operations) [2021-06-02T12:05:49Z] <jbond> enable puppet fleet wide. post changing puppetdb to use nginx-light #T164456

I have updated puppetdb to use nginx-light. further It should now be fairly simple to switch other services to nginx-light.

  1. Add profile::nginx to the role
  2. Add profile::nginx::variant: 'light' to hiera to switch to nginx-light

Change 697739 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] Add nginx profile to apt_repo

https://gerrit.wikimedia.org/r/697739

Change 697740 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] Switch apt* to nginx-light

https://gerrit.wikimedia.org/r/697740

Change 697740 abandoned by Muehlenhoff:

[operations/puppet@production] Switch apt* to nginx-light

Reason:

Obsolete

https://gerrit.wikimedia.org/r/697740

Change 697739 merged by Muehlenhoff:

[operations/puppet@production] Add nginx profile to apt_repo

https://gerrit.wikimedia.org/r/697739

Change 697978 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] Switch installserver::light to profile::nginx

https://gerrit.wikimedia.org/r/697978

Change 697987 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] Switch install* servers to nginx-light

https://gerrit.wikimedia.org/r/697987

Change 697988 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] Switch testreduce to profile::nginx

https://gerrit.wikimedia.org/r/697988

Change 697978 merged by Dzahn:

[operations/puppet@production] Switch installserver::light to profile::nginx

https://gerrit.wikimedia.org/r/697978

Mentioned in SAL (#wikimedia-operations) [2021-06-03T18:28:22Z] <mutante> temp. disabling puppet on install* servers. switching nginx to light variant (T164456)

Change 697987 merged by Dzahn:

[operations/puppet@production] Switch install* servers to nginx-light

https://gerrit.wikimedia.org/r/697987

Mentioned in SAL (#wikimedia-operations) [2021-06-03T19:14:36Z] <mutante> install1003 - restarting nginx after we switched from nginx-full to nginx-light package, same on other install servers T164456

checked on install* that nginx-full is gone, nginx-light is there and restarted nginx to be sure

this did not remove other nginx-* module packages though

Change 698152 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] Enable profile::nginx for parsoid::testing

https://gerrit.wikimedia.org/r/698152

Mentioned in SAL (#wikimedia-operations) [2021-06-04T07:29:38Z] <moritzm> cleanup now unused nginx mods and former deps on install* and puppetdb* servers after switch towards nginx-light (various X11 libs and libxslt) T164456

Change 698155 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] Switch scandium/testreduce to nginx-light

https://gerrit.wikimedia.org/r/698155

Change 698208 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] Switch htmldumps to nginx-light

https://gerrit.wikimedia.org/r/698208

Change 698215 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] Switch htmldumps to nginx-light

https://gerrit.wikimedia.org/r/698215

Change 698208 abandoned by Muehlenhoff:

[operations/puppet@production] Switch htmldumps to nginx-light

Reason:

Replaced by different patch

https://gerrit.wikimedia.org/r/698208

Change 698152 merged by Dzahn:

[operations/puppet@production] Enable profile::nginx for parsoid::testing

https://gerrit.wikimedia.org/r/698152

Change 697988 merged by Dzahn:

[operations/puppet@production] Switch testreduce to profile::nginx

https://gerrit.wikimedia.org/r/697988

Change 698215 merged by Muehlenhoff:

[operations/puppet@production] Switch htmldumps to nginx-light

https://gerrit.wikimedia.org/r/698215

Change 698458 had a related patch set uploaded (by ArielGlenn; author: Muehlenhoff):

[operations/puppet@production] Switch htmldumps to nginx-light

https://gerrit.wikimedia.org/r/698458

Change 698458 merged by Muehlenhoff:

[operations/puppet@production] Switch htmldumps to nginx-light

https://gerrit.wikimedia.org/r/698458

Mentioned in SAL (#wikimedia-operations) [2021-06-07T10:24:15Z] <moritzm> remove now obsolete nginx mods and dependencies on htmldumper1001 T164456

Change 698509 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] Enable profile::nginx for acmechief

https://gerrit.wikimedia.org/r/698509

Change 698510 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] Switch acmechief-test1001 to nginx-light

https://gerrit.wikimedia.org/r/698510

Change 698511 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] Switch to nginx-light on all acmechief servers

https://gerrit.wikimedia.org/r/698511

Change 698771 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] eventschemas: Switch to nginx-light

https://gerrit.wikimedia.org/r/698771

Change 698155 merged by Muehlenhoff:

[operations/puppet@production] Switch scandium/testreduce to nginx-light

https://gerrit.wikimedia.org/r/698155

Mentioned in SAL (#wikimedia-operations) [2021-06-08T14:43:38Z] <moritzm> cleanup now unused nginx mods and former deps (various X11 libs and libxslt) on testreduce1001/scandium after switch towards nginx-light T164456

Change 698800 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] role::docker_registry_ha::registry: Switch to profile::nginx

https://gerrit.wikimedia.org/r/698800

Change 698803 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] Switch docker registry to nginx-light

https://gerrit.wikimedia.org/r/698803

Change 698771 merged by Muehlenhoff:

[operations/puppet@production] eventschemas: Switch to nginx-light

https://gerrit.wikimedia.org/r/698771

Mentioned in SAL (#wikimedia-operations) [2021-06-09T09:58:08Z] <moritzm> cleanup now unused nginx mods and former deps (various X11 libs and libxslt) on schema* after switch towards nginx-light T164456

Change 698975 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] wdqs: Switch to profile::nginx

https://gerrit.wikimedia.org/r/698975

Change 698984 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] configcluster: Switch to profile::nginx

https://gerrit.wikimedia.org/r/698984

Change 699378 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] archiva: Switch to profile::nginx

https://gerrit.wikimedia.org/r/699378

Change 699379 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] archiva: Switch to nginx-light

https://gerrit.wikimedia.org/r/699379

Change 699378 merged by Muehlenhoff:

[operations/puppet@production] archiva: Switch to profile::nginx

https://gerrit.wikimedia.org/r/699378

Change 699379 merged by Muehlenhoff:

[operations/puppet@production] archiva: Switch to nginx-light

https://gerrit.wikimedia.org/r/699379

Change 698509 merged by Muehlenhoff:

[operations/puppet@production] Enable profile::nginx for acmechief

https://gerrit.wikimedia.org/r/698509

Change 698510 merged by Muehlenhoff:

[operations/puppet@production] Switch acmechief-test1001 to nginx-light

https://gerrit.wikimedia.org/r/698510

Change 698975 merged by Muehlenhoff:

[operations/puppet@production] wdqs: Switch to profile::nginx

https://gerrit.wikimedia.org/r/698975

Change 701880 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] mirrors: Switch to profile::nginx

https://gerrit.wikimedia.org/r/701880

Change 701883 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] Switch sodium to nginx-light

https://gerrit.wikimedia.org/r/701883

Change 701880 merged by Dzahn:

[operations/puppet@production] mirrors: Switch to profile::nginx

https://gerrit.wikimedia.org/r/701880

Change 701883 merged by Dzahn:

[operations/puppet@production] Switch sodium to nginx-light

https://gerrit.wikimedia.org/r/701883

Mentioned in SAL (#wikimedia-operations) [2021-06-28T10:22:48Z] <mutante> sodium (mirrors.wikimedia.org) - switching to nginx light variant T164456

Change 698511 merged by Muehlenhoff:

[operations/puppet@production] Switch to nginx-light on all acmechief servers

https://gerrit.wikimedia.org/r/698511

Change 698800 merged by Muehlenhoff:

[operations/puppet@production] role::docker_registry_ha::registry: Switch to profile::nginx

https://gerrit.wikimedia.org/r/698800

Mentioned in SAL (#wikimedia-operations) [2021-06-29T10:30:20Z] <moritzm> cleanup now unused nginx mods and former deps (various X11 libs and libxslt) on acmechief* after switch towards nginx-light T164456

Change 702101 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] conf: Switch to profile::nginx

https://gerrit.wikimedia.org/r/702101

Change 702106 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] relforge::Switch to profile::nginx

https://gerrit.wikimedia.org/r/702106

Change 702109 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] relforge: Switch to nginx-light

https://gerrit.wikimedia.org/r/702109

Change 702111 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] cloudelastic: Switch to nginx-light

https://gerrit.wikimedia.org/r/702111

Change 702113 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] swift proxies: Switch to nginx-light

https://gerrit.wikimedia.org/r/702113

Change 702114 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] maps: Switch to nginx-light

https://gerrit.wikimedia.org/r/702114

Change 702117 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] conf: Switch to nginx-light

https://gerrit.wikimedia.org/r/702117

Change 702111 merged by Ryan Kemper:

[operations/puppet@production] cloudelastic: Switch to nginx-light

https://gerrit.wikimedia.org/r/702111

Change 702109 merged by Ryan Kemper:

[operations/puppet@production] relforge: Switch to nginx-light

https://gerrit.wikimedia.org/r/702109

Change 702113 merged by Muehlenhoff:

[operations/puppet@production] swift proxies: Switch to nginx-light

https://gerrit.wikimedia.org/r/702113

Change 702106 abandoned by Muehlenhoff:

[operations/puppet@production] relforge::Switch to profile::nginx

Reason:

Obsolete, was fixed via the tlsproxy-specific Hiera setting instead

https://gerrit.wikimedia.org/r/702106

Change 702347 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] Switch remaining (stretch) maps hosts to nginx-light

https://gerrit.wikimedia.org/r/702347

Change 698803 merged by Dzahn:

[operations/puppet@production] Switch docker registry to nginx-light

https://gerrit.wikimedia.org/r/698803

Mentioned in SAL (#wikimedia-operations) [2021-06-30T13:04:29Z] <mutante> switching docker-registry to nginx light variant T164456

Change 702580 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] elastic: Switch to nginx-light

https://gerrit.wikimedia.org/r/702580

Change 702114 merged by Hnowlan:

[operations/puppet@production] maps: Switch buster nodes to nginx-light

https://gerrit.wikimedia.org/r/702114

Change 702347 merged by Hnowlan:

[operations/puppet@production] Switch remaining (stretch) maps hosts to nginx-light

https://gerrit.wikimedia.org/r/702347

Change 702669 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] Default nginx::profile to light flavour

https://gerrit.wikimedia.org/r/702669

Change 702580 merged by Ryan Kemper:

[operations/puppet@production] elastic: Switch to nginx-light

https://gerrit.wikimedia.org/r/702580

Change 702101 abandoned by Muehlenhoff:

[operations/puppet@production] conf: Switch to profile::nginx

Reason:

Obsoleted by different patch

https://gerrit.wikimedia.org/r/702101

Change 698984 abandoned by Muehlenhoff:

[operations/puppet@production] configcluster: Switch to profile::nginx

Reason:

Not needed, this was a wrong approach.

https://gerrit.wikimedia.org/r/698984

Change 702117 merged by Muehlenhoff:

[operations/puppet@production] conf: Switch to nginx-light

https://gerrit.wikimedia.org/r/702117

Change 708969 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] profile::tlsproxy::instance: Default to nginx-light

https://gerrit.wikimedia.org/r/708969

Removing Traffic tag here, as we've long ago stopped using nginx for our primary TLS ingress, and thus this doesn't really impact us in any major way.

MoritzMuehlenhoff claimed this task.

Everything that doesn't need features from -extras or -full has been migrated to -light.

Change 708969 merged by Muehlenhoff:

[operations/puppet@production] profile::tlsproxy::instance: Default to nginx-light

https://gerrit.wikimedia.org/r/708969