Migrate ores celery configs to celery 4
Closed, ResolvedPublic

Description

Right now, celery 4 supports upper case setting names but it's officially deprecated and we need to use lower case settings and they will be dropped soon. See http://docs.celeryproject.org/en/v4.1.0/whatsnew-4.0.html#v400-upgrade-settings
One big reason is that you can't mix old and new configs so if we want to add settings for sentinel (added in celery4), it might gets complicated. Also since some of our configs come from puppet and some from the config files. There is no easy way to handle this. The only thing I can think of is to move all of configs to puppet, deploy, apply the changes to puppet and then re-add migrated configs to ores repos and remove them from puppet.

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptNov 15 2018, 2:16 PM
Restricted Application added a project: User-Ladsgroup. · View Herald TranscriptNov 15 2018, 6:28 PM

Change 474157 had a related patch set uploaded (by Ladsgroup; owner: Ladsgroup):
[operations/puppet@production] ores: Drop old b/c configs

https://gerrit.wikimedia.org/r/474157

Change 474158 had a related patch set uploaded (by Ladsgroup; owner: Ladsgroup):
[operations/puppet@production] ores: Move all of celery configs to puppet

https://gerrit.wikimedia.org/r/474158

Change 474157 merged by Alexandros Kosiaris:
[operations/puppet@production] ores: Drop old b/c configs

https://gerrit.wikimedia.org/r/474157

Change 474158 merged by Alexandros Kosiaris:
[operations/puppet@production] ores: Move all of celery configs to puppet

https://gerrit.wikimedia.org/r/474158

Change 474694 had a related patch set uploaded (by Ladsgroup; owner: Ladsgroup):
[operations/puppet@production] ores: Change configs to celery4 ones

https://gerrit.wikimedia.org/r/474694

Change 474703 had a related patch set uploaded (by Ladsgroup; owner: Ladsgroup):
[mediawiki/services/ores/deploy@master] Bump ORES to HEAD

https://gerrit.wikimedia.org/r/474703

Change 474703 merged by Ladsgroup:
[mediawiki/services/ores/deploy@master] Bump ORES to HEAD

https://gerrit.wikimedia.org/r/474703

Mentioned in SAL (#wikimedia-operations) [2018-11-19T15:28:24Z] <ladsgroup@deploy1001> Started deploy [ores/deploy@e957b24]: T209587 T170950

Mentioned in SAL (#wikimedia-operations) [2018-11-19T15:45:33Z] <ladsgroup@deploy1001> Finished deploy [ores/deploy@e957b24]: T209587 T170950 (duration: 17m 09s)

Change 474694 merged by Alexandros Kosiaris:
[operations/puppet@production] ores: Change configs to celery4 ones

https://gerrit.wikimedia.org/r/474694

Change 475084 had a related patch set uploaded (by Alexandros Kosiaris; owner: Alexandros Kosiaris):
[operations/puppet@production] Followup fix for ores: Change configs to celery4

https://gerrit.wikimedia.org/r/475084

Change 475084 merged by Alexandros Kosiaris:
[operations/puppet@production] Followup fix for ores: Change configs to celery4

https://gerrit.wikimedia.org/r/475084

Change 476255 had a related patch set uploaded (by Ladsgroup; owner: Ladsgroup):
[operations/puppet@production] ores: labs celery4 config update

https://gerrit.wikimedia.org/r/476255

Change 476255 merged by Alexandros Kosiaris:
[operations/puppet@production] ores: labs celery4 config update

https://gerrit.wikimedia.org/r/476255

Ladsgroup closed this task as Resolved.Mon, Dec 17, 12:39 PM