These continuous processes should run using either k8s or Grid.
In the end, the Toolforge Redis server was used and Celery now runs as job.
The jobs can now be distributed to different servers to speed things up.