I ssh-ed in to both workers, no weird behavior. No logs either. It's as if the celery workers never received the tasks.
Ran sudo systemctl restart celery-quarry-worker.service on both of them, finished almost immediately, not even 'waiting for running tasks to finish'... so there is no running tasks. Celery broke?
In any case, a celery restart on both workers seemed to fix it.