As proposed by @Proc, we might have non-blocking filters (e.g. those that only tag the edit, or don't have any action enabled) after the edit, in a deferred job, so to save a bit on performance.

My quick thought is that it might be doable, but it would require a decent amount of work, and I'm unsure about the effective performance gain.