I noticed as part of T279120 research that about 30% of the response time for action=raw is EchoSeenTime. This code exists for the purpose of forcing a cache miss when a logged-in user revisits a page they have already visited recently, if they received new notifications since then.
This applies to page views and most wikipage actions, but not action=raw or action=render, where no skin output is used.