With prerendering having been off for 2 months, I now have final confirmation that it plays an insignificant part in Media Viewer performance (my original assessment measured it as 0.085% of image requests).

That being said, it doesn't hurt to have it turned on and it will benefit the small fraction of users who are the first to run into freshly uploaded content at a given resolution, so let's re-enable it.