The numbers make it much easier to find informations, I would miss them. 0,4% of active authors is quite a large number for a option which must be actively activated. If there are performance problems switch to a solution with CSS, but do not remove this useful feature. Are there any problems for users who don't enable this? I very seldom had problems, but I use this nearly every day.