It takes about 0.25s to generate the styles for this module alone. The HTTP request that includes this module also builds about a dozen other modules, so this impacts performance. Incidentally, while not the most-frequently built, it is the #2 most-frequently built. (Over 50 times per minute globally.).
I imagine most of this is taken up by Less compilation.