Images with transparency have two issues:

1. The background is dark grey which may not work with all images. Some sort of checker pattern is a common solution to this (like you get on Commons when hovering over images).
2. When hovering over the image the original, non-zoomed image is in the background.

This happens for PNG and GIF. SVG and TIFF uses PNG versions, so they're also affected.