Let's say you're looking at an annotation like:
You want to click on "Edit", so you move your mouse like this:
Whoops, the annotation disappeared, because we left the yellow-border area of the annotation before mousing over the grey-border box. We actually need to do this:
This is pretty annoying.