Edit the following test page with the visual editor:
https://www.mediawiki.org/wiki/Project:VisualEditor_testing/TestAxelBoldt?action=edit&oldid=2047299
Scroll down so that the word "link" in section "Regression 3" appears in the middle of the screen or higher. Highlight the word "link" and hit Ctrl-K to create a link. The resulting tall popup window causes the target word "link" to scroll out of view. Hitting Cancel or Done will not scroll the target back into view.
It appears that the target is out of view by just one line, so this looks like a classical off-by-one error.
This might be the same issue as T177660, but that report focuses on small screens while the issue reported here does not depend on screen size.