@Nirzar originally proposed moving the remove button to the top left to make it clear it was a top-level action on par with saving, but according to @Jdforrester-WMF, the top left is generally reserved for safe, non-destructive 'escape' actions. There may be another alternative to the current position.