When a translation is saved, the chosen categories are not saved anywhere. When you restore translation, all source categories are adapted to target. In case you had removed one category from these adapted one, it appears again when you restore.
Along with translation, categories need to be saved. Ideally, it can be a translation metadata just like stats storage.