Investigate what would be involved in Numerical sorting in categories, which is likely to be in the Wishlist Survey top 10.
The main ticket: T8948: Natural number sorting in category listings
It's been hanging around since 2006, and there might be a good reason for that.
If this is adding an extra column to an important table with millions of rows, it might not be feasible to fix.
Also see T32673: Implement central locale-specific, or tailored, sorting framework (tracking)