The unix_socket plugin no longer requires specific entries on my.cnf as since 10.4.3 it is enabled by default and only needs to show up on my.cnf to be specifically disabled.
https://mariadb.com/kb/en/authentication-plugin-unix-socket/
In MariaDB 10.4.3 and later, the unix_socket authentication plugin is installed by default, so if you do not want it to be available by default on those versions, then you will need to disable it.
Let's do a quick test and if it is all fine, clean it up.