Patches need to be tested to see if they are applied cleanly. Basic installation needs to happen seamlessly.
|Open||None||T974 Automate Testing of MediaWiki Tarball releases|
|Resolved||Legoktm||T949 update make-release to refuse to work if tag != $wgVersion|
Just an aside, as it does not test the patches: there is a rudimentary test of the tarball, checking proper extraction and correct version information. It can be found in mediawiki/tools/release or here on github: https://github.com/wikimedia/mediawiki-tools-release/blob/master/make-release/testReleaseTarball.php