Looks like you can pass smstate with an empty value to action=sitematrix to get all *but* the closed/fishbowl/nonglobal/private wikis. Could that be stated in the smstate documentation? I found it by accident.
Alternatively, adding the ability to pass smstate=!closed (etc.) for more granularity would be nice but more work.